Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to LLM Architecture and Attack Surface
- The construction, deployment, and API access of LLMs
- Essential components of LLM application stacks (e.g., prompts, agents, memory, APIs)
- Identifying where and how security challenges emerge in practical scenarios
Prompt Injection and Jailbreak Attacks
- The nature of prompt injection and its potential dangers
- Scenarios involving both direct and indirect prompt injection
- Jailbreaking methods used to circumvent safety filters
- Strategies for detecting and mitigating these threats
Data Leakage and Privacy Risks
- Preventing accidental data exposure via model responses
- Addressing PII leaks and the misuse of model memory
- Developing privacy-focused prompts and retrieval-augmented generation (RAG) solutions
LLM Output Filtering and Guarding
- Employing Guardrails AI for effective content filtering and validation
- Establishing clear output schemas and constraints
- Tracking and recording unsafe outputs
Human-in-the-Loop and Workflow Strategies
- Determining the optimal timing for human intervention
- Managing approval queues, scoring thresholds, and fallback protocols
- Calibrating trust levels and the importance of explainability
Secure LLM App Design Patterns
- Enforcing least privilege and sandboxing for API calls and agents
- Implementing rate limiting, throttling, and abuse detection mechanisms
- Building robust chains with LangChain and ensuring prompt isolation
Compliance, Logging, and Governance
- Safeguarding the auditability of LLM outputs
- Promoting traceability and managing prompt/version control
- Aligning practices with internal security policies and regulatory requirements
Wrap-up and Future Directions
Requirements
- A solid grasp of large language models and prompt-based interfaces
- Practical experience in developing LLM applications using Python
- Knowledge of API integrations and cloud-based deployment strategies
Target Audience
- AI developers
- Application and solution architects
- Technical product managers utilizing LLM tools
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 2900 € + VAT*
Contact us for an exact quote and to hear our latest promotions