Get in Touch
 Duration 14 hours

Course Outline

Introduction to LLM Architecture and Attack Surface

  • The construction, deployment, and API access of LLMs
  • Essential components of LLM application stacks (e.g., prompts, agents, memory, APIs)
  • Identifying where and how security challenges emerge in practical scenarios

Prompt Injection and Jailbreak Attacks

  • The nature of prompt injection and its potential dangers
  • Scenarios involving both direct and indirect prompt injection
  • Jailbreaking methods used to circumvent safety filters
  • Strategies for detecting and mitigating these threats

Data Leakage and Privacy Risks

  • Preventing accidental data exposure via model responses
  • Addressing PII leaks and the misuse of model memory
  • Developing privacy-focused prompts and retrieval-augmented generation (RAG) solutions

LLM Output Filtering and Guarding

  • Employing Guardrails AI for effective content filtering and validation
  • Establishing clear output schemas and constraints
  • Tracking and recording unsafe outputs

Human-in-the-Loop and Workflow Strategies

  • Determining the optimal timing for human intervention
  • Managing approval queues, scoring thresholds, and fallback protocols
  • Calibrating trust levels and the importance of explainability

Secure LLM App Design Patterns

  • Enforcing least privilege and sandboxing for API calls and agents
  • Implementing rate limiting, throttling, and abuse detection mechanisms
  • Building robust chains with LangChain and ensuring prompt isolation

Compliance, Logging, and Governance

  • Safeguarding the auditability of LLM outputs
  • Promoting traceability and managing prompt/version control
  • Aligning practices with internal security policies and regulatory requirements

Wrap-up and Future Directions

Requirements

  • A solid grasp of large language models and prompt-based interfaces
  • Practical experience in developing LLM applications using Python
  • Knowledge of API integrations and cloud-based deployment strategies

Target Audience

  • AI developers
  • Application and solution architects
  • Technical product managers utilizing LLM tools

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 2900 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Upcoming Courses

Related Categories