Course Outline
Foundational Architectural Principles for AI Systems
- Establishing layers, boundaries, and separation of concerns.
- Applying ports and adapters patterns to AI components.
- Defining quality attribute scenarios specific to AI features.
- Utilizing architecture decision records for effective governance.
Evolution of Existing Applications
- Pursuing incremental modernization over complete rewrites.
- Positioning AI services alongside existing monolithic structures.
- Employing strangler and anti-corruption layer patterns.
- Creating integration points for current APIs and data sources.
Architectural Patterns for LLM Integration
- Implementing a model gateway as an abstraction boundary.
- Managing synchronous, asynchronous, and streaming integration methods.
- Handling fallbacks, degradation, and provider failover scenarios.
- Treating prompt and model configurations as version-controlled assets.
Contracts, APIs, and Data Exchange Mechanisms
- Designing structured output schemas and validation rules.
- Implementing idempotency, retry logic, and rate limiting strategies.
- Managing latency budgets and timeout orchestration.
- Treating cost per request as a key architectural constraint.
End-to-End RAG Architecture
- Building ingestion, chunking, and embedding pipelines.
- Structuring index, retrieval, reranking, and generation stages.
- Positioning retrieval relative to existing application services.
- Analyzing trade-offs and failure modes at each processing stage.
Vector Databases and Retrieval Design
- Evaluating managed versus self-hosted vector stores.
- Implementing dense, sparse, and hybrid search techniques.
- Applying metadata filtering and tenant isolation strategies.
- Developing re-embedding strategies for model updates.
Retrieval Quality, Grounding, and Evaluation
- Constructing evaluation sets derived from real-world queries.
- Measuring retrieval and answer quality metrics.
- Managing citations, grounding, and hallucination containment.
- Establishing feedback loops to update the index.
Agent Architectures
- Understanding the agent loop and tool invocation processes.
- Comparing deterministic workflows with autonomous planners.
- Identifying scenarios where an agent is not the appropriate solution.
- Defining agent responsibilities and state management.
Multi-Agent Systems and Orchestration
- Structuring supervisor and orchestrator topologies.
- Defining handoff protocols and message contracts.
- Managing shared memory and context.
- Comparing frameworks based on architectural merit.
Service Communication and Tool Protocols
- Coordinating via event-driven and queue-based systems.
- Exposing tools through standardized protocols.
- Implementing sagas, compensation, and long-running transactions.
- Ensuring observability across service interactions.
AI Agents in Development Workflows
- Integrating coding agents within the delivery pipeline.
- Adopting spec-driven development and review gates.
- Generating tests and automating quality checks.
- Implementing guardrails to maintain architectural control.
Governance and Software Quality
- Conducting design reviews for AI features.
- Managing model and prompt changes effectively.
- Including regression evaluation as a pipeline stage.
- Defining ownership, policy, and approval pathways.
Security, Privacy, and Data Governance
- Defending against prompt injection and implementing depth layers.
- Managing secrets, access control, and least privilege principles.
- Addressing data residency, personal data, and retention policies.
- Ensuring auditability and human-in-the-loop oversight.
Scalability, Cost, and Observability
- Tracing processes across agent chains.
- Monitoring token usage and cost telemetry.
- Optimizing caching and latency.
- Defining service levels and incident response for AI services.
Capstone: Architecting an AI-Driven Solution
- Developing context, component, and deployment views.
- Designing retrieval and agent orchestration strategies.
- Formulating security, governance, and cost plans.
- Conducting peer reviews, critiques, and migration roadmap planning.
Requirements
- Practical experience in designing and sustaining production-grade software systems.
- Proficiency in REST APIs and service integration protocols.
- Understanding of relational databases and data modelling techniques.
- Fundamental familiarity with LLM-based tools or APIs.
Target Audience
- Software architects.
- Technical leads and senior engineers.
- Engineering managers tasked with architecture decision-making.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4350 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
The session was highly interactive and applicable to the business.
Jorge Boscan - Chevron Global Technology Services Company
Course - Advanced GitHub Copilot & AI for Projects and Infrastructure
Machine Translated
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny