Get in Touch
 Duration 21 hours

Course Outline

Architectural Foundations for AI Systems

  • Layers, boundaries, and the separation of concerns
  • Applying ports and adapters to AI components
  • Quality attribute scenarios specific to AI features
  • Using architecture decision records for governance

Evolving Existing Applications

  • Pursuing incremental modernization rather than full rewrites
  • Positioning AI services alongside existing monolithic structures
  • Utilizing strangler and anti-corruption layer patterns
  • Establishing integration seams for current APIs and data sources

LLM Integration Architectural Patterns

  • The model gateway as a boundary for abstraction
  • Synchronous, asynchronous, and streaming integration methods
  • Fallback strategies, degradation, and provider failover
  • Managing prompts and model configurations as versioned assets

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules
  • Implementing idempotency, retries, and rate limiting
  • Setting latency budgets and orchestrating timeouts
  • Treating cost per request as a key architectural constraint

End-to-End RAG Architecture

  • Pipelines for ingestion, chunking, and embedding
  • Stages for indexing, retrieval, reranking, and generation
  • Positioning retrieval relative to application services
  • Evaluating trade-offs and failure modes at each stage

Vector Databases and Retrieval Design

  • Comparing managed versus self-hosted vector stores
  • Dense, sparse, and hybrid search techniques
  • Metadata filtering and ensuring tenant isolation
  • Strategies for re-embedding when models are updated

Retrieval Quality, Grounding, and Evaluation

  • Creating evaluation sets based on real-world queries
  • Measuring retrieval and answer quality metrics
  • Managing citations, grounding, and containing hallucinations
  • Implementing feedback loops that update the index

Agent Architectures

  • The agent loop and the process of tool invocation
  • Deterministic workflows compared to autonomous planners
  • Identifying cases where an agent is not the appropriate solution
  • Defining the scope of agent responsibilities and state

Multi-Agent Systems and Orchestration

  • Supervisor and orchestrator topologies
  • Handoff protocols and message contracts
  • Managing shared memory and context
  • Comparing frameworks based on architectural merits

Service Communication and Tool Protocols

  • Coordination via event-driven and queue-based systems
  • Exposing tools through standard protocols
  • Handling sagas, compensation, and long-running transactions
  • Ensuring observability across multiple service hops

AI Agents in Development Workflows

  • Integrating coding agents into the delivery pipeline
  • Spec-driven development and review gates
  • Generating tests and automated quality checks
  • Implementing guardrails that maintain architectural control

Governance and Software Quality

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Using regression evaluation as a pipeline stage
  • Defining ownership, policy, and approval pathways

Security, Privacy, and Data Governance

  • Defending against prompt injection and implementing defense in depth
  • Managing secrets, access control, and least privilege principles
  • Addressing data residency, personal data, and retention policies
  • Ensuring auditability and human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing processes across agent chains
  • Monitoring token usage and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone: Architecture for an AI-Powered Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration
  • Planning for security, governance, and cost
  • Conducting peer review, critique, and establishing a migration roadmap

Requirements

  • Proven experience in designing and sustaining production-grade software systems
  • Practical understanding of REST APIs and service integration
  • Knowledge of relational databases and data modeling
  • Basic familiarity with LLM-based tools or APIs

Target Audience

  • Software Architects
  • Technical Leads and Senior Engineers
  • Engineering Managers tasked with architectural decision-making

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories