Course Outline
Architectural Foundations for AI Systems
- Layers, boundaries, and the separation of concerns
- Applying ports and adapters to AI components
- Quality attribute scenarios specific to AI features
- Using architecture decision records for governance
Evolving Existing Applications
- Pursuing incremental modernization rather than full rewrites
- Positioning AI services alongside existing monolithic structures
- Utilizing strangler and anti-corruption layer patterns
- Establishing integration seams for current APIs and data sources
LLM Integration Architectural Patterns
- The model gateway as a boundary for abstraction
- Synchronous, asynchronous, and streaming integration methods
- Fallback strategies, degradation, and provider failover
- Managing prompts and model configurations as versioned assets
Contracts, APIs, and Data Exchange
- Defining structured output schemas and validation rules
- Implementing idempotency, retries, and rate limiting
- Setting latency budgets and orchestrating timeouts
- Treating cost per request as a key architectural constraint
End-to-End RAG Architecture
- Pipelines for ingestion, chunking, and embedding
- Stages for indexing, retrieval, reranking, and generation
- Positioning retrieval relative to application services
- Evaluating trade-offs and failure modes at each stage
Vector Databases and Retrieval Design
- Comparing managed versus self-hosted vector stores
- Dense, sparse, and hybrid search techniques
- Metadata filtering and ensuring tenant isolation
- Strategies for re-embedding when models are updated
Retrieval Quality, Grounding, and Evaluation
- Creating evaluation sets based on real-world queries
- Measuring retrieval and answer quality metrics
- Managing citations, grounding, and containing hallucinations
- Implementing feedback loops that update the index
Agent Architectures
- The agent loop and the process of tool invocation
- Deterministic workflows compared to autonomous planners
- Identifying cases where an agent is not the appropriate solution
- Defining the scope of agent responsibilities and state
Multi-Agent Systems and Orchestration
- Supervisor and orchestrator topologies
- Handoff protocols and message contracts
- Managing shared memory and context
- Comparing frameworks based on architectural merits
Service Communication and Tool Protocols
- Coordination via event-driven and queue-based systems
- Exposing tools through standard protocols
- Handling sagas, compensation, and long-running transactions
- Ensuring observability across multiple service hops
AI Agents in Development Workflows
- Integrating coding agents into the delivery pipeline
- Spec-driven development and review gates
- Generating tests and automated quality checks
- Implementing guardrails that maintain architectural control
Governance and Software Quality
- Conducting design reviews for AI features
- Managing changes to models and prompts
- Using regression evaluation as a pipeline stage
- Defining ownership, policy, and approval pathways
Security, Privacy, and Data Governance
- Defending against prompt injection and implementing defense in depth
- Managing secrets, access control, and least privilege principles
- Addressing data residency, personal data, and retention policies
- Ensuring auditability and human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing processes across agent chains
- Monitoring token usage and cost telemetry
- Optimizing caching and latency
- Defining service levels and incident response for AI services
Capstone: Architecture for an AI-Powered Solution
- Developing context, component, and deployment views
- Designing retrieval and agent orchestration
- Planning for security, governance, and cost
- Conducting peer review, critique, and establishing a migration roadmap
Requirements
- Proven experience in designing and sustaining production-grade software systems
- Practical understanding of REST APIs and service integration
- Knowledge of relational databases and data modeling
- Basic familiarity with LLM-based tools or APIs
Target Audience
- Software Architects
- Technical Leads and Senior Engineers
- Engineering Managers tasked with architectural decision-making
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny