Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Foundations of Agentic Systems in Production
- Agentic architectures: loops, tools, memory, and orchestration layers
- Agent lifecycle: covering development, deployment, and continuous operation
- Challenges associated with production-scale agent management
Infrastructure and Deployment Models
- Deploying agents within containerized and cloud-based environments
- Scaling strategies: comparing horizontal and vertical scaling, along with concurrency and throttling
- Orchestrating multi-agent systems and balancing workloads
Monitoring and Observability
- Essential metrics: latency, success rate, memory usage, and agent call depth
- Tracing agent activities and analyzing call graphs
- Implementing observability instrumentation using Prometheus, OpenTelemetry, and Grafana
Logging, Auditing, and Compliance
- Establishing centralized logging and structured event collection
- Ensuring compliance and auditability within agentic workflows
- Creating audit trails and replay mechanisms to facilitate debugging
Performance Tuning and Resource Optimization
- Minimizing inference overhead and optimizing agent orchestration cycles
- Utilizing model caching and lightweight embeddings for accelerated retrieval
- Conducting load testing and stress scenarios for AI pipelines
Cost Control and Governance
- Analyzing agent cost drivers: API calls, memory, compute, and external integrations
- Monitoring agent-level expenditures and implementing chargeback models
- Establishing automation policies to curb agent sprawl and reduce idle resource consumption
CI/CD and Rollout Strategies for Agents
- Integrating agent pipelines into CI/CD systems
- Strategies for testing, versioning, and rolling back iterative agent updates
- Implementing progressive rollouts and secure deployment mechanisms
Failure Recovery and Reliability Engineering
- Designing systems for fault tolerance and graceful degradation
- Applying retry, timeout, and circuit breaker patterns to ensure agent reliability
- Establishing incident response and post-mortem frameworks for AI operations
Capstone Project
- Building and deploying an agentic AI system equipped with comprehensive monitoring and cost tracking
- Simulating load, assessing performance, and refining resource usage
- Presenting the final architecture and monitoring dashboard to peers
Summary and Next Steps
Requirements
- A robust command of MLOps and production machine learning systems
- Hands-on experience with containerized deployments (Docker/Kubernetes)
- Knowledge of cloud cost optimization strategies and observability tools
Target Audience
- MLOps Engineers
- Site Reliability Engineers (SREs)
- Engineering Managers responsible for AI infrastructure
21 Hours
Testimonials (3)
The trainer is patient and very helpful. He knows the topic well.
CLIFFORD TABARES - Universal Leaf Philippines, Inc.
Course - Agentic AI for Business Automation: Use Cases & Integration
Good mixvof knowledge and practice
Ion Mironescu - Facultatea S.A.I.A.P.M.
Course - Agentic AI for Enterprise Applications
The mix of theory and practice and of high level and low level perspectives
