Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Getting ML Models Ready for Deployment
- Packaging models using Docker
- Exporting models from TensorFlow and PyTorch
- Considerations for versioning and storage
Serving Models on Kubernetes
- An introduction to inference servers
- Deployment of TensorFlow Serving and TorchServe
- Configuration of model endpoints
Techniques for Optimizing Inference
- Strategies for batching
- Handling concurrent requests
- Tuning for latency and throughput
Autoscaling ML Workloads
- Horizontal Pod Autoscaler (HPA)
- Vertical Pod Autoscaler (VPA)
- Kubernetes Event-Driven Autoscaling (KEDA)
GPU Provisioning and Resource Oversight
- Configuration of GPU nodes
- Overview of the NVIDIA device plugin
- Setting resource requests and limits for ML workloads
Strategies for Model Rollout and Release
- Blue/green deployment techniques
- Canary rollout patterns
- A/B testing for model evaluation
Monitoring and Observability for Production ML
- Key metrics for inference workloads
- Best practices for logging and tracing
- Setup of dashboards and alerting systems
Security and Reliability Focus
- Securing model endpoints
- Implementing network policies and access control
- Maintaining high availability
Summary and Next Steps
Requirements
- A solid understanding of containerized application workflows
- Practical experience with Python-based machine learning models
- Familiarity with the fundamentals of Kubernetes
Target Audience
- ML engineers
- DevOps engineers
- Platform engineering teams
Testimonials (4)
basic understanding of container/kubernetes and how they interact features of the openshift plattform
Eric Scholze - NOW IT GmbH
Course - Introduction to Containers, Kubernetes & OpenShift
About the microservices and how to maintenance kubernetes
Yufri Isnaini Rochmat Maulana - Bank Indonesia
Course - Advanced Platform Engineering: Scaling with Microservices and Kubernetes
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
The knowledge and exchanges with Augustin