Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layered ETL architectural patterns
- Creating modular, reusable components
- Implementing hybrid approaches across various systems
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripts within transformations
- Creating custom plugins
- Expanding PDI functionality using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integrations
- Integration with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Oversight of extensive job networks
- Designing error recovery and failover mechanisms
- Orchestrating at the environment level
Repository Management, Version Control, and CI/CD
- Strategies for enterprise repositories
- Connecting PDI with Git
- Implementing continuous deployment practices
Deployment, Monitoring, and Production Operations
- Migrating solutions between environments
- Utilizing operational tools and dashboards
- Achieving full production readiness
Summary and Next Steps
Requirements
- Familiarity with ETL workflows and data modeling concepts
- Practical experience with intermediate-level PDI transformations
- Strong proficiency in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration operations
21 Hours
Testimonials (1)
It's a hands-on session.
