Course Outline
Introduction
Overview of Apache Spark Features and Architecture
- Apache Spark modules: Spark SQL, Spark Streaming, MLlib, GraphX
- RDD, Dataframes, drive-workers, DAG, etc.
Setting up Apache Spark on .NET
- Preparing the Java VM
- Running .NET for Apache Spark using .NET Core
Getting Started
- Creating a sample .NET console application
- Adding the Spark driver
- Initializing a SparkSession
- Executing the application
Preparing Data
- Building a data preparation pipeline
- Performing ETL (Extract, Transform, and Load)
Machine Learning
- Building a machine learning model
- Preparing the data
- Training a model
Real-time Processing
- Processed streaming data in real-time
- Case study: monitoring sensor data
Interactive Query
- Working with Spark SQL
- Analyzing structured data
Visualizing Results
- Plotting results
- Using third-party tools to visualize results
Troubleshooting
Summary and Conclusion
Requirements
- .NET programming experience using C# or F#
Audience
- Developers
Testimonials (5)
A lot of practical examples, different ways to approach the same problem, and sometimes not so obvious tricks how to improve the current solution
Rafał - Nordea
Course - Apache Spark MLlib
it was a great cource becuase we got the chance to discuss things and try working with the things we got taught. But the thing I liked the most was that everything was based on experience that Marcin had.
Jesper - ProgramDuon AB
Course - Advanced Blazor
The trainer explained the subjects very good with actual examples from real world which made it simpler for us to grasp the information
Florin-Viorel Marut - Continental Automotive Romania
Course - High-Performance Application Development with .NET Core
The trainer's proper knowledge and deep understanding of the topic and his capability to present and transfer the knowledge in a clear and efficient way.
Balázs Farkas - Greentube GmbH
Course - Implementing the Actor Model with Microsoft Orleans
Comprehensive - covered everything we were interested in. Able to work through examples.