Apache Beam | A Hands-On course to build Big data Pipelines

About Apache Beam | A Hands-On course to build Big data Pipelines

Apache Beam is a unified and portable programming model for both Batch and Streaming data use cases.

Earlier we could run Spark, Flink & Cloud Dataflow Jobs only on their respective clusters. But now Apache Beam has come up with a portable programming model where we can build language agnostic Big data pipelines and run it on any Big data engine (Apache Spark, Flink or in Google Cloud Platform using Cloud Dataflow service and many more Big data engines). Apache Beam is the future of building Big data processing pipelines and is going to be accepted by mass companies due to its portability. Many big companies have even started deploying Beam pipelines in their production servers. _What's included in the course ?_

Complete Apache Beam concepts explained from

Scratch to Real-Time implementation.

Every Apache Beam concept is taught through

Hands-on, practical examples

for better understanding

Core Apache Beam topics including Architecture, Various PTransforms (Map, FlatMap, Filter, ParDo etc.), Combiner, Side inputs/outputs.

ADVANCE topics - Type Hints, Encoding & Decoding, Watermarks, Triggers and many more.

Build 2 Real-time Big data case studies using Apache Beam programming model.

Learn to implement Windows functions - Tumbling, Sliding, Global and Session Windows.

Load processed data to Google Cloud BigQuery Tables from Apache Beam pipeline via Dataflow.

All codes and datasets used in lessons are attached in the course for your convenience.