When you enroll through our links, we may earn a small commission—at no extra cost to you. This helps keep our platform free and inspires us to add more value.

pluralsight logo

Modeling Streaming Data for Processing with Apache Beam

The Apache Beam unified model allows us to process batch as well as streaming data using the same API. Several execution backends such as Google Cloud Dataflow, Apache Spark, and Apache Flink are compatible with Beam.

     
  • 4
  •  |
  • Reviews ( 10 )
Free

This Course Includes

  • iconpluralsight
  • icon4 (10 reviews )
  • icon2 hour 27 minutes
  • iconenglish
  • iconOnline - Self Paced
  • iconExpanded Courses
  • iconpluralsight

About Modeling Streaming Data for Processing with Apache Beam

Streaming data usually needs to be processed real-time or near real-time which means stream processing systems need to have capabilities that allow them to process data with low latency, high performance and fault-tolerance. In this course, Modeling Streaming Data for Processing with Apache Beam, you will gain the ability to work with streams and use the Beam unified model to build data parallel pipelines. First, you will explore the similarities and differences between batch processing and stream processing. Next, you will discover the Apache Beam APIs which allow one to define pipelines that process batch as well as streaming data. Finally, you will learn how windowing operations can be applied to streaming data. When you are finished with this course, you will have a strong grasp of the models and architectures used with streaming data and be able to work with the Beam unified model to define and run transformations on input streams.

What You Will Learn?

  • Course Overview : 1min.
  • Getting Started with Stream Processing : 35mins.
  • Introducing Apache Beam for Stream Processing : 58mins.
  • Performing Windowing Operations : 52mins.