[{"id":"77179","title":"Introduction","description":"

This module introduces the course and course outline

","steps":[{"id":"533347","prompt":null,"isOptional":true,"activities":[{"id":"526215","href":"/paths/655/course_templates/229/video/526215?locale=uk","isLocked":false,"duration":247000,"title":"Course Introduction","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77180","title":"Beam Concepts Review","description":"

Review main concepts of Apache Beam, and how to apply them to write your own data processing pipelines.

","steps":[{"id":"533348","prompt":null,"isOptional":true,"activities":[{"id":"526216","href":"/paths/655/course_templates/229/video/526216?locale=uk","isLocked":false,"duration":152000,"title":"Beam Basics","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533349","prompt":null,"isOptional":true,"activities":[{"id":"526217","href":"/paths/655/course_templates/229/video/526217?locale=uk","isLocked":false,"duration":110000,"title":"Utility Transforms","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533350","prompt":null,"isOptional":true,"activities":[{"id":"526218","href":"/paths/655/course_templates/229/video/526218?locale=uk","isLocked":false,"duration":264000,"title":"DoFn Lifecycle","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533351","prompt":null,"isOptional":true,"activities":[{"id":"526219","href":"/paths/655/course_templates/229/labs/526219?locale=uk","isLocked":false,"duration":5400000,"title":"Serverless Data Processing with Dataflow - Writing an ETL pipeline using Apache Beam and Dataflow (Java)","description":"In this lab, you a) build a batch ETL pipeline in Apache Beam, which takes raw data from Google Cloud Storage and writes it to BigQuery b) run the Apache Beam pipeline on Dataflow and c) parameterize the execution of the pipeline.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false},{"id":"526220","href":"/paths/655/course_templates/229/labs/526220?locale=uk","isLocked":false,"duration":5400000,"title":"Serverless Data Processing with Dataflow - Writing an ETL Pipeline using Apache Beam and Dataflow (Python)","description":"In this lab, you a) build a batch ETL pipeline in Apache Beam, which takes raw data from Google Cloud Storage and writes it to BigQuery b) run the Apache Beam pipeline on Dataflow and c) parameterize the execution of the pipeline.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533352","prompt":null,"isOptional":true,"activities":[{"id":"526221","href":"/paths/655/course_templates/229/quizzes/526221?locale=uk","isLocked":false,"duration":900000,"title":"Quiz 1 - Beam Concepts Review","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533353","prompt":null,"isOptional":true,"activities":[{"id":"526222","href":"/paths/655/course_templates/229/documents/526222?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77181","title":"Windows, Watermarks, and Triggers","description":"

In this module, you will learn about how to process data in streaming with Dataflow. For that, there are three main concepts that you need to learn: how to group data in windows, the importance of watermark to know when the window is ready to produce results, and how you can control when and how many times the window will emit output.

","steps":[{"id":"533354","prompt":null,"isOptional":true,"activities":[{"id":"526223","href":"/paths/655/course_templates/229/video/526223?locale=uk","isLocked":false,"duration":378000,"title":"Windows","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533355","prompt":null,"isOptional":true,"activities":[{"id":"526224","href":"/paths/655/course_templates/229/video/526224?locale=uk","isLocked":false,"duration":528000,"title":"Watermarks","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533356","prompt":null,"isOptional":true,"activities":[{"id":"526225","href":"/paths/655/course_templates/229/video/526225?locale=uk","isLocked":false,"duration":491000,"title":"Triggers","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533357","prompt":null,"isOptional":true,"activities":[{"id":"526226","href":"/paths/655/course_templates/229/labs/526226?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Batch Analytics Pipelines with Dataflow (Java)","description":"In this lab you write a pipeline that aggregates site traffic by user and write a pipeline that aggregates site traffic by minute.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false},{"id":"526227","href":"/paths/655/course_templates/229/labs/526227?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Batch Analytics Pipelines with Dataflow (Python)","description":"In this lab you write a pipeline that aggregates site traffic by user and write a pipeline that aggregates site traffic by minute.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533358","prompt":null,"isOptional":true,"activities":[{"id":"526228","href":"/paths/655/course_templates/229/labs/526228?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Using Dataflow for Streaming Analytics (Java)","description":"In this lab you read data from a streaming source, perform the same aggregations you performed before, and write out results in a streaming fashion to BigQuery. You will also experiment with the difference in processing time and event time with lagging (late) data.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false},{"id":"526229","href":"/paths/655/course_templates/229/labs/526229?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Using Dataflow for Streaming Analytics (Python)","description":"In this lab you read data from a streaming source, perform the same aggregations you performed before, and write out results in a streaming fashion to BigQuery. You will also experiment with the difference in processing time and event time with lagging (late) data.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533359","prompt":null,"isOptional":true,"activities":[{"id":"526230","href":"/paths/655/course_templates/229/quizzes/526230?locale=uk","isLocked":false,"duration":1200000,"title":"Quiz 2 - Windows, Watermarks Triggers","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533360","prompt":null,"isOptional":true,"activities":[{"id":"526231","href":"/paths/655/course_templates/229/documents/526231?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77182","title":"Sources and Sinks","description":"

In this module, you will learn about what makes sources and sinks in Dataflow. The module will go over some examples of TextIO, FileIO, BigQueryIO, PubsubIO, KafKaIO, BigtableIO, Avro IO, and Splittable DoFn. The module will also point out some useful features associated with each I/O.

","steps":[{"id":"533361","prompt":null,"isOptional":true,"activities":[{"id":"526232","href":"/paths/655/course_templates/229/video/526232?locale=uk","isLocked":false,"duration":219000,"title":"Sources & Sinks","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533362","prompt":null,"isOptional":true,"activities":[{"id":"526233","href":"/paths/655/course_templates/229/video/526233?locale=uk","isLocked":false,"duration":233000,"title":"TextIO & FileIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533363","prompt":null,"isOptional":true,"activities":[{"id":"526234","href":"/paths/655/course_templates/229/video/526234?locale=uk","isLocked":false,"duration":140000,"title":"BigQueryIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533364","prompt":null,"isOptional":true,"activities":[{"id":"526235","href":"/paths/655/course_templates/229/video/526235?locale=uk","isLocked":false,"duration":110000,"title":"PubsubIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533365","prompt":null,"isOptional":true,"activities":[{"id":"526236","href":"/paths/655/course_templates/229/video/526236?locale=uk","isLocked":false,"duration":64000,"title":"KafkaIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533366","prompt":null,"isOptional":true,"activities":[{"id":"526237","href":"/paths/655/course_templates/229/video/526237?locale=uk","isLocked":false,"duration":65000,"title":"BigtableIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533367","prompt":null,"isOptional":true,"activities":[{"id":"526238","href":"/paths/655/course_templates/229/video/526238?locale=uk","isLocked":false,"duration":29000,"title":"AvroIO","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533368","prompt":null,"isOptional":true,"activities":[{"id":"526239","href":"/paths/655/course_templates/229/video/526239?locale=uk","isLocked":false,"duration":108000,"title":"Splittable DoFn","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533369","prompt":null,"isOptional":true,"activities":[{"id":"526240","href":"/paths/655/course_templates/229/quizzes/526240?locale=uk","isLocked":false,"duration":600000,"title":"Quiz 3 - Sources & Sinks","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533370","prompt":null,"isOptional":true,"activities":[{"id":"526241","href":"/paths/655/course_templates/229/documents/526241?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77183","title":"Schemas","description":"

This module will introduce schemas, which give developers a way to express structured data in their Beam pipelines.

","steps":[{"id":"533371","prompt":null,"isOptional":true,"activities":[{"id":"526242","href":"/paths/655/course_templates/229/video/526242?locale=uk","isLocked":false,"duration":217000,"title":"Beam schemas","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533372","prompt":null,"isOptional":true,"activities":[{"id":"526243","href":"/paths/655/course_templates/229/video/526243?locale=uk","isLocked":false,"duration":98000,"title":"Code examples","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533373","prompt":null,"isOptional":true,"activities":[{"id":"526244","href":"/paths/655/course_templates/229/labs/526244?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Branching Pipelines (Java)","description":"In this lab you a) implement a pipeline that has branches b) filter data before write c) add custom command line parameters to a pipeline","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false},{"id":"526245","href":"/paths/655/course_templates/229/labs/526245?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Branching Pipelines (Python)","description":"In this lab you a) implement a pipeline that has branches b) filter data before write c) add custom command line parameters to a pipeline d) Convert a custom pipeline into a Dataflow Flex Template and e) run a Dataflow Flex Template.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533374","prompt":null,"isOptional":true,"activities":[{"id":"526246","href":"/paths/655/course_templates/229/quizzes/526246?locale=uk","isLocked":false,"duration":600000,"title":"Quiz 4 - Schemas","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533375","prompt":null,"isOptional":true,"activities":[{"id":"526247","href":"/paths/655/course_templates/229/documents/526247?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77184","title":"State and Timers","description":"

This module covers State and Timers, two powerful features that you can use in your DoFn to implement stateful transformations.

","steps":[{"id":"533376","prompt":null,"isOptional":true,"activities":[{"id":"526248","href":"/paths/655/course_templates/229/video/526248?locale=uk","isLocked":false,"duration":321000,"title":"State API","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533377","prompt":null,"isOptional":true,"activities":[{"id":"526249","href":"/paths/655/course_templates/229/video/526249?locale=uk","isLocked":false,"duration":231000,"title":"Timer API","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533378","prompt":null,"isOptional":true,"activities":[{"id":"526250","href":"/paths/655/course_templates/229/video/526250?locale=uk","isLocked":false,"duration":208000,"title":"Summary","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533379","prompt":null,"isOptional":true,"activities":[{"id":"526251","href":"/paths/655/course_templates/229/quizzes/526251?locale=uk","isLocked":false,"duration":600000,"title":"Quiz 5 - State and Timers","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533380","prompt":null,"isOptional":true,"activities":[{"id":"526252","href":"/paths/655/course_templates/229/documents/526252?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77185","title":"Best Practices","description":"

This module will discuss best practices and review common patterns that maximize performance for your Dataflow pipelines.

","steps":[{"id":"533381","prompt":null,"isOptional":true,"activities":[{"id":"526253","href":"/paths/655/course_templates/229/video/526253?locale=uk","isLocked":false,"duration":147000,"title":"Schemas","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533382","prompt":null,"isOptional":true,"activities":[{"id":"526254","href":"/paths/655/course_templates/229/video/526254?locale=uk","isLocked":false,"duration":83000,"title":"Handling un-processable data","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533383","prompt":null,"isOptional":true,"activities":[{"id":"526255","href":"/paths/655/course_templates/229/video/526255?locale=uk","isLocked":false,"duration":64000,"title":"Error handling","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533384","prompt":null,"isOptional":true,"activities":[{"id":"526256","href":"/paths/655/course_templates/229/video/526256?locale=uk","isLocked":false,"duration":110000,"title":"AutoValue code generator","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533385","prompt":null,"isOptional":true,"activities":[{"id":"526257","href":"/paths/655/course_templates/229/video/526257?locale=uk","isLocked":false,"duration":74000,"title":"JSON data handling","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533386","prompt":null,"isOptional":true,"activities":[{"id":"526258","href":"/paths/655/course_templates/229/video/526258?locale=uk","isLocked":false,"duration":97000,"title":"Utilize DoFn lifecycle","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533387","prompt":null,"isOptional":true,"activities":[{"id":"526259","href":"/paths/655/course_templates/229/video/526259?locale=uk","isLocked":false,"duration":168000,"title":"Pipeline Optimizations","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533388","prompt":null,"isOptional":true,"activities":[{"id":"526260","href":"/paths/655/course_templates/229/labs/526260?locale=uk","isLocked":false,"duration":5400000,"title":"Serverless Data Processing with Dataflow - Advanced Streaming Analytics Pipeline with Dataflow (Java)","description":"In this lab you read deal with late and malformed streaming data using advanced Apache Beam concepts.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false},{"id":"526261","href":"/paths/655/course_templates/229/labs/526261?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Advanced Streaming Analytics Pipeline with Dataflow (Python)","description":"In this lab you read deal with late and malformed streaming data using advanced Apache Beam concepts.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533389","prompt":null,"isOptional":true,"activities":[{"id":"526262","href":"/paths/655/course_templates/229/quizzes/526262?locale=uk","isLocked":false,"duration":900000,"title":"Quiz 6 - Best Practices","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533390","prompt":null,"isOptional":true,"activities":[{"id":"526263","href":"/paths/655/course_templates/229/documents/526263?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77186","title":"Dataflow SQL and DataFrames","description":"

This modules introduces two new APIs to represent your business logic in Beam: SQL and Dataframes.

","steps":[{"id":"533391","prompt":null,"isOptional":true,"activities":[{"id":"526264","href":"/paths/655/course_templates/229/video/526264?locale=uk","isLocked":false,"duration":571000,"title":"Dataflow and Beam SQL","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533392","prompt":null,"isOptional":true,"activities":[{"id":"526265","href":"/paths/655/course_templates/229/video/526265?locale=uk","isLocked":false,"duration":54000,"title":"Windowing in SQL","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533393","prompt":null,"isOptional":true,"activities":[{"id":"526266","href":"/paths/655/course_templates/229/video/526266?locale=uk","isLocked":false,"duration":292000,"title":"Beam DataFrames","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533394","prompt":null,"isOptional":false,"activities":[{"id":"526267","href":"/paths/655/course_templates/229/labs/526267?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Using Dataflow SQL for Batch Analytics (Java)","description":"In this lab you add SQL statements to the previously written Beam pipeline that aggregates site traffic by user and by minute. You also execute a Beam SQL job from the BigQuery UI.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533395","prompt":null,"isOptional":false,"activities":[{"id":"526268","href":"/paths/655/course_templates/229/labs/526268?locale=uk","isLocked":false,"duration":7200000,"title":"Serverless Data Processing with Dataflow - Using Dataflow SQL for Streaming Analytics (Java)","description":"In this lab you read data from a streaming source, perform the same aggregations you performed before but this time in SQL, and write out results in a streaming fashion to BigQuery. You will also create a Dataflow SQL Streaming job from the BigQuery UI.","type":"lab","isComplete":false,"inProgress":false,"score":null,"disabled":true}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533396","prompt":null,"isOptional":true,"activities":[{"id":"526269","href":"/paths/655/course_templates/229/quizzes/526269?locale=uk","isLocked":false,"duration":600000,"title":"Quiz 7 - Dataflow SQL & DataFrames","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533397","prompt":null,"isOptional":true,"activities":[{"id":"526270","href":"/paths/655/course_templates/229/documents/526270?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77187","title":"Beam Notebooks","description":"

This module will cover Beam notebooks, an interface for Python developers to onboard onto the Beam SDK and develop their pipelines iteratively in a Jupyter notebook environment.

","steps":[{"id":"533398","prompt":null,"isOptional":true,"activities":[{"id":"526271","href":"/paths/655/course_templates/229/video/526271?locale=uk","isLocked":false,"duration":420000,"title":"Beam Notebooks","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533399","prompt":null,"isOptional":true,"activities":[{"id":"526272","href":"/paths/655/course_templates/229/quizzes/526272?locale=uk","isLocked":false,"duration":600000,"title":"Quiz 8 - Beam Notebooks","description":null,"type":"quiz","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false},{"id":"533400","prompt":null,"isOptional":true,"activities":[{"id":"526273","href":"/paths/655/course_templates/229/documents/526273?locale=uk","isLocked":false,"duration":1800000,"title":"Module Resources","description":null,"type":"document","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"77188","title":"Summary","description":"

This module provides a recap of the course

","steps":[{"id":"533401","prompt":null,"isOptional":true,"activities":[{"id":"526274","href":"/paths/655/course_templates/229/video/526274?locale=uk","isLocked":false,"duration":293000,"title":"Course Summary","description":null,"type":"video","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":false},{"id":"next-steps","title":"Your Next Steps","description":null,"steps":[{"id":"badge-step","prompt":null,"isOptional":true,"activities":[{"id":"badge","href":null,"isLocked":true,"duration":null,"title":"Course Badge","description":null,"type":"badge","isComplete":false,"inProgress":false,"score":null,"disabled":false}],"isComplete":false,"isTestedOut":false,"allActivitiesRequired":false}],"expanded":true}]

05

Serverless Data Processing with Dataflow: Develop Pipelines