Serverless Data Processing with Dataflow - Writing an ETL pipeline using Apache Beam and Dataflow (Java) avis

xvccvxc

Jordan V. · Examiné il y a 7 jours

The "walkthrough" could have better explanations, specially since this is the first hands on creation of pipelines through code

Felipe T. · Examiné il y a 7 jours

Quan D. · Examiné il y a 7 jours

Jordan V. · Examiné il y a 7 jours

Doesn't compile: [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 9.787 s [INFO] Finished at: 2024-09-12T14:16:00+00:00 [INFO] Final Memory: 41M/55M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project advanced-dataflow-lab-1-lab: Compilation failure: Compilation failure: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,26] cannot find symbol [ERROR] symbol: class Logger [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[33,38] cannot find symbol [ERROR] symbol: class DataflowPipelineOptions [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[65,19] cannot find symbol [ERROR] symbol: class PipelineResult [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,39] cannot find symbol [ERROR] symbol: variable LoggerFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[46,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[69,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options

Fernando A. · Examiné il y a 7 jours

The lab console and the web ide never opened for me to continue with the lab.

Probal Kumar D. · Examiné il y a 8 jours

I could not understand what the author meant when i read the description

Jakub M. · Examiné il y a 8 jours

Cornelius K. · Examiné il y a 8 jours

Saurabh D. · Examiné il y a 9 jours

Maria P. · Examiné il y a 9 jours

too confusing

Muhammad S. · Examiné il y a 9 jours

Daniel P. · Examiné il y a 9 jours

was good

José Carlos V. · Examiné il y a 9 jours

Sanjeev U. · Examiné il y a 9 jours

Vaishnavi K. · Examiné il y a 9 jours

Kentaro I. · Examiné il y a 9 jours

Sam T. · Examiné il y a 10 jours

I have error in step build maven This is error java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location to store temp files.This can be set by withCustomGcsTempLocation() in the Builderor through the fallback pipeline option --tempLocation. so I need to find solution for a while I need to solve with add line public static void main(String[] args) { Options options = PipelineOptionsFactory.fromArgs(args).as(Options.class); // Set the GCS temp location through options options.setTempLocation("gs://YOUR_BUCKET/temp/"); run(options); }

sutee k. · Examiné il y a 10 jours

Edson H. · Examiné il y a 10 jours

Cristian Camilo S. · Examiné il y a 10 jours

Peter D. · Examiné il y a 10 jours

Peter D. · Examiné il y a 10 jours

Eduardo A. · Examiné il y a 10 jours

Lemni N. · Examiné il y a 11 jours

Mukul J. · Examiné il y a 11 jours