Opiniones sobre Procesamiento de datos sin servidores con Dataflow: Cómo escribir una canalización de ETL mediante Apache Beam y Cloud Dataflow (Java)

xvccvxc

Jordan V. · Se revisó hace 7 días

The "walkthrough" could have better explanations, specially since this is the first hands on creation of pipelines through code

Felipe T. · Se revisó hace 7 días

Quan D. · Se revisó hace 7 días

Jordan V. · Se revisó hace 7 días

Doesn't compile: [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 9.787 s [INFO] Finished at: 2024-09-12T14:16:00+00:00 [INFO] Final Memory: 41M/55M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project advanced-dataflow-lab-1-lab: Compilation failure: Compilation failure: [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,26] cannot find symbol [ERROR] symbol: class Logger [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[33,38] cannot find symbol [ERROR] symbol: class DataflowPipelineOptions [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[65,19] cannot find symbol [ERROR] symbol: class PipelineResult [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[27,39] cannot find symbol [ERROR] symbol: variable LoggerFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[46,27] cannot find symbol [ERROR] symbol: variable PipelineOptionsFactory [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,9] cannot find symbol [ERROR] symbol: class Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[68,29] cannot find symbol [ERROR] symbol: variable Pipeline [ERROR] location: class com.mypackage.pipeline.MyPipeline [ERROR] /home/project/training-data-analyst/quests/dataflow/1_Basic_ETL/labs/src/main/java/com/mypackage/pipeline/MyPipeline.java:[69,16] cannot find symbol [ERROR] symbol: method setJobName(java.lang.String) [ERROR] location: variable options of type com.mypackage.pipeline.MyPipeline.Options

Fernando A. · Se revisó hace 7 días

The lab console and the web ide never opened for me to continue with the lab.

Probal Kumar D. · Se revisó hace 8 días

I could not understand what the author meant when i read the description

Jakub M. · Se revisó hace 8 días

Cornelius K. · Se revisó hace 8 días

Saurabh D. · Se revisó hace 9 días

Maria P. · Se revisó hace 9 días

too confusing

Muhammad S. · Se revisó hace 9 días

Daniel P. · Se revisó hace 9 días

was good

José Carlos V. · Se revisó hace 9 días

Sanjeev U. · Se revisó hace 9 días

Vaishnavi K. · Se revisó hace 9 días

Kentaro I. · Se revisó hace 9 días

Sam T. · Se revisó hace 10 días

I have error in step build maven This is error java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location to store temp files.This can be set by withCustomGcsTempLocation() in the Builderor through the fallback pipeline option --tempLocation. so I need to find solution for a while I need to solve with add line public static void main(String[] args) { Options options = PipelineOptionsFactory.fromArgs(args).as(Options.class); // Set the GCS temp location through options options.setTempLocation("gs://YOUR_BUCKET/temp/"); run(options); }

sutee k. · Se revisó hace 10 días

Edson H. · Se revisó hace 10 días

Cristian Camilo S. · Se revisó hace 10 días

Peter D. · Se revisó hace 10 días

Peter D. · Se revisó hace 10 días

Eduardo A. · Se revisó hace 10 días

Lemni N. · Se revisó hace 11 días

Mukul J. · Se revisó hace 11 días