ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) avis

Mauricio D. · Examiné il y a environ 2 heures

Tshepiso M. · Examiné il y a environ 5 heures

Edson H. · Examiné il y a environ 5 heures

Barry S. · Examiné il y a environ 10 heures

Grover Javier R. · Examiné il y a environ 11 heures

JOIN section Workflow keeps failing. Must be a problem with command: python dataflow_python_examples/data_lake_to_mart.py \ --worker_disk_type="compute.googleapis.com/projects//zones//diskTypes/pd-ssd" \ --project=$PROJECT \ --runner=DataflowRunner \ --machine_type=e2-standard-2 \ --staging_location=gs://$PROJECT/test \ --temp_location gs://$PROJECT/test \ --save_main_session \ --region=us-east1

Barry S. · Examiné il y a environ 12 heures

Aleksandra O. · Examiné il y a environ 13 heures

Tulasi V. · Examiné il y a environ 14 heures

Tom J. · Examiné il y a environ 15 heures

Kshitija B. · Examiné il y a environ 15 heures

tallapally g. · Examiné il y a environ 15 heures

one of the commands is missing a default setting and fails

Chris D. · Examiné il y a environ 18 heures

good lab

Adhi K. · Examiné il y a environ 18 heures

尚太 神. · Examiné il y a environ 21 heures

Benjamin S. · Examiné il y a 1 jour

Ezequiel R. · Examiné il y a 1 jour

Ceргeй В. · Examiné il y a 1 jour

Shalin M. · Examiné il y a 1 jour

christian m. · Examiné il y a 1 jour

Christian F. · Examiné il y a 1 jour

I have problem with the Console, when I was on the docker container with python, on the second step to run the data_trasformation.py script, I kept having this message: root@48034960a23f:/dataflow# python dataflow_python_examples/data_transformation.py --project=$PROJECT --region=us-east4 --runner=DataflowRunner --machine_type=e2-standard-2 --staging_location=gs://$PROJECT/test --temp_location gs: //$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_transformation.py", line 166, in <module> run() File "dataflow_python_examples/data_transformation.py", line 132, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/usr/local/lib/python3.8/site-packages/apache_beam/pipeline.py", line 212, in __init__ raise ValueError( ValueError: Pipeline has validations errors: Invalid GCS path (gs:///test), given for the option: temp_location. Invalid GCS path (gs:///test), given for the option: staging_location. Invalid Project ID (). Please make sure you specified the Project ID, not project number. So i Had to start from the beggining again, and this made me unable to finish the lab on time!! What do I have to do now with my credits to redo this lab??

Almudena O. · Examiné il y a 1 jour

Yves E. · Examiné il y a 1 jour

Béla K. · Examiné il y a 1 jour

Dheeraj K. · Examiné il y a 1 jour

Aruna D. · Examiné il y a 1 jour