ETL Processing on Google Cloud Using Dataflow and BigQuery (Python) Reviews

I have problem with the Console, when I was on the docker container with python, on the second step to run the data_trasformation.py script, I kept having this message: root@48034960a23f:/dataflow# python dataflow_python_examples/data_transformation.py --project=$PROJECT --region=us-east4 --runner=DataflowRunner --machine_type=e2-standard-2 --staging_location=gs://$PROJECT/test --temp_location gs: //$PROJECT/test --input gs://$PROJECT/data_files/head_usa_names.csv --save_main_session Traceback (most recent call last): File "dataflow_python_examples/data_transformation.py", line 166, in <module> run() File "dataflow_python_examples/data_transformation.py", line 132, in run p = beam.Pipeline(options=PipelineOptions(pipeline_args)) File "/usr/local/lib/python3.8/site-packages/apache_beam/pipeline.py", line 212, in __init__ raise ValueError( ValueError: Pipeline has validations errors: Invalid GCS path (gs:///test), given for the option: temp_location. Invalid GCS path (gs:///test), given for the option: staging_location. Invalid Project ID (). Please make sure you specified the Project ID, not project number. So i Had to start from the beggining again, and this made me unable to finish the lab on time!! What do I have to do now with my credits to redo this lab??

Almudena O. · Reviewed about 1 month ago

Yves E. · Reviewed about 1 month ago

Béla K. · Reviewed about 1 month ago

Dheeraj K. · Reviewed about 1 month ago

Aruna D. · Reviewed about 1 month ago

Gustavo Valente N. · Reviewed about 1 month ago

Veekshith R. · Reviewed about 1 month ago

Uday T. · Reviewed about 1 month ago

hari r. · Reviewed about 1 month ago

Gizem P. · Reviewed about 1 month ago

Apricot S. · Reviewed about 1 month ago

Sarah Z. · Reviewed about 1 month ago

Hitesh B. · Reviewed about 1 month ago

Trapti G. · Reviewed about 1 month ago

MOISES ALFONSO G. · Reviewed about 1 month ago

Çağrı K. · Reviewed about 1 month ago

Fernanda S. · Reviewed about 1 month ago

Rishabh B. · Reviewed about 1 month ago

Adriano D. · Reviewed about 1 month ago

Sukla D. · Reviewed about 1 month ago

Shubham D. · Reviewed about 1 month ago

Kunjal D. · Reviewed about 1 month ago

Navneet k. · Reviewed about 1 month ago

Gonzalo V. · Reviewed about 1 month ago

Avi G. · Reviewed about 1 month ago