Offloading Financial Mainframe Data into BigQuery and Elastic Search Reviews

Had an issue with the queries. ` is a bash syntax so it clashes with bigquery so \` should be used instead, like this: gcloud dataflow flex-template run bqtoelastic-`date +%s` --template-file-gcs-location gs://dataflow-templates-us-central1/latest/flex/BigQuery_to_Elasticsearch --region us-central1 --num-workers 1 --parameters index=transactions,maxNumWorkers=1,query="select * from \`$GOOGLE_CLOUD_PROJECT.mainframe_import.account_transactions\`",connectionUrl=$CONNECTION_URL,apiKey=$API_KEY This issue is in Task 3 and 5.

Arkapravo G. · Reviewed over 1 year ago

Mahak G. · Reviewed over 1 year ago

Vladyslav P. · Reviewed over 1 year ago

Able A. · Reviewed over 1 year ago

Offloading data of varied length into Bigquery and Elastic Search requires a constant dataflow template that can run it with dual Cloud Shell parallely through arbitrary Java 11/Kotlin CLI for a browser

Anshuman M. · Reviewed over 1 year ago

Mahak G. · Reviewed over 1 year ago

Naresh b. · Reviewed over 1 year ago

Mahak G. · Reviewed over 1 year ago

Keyur D. · Reviewed over 1 year ago

Keyur D. · Reviewed over 1 year ago

Keyur D. · Reviewed over 1 year ago

sudhir m. · Reviewed over 1 year ago

M.SALMAN A. · Reviewed over 1 year ago

QUICK GCP L. · Reviewed over 1 year ago

Chetana D. · Reviewed over 1 year ago

Sandesh B. · Reviewed over 1 year ago

Deborah S. · Reviewed over 1 year ago

Avijit S. · Reviewed over 1 year ago

Avijit S. · Reviewed over 1 year ago

Fahad N. · Reviewed over 1 year ago

Kartheek T. · Reviewed over 1 year ago

Rishikesh K. · Reviewed over 1 year ago

Lubna S. · Reviewed over 1 year ago