Automate Validation using the Data Validation Tool (DVT) Reviews

no happy

Neeraja K. · Reviewed about 2 months ago

doesnt work

Cesar P. · Reviewed 2 months ago

Cesar P. · Reviewed 2 months ago

Taniya S. · Reviewed 2 months ago

Gabriel G. · Reviewed 2 months ago

Kai Nang K. · Reviewed 3 months ago

Kai Nang K. · Reviewed 3 months ago

Mounir S. · Reviewed 3 months ago

Veera Raghava d. · Reviewed 3 months ago

Kylie H. · Reviewed 5 months ago

validation failed

Sean P. · Reviewed 5 months ago

TASK4 data-validation validate column \ --source-conn HIVE_CONN \ --target-conn BQ_CONN \ --tables-list default.mascots=$PROJECT_ID.dvtlab.mascots \ --config-file mascots.yaml 06/19/2024 05:43:51 PM-INFO: Using database default as default 06/19/2024 05:43:51 PM-INFO: Pinging the impalad 06/19/2024 05:43:51 PM-INFO: Success! Config output written to ./mascots.yaml 06/19/2024 05:43:51 PM-INFO: Closing active operation 06/19/2024 05:43:51 PM-ERROR: Failed to open transport (tries_left=3) Traceback (most recent call last): File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/thrift/transport/TSocket.py", line 90, in isOpen self.handle.settimeout(0) OSError: [Errno 9] Bad file descriptor During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 1098, in _execute open_transport(transport) File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 1162, in open_transport if not transport.isOpen(): File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/thrift_sasl/__init__.py", line 67, in isOpen return is_open() File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/thrift/transport/TSocket.py", line 98, in isOpen self.handle.settimeout(original_timeout) OSError: [Errno 9] Bad file descriptor 06/19/2024 05:43:51 PM-ERROR: Failure encountered closing last operation. Traceback (most recent call last): File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 272, in close self.close_operation() File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 304, in close_operation self._reset_state() File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 313, in _reset_state self._last_operation.close() File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 1362, in close return self._rpc('CloseOperation', req, False) File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 1085, in _rpc err_if_rpc_not_ok(response) File "/home/student-02-00a5c78b28bd/env/lib/python3.9/site-packages/impala/hiveserver2.py", line 781, in err_if_rpc_not_ok raise HiveServer2Error(resp.status.errorMessage) impala.error.HiveServer2Error: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=1b70d1e3-b077-44b5-8449-1d2d05fc9070]

MING HSIEN W. · Reviewed 5 months ago

sdf

Suresh Kumar G. · Reviewed 5 months ago

sdf

Suresh Kumar G. · Reviewed 5 months ago

sdf

Suresh Kumar G. · Reviewed 5 months ago

Suresh Kumar G. · Reviewed 5 months ago

Raju J. · Reviewed 5 months ago

Suresh Kumar G. · Reviewed 6 months ago

Srigopal M. · Reviewed 6 months ago

William M. · Reviewed 6 months ago

There were a few issues. I'll write with more details later.

Alyson S. · Reviewed 6 months ago

Rahul K. · Reviewed 7 months ago

I was being asked to run column validation even if I already did it, and the code for listing and running saved configs was wrong, making me not being able to complete two tasks.

Tiago G. · Reviewed 8 months ago

Val S. · Reviewed 9 months ago

Anrie S. · Reviewed 10 months ago