Senior Data Engineer – DataStage to Azure Databricks Migration

Role

Senior Data Engineer – DataStage to Azure Databricks Migration

Remote

Rate: $65/hr on C2C

Job ID: SF_OP_207156-3

Job Description

• Strong hands-on experience in IBM DataStage, Teradata, SQL and Azure Databricks.
• Analyze existing DataStage jobs and their Teradata dependencies.
• Knowledge of Teradata utilities/components such as BTEQ and TPT.
• Experience configuring or working with JDBC/ODBC database connectivity from ETL platforms.
• Identify and remediate Teradata-specific SQL for compatibility with Databricks/Spark SQL
• Perform data reconciliation and validation, including row-count and checksum validation.
• Troubleshoot migration issues related to SQL, connectivity, schemas, metadata and data types.
• Support unit testing, SIT, UAT, cutover and post-production stabilization.
• Good understanding of ADLS Gen2, Delta tables, Unity Catalog and Azure connectivity/security.
• Experience in large-scale Teradata-to-Azure/Databricks migration is preferred.