HYBRID Data Scientist – Azure Data Engineering 812974

Candidates must reside in the State of Indiana.

Position Summary

We are seeking an experienced data professional to design, develop, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Analytics. This role focuses on data pipelines, lakehouse architecture, data modeling, performance optimization, and governance while collaborating with technical and business teams to deliver reliable data products.

Job Duties & Responsibilities

• Build and maintain batch and streaming data pipelines using PySpark, Spark SQL, Delta Lake, and Azure data engineering tools.
• Develop and optimize data models, SQL workloads, and warehouse solutions in Azure Synapse Analytics.
• Orchestrate, monitor, and troubleshoot data pipelines and workflows.
• Implement data governance, access controls, and security measures to protect sensitive information.
• Optimize data processing performance and support data integration across multiple systems.
• Develop technical documentation and contribute to data standards, solution reviews, and process improvements.
• Collaborate with data architects, analysts, scientists, and project managers to translate requirements into technical solutions.

Requirements & Qualifications

Candidates must meet at least one of the following:

• Master's degree in Data Science, Analytics, Informatics, Computer Science, Mathematics, Engineering, or a related field.
• Bachelor's degree in a related field plus at least 2 years of relevant experience.
• At least 4 years of hands-on experience in a similar data engineering role.

Relevant certifications and coursework may substitute for formal education or experience requirements.

Required Technical Experience — 4 Years

• PySpark, Spark SQL, and Databricks notebooks.
• Delta Lake transactions, upserts, schema management, and table maintenance.
• Medallion lakehouse architecture and incremental data ingestion.
• Unity Catalog governance and permissions.
• Spark performance tuning and cluster or warehouse sizing.
• Azure Data Factory, Databricks Workflows, and pipeline orchestration.
• Azure Synapse MPP table design, SQL development, and dimensional modeling.
• ADLS Gen2, external tables, and Parquet, Delta, and CSV data formats.
• Synapse data loading tools, workload management, and performance optimization.
• Azure identity and security services, including Entra ID, managed identities, and Key Vault.
• Git, CI/CD, Azure DevOps or GitHub, and deployment automation.
• Azure Monitor, Log Analytics, pipeline monitoring, and troubleshooting.
• Microsoft lakehouse patterns and Synapse/Databricks interoperability.

Additional Requirements

• Strong written and verbal communication skills.

Desired Experience

• 4 years of experience with Power BI connectivity to Synapse, including Import versus DirectQuery and data model performance.

Preferred Certifications

• Databricks Certified Data Engineer Associate; Professional certification is a plus.
• Microsoft Certified: Azure Data Engineer Associate (DP-203), if already held.