Azure Data Engineer
Diverse Lynx · Stamford, CT · Hybrid
Strong hiring record · median 5 days open
- First seen
- 17 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Role
Azure Data Engineer
Location
Stamford, CT- Hybrid (Minimum 2 days a week at Onsite)
Job Type
Contract
Role Description-
PySpark, Azure Data Factory, Azure Databricks, SQL, ADLS Gen2
Roles & Responsibilities
- Lead the Azure Data Engineering team and provide day-to-day technical direction, delivery oversight, and issue resolution.
- Design, develop, orchestrate, and maintain scalable ADF pipelines for batch ingestion, data integration, transformation, and downstream processing.
- Develop complex and reusable data-transformation frameworks using PySpark and Azure Databricks notebooks.
- Design metadata-driven ingestion, transformation, validation, reconciliation, logging, and restart/recovery components.
- Build and maintain solutions across ADLS Gen2, Azure Databricks, SQL databases, storage accounts, Azure Key Vault, and upstream/downstream enterprise systems.
- Migrate RDBMS and traditional ETL workloads to modern Data Lake, ELT, and cloud-native processing patterns.
- Eligible to workimize PySpark workloads for partitioning, caching, shuffle reduction, file sizing, scalability, and efficient processing of large datasets.
- Implement data-quality rules, control totals, exception handling, auditability, monitoring, alerting, and operational support mechanisms.
- Support data lake and SQL Server control/governance frameworks, including standards, templates, naming conventions, and directory structures.
- Analyze defects, incidents, change requests, and enhancement needs; perform root-cause analysis and implement sustainable fixes.
- Convert functional and business requirements into technical designs, estimates, implementation plans, and deployment activities.
- Perform code reviews and enforce engineering standards, security practices, source-control discipline, CI/CD, and documentation quality.
- Coordinate with onsite architects, business analysts, QA teams, application teams, production support teams, and customer stakeholders.
- Own offshore deliverables, dependencies, risks, status reporting, release readiness, and post-production stabilization.
- Mentor team members, build technical capability, and ensure high-quality, timely completion of deliverables.
Insurance / Reinsurance Domain Expectations
The candidate should have practical experience working with Insurance and/or Reinsurance data, preferably across several of the following areas:
- Policy, contract, coverage, and exposure data
- Premium, billing, claims, and loss transactions
- Treaty and facultative reinsurance concepts
- Reinsurance premiums, recoveries, claims, and settlements
- Catastrophe, event, and loss-related datasets
- Financial, accounting, bordereaux, and reconciliation feeds
- Regulatory, management, and downstream analytical reporting
Skills
- Azure
- PySpark
- Azure Data Factory
- Azure Databricks
- SQL
- Azure Key Vault
- ETL
- ELT
- SQL Server
More jobs at Diverse Lynx
All 174- ReactJS DeveloperDiverse Lynx · Phoenix, AZ · USD 54/hrtoday
- Forward Deployed Engineer (Junior FDE)@TexasDiverse Lynx · Irving, TX · USD 90,000–100,000/yrtoday
- HPC Java developerDiverse Lynx · San Jose, CA · USD 75/hrtoday
- Mainframe Modernization & AI EngineerDiverse Lynx · Cary, NCtoday
- Senior Developer - Slack IntegrationDiverse Lynx · Bloomington, ILtoday
Similar roles
- Data ScientistSterling Computers · North Sioux City, SD, United Statestoday
- Senior Snowflake Engineer(Technical Lead — Contractor)ICONMA · Boston, CAtoday
- Data Science Intern (2027 Start)Databricks · Mountain View, California · San Francisco, California · USD 54–60/hrtoday
- Staff Data Scientist - Trust and SafetyDatabricks · San Francisco, California · USD 192,000–260,000/yrtoday
- Staff Data Scientist - InfrastructureDatabricks · Mountain View, California · USD 192,000–260,000/yrtoday
- Staff Data ScientistDatabricks · San Francisco, California · USD 192,000–260,000/yrtoday