JobHabor
Menu

Lead Data Engineer / Architect

Sidram Technologies · cary, NC, United States · Hybrid

Weak hiring record · median 372 days open

100100

Hiring signal

Actively hiring

Posted today · Reposted once · Checked today · How we score

First seen
19 November 2026
Reposted
Once since September 2026
Last checked
Today · still on the employer's board
All reasons
  • 88% of this employer's openings are over 60 days old

In its favour

  • Posted yesterday
  • Still listed on the employer's own board
  • Publishes a salary range

Did you apply?

Lead Data Engineer / Architect at Sidram Technologies. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Role: Lead Data Engineer / Architect

Client

MetLife |

Location

Cary, NC

Work Model

Day 1 onsite; hybrid schedule, Tuesday–Thursday onsite

Experience

10–15 years

Employment

Full-time with Altimetrik

1. Compensation & Visa Requirements

Visa-independent candidates

Salary up to $160K per annum, depending on experience and fit.

H-1B transfer candidates: Maximum $145K–$150K per annum.

H-1B transfer candidates must be able to start upon receipt of the H-1B transfer receipt notice and minimum 2 years of Gap in 6 Years of H1-B.

Day 1 onsite is mandatory. Candidates must be available to work onsite in Cary, NC, Tuesday through Thursday.

Candidates must be comfortable with the stated compensation range and onsite requirements before submission.

2. Mandatory Skills – Must-Have

Python, PySpark, Scala and SQL – strong production-level data engineering skills.

Azure Databricks – Delta Lake, Spark performance tuning, Jobs/Workflows and Unity Catalog.

Azure data services – ADLS Gen2 and Azure Data Factory (ADF).

Lakehouse / Medallion Architecture – proven experience implementing Bronze, Silver and Gold layers at enterprise scale.

Data Pipeline Engineering – metadata-driven ingestion frameworks, data transformation, data quality and large-scale pipeline optimization.

Production AI/LLM Experience – hands-on experience designing and deploying LLM-based solutions, including RAG, embeddings, retrieval and prompt engineering.

LLM Frameworks – experience with LangChain, LlamaIndex or LangGraph, plus Azure OpenAI, OpenAI or Databricks Model Serving.

Azure DevOps / CI-CD – experience automating data pipeline deployments; Terraform and Databricks Asset Bundles are highly relevant.

Technical Leadership – ability to design solutions, write production code, review code and guide data engineering teams.

Financial services or insurance data, especially financial reconciliation, general ledger or accounting data.

AI-driven data quality, anomaly detection and automated reconciliation.

Knowledge graphs, ontologies, semantic layers or enterprise Text-to-SQL solutions.

Azure security, data governance, PII protection and fine-grained access controls.

MLOps/LLMOps, model evaluation and production AI monitoring.

Important

This is a hands-on Lead Data Engineer position, not a purely managerial or coordination role. Candidates must demonstrate recent production coding experience.

4. Recruiter Screening Checklist

Confirm all of the following before submission

12–18 years of relevant experience.

Visa status and eligibility to meet the applicable compensation terms.

H-1B transfer candidate, if applicable, can start upon receipt of the transfer receipt notice.

Willing and able to work onsite in Cary, NC, from Day 1, Tuesday–Thursday.

Strong hands-on Python, PySpark, Scala and SQL.

Strong Azure Databricks, Delta Lake, ADLS Gen2 and ADF experience.

Proven enterprise lakehouse / medallion architecture experience.

Production experience building and deploying LLM/RAG solutions.

Recent production coding and technical leadership experience.

Compensation expectations confirmed before submission.

Candidate Priority

Highest priority

Candidates who combine Azure Databricks and enterprise data engineering expertise with production LLM/RAG implementation experience.

Secondary priority

Candidates with strong data platform engineering and production AI experience who also bring insurance/financial services domain knowledge and governance expertise.

Rachael

IT Services | Development | Staffing

Email

rachael@sidramtech.com

Skills

  • automation
  • Terraform
  • Governance
  • Metadata
  • Architecture
  • Data Pipelines
  • Data Quality
  • Microsoft Azure
  • PySpark
  • Performance Tuning
  • Databricks
  • Data Transformation
  • Artificial intelligence
  • OpenAI
  • Data Governance
  • Apache Spark
  • Conceptual Models
  • Python (Programming Language)
  • Data Layers
  • SQL Databases
  • Continuous Integration
  • Code Review
  • Knowledge of Finance
  • Large Language Models
  • Data Lakes
  • Technical Management
  • Workflows
  • Information Engineering
  • Access Controls
  • General Ledger Documents
  • Prompt Engineering
  • Azure Data Factory
  • Machine Learning Operations
  • Systems Implementations
  • Graph Database
  • GPT
  • Anomaly Detection
  • Model Validation
  • Data Infrastructure
  • Retrieval-Augmented Generation
  • Scala (Programming Language)
  • Azure Data Lake
  • Production Code
  • Accounting Ledgers
  • Knowledge of Engineering
  • Llamaindex
  • LangGraph Framework
  • Bank Reconciliation

More jobs at Sidram Technologies

All 2,919

Similar roles