
Lead Data Engineer / Architect
Sidram Technologies · cary, NC, United States · Hybrid
Weak hiring record · median 372 days open
- First seen
- 19 November 2026
- Reposted
- Once since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- 88% of this employer's openings are over 60 days old
In its favour
- Posted yesterday
- Still listed on the employer's own board
- Publishes a salary range
Role: Lead Data Engineer / Architect
Client
MetLife |
Location
Cary, NC
Work Model
Day 1 onsite; hybrid schedule, Tuesday–Thursday onsite
Experience
10–15 years
Employment
Full-time with Altimetrik
1. Compensation & Visa Requirements
Visa-independent candidates
Salary up to $160K per annum, depending on experience and fit.
H-1B transfer candidates: Maximum $145K–$150K per annum.
H-1B transfer candidates must be able to start upon receipt of the H-1B transfer receipt notice and minimum 2 years of Gap in 6 Years of H1-B.
Day 1 onsite is mandatory. Candidates must be available to work onsite in Cary, NC, Tuesday through Thursday.
Candidates must be comfortable with the stated compensation range and onsite requirements before submission.
2. Mandatory Skills – Must-Have
Python, PySpark, Scala and SQL – strong production-level data engineering skills.
Azure Databricks – Delta Lake, Spark performance tuning, Jobs/Workflows and Unity Catalog.
Azure data services – ADLS Gen2 and Azure Data Factory (ADF).
Lakehouse / Medallion Architecture – proven experience implementing Bronze, Silver and Gold layers at enterprise scale.
Data Pipeline Engineering – metadata-driven ingestion frameworks, data transformation, data quality and large-scale pipeline optimization.
Production AI/LLM Experience – hands-on experience designing and deploying LLM-based solutions, including RAG, embeddings, retrieval and prompt engineering.
LLM Frameworks – experience with LangChain, LlamaIndex or LangGraph, plus Azure OpenAI, OpenAI or Databricks Model Serving.
Azure DevOps / CI-CD – experience automating data pipeline deployments; Terraform and Databricks Asset Bundles are highly relevant.
Technical Leadership – ability to design solutions, write production code, review code and guide data engineering teams.
Financial services or insurance data, especially financial reconciliation, general ledger or accounting data.
AI-driven data quality, anomaly detection and automated reconciliation.
Knowledge graphs, ontologies, semantic layers or enterprise Text-to-SQL solutions.
Azure security, data governance, PII protection and fine-grained access controls.
MLOps/LLMOps, model evaluation and production AI monitoring.
Important
This is a hands-on Lead Data Engineer position, not a purely managerial or coordination role. Candidates must demonstrate recent production coding experience.
4. Recruiter Screening Checklist
Confirm all of the following before submission
12–18 years of relevant experience.
Visa status and eligibility to meet the applicable compensation terms.
H-1B transfer candidate, if applicable, can start upon receipt of the transfer receipt notice.
Willing and able to work onsite in Cary, NC, from Day 1, Tuesday–Thursday.
Strong hands-on Python, PySpark, Scala and SQL.
Strong Azure Databricks, Delta Lake, ADLS Gen2 and ADF experience.
Proven enterprise lakehouse / medallion architecture experience.
Production experience building and deploying LLM/RAG solutions.
Recent production coding and technical leadership experience.
Compensation expectations confirmed before submission.
Candidate Priority
Highest priority
Candidates who combine Azure Databricks and enterprise data engineering expertise with production LLM/RAG implementation experience.
Secondary priority
Candidates with strong data platform engineering and production AI experience who also bring insurance/financial services domain knowledge and governance expertise.
Rachael
IT Services | Development | Staffing
rachael@sidramtech.com
Skills
- automation
- Terraform
- Governance
- Metadata
- Architecture
- Data Pipelines
- Data Quality
- Microsoft Azure
- PySpark
- Performance Tuning
- Databricks
- Data Transformation
- Artificial intelligence
- OpenAI
- Data Governance
- Apache Spark
- Conceptual Models
- Python (Programming Language)
- Data Layers
- SQL Databases
- Continuous Integration
- Code Review
- Knowledge of Finance
- Large Language Models
- Data Lakes
- Technical Management
- Workflows
- Information Engineering
- Access Controls
- General Ledger Documents
- Prompt Engineering
- Azure Data Factory
- Machine Learning Operations
- Systems Implementations
- Graph Database
- GPT
- Anomaly Detection
- Model Validation
- Data Infrastructure
- Retrieval-Augmented Generation
- Scala (Programming Language)
- Azure Data Lake
- Production Code
- Accounting Ledgers
- Knowledge of Engineering
- Llamaindex
- LangGraph Framework
- Bank Reconciliation
More jobs at Sidram Technologies
All 2,919- Full-Stack EngineersSidram Technologies · Bay Area, CA, United Statestoday
- Cybersecurity / GRC Security AnalystSidram Technologies · Houston, TX, United Statestoday
- StrongDM Engineer/PAM Engineer/IAM Engineer/ Cloud Security EngineerSidram Technologies · Irvine, CA, United Statestoday
- AI Testing- QA EngineerSidram Technologies · Charlotte, NC, United Statestoday
Similar roles
- Senior Battery Data EngineerRedwood Materials · San Francisco, California, United Statestoday
- Manager, Data EngineeringBarkleyOKRP · Kansas City, MO, Denver, CO · Chicago, IL · New York, NY +1today
- SLDS Data EngineerCrescens · Denver, COtoday
- Data EngineerICONMA · Newark, NJtoday
- Senior Data Platform EngineerGtt · Atlanta, GAtoday
- BI Analyst - TableauAPN Consulting · Remote, NYtoday