
Data Architect (Hands-On Lead Data Engineer
Sidram Technologies · Cary, NC, United States · Hybrid
Weak hiring record · median 369 days open
- First seen
- 12 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- 89% of this employer's openings are over 60 days old
In its favour
- Posted 3 days ago
- Still listed on the employer's own board
Job Title
Data Architect (Hands-On Lead Data Engineer) Need - BFSI Experience
Employment Type
Full-Time
Location
Cary, NC
Work Model
Hybrid – Onsite Tuesday through Thursday required from Day 1
Experience
12–18 Years (Minimum 10–15+ years of relevant data engineering and architecture experience)
Role Overview
We are seeking a deeply technical, hands-on Data Architect / Lead Data Engineer to join Altimetrik in support of our premier insurance client, MetLife, in Cary, NC. This is a hybrid, hands-on engineering and architectural leadership role—not a purely managerial or coordination position. The ideal candidate will actively design, code, and deploy enterprise-scale Lakehouse platforms on Azure Databricks while leading the implementation of production Generative AI (LLM/RAG) and automated financial data reconciliation solutions.
Key Responsibilities
- Enterprise Lakehouse Architecture: Design, architect, and implement scalable Bronze, Silver, and Gold Medallion architectures using Azure Databricks, Delta Lake, ADLS Gen2, and Azure Data Factory (ADF).
- Hands-On Data Engineering: Write, review, and optimize production-grade data pipelines using Python, PySpark, Scala, and SQL, focusing on metadata-driven ingestion frameworks, Spark performance tuning, and data quality.
- Production GenAI & LLM Solutions: Architect and deploy production-ready LLM and Retrieval-Augmented Generation (RAG) workflows—including embeddings, vector retrieval, prompt engineering, and enterprise Text-to-SQL or semantic layer solutions.
- AI-Driven Financial & Data Quality Automation: Build automated reconciliation, anomaly detection, and AI-driven data quality pipelines tailored to financial services, general ledger, and accounting datasets.
- Governance, Security & MLOps/LLMOps: Implement Unity Catalog, fine-grained access controls, PII data protection, and robust CI/CD pipelines (Azure DevOps, Terraform, Databricks Asset Bundles) alongside model evaluation and production AI monitoring.
- Technical Leadership: Provide architectural guidance, conduct code reviews, and mentor data engineering teams while remaining actively involved in daily production coding.
Required Qualifications
- Experience: 12–18 years of progressive experience in data engineering, enterprise data architecture, and distributed big data processing, with demonstrated recent hands-on production coding experience.
- Core Programming: Expert-level, production-grade proficiency in Python, PySpark, Scala, and SQL.
- Azure Data Ecosystem: Strong hands-on expertise in Azure Databricks (Delta Lake, Spark performance tuning, Jobs/Workflows, Unity Catalog), ADLS Gen2, and Azure Data Factory (ADF).
- Medallion & Pipeline Engineering: Proven track record implementing enterprise Lakehouse/Medallion architectures and metadata-driven ingestion frameworks at scale.
- Production Generative AI & LLMs: Hands-on experience designing and deploying production LLM/RAG solutions utilizing frameworks such as LangChain, LlamaIndex, or LangGraph, integrated with Azure OpenAI, OpenAI, or Databricks Model Serving.
- DevOps & Infrastructure as Code: Experience automating data and AI deployments using Azure DevOps (CI/CD), Terraform, and Databricks Asset Bundles.
- Data Security & Governance: Strong understanding of Azure security frameworks, data governance, PII protection, and role/attribute-based access controls.
Preferred Qualifications
- Domain Expertise: Prior experience in insurance or financial services, specifically working with general ledger (GL), accounting, or financial reconciliation data.
- Advanced AI & Semantic Architectures: Hands-on experience building knowledge graphs, ontologies, semantic layers, enterprise Text-to-SQL applications, and MLOps/LLMOps monitoring pipelines.
Best Regards,
Arun | Sr US IT Recruiter
SIDRAM TECHNOLOGIES
IT Services | Development | Staffing
URL
http:/www.sidramtech.
com | Email
arun@sidramtech.com
Skills
- Salesforce
- automation
- Governance
- DevOps
- Architecture
- Data Pipelines
- Data Quality
- Microsoft Azure
- PySpark
- Performance Tuning
- Data Protection
- Mentoring
- Databricks
- Accounting
- Artificial intelligence
- OpenAI
- Data Governance
- Generative AI
- Big Data
- Apache Spark
- Data Architecture
- Conceptual Models
- Python (Programming Language)
- Data Layers
- SQL Databases
- Continuous Integration
- Safety Principles
- Code Review
- Knowledge of Finance
- Computer Programming
- Large Language Models
- Data Lakes
- Information Engineering
- Financial Data Analysis
- Access Controls
- Data Security
- General Ledger Documents
- Design Leadership
- Prompt Engineering
- Azure Data Factory
- Semantics
- Machine Learning Operations
- Delivery Pipeline
- Graph Database
- Anomaly Detection
- Model Validation
- IT Security Standards
- Retrieval-Augmented Generation
- Scala (Programming Language)
- Azure Data Lake
- Llamaindex
- LangGraph Framework
- Information Retrieval
- Bank Reconciliation
- Production Management
More jobs at Sidram Technologies
All 2,859- Cybersecurity / GRC Security AnalystSidram Technologies · Houston, TX, United States3d ago
- Developer/Programmer Analyst 3Sidram Technologies · Austin, TX, United States3d ago
- Full Stack DATA Engineer - Hybrid NYCSidram Technologies · New York, NY, United States3d ago
- SAP BusinessObjects Data Services (BODS) DeveloperSidram Technologies · Deerfield, IL, United States3d ago
- Databricks AdministratorSidram Technologies · Remote3d ago
Similar roles
- Senior Database Administrator - Production SupportJobgether · US · USD 116,450–157,550/yrtoday
- Power BI Developer / Data Visualization AnalystJobgether · UStoday
- Data Engineering Solution LeadJobgether · UStoday
- Staff Data Platform Engineer, Knowledge PlatformAirwallex · US - Seattletoday
- Data Platform Principal Architect, Seattle/San FranciscoAirwallex · US - Seattletoday
- Senior Battery Data EngineerRedwood Materials · San Francisco, California, United Statestoday