JobHabor
Menu

Data Architect (Hands-On Lead Data Engineer

Sidram Technologies · Cary, NC, United States · Hybrid

Weak hiring record · median 369 days open

100100

Hiring signal

Actively hiring

Open 4 days · Never reposted · Checked today · How we score

First seen
12 November 2026
Reposted
Not since September 2026
Last checked
Today · still on the employer's board
All reasons
  • 89% of this employer's openings are over 60 days old

In its favour

  • Posted 3 days ago
  • Still listed on the employer's own board

Did you apply?

Data Architect (Hands-On Lead Data Engineer at Sidram Technologies. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Job Title

Data Architect (Hands-On Lead Data Engineer) Need - BFSI Experience

Employment Type

Full-Time

Location

Cary, NC

Work Model

Hybrid – Onsite Tuesday through Thursday required from Day 1

Experience

12–18 Years (Minimum 10–15+ years of relevant data engineering and architecture experience)

Role Overview

We are seeking a deeply technical, hands-on Data Architect / Lead Data Engineer to join Altimetrik in support of our premier insurance client, MetLife, in Cary, NC. This is a hybrid, hands-on engineering and architectural leadership role—not a purely managerial or coordination position. The ideal candidate will actively design, code, and deploy enterprise-scale Lakehouse platforms on Azure Databricks while leading the implementation of production Generative AI (LLM/RAG) and automated financial data reconciliation solutions.

Key Responsibilities

  • Enterprise Lakehouse Architecture: Design, architect, and implement scalable Bronze, Silver, and Gold Medallion architectures using Azure Databricks, Delta Lake, ADLS Gen2, and Azure Data Factory (ADF).
  • Hands-On Data Engineering: Write, review, and optimize production-grade data pipelines using Python, PySpark, Scala, and SQL, focusing on metadata-driven ingestion frameworks, Spark performance tuning, and data quality.
  • Production GenAI & LLM Solutions: Architect and deploy production-ready LLM and Retrieval-Augmented Generation (RAG) workflows—including embeddings, vector retrieval, prompt engineering, and enterprise Text-to-SQL or semantic layer solutions.
  • AI-Driven Financial & Data Quality Automation: Build automated reconciliation, anomaly detection, and AI-driven data quality pipelines tailored to financial services, general ledger, and accounting datasets.
  • Governance, Security & MLOps/LLMOps: Implement Unity Catalog, fine-grained access controls, PII data protection, and robust CI/CD pipelines (Azure DevOps, Terraform, Databricks Asset Bundles) alongside model evaluation and production AI monitoring.
  • Technical Leadership: Provide architectural guidance, conduct code reviews, and mentor data engineering teams while remaining actively involved in daily production coding.

Required Qualifications

  • Experience: 12–18 years of progressive experience in data engineering, enterprise data architecture, and distributed big data processing, with demonstrated recent hands-on production coding experience.
  • Core Programming: Expert-level, production-grade proficiency in Python, PySpark, Scala, and SQL.
  • Azure Data Ecosystem: Strong hands-on expertise in Azure Databricks (Delta Lake, Spark performance tuning, Jobs/Workflows, Unity Catalog), ADLS Gen2, and Azure Data Factory (ADF).
  • Medallion & Pipeline Engineering: Proven track record implementing enterprise Lakehouse/Medallion architectures and metadata-driven ingestion frameworks at scale.
  • Production Generative AI & LLMs: Hands-on experience designing and deploying production LLM/RAG solutions utilizing frameworks such as LangChain, LlamaIndex, or LangGraph, integrated with Azure OpenAI, OpenAI, or Databricks Model Serving.
  • DevOps & Infrastructure as Code: Experience automating data and AI deployments using Azure DevOps (CI/CD), Terraform, and Databricks Asset Bundles.
  • Data Security & Governance: Strong understanding of Azure security frameworks, data governance, PII protection, and role/attribute-based access controls.

Preferred Qualifications

  • Domain Expertise: Prior experience in insurance or financial services, specifically working with general ledger (GL), accounting, or financial reconciliation data.
  • Advanced AI & Semantic Architectures: Hands-on experience building knowledge graphs, ontologies, semantic layers, enterprise Text-to-SQL applications, and MLOps/LLMOps monitoring pipelines.

Best Regards,

Arun | Sr US IT Recruiter

SIDRAM TECHNOLOGIES

IT Services | Development | Staffing

URL

http:/www.sidramtech.

com | Email

arun@sidramtech.com

Skills

  • Salesforce
  • automation
  • Governance
  • DevOps
  • Architecture
  • Data Pipelines
  • Data Quality
  • Microsoft Azure
  • PySpark
  • Performance Tuning
  • Data Protection
  • Mentoring
  • Databricks
  • Accounting
  • Artificial intelligence
  • OpenAI
  • Data Governance
  • Generative AI
  • Big Data
  • Apache Spark
  • Data Architecture
  • Conceptual Models
  • Python (Programming Language)
  • Data Layers
  • SQL Databases
  • Continuous Integration
  • Safety Principles
  • Code Review
  • Knowledge of Finance
  • Computer Programming
  • Large Language Models
  • Data Lakes
  • Information Engineering
  • Financial Data Analysis
  • Access Controls
  • Data Security
  • General Ledger Documents
  • Design Leadership
  • Prompt Engineering
  • Azure Data Factory
  • Semantics
  • Machine Learning Operations
  • Delivery Pipeline
  • Graph Database
  • Anomaly Detection
  • Model Validation
  • IT Security Standards
  • Retrieval-Augmented Generation
  • Scala (Programming Language)
  • Azure Data Lake
  • Llamaindex
  • LangGraph Framework
  • Information Retrieval
  • Bank Reconciliation
  • Production Management

More jobs at Sidram Technologies

All 2,859

Similar roles