Data Architect

Skill Cluster

Data-Databricks Data platform with Spark,Python/Scala/Java,Kafka, HDFS, Hive,NoSQL.

Primary Skill

DataBricks,PySpark

Hands-on Data Architect (Databricks Lakehouse)

Role Overview

Own the target-state architecture in Databricks and actively contribute to pipeline development. Define how API/FTP data flows into Bronze/Silver/Gold layers with cleansing and enrichment logic.

Key Responsibilities

Design Databricks Lakehouse architecture (Bronze/Silver/Gold)Define ingestion patterns for API & FTP

Architect scalable cleansing & enrichment frameworks

Translate legacy SQL logic into Spark-based transformations

Define Delta Lake optimization strategy

Establish security, governance, and PHI controls

Implement CI/CD for data pipelines

Mentor engineering team

Required Skills

Strong expertise in Databricks & Delta Lake

Advanced PySpark & Spark SQL

Experience designing data pipelines from scratch

Strong understanding of SQL Server logic & stored procedures

Azure cloud experience

Healthcare data architecture experience preferred