Databricks Developer- Medicare Advantage

Databricks Developer- Medicare Advantage

Location: West Coast preferred

Work Model: Remote (U.S.-based candidates only)

Level

Senior- long term contract with opportunity to transition to FTE

Overview

Our client, a leading Medicare Advantage health plan, is seeking an experienced Databricks Developer to support data engineering and analytics initiatives across claims, eligibility, and member/provider data domains. This role will build, optimize, and maintain data pipelines on the Databricks platform that power Medicare Advantage reporting, compliance, and operational analytics. Candidates should be comfortable working independently in a remote setup, be available to start promptly, and bring proven experience in healthcare payer environments

The developer will work closely with data engineering, BI, and analytics teams to translate payer business requirements into reliable, compliant data solutions supporting CMS-aligned reporting.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks to support Medicare Advantage claims, eligibility, and enrollment data processing.
• Develop and optimize ETL/ELT workflows for healthcare data, including EDI 837/835 claims transactions, member eligibility windows, and provider data feeds.
• Implement incremental load strategies and SCD Type 1/Type 2 patterns to manage historical claims runout and eligibility changes.
• Ensure data quality, validation, and reconciliation across pipelines feeding CMS-aligned and Medicare Advantage compliance reporting.
• Apply PHI/HIPAA controls and role-based security practices throughout pipeline design and data handling.
• Collaborate with data engineering, BI, and analytics teams to translate payer business requirements into reliable data solutions.
• Deliver clean, query-ready gold-layer tables that feed downstream reporting and analytics consumers.
• Troubleshoot data processing and platform performance issues, and maintain technical documentation.

Required Experience & Skills

• 8+ years of data engineering experience.
• 3+ years of hands-on healthcare domain experience, ideally within payer environments (Medicare Advantage plans).
• Direct, hands-on experience with Medicare/Medicare Advantage data: things like claims ingestion, eligibility logic, EDI 837/835 transactions, or CMS-aligned reporting.
• 3–5+ years of strong hands-on experience with Databricks (Workflows, Unity Catalog, cluster management) and Spark (PySpark/Scala).
• Hands-on experience with Delta Lake and lakehouse/medallion architecture (bronze/silver/gold layering).
• 4+ years of experience with Azure cloud data services (ADLS, Synapse) or equivalent cloud platform (AWS/GCP).
• 8+ years of strong SQL skills, including complex transformations and performance tuning within Databricks/Spark SQL.
• Proven track record building production-grade ETL/ELT pipelines.
• Familiarity with claims, eligibility, billing/finance, patient encounter, and provider/member data structures.
• Working knowledge of PHI/HIPAA-regulated data handling and role-based access controls.
• Strong problem-solving skills, with the ability to work independently in a remote environment.
• U.S.-based, remote-capable (U.S. resident, citizen, or Green Card holder).

Nice to Have

• Databricks certification.
• Familiarity with CI/CD pipelines (Azure DevOps/Git, Databricks Repos) for data workflows.
• Experience with Azure Data Factory or similar orchestration tools.
• Familiarity with a downstream BI/consumption tool (Power BI, Tableau, or similar).
• Prior experience with Snowflake or other cloud data warehouses.
• Experience with EHR-adjacent systems (e.g., Epic Clarity) or provider-side data.