Data Engineer – Databricks / Customer 360
Diverse Lynx · Marlboro, MA · Hybrid
Strong hiring record · median 4 days open
- First seen
- 10 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Posted 4 days ago
- Still listed on the employer's own board
- Publishes a salary range
Job Title
Data Engineer – Databricks / Customer 360
Location
Marlboro, MA – Hybrid (3 days in office
Tuesday, Wednesday & Thursday)
Bill Rate
$70/hr
ROLE_DESCRIPTION
We are seeking a skilled Data Engineer to design, build, Eligible to workimize, and govern scalable data pipelines and Customer 360 data solutions within the Databricks platform.
RESPONSIBILITIES
- Design, develop, and deploy batch and streaming data pipelines using PySpark, Spark SQL, and Lakeflow to ingest data from POS, e-commerce platforms, loyalty systems, and marketing clouds.
- Implement data transformations and business logic within the Medallion Architecture (Bronze, Silver, and Gold layers).
- Build and Eligible to workimize Gold dimension tables as the single source of truth.
- Define governed business KPIs using Unity Catalog Metric Views.
- Implement data quality frameworks and cleansing routines to ensure accurate and trustworthy Customer 360 data.
- Monitor, debug, and Eligible to workimize Databricks jobs and Spark clusters for performance and cost efficiency.
- Implement partitioning, caching, and Delta Lake data layout best practices.
- Manage Databricks environments, clusters, and deployments using Terraform and AWS DevOps/GitHub Actions.
- Implement CI/CD best practices for data pipelines.
- Implement Unity Catalog governance capabilities, including data lineage, access controls, tags, and data masking.
- Collaborate with Functional Consultants, Data Scientists, and Analytics Engineers to deliver consumption-ready datasets.
- Build and govern Unity Catalog Business Semantics, including Metric Views, Domains, Pages, Glossary terms, and certified assets.
- Configure and curate AI/BI Genie Spaces and the Genie Ontology to enable conversational analytics and AI-driven data consumption.
SKILLS_REQUIRED
- PySpark
- Spark SQL
- Lakeflow
- Lakeflow Connect
- Lakeflow Declarative Pipelines
- Terraform
- AWS DevOps
- GitHub Actions
Skills
- Databricks
- PySpark
- Spark
- SQL
- Unity Catalog
- Delta Lake
- Terraform
- AWS
- GitHub Actions
More jobs at Diverse Lynx
All 126- FDE (Forward Deployed Engineer / Solution Architect)Diverse Lynx · Orlando, FL (Hybrid 3 days onsite).2d ago
- .NET Full Stack DeveloperDiverse Lynx · Coraopolis, Pennsylvania · USD 13–50/hr2d ago
- Adobe Experience Manager (AEM) Lead DeveloperDiverse Lynx · Remote, CA · USD 60–65/hr2d ago
- Agentic AI EngineerDiverse Lynx · Chandler, AZ(3 days onsite) · USD 60–65/hr2d ago
- Senior Full Stack Developer(Python/Angular)Diverse Lynx · NYC · USD 20–100/hr2d ago
Similar roles
- Director, Corporate Legal & Compliance Enablement - AI and Data ScienceJobgether · US · USD 211,674–246,953/yrtoday
- Data Science Senior Advisor (Pricing & Underwriting)Jobgether · US · USD 131,200–218,600/yrtoday
- Senior Database Administrator - Production SupportJobgether · US · USD 116,450–157,550/yrtoday
- Staff Data Platform Engineer, Knowledge PlatformAirwallex · US - Seattletoday
- Power BI Developer / Data Visualization AnalystJobgether · UStoday
- Data Engineering Solution LeadJobgether · UStoday