Databricks Architect (26-02879) -

Location

Remote Job

Duration

Long-Term

Job Summary

We are looking for an experienced Databricks Architect to design and implement scalable, secure, and high-performance data solutions using Databricks and cloud technologies.

Key Responsibilities

• Design and implement Databricks Lakehouse architecture and Medallion Architecture.
• Develop and optimize data pipelines using PySpark, Spark SQL, Python, and Delta Lake.
• Implement Unity Catalog for data governance, security, and access control.
• Design ETL/ELT workflows, batch, and real-time data processing solutions.
• Optimize Spark performance, platform scalability, and cloud costs.
• Lead technical design discussions and mentor data engineering teams.

Required Skills

• Strong expertise in Databricks, Apache Spark, PySpark, Python, and SQL.
• Hands-on experience with Delta Lake, Unity Catalog, and data modeling.
• Experience with Azure, AWS, or GCP cloud platforms.
• Knowledge of CI/CD, data governance, and performance tuning.
• Strong solution architecture and stakeholder management skills.

Preferred Qualifications

Databricks certifications and experience delivering enterprise-scale data platforms.