AWS PySpark Databricks Developer
Diverse Lynx · NYC, NY · Remote
Strong hiring record · median 5 days open
- First seen
- 12 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Posted 6 days ago
- Still listed on the employer's own board
- Someone has already applied through it
Bill Rate
MAX CONFIRMED-$65/HR.
Location
REMOTE-EST HOURS
Duration
6 months
Role
Databricks Engineer
Role Descriptions
Terradata to Databricks migration
Essential Skills
Terradata to Databricks migration
Desirable Skills
Keyword
Skills
Digital
Python~Digital
Databricks~Digital
PySpark
Experience Required
8 + Years
CANDIDATE MUST HAVE HANDSON EXP IN DATABRICKS, PYTHON AND PYSPARK
Job Title AWS PySpark Databricks Developer
Relevant Experience
(in Yrs) 5-6 years+
Technical/Functional Skills
- 5–6 years of total experience in data engineering or big data development.
- 2–3 years hands-on experience with Databricks and Apache Spark.
- Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM).
FastAPI, GKE, Cloud Run, REST APIs, and Terraform following enterprise DevOps, CI/CD, IA
- Strong programming skills in PySpark, Python, and Eligible to workionally Scala.
- Solid understanding of data lakes, lakehouses, and Delta Lake concepts.
- Experience in SQL development and performance tuning.
- Familiarity with Airflow, dbt, or similar orchestration tools is a plus.
- Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.
- Knowledge of data security, governance, and compliance frameworks.
ETL workflows using GCP Dataflow, Snowflake, and BigQuery
Experience Required 5-6 years+
Roles & Responsibilities
- Develop and maintain scalable data pipelines using Apache Spark on Databricks.
- Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
- Design and implement data models, schemas, and Lakehouse architecture in Databricks.
- Eligible to workimize and tune Spark jobs for performance and cost-efficiency.
- Integrate data from multiple structured and unstructured data sources.
- Monitor and manage data workflows, ensuring data quality, consistency, and security.
- Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications.
- Write clean, reusable, well-documented code using Python / PySpark / Scala.
Skills
More jobs at Diverse Lynx
All 135- Sr. Full Stack Developer – Python / .NET / AWS GlueDiverse Lynx · Chicago, IL · USD 55–60/hrtoday
- IBM MQ Infra AdminDiverse Lynx · Dallas TX · USD 10–55/hrtoday
- QA Automation Engineer@Tampa, FLDiverse Lynx · Tampa, FL · USD 8–20/hrtoday
- .NET Full Stack Architect with FHIR expertiseDiverse Lynx · Remote · USD 60–65/hrtoday
- Databricks DeveloperDiverse Lynx · New York, NY · USD 59–61/hrtoday
Similar roles
- Databricks DeveloperDiverse Lynx · New York, NY · USD 59–61/hrtoday
- Sr. Databricks Developer (W2 Only)Saransh · Columbus, OH, United States14d ago
- Sr. Databricks DeveloperSaransh · Columbus, OH, United States14d ago
- Databricks Partner Development ManagerKMS Technology · Atlanta, GA, United States · USD 250,000–300,000/yr14d ago
- Databricks Apps / Streamlit Developer Insurance UnderwritingDiverse Lynx · Charlotte, NC · USD 69/hr7d ago
- Sr. Databricks Developer – 12+ years expHan IT Staffing · DEyesterday