Software Developer Contractor: 6-9 years (Advanced)

Job Title

Python / SQL Data Engineer

Experience

5+ Years (Suggested)

Work Location

Remote

Employment Type

Contract / Full-Time

Job Summary

We are seeking a skilled Python / SQL Data Engineer with strong expertise in SQL, Python, Unix scripting, and Apache Airflow. The ideal candidate will be responsible for developing and maintaining data pipelines, automating data workflows, performing complex data transformations, and supporting cloud-based data engineering solutions.

The candidate should have strong SQL development skills, good Python programming capabilities, and hands-on experience with Unix scripting and workflow orchestration tools such as Airflow. Familiarity with at least one major cloud platform—AWS, GCP, or Azure—is required.

Key Responsibilities

• Develop, optimize, and maintain complex SQL queries, stored procedures, and data transformation logic.
• Write Python scripts and applications to automate data processing, validation, and integration tasks.
• Develop and maintain Unix shell scripts for batch processing, automation, and system-level operations.
• Design, develop, and manage data pipelines and workflows using Apache Airflow.
• Build, schedule, monitor, and troubleshoot automated data workflows.
• Perform data extraction, transformation, validation, and loading (ETL/ELT).
• Work with cloud-based data services and infrastructure across AWS, GCP, or Azure.
• Ensure data accuracy, consistency, quality, and reliability across pipelines.
• Identify performance bottlenecks and optimize SQL queries and data processing workflows.
• Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
• Troubleshoot production issues and ensure smooth execution of scheduled data pipelines.

Required Qualifications

• Strong hands-on experience in advanced SQL development, including complex queries, joins, aggregations, and query optimization.
• Intermediate to strong proficiency in Python programming and scripting.
• Intermediate to strong experience with Unix/Linux shell scripting.
• Intermediate to strong experience with Apache Airflow for workflow orchestration and pipeline scheduling.
• Familiarity with at least one cloud platform: AWS, Google Cloud Platform (GCP), or Microsoft Azure.
• Understanding of ETL/ELT processes, data integration, and data pipeline development.
• Strong debugging, analytical, and problem-solving skills.
• Ability to work independently and collaborate effectively with technical teams.

Good to Have

• Hands-on experience with Snowflake.
• Experience with cloud-based data warehouses and data processing platforms.
• Knowledge of data pipeline monitoring, scheduling, and performance optimization.
• Experience with large-scale data processing and automation.