Mid-Level Data Engineer

Company Name

VARITE India Private Limited

About The Client

Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.

About The Job

• Experience: 3–7 Years
• We are looking for a skilled Mid-Level Data Engineer with hands-on experience in AWS Data Engineering, particularly in designing and developing data pipelines using Amazon Redshift.
• The ideal candidate should have strong expertise in data processing, pipeline development, and cloud-based data engineering solutions, along with proficiency in Spark, SQL, Python, Airflow, and Kafka.

Essential Job Functions

• Design, develop, and maintain scalable data pipelines using AWS services, particularly Amazon Redshift.
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and processing.
• Develop distributed data processing solutions using Apache Spark and PySpark.
• Implement data streaming and ingestion solutions using Apache Kafka and MQTT.
• Develop and manage workflow orchestration and scheduling using Apache Airflow.
• Design and maintain Redshift-based enterprise data warehouses, data marts, and analytical data models.
• Write optimized SQL queries and Python scripts for data processing and transformation.
• Ensure data quality, reliability, scalability, and performance across data pipelines.
• Troubleshoot pipeline failures and optimize data processing workflows.
• Collaborate with cross-functional teams to deliver reliable and efficient data engineering solutions.

Qualifications

Required Skills & Qualifications

• 3–7 years of relevant experience in Data Engineering.
• Strong hands-on experience in AWS Data Engineering.
• Mandatory experience developing and managing data pipelines using Amazon Redshift.
• Proficiency in Apache Spark and PySpark.
• Strong knowledge of SQL and/or Python for data processing and transformation.
• Hands-on experience with Apache Airflow for data pipeline orchestration.
• Experience with Apache Kafka for data streaming and ingestion.
• Understanding of ETL/ELT processes, data warehousing, data marts, and analytical data modelling.
• Familiarity with cloud-native technologies and scalable data engineering architectures.

Good to Have

• Experience with MQTT and real-time data ingestion.
• Knowledge of Tableau for data visualization and reporting.
• Previous experience in the Manufacturing industry.
• Understanding of Industrial IoT (IIoT) and manufacturing data ecosystems.

Preferred Candidate Profile

• Strong analytical and problem-solving skills.
• Ability to independently develop and maintain data pipelines.
• Good understanding of data engineering best practices.
• Strong collaboration and communication skills.
• Ability to troubleshoot and optimize complex data workflows.

How to Apply

Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards

Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral

0-2 years INR 5,000

2-6 years INR 7,500

6+ years INR 10,000

About VARITE

VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.