Data Engineer

Company Name

VARITE India Private Limited

About The Client

A global IT services and consulting company, multinational information technology (IT), headquartered in Tokyo, Japan. The Client offers a wide array of IT services, including application development, infrastructure management, and business process outsourcing. Their consulting services span business and technology, while their digital solutions focus on transformation and user experience design. It excels in data and intelligence services, emphasizing analytics, AI, and machine learning. Additionally, their cybersecurity, cloud, and application services round out a comprehensive portfolio designed to meet the diverse needs of businesses worldwide.

About The Job

• We are seeking a highly skilled Data Engineer with 7 to 9 years of experience in designing, developing, and supporting cloud-based data processing solutions.
• The ideal candidate should have strong hands-on experience with Google Cloud Platform (GCP) services, particularly Cloud Functions, Cloud Run Jobs, Dataflow, and Python, to build scalable and reliable data integration and transformation pipelines.
• The candidate will collaborate with cross-functional teams in an Agile environment to deliver high-quality data solutions that support business and analytics requirements.

Essential Job Functions

• Design, develop, deploy, and maintain scalable data pipelines using Google Cloud Platform (GCP) services.
• Build and manage serverless data processing solutions using Cloud Functions and Cloud Run Jobs.
• Develop, optimize, and support batch and streaming data pipelines using Dataflow.
• Create reusable, efficient, and maintainable code using Python.
• Integrate data from multiple sources and ensure data quality, consistency, and reliability.
• Monitor, troubleshoot, and optimize data processing workflows and cloud resources.
• Collaborate with Business Analysts, Architects, and stakeholders to understand data requirements and translate them into technical solutions.
• Participate in code reviews, unit testing, deployment activities, and production support.
• Follow Agile development practices and contribute to sprint planning, estimation, and retrospectives.
• Ensure adherence to security, governance, and operational best practices.

Qualifications

Mandatory Skills

• Strong experience with Google Cloud Platform (GCP).
• Hands-on experience in:
• Cloud Functions
• Cloud Run Jobs
• Dataflow
• Python
• Experience in designing and developing ETL/ELT and data integration solutions.
• Knowledge of batch and streaming data processing frameworks.
• Strong understanding of data modeling, data transformations, and data quality concepts.
• Experience with source code management and CI/CD practices.
• Good problem-solving, analytical, and communication skills.

Nice to Have Skills

• Knowledge of Agile methodologies and Scrum practices.
• Experience with DevOps tools and CI/CD pipelines.
• Working knowledge of other GCP services such as BigQuery, Pub/Sub, Cloud Storage, Composer, and IAM.
• Experience with monitoring and logging tools within GCP.
• Exposure to data warehousing and analytics platforms.

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 7 to 9 years of experience in Data Engineering and cloud-based data solutions.
• Proven experience delivering enterprise-scale data integration and processing projects.
• Professional certifications in Google Cloud Platform (GCP) are desirable.

How to Apply

Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards

Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral

• 0-2 years – INR 5,000
• 2-6 years – INR 7,500
• 6+ years – INR 10,000

About VARITE

VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.