GCP Consultant/Developer

Job Title

GCP Consultant/Developer

Location

Hyderabad

EXP

6+Years

Description

Skills

Google BigQuery, DataProc, Data fusion, Apache Airflow, Google Cloud Platform, Python, SQL, CI/CD pipelines

Responsibilities

This role requires a strong understanding of Google cloud infrastructure, as well as experience in designing and implementing scalable and reliable data solutions. The candidate should be adept at troubleshooting and optimizing performance to ensure efficient data processing.

Work with various product teams to understand the GCP solutions that they are going to deploy into production.

Support Data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc.

Work with other DEs to integrate data solutions into applications.

Manage & configure data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems.

Maintain and support ETL processes to ensure data quality and consistency.

Support efficient data retrieval and analysis.

Monitor data pipelines and processes for data quality issues.

Troubleshoot and resolve data-related problems in a timely manner by collaborating with business users and leaders.

Perform regular data backups and implement disaster recovery procedures.

Collaborate with cross-functional teams including multiple business leaders to understand data requirements and provide technical guidance and support.

Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.

Optimize data structures and queries for performance and scalability as problem management for long running jobs

Deployments on BigQuery, BigQuery object provision automation, BigQuery capacity management (Proactive/Reactive)

Optimizing and tuning Big Queries, Changes to DDL statements

Admin activities e.g., Create/Drop/Alter table/view, Data loads and fixes.

Provide configuration details to terraform team

Basic functional knowledge on manufacturing domain particularly HVAC industry,