GCP Data Platform Engineer w/ DevOps

Role

GCP Data Platform Engineer w/ DevOps

Location

Charlotte, NC (Hybrid, Onsite 3 Days/Week)

Responsibilities

• Create CI/CD pipelines using GitHub Actions and Harness
• Collaborate with data & ML engineers to productionize their workflows
• Accountable for NFRs such as observability, pipeline management, execution scheduling, orchestration, and storage volumes
• Serve as a horizontal enablement resource supporting multiple data and ML engineers
• Create entitlements and service accounts as needed for automated processes and cross-project access

Must Have Experience With

• GitHub Actions and Harness
• Python
• Google Cloud Platform (GCP): DAGs/Cloud Composer/Airflow, GCS, Cloud Logging Service
• Release Coordination/Change Management/Deployment Support
• Access and Entitlement Management

Good to have knowledge on, but not main requirements:

• BigQuery
• Dataproc Serverless
• Dataflow
• Spark
• Beam