Senior Data Engineer (Healthcare domain)

Posted 9d ago

Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
Build and maintain infrastructure using Terraform for cloud platforms
Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
Work with large datasets to optimize performance and ensure seamless data integration
Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
Discover, analyze, and organize disparate data sources into clean, understandable schemas
Hands-on experience with cloud computing services in data and analytics
Experience with data modeling, reporting tools, data governance, and data warehousing
Proficiency in Python and PySpark for distributed data processing
Experience with Azure, Snowflake, and Databricks
Experience with Docker and Kubernetes
Knowledge of infrastructure as code (Terraform)
Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
Experience with stream processing technologies such as Kafka, Spark Structured Streaming
At least an Upper-Intermediate level of English

Skills