Data Engineer

Duties and Responsibilities

• Design, build, and maintain data transformation pipelines to produce business-ready datasets to stakeholders.
• Document data pipelines, data models, and data transformation processes.
• Collaborate with business stakeholders teams to identify and understand data requirements for various business needs.

Required Skills/Qualifications

• Experience with Python and Scala.
• Experience with big data processing frameworks such as Spark, Flink, or Ray.
• Experience with dimensional modeling.
• Experience on building large scale distributed systems in AWS or a similar cloud provider.
• Experience using AI (e.g., Claude) to accelerate workflows.
• Experience with data orchestration tools like Airflow or Dagster.
• Experience with infrastructure-as-code tools (e.g., Terraform) and modern CI/CD pipelines.