Azure Data Engineer

Cloud Data EngineerKey responsibilities

Ensure the stability, scalability, and performance of the data pipelines solution.Monitor and maintain batch data pipelines in a cloud-based environment.Improve operational processes including incident handling, performance monitoring, and issue resolution.Optimize Databricks workloads to improve efficiency and reduce costs.Analyze and fine-tune the cloud infrastructure for better cost optimization.

Qualifications

Education

Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.

Professional Experience

Experience in operating and maintaining large-scale cloud data solutions in production environments.Proven experience as a Data Engineer, with a strong focus on Azure Data factory and Databricks.Experience working in an automotive domain is a plus.

Technical Skills

Solid understanding of common issues in cloud-based data pipelines and analytics solutionsWorking knowledge of Databricks and Lakehouse architecture in a cloud environment.Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelinesExperience with command-line scripting (e.g., PowerShell).Experience with data pipeline orchestration tools (e.g. Azure Data Factory)Understanding of monitoring and logging tools is a plus.

B.E

2 -6 Years