
Data Engineer
techcarrot FZ · Hyderabad, Chennai, Noida, Uttar Pradesh, India
Mixed hiring record · median 44 days open
- First seen
- 8 November 2026
- Reposted
- Once since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- 43% of this employer's openings are over 60 days old
In its favour
- Still listed on the employer's own board
We are looking for a Data Engineer to build, enhance, and support scalable data solutions on Azure. The role involves developing data pipelines, integrating SAP and non-SAP source systems, implementing data transformations in Databricks, and delivering trusted datasets for reporting, analytics, and business intelligence.
The ideal candidate should have strong experience in Azure Data Factory, Databricks, SQL, and Python, along with a passion for solving complex data challenges.
Key Responsibilities
Data Ingestion & Integration
- Develop and maintain data ingestion pipelines using Azure Data Factory (ADF).
- Integrate data from SAP, databases, APIs, flat files, and cloud applications.
- Implement incremental and CDC-based data loading patterns.
- Troubleshoot data integration and pipeline issues.
Data Transformation & Processing
- Develop PySpark and SQL-based transformations in Azure Databricks.
- Build and maintain Bronze, Silver, and Gold layer datasets.
- Cleanse, validate, and enrich data to meet business requirements.
- Optimize jobs for performance, scalability, and cost efficiency.
Data Warehousing & Modeling
- Support implementation of enterprise data models and Common Data Models (CDM).
- Develop curated datasets for reporting and analytics.
- Ensure data consistency across multiple business domains.
Analytics Enablement
- Deliver trusted datasets for Power BI and self-service analytics.
- Work closely with Business Analysts, BI Developers, and Data Architects to understand data requirements.
- Support report and dashboard performance improvements.
Governance & Quality
- Implement data quality checks and validation frameworks.
- Adhere to data governance standards and security policies.
- Document data flows, business rules, and technical processes.
Support & Operations
- Monitor scheduled jobs and data pipelines.
- Investigate and resolve production incidents.
- Perform root cause analysis and implement corrective actions.
- Participate in deployment and release activities.
Requirements
Preferred Skills
- SAP ECC / SAP S/4HANA data integration
- REST API integrations
- Event-driven architectures
- Unity Catalog
- Microsoft Fabric
- Retail or Automotive domain experience
Experience
- Overall 5-8 years of experience , 3-6 years of Data Engineering experience.
- 2+ years of experience with Azure Databricks.
- 2+ years of experience with Azure Data Factory.
- Experience building enterprise-scale cloud data pipelines.
Technical Skills
- Azure Data Factory (ADF)
- Azure Databricks
- Python and PySpark
- SQL
- Azure Data Lake Storage (ADLS)
- Delta Lake
Data Engineering Concepts
- ETL / ELT development
- Data warehousing
- Medallion Architecture
- Incremental loading
- Data modeling
- Data quality management
Reporting & Analytics
- Power BI
- Dataset optimization
- Dimensional modeling
Version Control & DevOps
- Git
- Azure DevOps
- CI/CD concepts
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Skills
- Azure Data Lake Storage (ADLS)
- windows azure platform
- python programming
- troubleshooting
- data integration
- sap ecc
- REST API integrations
- Unity
- sap is r
- Delta
- Power BI
- Dimensional modeling
- version control
- git
- sap
- microsoft windows
- Databricks
- Enterprise Analytics
- SQL
- Python
- analytics
- business intelligence
- PySpark
- Common Data Models
- Azure Data Factory
- CI/CD concepts
- Azure DevOps
- • Azure Data Lake Storage (ADLS)
- Data warehousing
- Azure
More jobs at techcarrot FZ
All 42- Data Operations Analysttechcarrot FZ · Offshore, Telangana, India4d ago
- AI Engineertechcarrot FZ · Hyderabad, Chennai, Noida, Uttar Pradesh, India4d ago
- Senior AI Engineertechcarrot FZ · Dubai, Dubayy (Dubai), United Arab Emirates4d ago
- Full Stack React Application Developertechcarrot FZ · Hyderabad, Chennai, Noida, Telangana, India6d ago
- Scrum Mastertechcarrot FZ · Dubai, Dubayy (Dubai), United Arab Emirates6d ago
Similar roles
- Associate Data ScientistNielsenIQ · Vadodara, GJ, Indiatoday
- Data EngineerZensar · Indiatoday
- Data EngineerZensar Technologies · Indiatoday
- Senior Engineer – Data Engineering (Databricks) - ContractorJobgether · Indiatoday
- Clinical Data EngineerJobgether · Indiatoday
- Data ScientistNielsenIQ · Pune, MH, Indiatoday