
Data Engineer | DISA-DIA-OMDE-JHB-0091
Decision · Johannesburg, South Africa
Mixed hiring record · median 34 days open
- First seen
- 19 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- 25% of this employer's openings are over 60 days old
In its favour
- Posted today
- Still listed on the employer's own board
1. Azure Databricks Hands-On Experience
- Status: Exceeded
- Notes: She brings 3 dedicated years of hands-on Databricks experience, specifically architecting and implementing ETL/ELT pipelines using Azure Databricks, Spark clusters, high concurrency performance tuning, and Databricks Asset Bundles (DABs) in her current role at Investec and previous work with Standard Bank.
2. Apache Spark, PySpark, and SQL
- Status: Met
- Notes: Highly proficient across Python, PySpark, SparkSQL, and T-SQL. Her experience includes developing complex transformations and automated notebooks for enterprise-scale data workloads.
- Delta Lake & Medallion Architecture (Bronze, Silver, Gold)
- Status: Met
- Notes: Extensively experienced in implementing Lakehouse architecture using Delta Lake, delta tables, parquet files, and executing full on-prem to cloud data migrations utilizing the Medallion Architecture across multiple financial sector roles.
4. Data Pipelines & Data Integration Solutions
- Status: Met
- Notes: Extensive enterprise background building batch processing data pipelines, integrating disparate sources (REST APIs, Cosmos NoSQL, Azure SQL, on-prem databases) using Azure Data Factory (ADF), SSIS, and custom orchestration tools like Control-M.
5. Azure DevOps and CI/CD Pipelines
- Status: Met
- Notes: Strong 5-year track record managing CI/CD pipeline workflows for schema migrations, infrastructure deployments (using Terraform and Bicep/ARM templates), and code promotion via Azure DevOps and Git/GitHub.
6. Data Quality, Performance Tuning, and Cost Optimization
- Status: Met
- Notes: Leverages data governance frameworks like Unity Catalog and data quality best practices. She also brings strong relational database and cloud performance tuning experience (indexing, partitioning, cluster optimization) gained across 11+ years of database development..
- Advantageous Skills (Generative AI / LLMs & SharePoint Integration)
- Status: Partial / Present
- Notes: Her CV notes exposure to Azure ML and AI services (retraining/deploying models), although explicit Generative AI/LLM project deployment and specific SharePoint integrations are not highlighted and should be verified in conversation if needed.
Skills
- Azure Databricks
- Databricks
- ETL
- ELT
- Spark
- PySpark
- SQL
- Python
- T-SQL
- Delta Lake
- Parquet
- Azure SQL
- Azure Data Factory
- SSIS
- Azure DevOps
- Terraform
- Bicep
- ARM Templates
- Git
- GitHub
- Unity Catalog
- Generative AI
- LLM
- SharePoint
- Azure ML
- Azure AI Services
More jobs at Decision
All 9- Senior Data Engineer | DIUK-DIA-SDE-LO-0041Decision · London, United Kingdom6d ago
- Technical Data Steward – Foods BI and AI | DISA-DIA-CONTDS-0133Decision · Cape Town, South Africa8d ago
- Data Engineer | DISA-DIA-DE-JHB-0065Decision · Johannesburg, South Africa9d ago
- Data Engineer - DISA-DIA-DE-CT-0120Decision · Cape Town, South Africa1mo ago
- Data Scientist | DISA-DIA-SD-JHB-0083Decision · Johannesburg, South Africa1mo ago
Similar roles
- Software License Management SpecialistAECOM · Centurion, 263A WEST AVENUE, South Africatoday
- Senior .Net Full Stack Developer Johannesburg - SLDvt · Melrose Arch, Gauteng, South Africa · ZAR 500/hrtoday
- Principal Engineer - Structures, Data CenterAECOM · Centurion, GP, South Africayesterday
- Junior IT Coordinator (12 Month Contract)Scatec · Cape Town, South Africayesterday
- AI Build EngineerDvt · Johannesburg, Gauteng, South Africa2d ago
- NOC EngineerHerotel · Plattekloof, South Africa2d ago