Data Lakehouse Developer
B3consultingpoland · Wrocław, Poland
Weak hiring record · median 124 days open
All reasons
- 73% of this employer's openings are over 60 days old
In its favour
- Still listed on the employer's own board
We are part of an international organization listed on Nasdaq Stockholm, operating in 11 countries. In Poland, we work with full autonomy. We independently choose our technologies, processes, and ways of working while maintaining the highest professional standards.
We deliver a wide range of IT projects in Poland and internationally, across multiple domains and technologies. This allows our consultants to develop their competencies and gain experience aligned with their professional ambitions.
Our collaboration is built around the CARE philosophy. For us, it means responsible project matching, transparent cooperation, and a long-term approach to professional growth.
Join us as **Data Lakehouse Developer.** The project focuses on building and maintaining a scalable Data Lakehouse architecture—using Apache Iceberg, Delta Lake, or Apache Hudi—to process data across the entire pipeline, from raw lake ingestion to refined presentation layers
Grow in an environment that cares about your development as much as you do.
**Your responsibilities**
**Data Lakehouse & Architecture
** Design and maintain versioned data layers (Bronze, Silver, Gold) using Apache Iceberg, Delta Lake, or Apache Hudi, including CI/CD for schema evolution.
**Spark & MongoDB Integration
** Build PySpark/Spark-SQL pipelines for data reconciliation between MongoDB and source systems, optimizing reads using partitioning and match push-down.
**Performance & Cost Tuning
** Optimize Spark jobs (AQE, caching, broadcast joins) to lower latency and minimize Data Lakehouse processing costs.
**Quality, Monitoring & SLAs
** Implement automated data quality checks, SLA/SLO tracking, and distributed monitoring for batch/streaming pipelines using Prometheus, Grafana, and Dynatrace.
**Kubernetes & Automation
** Automate Spark application deployments on Kubernetes using Docker, Spark Operator, and CI/CD pipelines.
**Delivery & Collaboration
** Diagnose data discrepancies, maintain technical runbooks, conduct code reviews, and collaborate in Agile teams (Scrum/Kanban).
**Requirements**
- 4+ years of hands-on production experience in data engineering.
- Strong proficiency in Python, PySpark, Spark-SQL, DataFrames, and Structured Streaming.
- Proven experience with MongoDB (Spark Connector, indexing) and Apache Iceberg (table versioning, upserts/merges).
- Hands-on background in CI/CD automation (Jenkins) and containerized deployments on Kubernetes.
- You need to live in Poland and/or be eligible to work here.
**What we offer**
- Work in a Scandinavian culture built on logic and dialogue.
- Health and sports benefits tailored to your needs.
- Speed Coaching – short sessions that provide new perspectives and solutions.
- Sports training, an internal team, and opportunities to take part in competitions.
- Team events and development-focused meetups.
Apply today!
Skills
- Apache Iceberg
- Delta Lake
- Apache
- Hudi
- Spark
- MongoDB
- PySpark
- Prometheus
- Grafana
- Dynatrace
- Kubernetes
- Docker
- Python
- Jenkins
More jobs at B3consultingpoland
All 40- Senior Mobile iOS DeveloperB3consultingpoland · Location not stated4d ago
- AI/ML Product Manager (Prague)B3consultingpoland · Location not stated4d ago
- Forward Deployed EngineerB3consultingpoland · Warszawa, Poland12d ago
- Senior Agentic EngineerB3consultingpoland · Warszawa, Poland14d ago
- Senior Software EngineerB3consultingpoland · Location not stated18d ago
Similar roles
- [GFA] Azure Senior Data EngineerSoftware Mind · Kraków, Lesser Poland Voivodeship, Poland3mo ago
- Senior Data EngineerBackbase · Krakow5d ago
- Software Engineer - Lakehouse and AI Data Platform - Warsaw - Analyst/AssociateGoldman Sachs · Warsaw, Mazowieckie, Poland17d ago
- Software Engineer - Lakehouse and AI Data Platform - VP - WarsawGoldman Sachs · Warsaw, Mazowieckie, Poland6mo ago
- Software Engineer - Lakehouse and AI Data Platform - Warsaw - Analyst / AssociateCandidate Experience Site - Lateral · Warsaw, Mazowieckie, Poland5d ago
- Data Infrastructure Engineer (Java & Rust)MWDN · Warsaw, Masovian Voivodeship, Polandtoday