DevOps Engineer – Kafka Specialist

At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, and Cybersecurity – supporting industries like Telecom, Banking, and Hi-Tech.

We are looking for a Kafka Infrastructure Engineer to join a high-performing team focused on building and maintaining robust streaming infrastructure. You’ll be working on complex enterprise environments, ensuring the reliability and performance of Kafka-based platforms that support key business applications and services.

Responsibilities

• Manage and maintain high-availability Kafka clusters in production
• Monitor Kafka using tools like Burrow, identify lags and performance bottlenecks
• Handle topic configurations, partitioning, replication, and Zookeeper coordination
• Deploy and configure Kafka environments using Ansible
• Work with developers to support application releases and environment expansions
• Liaise with Cloudera support on Kafka-specific issues
• Maintain and support MirrorMaker/SRM for cross-cluster replication
• Support DR processes and participate in on-call rotations
• Log parsing and integration (e.g. Logstash)
• Collaborate with cross-functional teams to optimise performance and stability

Requirements

• Strong experience operating Kafka clusters in a production environment
• Knowledge of Kafka internals: topics, partitions, replication, Zookeeper
• Hands-on experience with Ansible for configuration management
• Exposure to Cloudera Kafka distribution (nice to have)
• Knowledge of SQL
• Experience with MirrorMaker/SRM
• Familiarity with log processing tools and Kafka monitoring
• Readiness to work on-call and support critical environments
• Good communication skills and ability to collaborate across teams

Benefits

• Hybrid work model – 1 day per week in the client's office in Warsaw
• Comprehensive medical care
• Solid, competitive salary.
• Work in multilingual, multinational and multicultural environment on international projects