
Big Data / Kafka Administrator
Diverse Lynx · Saint Louis, MO · Onsite
Strong hiring record · median 15 days open
- First seen
- 3 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Still listed on the employer's own board
- Publishes a salary range
Job Title
Kafka / Big Data Admin
Work Location
Saint Louis, MO 63131 - **onsite work**
Vendor Rate
50.00/hr
Duration
12 Months
Interview Process (Is face to face required?) Yes, face to face is mandatory for Interview
Job Details
Detailed Job Description
Experienced Big Data Administrator responsible for managing, supporting, automating, and Eligible to workimizing enterprise-scale Hadoop, Kafka, AWS cloud, and DevOps platforms. The role focuses on ensuring high availability, performance, security, scalability, and operational excellence across big data ecosystems while collaborating with development, architecture, and business teams.
Key Responsibilities
Kafka Administration
Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.
Monitor broker health, partitions, replication factors, and consumer lag.
Perform capacity planning and cluster scaling activities.
Manage Kafka security using SSL, SASL, ACLs, and encryption standards.
Troubleshoot producer, consumer, and broker performance issues.
Support Kafka Connect, Schema Registry, Cruise Control, and MirrorMaker implementations.
AWS Cloud Administration
Manage cloud infrastructure services including EC2, S3, IAM, VPC, EBS, CloudWatch, CloudTrail and AWS Glue.
Support AWS Managed Streaming for Kafka (MSK), EMR, Lambda, and Airflow environments.
Implement cloud security best practices and governance controls.
Perform infrastructure provisioning and automation using Infrastructure as Code (IaC).
Monitor cloud resource utilization and Eligible to workimize operational costs.
DevOps & Automation
Design and maintain CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools.
Automate infrastructure deployment using Terraform, CloudFormation, and Ansible.
Manage source control repositories and release processes.
Implement monitoring and alerting solutions using Prometheus, Grafana, Splunk, ELK, or CloudWatch.
Support containerization technologies such as Docker and Kubernetes.
Develop automation scripts using Python, Shell, or Bash.
Operations & Support
Provide Level 2 and Level 3 production support.
Participate in on-call support rotations and incident management activities.
Perform root cause analysis (RCA) and implement preventive measures.
Create and maintain operational documentation and standard operating procedures.
Ensure compliance with security, audit, and regulatory requirements.
Required Skills
Apache Kafka Administration
Food and Beverage and MSK
AWS Cloud Services
Linux (RHEL/Rocky Linux)
Shell Scripting and Python
Jenkins, Git, Ansible, Terraform
Docker and Kubernetes
Monitoring Tools (Grafana, Prometheus, Splunk) Networking, Security, and High Availability Concepts Performance Tuning and Capacity Planning
Preferred Qualifications
Bachelor’s degree in Computer Science, Information Technology, or related field.
Experience with Cloudera CDP, AWS MSK, Airflow, and Spark.
AWS, Eligible to workP, Kafka, or Kubernetes certifications.
Experience supporting large-scale production environments handling petabyte-scale data workloads.
Key Achievements Expected
Maintain platform availability above 99.9%.
AdEligible to work AI-assisted engineering practices to improve operational efficiency, reduce manual effort, and accelerate troubleshooting and documentation.
Automate repetitive operational tasks.
Improve cluster performance and resource utilization.
Ensure secure, scalable, and reliable data platform operations.
Support enterprise data engineering, analytics, and AI/ML workloads efficiently.
Minimum years of experience
8-10 years
Skills
More jobs at Diverse Lynx
All 446- Senior Generative AI EngineerDiverse Lynx · Richardson, TXtoday
- Sr Appian developerDiverse Lynx · Louisville, KY · USD 8–60/hrtoday
- OpenShift CP4 AdminDiverse Lynx · Remotetoday
- Senior DevOps EngineerDiverse Lynx · Remote · USD 110,000/yrtoday
- Senior Apache Spark Technical Lead - Scala, PythonDiverse Lynx · Basking Ridge, NJ · USD 50–53/hrtoday
Similar roles
- Data Engineer – Mobile Monetization – Big Data, GenAI & Mobile AdTechPubMatic · Redwood City, US · USD 200,000–230,000/yr8d ago
- Software Developer (Java, API, and Big Data Experience)Ardent Principles · Chantilly, VA, United States · USD 130,000–260,000/yr8d ago
- Principal Engineer, Big Data PlatformPinterest · San Francisco, CA, US · Remote · US12d ago
- Print Supplies Big Data AnalystHp · Vancouver, Washington, United States of America · USD 105,050–161,800/yr8d ago
- Print Supplies Big Data AnalystHp · Vancouver, Washington, United States of America · USD 105,050–161,800/yr8d ago
- Big Data EngineerSga · Rockville, NY - New York, MD8d ago