Consultant | Big Data - Hadoop | Splunk

Company Description

IMCS Group is one of the fastest growing MWBE (Minority Woman Owned Enterprise) staffing firms in the U.S. We focus on bringing a Diversity Recruitment approach to Fortune 500 companies within North America and EMEA region contingent labor programs. IMCS Group excels in providing top talent in IT, Healthcare, Engineering, Finance, Light Industrial, Contact Center, and Clerical. We have offices in the US, Canada, Mexico, and India in which we can provide support to our clients.

Description

Job Title

Kafka Admin

Work Location

Saint LouisMO63131

Vendor Rate

***

Contract duration

12

Target Start Date

31 Aug 2026

Does this position require Visa independent candidates only? Yes

Interview Process (Is face to face required?) Yes, face to face is mandatory for Interview

**onsite work**

Job Details

Detailed Job Description

Experienced Big Data Administrator responsible for managing, supporting, automating, and optimizing enterprise-scale Hadoop, Kafka, AWS cloud, and DevOps platforms. The role focuses on ensuring high availability, performance, security, scalability, and operational excellence across big data ecosystems while collaborating with development, architecture, and business teams.

Key Responsibilities

Kafka Administration

Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments.

Monitor broker health, partitions, replication factors, and consumer lag.

Perform capacity planning and cluster scaling activities.

Manage Kafka security using SSL, SASL, ACLs, and encryption standards.

Troubleshoot producer, consumer, and broker performance issues.

Support Kafka Connect, Schema Registry, Cruise Control, and MirrorMaker implementations.

AWS Cloud Administration

Manage cloud infrastructure services including EC2, S3, IAM, VPC, EBS, CloudWatch, CloudTrail and AWS Glue.

Support AWS Managed Streaming for Kafka (MSK), EMR, Lambda, and Airflow environments.

Implement cloud security best practices and governance controls.

Perform infrastructure provisioning and automation using Infrastructure as Code (IaC).

Monitor cloud resource utilization and optimize operational costs.

DevOps & Automation

Design and maintain CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools.

Automate infrastructure deployment using Terraform, CloudFormation, and Ansible.

Manage source control repositories and release processes.

Implement monitoring and alerting solutions using Prometheus, Grafana, Splunk, ELK, or CloudWatch.

Support containerization technologies such as Docker and Kubernetes.

Develop automation scripts using Python, Shell, or Bash.

Operations & Support

Provide Level 2 and Level 3 production support.

Participate in on-call support rotations and incident management activities.

Perform root cause analysis (RCA) and implement preventive measures.

Create and maintain operational documentation and standard operating procedures.

Ensure compliance with security, audit, and regulatory requirements.

Required Skills

Apache Kafka Administration

Food and Beverage and MSK

AWS Cloud Services

Linux (RHEL/Rocky Linux)

Shell Scripting and Python

Jenkins, Git, Ansible, Terraform

Docker and Kubernetes

Monitoring Tools (Grafana, Prometheus, Splunk)

Networking, Security, and High Availability Concepts

Performance Tuning and Capacity Planning

Preferred Qualifications

Bachelor’s degree in Computer Science, Information Technology, or related field.

Experience with Cloudera CDP, AWS MSK, Airflow, and Spark.

AWS, GCP, Kafka, or Kubernetes certifications.

Experience supporting large-scale production environments handling petabyte-scale data workloads.

Key Achievements Expected

Maintain platform availability above 99.9%.

Adopt AI-assisted engineering practices to improve operational efficiency, reduce manual effort, and accelerate troubleshooting and documentation.

Automate repetitive operational tasks.

Improve cluster performance and resource utilization.

Ensure secure, scalable, and reliable data platform operations.

Support enterprise data engineering, analytics, and AI/ML workloads efficiently.

Minimum years of experience

8-10 years

Certifications Needed

No

Top 3 responsibilities you would expect the Subcon to shoulder and execute

Perform infrastructure provisioning and automation using Infrastructure as Code IaC.

Design and maintain CICD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools. Automate infrastructure deployment using Terraform, CloudFormation, and Ansible

Manage source control repositories and release processes. Implement monitoring and alerting solutions using Prometheus, Grafana, Splunk, ELK, or CloudWatch

Interview Process (Is face to face required?)

Yes

Any additional information you would like to share about the project specs/ nature of work

Custom Fields

Name

Intake Call Requested

Value

true

Name

Intake Call Completed

Value

true

EEOC Disclaimer

IMCS Group is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. IMCS Group is committed to maintaining an inclusive workforce, where employees are hired, retained, compensated, and promoted based on their contributions to our Company.