Senior Cloudera Hadoop Administrator (26-59002) -

Job Title- Senior Cloudera Hadoop Administrator

Job Location- Remote

Shift Timings- 7:30 PM IST to 4:30 AM IST

Experience Required- 7+ Years

About the Role

We are looking for a Senior Hadoop Administrator to join our Data Platform Infrastructure team, focused on operating Cloudera (CDH/CDP 7.x) clusters at scale in on-prem environments. You will own the health, scalability, and reliability of our Hadoop clusters, and drive automation that reduces manual, error-prone operational work across a large fleet of servers and multiple environments. You will work closely with data engineering teams, application owners, and infrastructure and security teams, and mentor junior engineers, to keep the platform stable, secure, and performant.

What You'll Do

Own and drive the roadmap for Cloudera cluster operations: lead CDH-to-CDP migrations and CDP 7.x upgrades, manage node lifecycle (adding, decommissioning, rebalancing, replacing), and maintain cluster health across environments at scale

Lead troubleshooting of complex production and non-production issues, using Cloudera Manager, service logs, metrics, and OS-level diagnostics to find root cause across HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, and related services

Manage a large fleet of on-prem servers and environments (dev, test, prod, DR), ensuring consistent configuration, patching, and capacity across clusters

Drive automation strategy for operational workflows

replace manual runbooks with scripts and tools for upgrades, patching, remediation, scaling, and routine maintenance

Diagnose and resolve complex platform blockers, including job failures, resource contention (YARN queues, memory, I/O), HDFS imbalance and small-file issues, and misconfigurations

Own platform security and governance

Kerberos, LDAP/AD integration, TLS, Apache Ranger, Atlas, and data access controls

Define and improve the observability strategy

monitoring, logging, and alerting (Cloudera Manager, Prometheus, Grafana, or similar) to reduce time-to-detect and time-to-resolve

Own capacity planning, performance tuning, backup, and disaster recovery (including HDFS snapshots, BDR/replication, and metadata backups)

Set standards for issue tracking and triage

write detailed bug reports and RCAs, work with Cloudera Support on escalations, and improve team-wide reporting practices

Partner with data engineering, application, network, and security teams to align on requirements, maintenance windows, and upgrade schedules

Lead on-call rotations and incident response, own post-incident reviews, and drive continuous improvement across the platform

Mentor and upskill junior and mid-level engineers through technical guidance and design reviews

What We're Looking For Required

7-9 years of experience in Hadoop administration, big data platform engineering, or infrastructure operations

Deep, hands-on experience administering Cloudera CDH and CDP 7.x in on-prem environments, including upgrades, migrations, and cluster expansion

Proven experience managing large server fleets and multiple environments (hundreds of nodes preferred)

Strong knowledge of the Hadoop ecosystem

HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, ZooKeeper, Oozie

Strong Linux administration skills (RHEL/CentOS), including performance tuning, networking, storage, and kernel/OS-level troubleshooting

Strong scripting skills (Python, Bash, or similar) with a track record of building automation used by multiple teams

Expert-level debugging of distributed systems, from symptom to root cause across interdependent services

Hands-on experience with Kerberos, LDAP/AD, TLS/SSL, and Hadoop security tooling (Ranger, Sentry/Knox)

Excellent written and verbal communication, with the ability to produce clear status updates, RCAs, and technical documentation

Demonstrated experience mentoring engineers and leading technical initiatives

Preferred

Experience with CDH-to-CDP migration and CDP Private Cloud Base

Configuration management and automation tools (Ansible, Puppet, Chef) for fleet-wide consistency

Experience with Cloudera Manager APIs and automation via REST/CLI Monitoring and observability tools (Prometheus, Grafana, Nagios, Splunk, ELK) Familiarity with CI/CD tooling (Jenkins, GitHub Actions) and Git-based workflows Experience with Nuance-related environments or workloads

Experience with HDFS and Hive data replication, backup, and DR design

Exposure to containerized or hybrid workloads (Kubernetes, CDP Private Cloud Data Services)

Experience contributing to architectural decisions for data platforms

Technologies You'll Work With

Cloudera Manager

• CDH / CDP 7.x
• HDFS
• YARN
• Hive
• Impala
• Spark
• HBase
• Kafka
• Kerberos
• Ranger
• Linux (RHEL)
• Python
• Bash
• Ansible
• Prometheus/Grafana
• Git
• On-prem infrastructure