Hadoop Administration ( Lead )
Sonsoft- Location
- Austin, TX, United States
- Workplace
- —
- Employment
- Full Time
- Salary
- —
Posted 9y ago
- At least 2 years of experience in Implementation and Administration of Hadoop infrastructure
- At least 2 years of experience in Project life cycle activities on development and maintenance projects.
- Operational expertise in troubleshooting , understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Hadoop, MapReduce, HBase, Hive, Pig, Mahout
Hadoop Administration skills
Experience working in Cloudera Manager or Ambari, Ganglia, Nagios
- Experience in using Hadoop Schedulers - FIFO, Fair Scheduler, Capacity Scheduler
- Experience in Job Schedule Management - Oozie or Enterprise Schedulers like Control-M, Tivoli
- Good knowledge of Linux
- Exposure to setting up Ad/LDAP/Kerberos Authentication models
- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting, Autosys
- Experience in Shell and Perl scripting and exposure to Python
- Knowledge of Troubleshooting Core Java Applications is a plus
- Exposure to Real-time Execution engines like Spark, Storm, Kafka
Version control Management tools
Subversion or Clearcase or CVS, Github
- Experience in Service Management Ticketing tools - ServiceNow, Service Manager, Remedy
Responsibilities
Upgrades
Hadoop Ecosystem and Clusters maintenance as well as creation and removal of nodes
Perform administrative activities with Cloudera Manager/Ambari and tools like Ganglia, Nagios
Setting up and maintaining Infrastructure and configuration for Hive, Pig and MapReduce
Monitor Hadoop Cluster Availability, Connectivity and Security
- Setting up Linux users, groups, Kerberos principals and keys
- Aligning with the Systems engineering team in maintaining hardware and software environments required for Hadoop
- Software installation, configuration, patches and upgrades
- Working with data delivery teams to setup Hadoop application development environments
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines
- Screen Hadoop cluster job performances
- Data modelling, Database backup and recovery
- Manage and review Hadoop log files
- File system management, Disk space management and monitoring (Nagios, Splunk etc)
- HDFS support and maintenance
- Planning of Back-up, High Availability and Disaster Recovery Infrastructure
- Diligently teaming with Infrastructure, Network, Database, Application and Business Intelligence teams to guarantee high data quality and availability
- Collaborating with application teams to install operating system and Hadoop updates, patches and version upgrades
- Ability to work in team in diverse/ multiple stakeholder environment
- Experience to XXdomain
- Experience and desire to work in a Global delivery environment
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of overall IT experience
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
Note
-
1.This is a
Full-Time & Permanent job
opportunity for you.
2.Only US Citizen
Green Card Holder
GC-EAD,& TN
can apply.
3.
No
H4-EAD L2-EAD
OPT-EAD, H1B candidates please.
4.Please mention your Visa Status in your email or resume.
Skills
- Hadoop
- HBase
- Hive
- Nagios
- Linux
- LDAP
- Kerberos
- Puppet
- Chef
- Shell
- Perl
- Python
- Java
- Spark
- Storm
- Kafka
- GitHub
- ServiceNow
- Splunk
- HDFS
More jobs at Sonsoft
All 1,015JAVA DEVELOPER WITH Gaming EXP
Sonsoft · Austin, TX, United States · 9y ago
Senior Technology Architect - J2ee JAXB(USC&GC)
Sonsoft · Armonk, NY, United States · 9y ago
Senior Java Technology Architect - J2ee, JAXB(USC&GC)
Sonsoft · Saint Paul, MN, United States · 9y ago
Core Java(USC&GC)
Sonsoft · Dallas, TX, United States · 9y ago
Core Java(Anywhere In US)_(USC&GC)
Sonsoft · Jersey City, NJ, United States · 9y ago
Similar roles
IT Support Lead
Nadia Care · Philadelphia, Pennsylvania, United States · USD 70–80/hr · today
Computing Undergraduate Student Intern: DevOps Internship Program - Summer 2027
Llnl · Livermore, CA, United States · USD 23–32/hr · today
IT Support Assistant (Onsite - Phoenix, AZ)
Intelligent Technical Solutions · Phoenix, AZ · USD 15–16/hr · today
Senior Cloud Infrastructure Engineer
Anduril Industries · Washington · District of Columbia · United States · USD 146,000–194,000/yr · today
Senior AI Infrastructure Engineer, Physical Infrastructure
Anduril Industries · Costa Mesa, California, United States · USD 166,000–220,000/yr · today
Network Engineer, Factory Systems and Operational Technology
Anduril Industries · Costa Mesa, California, United States · USD 120,000–170,000/yr · today