Hadoop Admin / Hadoop Developer

Role Description

-

• Configure parameters for best cluster performance
• Install and implement security policies for the cluster
• Maintain and monitor the cluster
• Load Data in Cluster
• Create Unix scripts for managing Hadoop cluster
• Troubleshoot and fix issues
• Hadoop batch Workflow Management
• Performance and memory tuning
• Collaboration and coordination with onsite stakeholders from NBCU's IT as well as business groups

Responsibilities

-

• Physical Unix Side Cluster (Maintaining and Installing OS / Pivotal HD, Removing Node, Reconfiguring Hadoop Cluster, Pivotal HD failover Implementation, Patches/Upgrade)
• HAWQ Administration (HAWQ DBA Role, Manage HAWQ Space, Maintain Hawq data/ Performance, HAWQ Failover Implementation, Administer fallback and provide periodic report on failback tables, Patches/Upgrades)
• HAWQ Interfaces (Admin, Installation & Configuration), Micro Strategy / Tableu Interface, HAWQ Access User IDs & Roles, New Software Access, Chorus Workspaces/Analysis)
• Pivotal HD / Hadoop Tools ( (a) Installation and configuration of Hive, Pig, Mahout, Chorus Trifacta,Datameter,Platfora (b) Analysis of Hive, Pig, Mahout (c) Admin support for all above and related Pivotal HD/ Bigdata/Hadoop Tools)
• User Setup (Creating Unix Users, Pivotal HD Setup for user Access, HAWQ Users and Permissions, connection to other tools)

All your information will be kept confidential according to EEO guidelines.