Mid-level Big Data Engineer

Role

Mid-level Big Data Engineer

Position Type

Full-Time Contract (40hrs/week)

Contract Duration

6 months+

Work Schedule

8 hours/day (Mon-Fri)

Location

Hybrid in Hyderabad, India

Roles and Responsibilities

• 6+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
• Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
• Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
• Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
• Must have Linux experience (Shell scripting/Python

Required Skills

• Experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
• Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
• Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
• Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
• Must have Linux experience (Shell scripting/Python)

Preferred Skills

• Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
• Good to have experience creating CI/CD pipelines – Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit Cloudformation