Lead Data Engineer - Data Archival - Bangalore

Missions

• Job description:

Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

Today we manage

SG Data platform service offers and data tools

Data ingestion

to ingest the data from a data source

Data processing

to process, transform and distribute the data to the target location

Data exposition

to distribute and expose the data hosted in the data platform

Data cleaning

to purge the data on the Lake in a secure way

Data tools

data formatter, data anonymizer

As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile

• Experience: 3-5 Years
• Skills:

Computer programming

Spark, Scala, Java, Python

• Operating system knowledge for Unix, Linux
• Databases and SQL
• ETL and data warehousing
• Hadoop
• Apach Spark

Tasks

• Maintain an excellent service level of the platform and avoid issues.
• Researching new methods of obtaining valuable data and improving its quality
• Creating and enhancing data solutions using various programming languages and tools
• Creating and enhancing data architectures that meet the requirements of the business
• Communicate inside if the tech league group to find new approaches