Data Engineer - Data Platforms

Job Title

Data Engineer - Data Platforms

Location

Piscataway, NJ

Duration

12 Months

Interview

Virtual

Pay Rate

$68 on C2C (All inclusive)

2MCR - 5825048

Required Skills

• Apache Spark & Scala – Strong hands-on experience developing distributed data-processing applications.
• Hadoop / Hive / Impala – Strong experience working with enterprise Big Data platforms and large datasets.
• SQL – Advanced SQL skills including complex queries, joins, transformations, reconciliation, and performance tuning.
• Python – Strong scripting and data-processing experience for automation, utilities, and data engineering activities.

Preferred Skills

• Experience working within banking or financial services environments.
• Understanding of large-volume transactional and financial datasets.
• Knowledge of ETL/data pipelines, data quality, and data reconciliation.
• Experience with Agile development and CI/CD practices.

*BGC*

A Data Engineer with expertise in Data Platforms specializes in developing applications on Big Data technologies, such as API development. This role requires a strong foundation in traditional Application Development, along with knowledge of Analytics libraries, open-source Natural Language Processing, and statistical and big data computing libraries. The ideal candidate will possess exceptional technical abilities to understand, design, write, and debug complex code.