Data Engineer

Long term Contract position with a major financial firm.

Hybrid, 3 days/week in Newark, NJ.

Data Engineer

Business Requirements

Centralize market data feeds from various third-party market data vendors into the central "Market Data Hub.

Source data feeds from a 3rd party EDM system (e.g. Gresham, Golden Source, RIMES, Bloomberg).

Ensure that data quality rules and checks are applied to each dataset. (This would be configurable within the EDM System)

Land consolidated data from EDM system within

MS Fabric (example data flow

3rd party market data vendor  EDM System  MS Fabric)

Migrate existing market data feed ingestion and ETF processes to the MS Fabric or EDM System.

Sunset existing market data feed ingestion.

5-10 years of experience.

Responsibilities

• Prior experience working with Market Data feeds and asset management industry or financial services experience.
• Prior experience designing and implementing a medallion architecture for enterprise data.
• Prior experience in Fabric and EDM (e.g. enterprise data management system, like Gresham, Golden Source, RIMES, Bloomberg) preferred.
• Design, build and maintain data quality rules and data extracts from EDM vendor.
• Design, build and maintain scalable data pipelines from EDM vendor into MS Fabric to support 3rd party market data feeds.

o Note some data feeds may need to bypass the EDM vendor and be ingested directly into MS Fabric.

• Design, build and maintain data validation and quality rules for data ingested into MS fabric.
• Prior experience with Microsoft Purview or other data governance tool is a plus
• Prepares data for analytical or operational uses
• Builds data pipelines to pull information from different source systems; integrating, consolidating and cleansing data; and structuring it for use in applications
• Creates interfaces and mechanisms for the flow and access of information.

payrate 65 - 75 per hour depending on experience

​

#LI-AC1