Sr. Data Engineer(Capital Markets/CCAR)

Role

Sr. Data Engineer(Capital Markets/CCAR)\

Duration

Long Term Contract

Location

Charlotte, NC(Hybrid, Onsite 3 Days/Week)

Objective

Build and support a centralized regulatory reporting data platform from EOD Price/Position sources through Risk and Federal Reporting.

Scope of Work

High Level Data Flow

EOD Price/Position > CM/Nikko > Data Store > Analysis > Risk > Fed Reporting

• End-to-end data pipelines (ingestion, transformation, validation)
• Data models for centralized data flows
• Historical data onboarding and reconciliation from external data sources
• Data quality controls and monitoring frameworks
• Documentation including design, data lineage, and controls
• Integration with upstream and downstream systems
• Support for regulatory requirements including CCAR

Key Responsibilities & Experience Required

• Design, develop, and maintain scalable data pipelines and data platforms supporting CCAR, stress testing, capital planning, and regulatory reporting initiatives.
• Strong experience with Azure Cloud technologies, including Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and cloud-based data architecture.
• Hands-on expertise with Azure Data Factory (ADF) for data ingestion, orchestration, workflow automation, and monitoring of enterprise data pipelines.
• Experience building and optimizing large-scale data processing solutions using Databricks, Apache Spark, and Delta Lake.
• Strong programming and data manipulation skills using Python and SQL for data transformation, validation, reconciliation, and analytics.
• Familiarity with DevOps practices, including CI/CD, automation, version control, testing, and deployment processes, with the ability to work effectively across Risk, Finance, and Technology teams.