Data Architect
HCL Global Systems · Dallas, TX
Strong hiring record · median 33 days open
- First seen
- 18 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Data Architect
Dallas, TX
Data Lake / Table Formats
Apache Hudi, Apache Iceberg
AWS Data Services
EMR, Glue, Athena, S3
Apache Airflow / MWAA
Python, PySpark
Terraform
GitHub
Does your candidate have the required skills for this req?
Is your candidate located in Dallas TX
Is your candidate able to travel client site 4 days/week
Candidate able Clear written and verbal communication, including translating technical controls into business language and vice versa.
Position Overview
We are looking for an experienced Senior Data Engineer contractor to support the onboarding and integration of datasets used by Middle Office functions.
The successful candidate will be responsible for designing, developing, and operationalizing reliable data pipelines that ingest data from multiple sources, transform and model it for downstream consumption, and make it available through scalable data platforms.
This is a hands-on engineering role requiring strong experience with AWS, Apache Spark/PySpark, modern data lake technologies, workflow orchestration, data modeling, and infrastructure-as-code/CI/CD practices.
The ideal candidate should be comfortable taking a dataset from initial requirements and source analysis through to a production-ready, supportable data product or pipeline.
K
Required Technical Skills
AWS & Cloud Data Engineering
Strong hands-on experience with AWS data and analytics services, particularly:
- AWS EMR
- AWS Glue and Glue Data Catalog
- Amazon Athena
- Amazon S3
- AWS IAM and general AWS security concepts
The candidate should understand how these services work together when designing and operating enterprise-scale data pipelines.
Spark & Big Data
Expert-level or strong hands-on experience with
- Apache Spark
- PySpark
- Distributed data processing
- Large-scale dataset transformation and optimization
- Spark performance tuning and troubleshooting
- Partitioning and efficient data processing strategies
Strong experience working with modern data lake/table formats, particularly:
- Apache Hudi
- Apache Iceberg
The candidate should understand concepts such as schema evolution, partitioning, incremental processing, upserts, snapshots, and management of large analytical tables.
Python & Software Engineering
Strong programming skills in
- Python
- PySpark
Candidate should consistently produce clean, modular, maintainable, and production-quality code, with experience in:
- Object-oriented and modular design where appropriate
- Unit and integration testing
- Error and exception handling
- Logging
- Code reviews
- Git-based development workflows
Workflow Orchestration
Strong hands-on experience with Apache Airflow or a comparable enterprise orchestration platform.
Candidate should be comfortable designing
- DAGs and workflow dependencies
- Scheduling
- Retry and failure-handling strategies
- Backfill and rerun processes
- Monitoring and alerting
- Parameterized and reusable workflows
Experience with Amazon MWAA is an asset.
Data Architecture & Modeling
Strong understanding of
- Data modeling
- Data pipeline architecture
- Data lake architecture
- Schema design
- Data partitioning
- Incremental data processing
- Historical data management
- Data quality and reconciliation
- Data lineage
Candidate should be capable of translating business requirements into a scalable technical data model and an operationally supportable data pipeline.
Infrastructure & CI/CD
Working knowledge of modern
DevOps and infrastructure-as-code practices, including
- Terraform
- GitHub Actions
- Git
- CI/CD pipelines
- Automated testing and deployment
- Environment configuration and promotion
The candidate does not need to be a dedicated DevOps engineer but should be comfortable working with infrastructure definitions and deployment pipelines as part of normal data engineering development.
Preferred Qualifications
- Previous experience building data platforms or data products within financial services, asset management, capital markets, or investment management.
- Experience supporting Middle Office, investment operations, risk, portfolio management, or trading-related datasets.
- Experience onboarding datasets from external vendors, APIs, files, databases, or enterprise data platforms.
- Understanding of data governance, lineage, entitlement, security, and audit requirements in an enterprise environment.
- Experience designing pipelines that process both historical and incremental/daily datasets.
- Experience troubleshooting and optimizing large-scale Spark workloads.
- Experience operating production data pipelines with defined SLAs and operational support requirements.
Candidate Profile
We are looking for someone who is more than a developer executing predefined specifications. The contractor should be able to independently understand a data requirement, analyze the source data, propose an appropriate technical design, implement the solution, and bring the pipeline into production.
The successful candidate should demonstrate
- Strong analytical and problem-solving abilities.
- Ownership and accountability for delivering production-quality solutions.
- Ability to work independently while collaborating effectively across teams.
- Strong communication skills when working with both technical and business stakeholders.
- Attention to data quality, reliability, maintainability, and operational readiness.
- Ability to quickly understand unfamiliar datasets and business requirements.
Core Technology Stack
Cloud
AWS
Processing
Apache Spark, PySpark
Data Lake / Table Formats
Apache Hudi, Apache Iceberg
AWS Data Services
EMR, Glue, Athena, S3
Orchestration
Apache Airflow / MWAA
Programming
Python, PySpark
Infrastructure as Code
Terraform
CI/CD
GitHub Actions
Version Control
Git
Minimum Experience
- Approximately 5+ years of professional data engineering or big-data engineering experience.
- Demonstrated experience developing and supporting production data pipelines.
- Strong hands-on Spark/PySpark and Python development experience.
- Hands-on experience with AWS-based data platforms.
- Demonstrated experience with at least one modern data lake/table technology such as Hudi or Iceberg.
- Experience with workflow orchestration and CI/CD practices.
For this contractor role, preference should be given to candidates who can demonstrate hands-on delivery experience rather than primarily architectural or theoretical knowledge.
Skills
More jobs at HCL Global Systems
All 189- Sr FinOps EngineerHCL Global Systems · Dallas, TXtoday
- QA Analyst (26-02171) -HCL Global Systems · Remoteyesterday
- ServiceNow PlatformHCL Global Systems · TXyesterday
- Lead iOS Developer (26-02169) -HCL Global Systems · Location not statedyesterday
- AIML/Generative AI solutionsHCL Global Systems · TXyesterday
Similar roles
- Data Architect / Data EngineerSky Solutions · Tysons Corner, VA · USD 81,462–170,703/yrtoday
- Enterprise Data Architect – Customer Data Platform (Azure Databricks Lakehouse)Southern · Birmingham, AL, United States · Atlanta, GA, United Statesyesterday
- Data Architect (Hands-On Lead Data EngineerSidram Technologies · Cary, NC, United States5d ago
- SAP Data Architect V - Business Data Cloud #26-28986US Tech Solutions · Racine, WIyesterday
- Solution Architect / Sr. Solution Architect - Snowflake Data EngineerAlpha Financial Markets Consulting · United States · USD 110,000–160,000/yrtoday
- Senior Data Architect (SDA)Genesis10 · Dallas, TX · USD 85–100/hr4d ago