
Development - Data Engineer
Artech · Richmond, VA
Strong hiring record · median 1 days open
- First seen
- 20 November 2026
- Reposted
- Not since September 2026
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Role: Data Engineer
Contract: 6 Months
Location: Richmond, VA
Interview Process - One technical interview (approximately 30 minutes)
Position Overview
We are seeking an experienced Senior Data Engineer with 8+ years of professional experience in data engineering or software development to join the Customer Data Engineering team. The ideal candidate will have strong hands-on experience with Scala, Apache Spark, and AWS, with a primary focus on building, enhancing, maintaining, and optimizing large-scale ETL data pipelines.
The engineer will work on existing Spark/Scala-based data pipelines supporting the integration of new Discover customers and personal loan data into the Capital One ecosystem. This role requires a senior-level engineer who can work independently, contribute immediately, write production-ready code, and support complex data engineering initiatives within tight project timelines.
Key Responsibilities
- Design, develop, enhance, and maintain large-scale ETL data pipelines using Scala and Apache Spark.
- Develop and optimize distributed data processing applications running on AWS EMR.
- Support existing Spark/Scala data pipelines to facilitate the integration of new Discover customer and personal loan data.
- Build, maintain, and enhance data ingestion and transformation workflows across multiple databases and data platforms.
- Leverage AWS services, including EMR, S3, Glue, Redshift, and Athena, to support scalable data engineering solutions.
- Work with large datasets, implementing data extraction, transformation, processing, and loading (ETL) workflows.
- Develop and optimize data processing jobs to improve performance, scalability, reliability, and efficiency.
- Work with Databricks and distributed computing frameworks to support data engineering and analytics initiatives.
- Collaborate with cross-functional engineering teams to understand data requirements and deliver reliable data solutions.
- Troubleshoot complex data pipeline issues, identify root causes, and implement effective solutions.
- Follow engineering best practices, coding standards, and data security requirements while handling sensitive customer information.
- Work independently on complex technical challenges and contribute to engineering standards and best practices across the team.
Required Qualifications
- 8+ years of professional experience in Data Engineering or related Software Engineering roles.
- Strong hands-on experience with Scala programming in production environments.
- Extensive experience with Apache Spark and Spark-based data processing.
- Strong experience working with AWS EMR (Elastic MapReduce).
- Solid understanding of AWS ecosystem and infrastructure supporting data engineering workloads.
- Hands-on experience with AWS services such as S3, Redshift, and Athena.
- Experience developing, maintaining, and optimizing large-scale ETL pipelines.
- Ability to independently develop production-ready code and troubleshoot complex data engineering problems.
- Strong understanding of distributed computing and large-scale data processing concepts.
Preferred Qualifications
- Experience working with Databricks.
- Familiarity with AWS Glue.
- Experience with Python and SQL.
- Experience working with databases and data platforms such as Cassandra, DynamoDB, Neptune, and Snowflake.
- Experience supporting customer data integration, migration, and analytics environments.
- Exposure to Generative AI technologies, including LLMs, GPT, and MCP, is an added advantage.
Skills
- Scala
- Spark
- AWS
- ETL
- EMR
- S3
- AWS Glue
- Redshift
- Athena
- Databricks
- Elastic
- Python
- SQL
- Cassandra
- DynamoDB
- Snowflake
- Generative AI
- LLM
- GPT
- Model Context Protocol
More jobs at Artech
All 82- Database Administrator IIArtech · Plano, TXtoday
- Senior GenAI Engineer – Mainframe Code Intelligence & Data LineageArtech · Cary, NC · USD 60–62/hrtoday
- AI Databricks Technical Project ManagerArtech · Tampa, FL · USD 35–40/hrtoday
- Application Developer SAP Enterprise IntegrationArtech · Toronto, ON · USD 60–65/hrtoday
- Cybersecurity Contractor: 6-9 years (Advanced)Artech · New York, NYtoday
Similar roles
- Junior Data ScientistThe Bison Group · Springfield, VA · 140,000/yrtoday
- Business Intelligence DeveloperLabcorp · Durham, NC, United StatesUpdated today
- Senior Lead Business Intelligence DeveloperLabcorp · Durham, NC, United States · Burlington, NC, United StatesUpdated today
- RCM Data Analyst I - HybridLabcorp · Burlington, NC, United StatesUpdated today
- Principal Data Scientist, User EcosystemReddit · United States · USD 313,000–365,100/yrtoday
- Analytics EngineerReddit · United States · USD 164,200–229,990/yrtoday