JobHabor
Menu

Development - Data Engineer

Artech · Richmond, VA

Strong hiring record · median 1 days open

100100

Hiring signal

Actively hiring

Open 1 day · Never reposted · How we score

First seen
20 November 2026
Reposted
Not since September 2026
All reasons

In its favour

  • Posted today
  • Still listed on the employer's own board

Did you apply?

Development - Data Engineer at Artech. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Role: Data Engineer

Contract: 6 Months

Location: Richmond, VA

Interview Process - One technical interview (approximately 30 minutes)

Position Overview

We are seeking an experienced Senior Data Engineer with 8+ years of professional experience in data engineering or software development to join the Customer Data Engineering team. The ideal candidate will have strong hands-on experience with Scala, Apache Spark, and AWS, with a primary focus on building, enhancing, maintaining, and optimizing large-scale ETL data pipelines.

The engineer will work on existing Spark/Scala-based data pipelines supporting the integration of new Discover customers and personal loan data into the Capital One ecosystem. This role requires a senior-level engineer who can work independently, contribute immediately, write production-ready code, and support complex data engineering initiatives within tight project timelines.

Key Responsibilities

  • Design, develop, enhance, and maintain large-scale ETL data pipelines using Scala and Apache Spark.
  • Develop and optimize distributed data processing applications running on AWS EMR.
  • Support existing Spark/Scala data pipelines to facilitate the integration of new Discover customer and personal loan data.
  • Build, maintain, and enhance data ingestion and transformation workflows across multiple databases and data platforms.
  • Leverage AWS services, including EMR, S3, Glue, Redshift, and Athena, to support scalable data engineering solutions.
  • Work with large datasets, implementing data extraction, transformation, processing, and loading (ETL) workflows.
  • Develop and optimize data processing jobs to improve performance, scalability, reliability, and efficiency.
  • Work with Databricks and distributed computing frameworks to support data engineering and analytics initiatives.
  • Collaborate with cross-functional engineering teams to understand data requirements and deliver reliable data solutions.
  • Troubleshoot complex data pipeline issues, identify root causes, and implement effective solutions.
  • Follow engineering best practices, coding standards, and data security requirements while handling sensitive customer information.
  • Work independently on complex technical challenges and contribute to engineering standards and best practices across the team.

Required Qualifications

  • 8+ years of professional experience in Data Engineering or related Software Engineering roles.
  • Strong hands-on experience with Scala programming in production environments.
  • Extensive experience with Apache Spark and Spark-based data processing.
  • Strong experience working with AWS EMR (Elastic MapReduce).
  • Solid understanding of AWS ecosystem and infrastructure supporting data engineering workloads.
  • Hands-on experience with AWS services such as S3, Redshift, and Athena.
  • Experience developing, maintaining, and optimizing large-scale ETL pipelines.
  • Ability to independently develop production-ready code and troubleshoot complex data engineering problems.
  • Strong understanding of distributed computing and large-scale data processing concepts.

Preferred Qualifications

  • Experience working with Databricks.
  • Familiarity with AWS Glue.
  • Experience with Python and SQL.
  • Experience working with databases and data platforms such as Cassandra, DynamoDB, Neptune, and Snowflake.
  • Experience supporting customer data integration, migration, and analytics environments.
  • Exposure to Generative AI technologies, including LLMs, GPT, and MCP, is an added advantage.

Skills

More jobs at Artech

All 82

Similar roles