
Java Data Engineer
Q1 Technologies · Aurora, IL
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Location
Austin TX
Duration
6 months
GBaMS ReqID
11030281
Job Title
Java Data Eng
Job Responsibility
Design| develop| test| deploy| and maintain scalable applications| services| and data pipelines using Java| Scala| and Python.Develop backend services| RESTful APIs| and microservices using Java and Spring Boot.Build and maintain large-scale ETL/ELT| batch| and streaming data pipelines.Hands-on experience with Apache Spark| PySpark| and/or Scala-based data processing.Work with structured and unstructured data across relational databases| data lakes| and distributed data platforms.Strong experience with SQL and databases such as PostgreSQL| MySQL| or Oracle.Experience with messaging and streaming platforms such as Apache Kafka or equivalent technologies.Integrate AI and Generative AI capabilities into applications and data workflows using LLMs and AI APIs.Familiarity with Prompt Engineering| RAG| embeddings| vector search| and vector databases.Experience with cloud platforms such as AWS| Azure| or GCP and modern CI/CD practices.Strong understanding of software engineering principles| design patterns| testing| debugging| performance| and production support.6+ years of relevant experience with strong problem-solving| communication| and collaboration skills in an Agile environment.
Essential Skills
Design| develop| test| deploy| and maintain scalable applications| services| and data pipelines using Java| Scala| and Python.Develop backend services| RESTful APIs| and microservices using Java and Spring Boot.Build and maintain large-scale ETL/ELT| batch| and streaming data pipelines.Hands-on experience with Apache Spark| PySpark| and/or Scala-based data processing.Work with structured and unstructured data across relational databases| data lakes| and distributed data platforms.Strong experience with SQL and databases such as PostgreSQL| MySQL| or Oracle.Experience with messaging and streaming platforms such as Apache Kafka or equivalent technologies.Integrate AI and Generative AI capabilities into applications and data workflows using LLMs and AI APIs.Familiarity with Prompt Engineering| RAG| embeddings| vector search| and vector databases.Experience with cloud platforms such as AWS| Azure| or GCP and modern CI/CD practices.Strong understanding of software engineering principles| design patterns| testing| debugging| performance| and production support.6+ years of relevant experience with strong problem-solving| communication| and collaboration skills in an Agile environment.
Desirable Skills
Skills
Digital
Apache Spark~Digital
Kafka~Core Java
Experience Required
7+
Skills
- Java
- Scala
- Python
- Spring Boot
- ETL
- ELT
- Spark
- PySpark
- SQL
- PostgreSQL
- MySQL
- Oracle Database
- Kafka
- Generative AI
- LLM
- Prompt Engineering
- Retrieval-Augmented Generation
- Embeddings
- Vector Databases
- AWS
- Azure
- GCP
More jobs at Q1 Technologies
All 131- Data Eng w/ Python and AI, LLMQ1 Technologies · Aurora, ILtoday
- Network EngineerQ1 Technologies · Aurora, ILtoday
- Disaster Recovery ArchitectQ1 Technologies · SEATTLE, WAtoday
- Cyber Security / CIAM Engineer (26-07218) -Q1 Technologies · Location not stated2d ago
- Tooling Engineer - HarnessQ1 Technologies · Atlanta, GA2d ago
Similar roles
- Data EngineerNR Consulting - India · Chennai, TNjust now
- Associate Data ScientistJerry.ai · New Yorktoday
- Data ScientistJerry.ai · New Yorktoday
- Principal Data EngineerSERHANT. · Remote, USA · USD 180,000/yrtoday
- Marketing Data AnalystPyramid Consulting · Plano, TXtoday
- Data ArchitectZensar Technologies · Durham, NC, United Statestoday