
Generative AI Engineer
Ova Technologies · New York, NY · Remote
Mixed hiring record · median 14 days open
All reasons
In its favour
- Still listed on the employer's own board
Job Description: Generative AI Engineer
Job Title
Generative AI Engineer
Experience
3–6 Years (with relevant GenAI experience)
Employment Type
Full-Time
Location
Hybrid / Remote / On-site
Department
AI / Machine Learning / Engineering
Job Summary
We are looking for a skilled Generative AI Engineer to design, develop, and deploy AI-powered applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), vector databases, and modern AI frameworks. The ideal candidate will have strong Python programming skills, experience integrating LLMs into production applications, and a solid understanding of machine learning, NLP, and cloud-based AI solutions.
Key Responsibilities
- Design, develop, and deploy Generative AI applications using LLMs such as GPT, Claude, Gemini, and open-source models.
- Build and optimize RAG pipelines, including document ingestion, chunking, embedding generation, retrieval, reranking, and response generation.
- Develop AI agents and multi-agent workflows using frameworks such as LangChain, LangGraph, or Semantic Kernel.
- Integrate vector databases such as Pinecone, FAISS, Chroma, or Weaviate.
- Implement prompt engineering, context management, and model evaluation techniques to improve response quality.
- Develop REST APIs and backend services using Python and frameworks such as FastAPI or Flask.
- Work with structured and unstructured data, including PDFs, documents, databases, and enterprise knowledge bases.
- Implement responsible AI practices, including guardrails, hallucination mitigation, security, and data privacy.
- Optimize model performance, latency, token consumption, and inference costs.
- Deploy and monitor AI applications using cloud platforms and MLOps/LLMOps practices.
- Collaborate with data scientists, software engineers, product managers, and business stakeholders.
Required Skills and Qualifications
- Strong programming experience in Python.
- Hands-on experience building Generative AI applications using commercial or open-source LLMs.
- Strong understanding of LLM architecture, transformer models, tokenization, embeddings, and context windows.
- Practical experience implementing RAG-based applications.
- Experience with prompt engineering, few-shot learning, and structured output generation.
- Familiarity with vector databases and semantic search.
- Experience with APIs, microservices, and backend development.
- Knowledge of NLP, machine learning, and deep learning fundamentals.
- Familiarity with Git, Docker, CI/CD, and software development best practices.
- Experience with at least one cloud platform: AWS, Azure, or Google Cloud.
Preferred Skills
- Experience building AI agents, tool-calling workflows, and multi-step reasoning applications.
- Familiarity with LangChain, LangGraph, LlamaIndex, or Semantic Kernel.
- Experience with fine-tuning, LoRA/QLoRA, or parameter-efficient model adaptation.
- Knowledge of LLM evaluation frameworks and observability tools.
- Experience with Hugging Face Transformers, PyTorch, or TensorFlow.
- Familiarity with Kubernetes, MLflow, and production model-serving systems.
- Experience implementing AI safety, access controls, and enterprise-grade security.
Education
Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Information Technology, or a related field, or equivalent practical experience.
Key Deliverables
- Production-ready Generative AI applications.
- Scalable RAG pipelines and enterprise knowledge assistants.
- Reliable AI agents and automated workflows.
- Measurable improvements in response accuracy, latency, and operational cost.
- Well-documented, secure, and maintainable AI services.
Success Criteria
- Quality, relevance, and factual accuracy of AI-generated responses.
- Retrieval accuracy and reduction in hallucinations.
- Application performance, reliability, and scalability.
- Cost-effective model usage and efficient inference.
- Successful integration of AI solutions into business workflows.
Skills
More jobs at Ova Technologies
All 129- AWS engg 12 (26-00643) -Ova Technologies · Location not statedtoday
- QA Maya VR Krishna Fixes 1103Ova Technologies · New Yorktoday
- Dev AWS engineer (26-00641) -Ova Technologies · Location not statedtoday
- test bE job 2 (26-00640) -Ova Technologies · Location not statedtoday
- QA Maya VR AutoLaunch 1102Ova Technologies · New Yorktoday
Similar roles
- Security Systems Programmer | Access Control & CCTV SurveillanceD6756bd9-e2bb-4a9f-8ebf-9f2e8b50aab8 · Houston, TX, United States · USD 27–32/yrjust now
- Lead Software Engineer - HybridBb244608-e6f4-40bb-bc83-efdedb8af462 · San Francisco, CA, United States · USD 145,000–190,000/yrjust now
- Sr. Applied AI Engineer, Life Science MarketsVi · United Statestoday
- Software Engineering Practice LeadJobgether · US · USD 220,000/yrtoday
- Software Engineer - AI Evaluation & AutomationHonorVet Technologies · San Diego, CAtoday
- Staff Backend Engineer, OperationsJobgether · US · USD 246,000–314,000/yrtoday