
Validation Engineer, AI & Data
RADcube - A NLogix · Indianapolis, IN, United States
- Software & SaaS
- 201–500 employees
- Carmel, Indiana
Strong hiring record · median 17 days open
- First seen
- 11 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
In its favour
- Posted 5 days ago
- Still listed on the employer's own board
Validation Engineer, AI & Data
Location: Indianapolis, IN
Summary
Validate the accuracy, reliability, completeness, and consistency of business context and AI generated responses against approved business requirements and ground truth answers.
Responsibilities
- Design and implement the testing strategy for the Domain Context Model, Business Context Repository, ontology mappings, and AI response evaluation.
- Develop representative ground truth question and answer test sets with defined expected results and tolerances, validated by data owners.
- Build and maintain automated evaluation tests for AI responses generated through the client’s Context Injection toolkit.
- Evaluate AI responses with and without domain context to establish baseline accuracy and measure improvements.
- Validate numeric answers, SQL and query results, business logic, aggregations, join relationships, and narrative responses.
- Identify and classify failures, including hallucinations, stale information, incorrect schemas, faulty joins, missing business context, and persona mismatches.
- Develop repeatable evaluation scripts, scoring rubrics, regression tests, and accuracy reporting dashboards or scorecards.
- Verify context repository data completeness, classification consistency, access control behavior, and changes introduced through automated context updates.
- Document test evidence, defects, remediation results, AI readiness assessments, and validation outcomes.
- Support release readiness, weekly demonstrations, and handover of reusable evaluation frameworks and documentation.
Requirements
Required Technical Expertise
Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks, ETL and data validation, AI and LLM evaluation, ground truth testing, regression testing, and test automation.
More jobs at RADcube - A NLogix
All 26- Agentic AI Engineer – AzureRADcube - A NLogix · Bangalore South, Karnataka, India5d ago
- AI Business AnalystRADcube - A NLogix · Indianapolis, IN, United States6d ago
- Solutions Architect - AIRADcube - A NLogix · Indianapolis, IN, United States6d ago
- Senior Data Engineer (Databricks | Data & AI)RADcube - A NLogix · Indianapolis, IN, United States6d ago
- AI ArchitectRADcube - A NLogix · Bangalore South, Karnataka, India12d ago
Similar roles
- Vehicle Software Validation EngineerArtech · Dearborn, MI2d ago
- Senior Optical Systems Validation Engineer - Optical Circuit Switch (OCS)PsiQuantum · Palo Alto, California3d ago
- Senior Electronics Systems Integration & Validation EngineerPsiQuantum · Milpitas, California, United States3d ago
- QA and Agentic AI Validation EngineerGenesis10 · Pennington, NJ · USD 55–63/hr3d ago
- Python Test Automation Engineer - OTA ValidationApolis · Dearborn, MI2d ago
- Firmware Validation Engineer I (Onsite)Axon · Scottsdale, Arizona, United States2d ago