JobHabor
Menu

AI Performance engineer (26-09859) -

ClifyX · Location not stated

Strong hiring record · median 17 days open

100100

Hiring signal

Actively hiring

Posted today · Never reposted · How we score

First seen
20 November 2026
Reposted
Not since September 2026
All reasons
  • No location stated

In its favour

  • Posted today
  • Still listed on the employer's own board

Did you apply?

AI Performance engineer (26-09859) - at ClifyX. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Job Description

AI Performance engineer

Top skills Python Programming Advance Machine Learning Libraries NLP Data

Classification Model Classification Prompt Engineering.

Key responsibilities

Experience in Performance Testing and good knowledge in Performance Engineering

Should be able to gather requirements that are required for the project or Application by working with various stake holders

Should be able to develop Detail Performance Test Plan and be able to give walkthrough to stake holders

Should have good experience in scripting and execution skills using at least two performance testing tool LoadRunner Jmeter NeoLoad Any other

Should have worked in at least one of the Application Monitoring Tool Dynatrace NewRelic Appdynamics Any other

Coordinate with all stakeholders teams to identify performance bottlenecks across all tiers components layers

Should be able to review scripts developed by team member and have experience in following best practice

Analysis and resolution of critical and complex application issues like crashes hung threads memory leaks etc

Should be able to etc prepare reports that are required with in project like WSR MMR QBR

Should have good knowledge in CICD pipeline tools like DevOps Jenkins and in AI

Should have worked in one other Non-Functional Testing Apart from Performance Testing like Chaos Engineering Batch Performance Failover testing etc

Should have performance monitoring experience across Windows and UNIX platforms with OpenView SiteScope Wily or similar tools

Ability to understand and analyze AWR reports or similar report that helps to understand the root cause of the Performance Issues

JD For AI Assurance / AI Evaluation Engineer with Experience: 5-12 Years

Role Description

Join the AI Trust Assurance (AITA) team to evaluate, test, and assure AI applications, AI agents, GenAI solutions, and multimodal AI systems. The role focuses on validating the quality, safety, reliability, performance, and compliance of AI systems using industry-standard evaluation frameworks, tools, and methodologies.

About the Role

We are looking for professionals with experience in AI, Machine Learning, Data Science, Generative AI, Agentic AI, or Test Automation who are passionate about building trust in AI systems by evaluating AI systems through Metrics scoring approach.

You will help evaluate LLMs, RAG applications, AI agents, voice agents, multimodal applications, and AI-powered business solutions by designing evaluation frameworks, datasets, benchmarks, and automated validation processes.

Key Responsibilities

  • Develop Python-based frameworks, utilities, and automation for AI evaluation.
  • Evaluate AI applications, LLMs, RAG systems, AI agents, and multi-agent workflows.
  • Evaluate Text-to-Text, Voice-to-Voice, Voice-to-Text, Video-to-Text, and Multimodal AI applications.
  • Design and execute prompt testing and response validation.
  • Create and maintain evaluation datasets, benchmarks, and golden datasets.
  • Assess agent reasoning, planning, memory, tool usage, workflow execution, and task completion.
  • Validate AI systems for hallucinations, grounding, safety, bias, robustness, and compliance.
  • Identify appropriate evaluation metrics, scoring thresholds, and benchmarks for AI agents. Interpret evaluation results, explain scoring rationale, and provide data-driven recommendations to AI developers to improve model and agent performance.
  • Monitor AI applications using observability and tracing tools.
  • Prepare and analyse evaluation reports, dashboards, and insights for stakeholders.
  • Perform continuous post-production evaluation and monitoring of AI applications to identify model drift, performance degradation, safety risks.
  • Collaborate with AI Engineers, Data Scientists, ML Engineers, Developers, and Business Teams.

Required Skills

  • Bachelor's or master's degree in computer science, AI & ML, Data Science, Engineering, or a related field.

More jobs at ClifyX

All 215

Similar roles