QA Analyst with AI Expertise

Hey there, think you stumbled upon this job posting by chance? We don't believe in chance at Nimber.

Caught your eye? Great. Keep going...

We are Nimber, and we are not just filling positions, we are building a team that is ready to shake things up. If you are ready to rewrite the rules and make a real impact, this is your moment. Join us and let's put the future where it belongs: in the hands of passionate people.

But what does Nimber mean? In mathematics and game theory, they are numbers with special properties of addition and multiplication. And what we really want is to add value to customers' projects.

Position

QA Analyst with AI Expertise

Location

Portugal / Hybrid

Job Summary

We are looking for a QA Analyst with Artificial Intelligence expertise to ensure the quality and reliability of AI-powered applications. The successful candidate will combine strong manual and functional testing skills with a solid understanding of AI/ML systems, contributing to test strategy, test execution, AI-specific validation, data quality, defect management, and continuous improvement within an Agile environment.

Key Responsibilities

• Define test strategies and test plans adapted to AI/ML-based systems.
• Design, execute, and maintain manual and exploratory tests covering functional, non-functional, and AI-specific scenarios.
• Validate AI model behavior, including correctness, robustness, fairness, explainability, and edge cases.
• Perform backlog analysis, estimate testing effort, identify risks, and contribute to overall testing strategy.
• Support UAT activities and ensure business requirements are correctly reflected in AI outputs.
• Analyze test results, model outputs, prediction accuracy, and regression impacts.
• Design and execute data quality and data pipeline validation scenarios.
• Identify, track, and report defects, validate fixes, and monitor model performance over time.
• Contribute to the definition of AI quality metrics and KPIs such as accuracy and precision.
• Participate actively in Agile/SCRUM ceremonies and contribute to continuous improvement.
• Prepare test and issue status reports and maintain clear testing documentation.
• Keep up to date with AI/ML trends and QA best practices, sharing knowledge and supporting less experienced team members.

Requirements

• Minimum 3 years of experience as a QA Analyst.
• Hands-on knowledge of AI/ML, including supervised and unsupervised learning, model training and inference, and datasets.
• Experience with JIRA/XRAY.
• Experience with API testing, preferably using SoapUI or Postman.
• Good knowledge of SQL/SQL Developer for data validation.
• Experience with Python or scripting for test data preparation.
• Knowledge of test automation frameworks such as Playwright, Selenium, or Katalon.
• Experience working in an Agile/SCRUM environment.
• Strong communication, documentation, analytical, and problem-solving skills.
• Good level of English; French is a plus.
• Higher education in Computer Science, Software Engineering, Data Science, or equivalent.
• Detail-oriented, proactive, autonomous, and able to prioritize based on risks and business impact.
• Curiosity and enthusiasm for AI, data, and emerging technologies.

This is our winning strategy, built on the core principles of impartiality, independence, and fairness at Nimber. The only thing missing is you!

Ready to join us and succeed?

If you're tired of feeling like just a number, send us your application and become a Nimber.