QA Engineer | Barcelona
TransPerfect · Barcelona, Catalunya [Cataluña], Spain · Hybrid
Strong hiring record · median 1 days open
- First seen
- 16 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.
The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.
As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.
This position offers
- A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions
- Ownership of test automation and opportunities to influence product quality and release readiness
- Collaboration with distributed product, development, and release teams
- Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows
- Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices
Your responsibilities will include
- Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications
- Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks
- Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality
- Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria
- Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed
- Validate data integrity, access control, error handling, usability, and compatibility across supported environments
- Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings
- Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions
- Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements
- Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed
- Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs
- Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats
- Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone
- Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts
- Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies
- Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency
Communication
- Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders
- Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups
Required skills and experience
- Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience
- Professional experience in software quality engineering with both manual and automated testing
- Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks
- Programming proficiency in C#, Java, or a comparable language used for test automation
- Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior
- Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira
- Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results
- Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results
- Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation
- Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively
Desired skills and experience
- Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features
- Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs
- Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling
- Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization
- Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation
- Professional working knowledge of an additional language, especially for multilingual product testing
- Ability to work across time zones and understand complex business workflows
By applying, I confirm I have read and accept
TransPerfect's Privacy Policy
https://www.transperfect.com/about/data-privacy-recruiting
Skills
- LLM
- Playwright
- Selenium
- Azure DevOps
- C#
- Java
- TeamCity
- Jira
- Retrieval-Augmented Generation
- Generative AI
- .NET
- SQL
More jobs at TransPerfect
All 17- Help Desk Support SpecialistTransPerfect · New York City, NY, United States · USD 50,000–55,000/yrtoday
- Subject Matter Expert - Task Creator (Product Manager, Business Operations, Project/PMO & Managers)TransPerfect · Jakarta Raya, Indonesia · Thu Duc City, Ho Chi Minh City, Hồ Chí Minh, Vietnam · Hanoi, Hà Nội, Vietnam +1 · USD 45today
- Subject Matter Expert - Task Creator (IT & Software)TransPerfect · Jakarta Raya, Indonesia · Thu Duc City, Ho Chi Minh City, Hồ Chí Minh, Vietnam · Hanoi, Hà Nội, Vietnam +1 · USD 45today
- Subject Matter Expert - Task Creator (Data, Business & BI Analysts)TransPerfect · Jakarta Raya, Indonesia · Thu Duc City, Ho Chi Minh City, Hồ Chí Minh, Vietnam · Hanoi, Hà Nội, Vietnam +1 · USD 45today
- SME Task Creator – Product Manager, Business Operations, Project/PMO & Managers - IndiaTransPerfect · Bangalore, Karnātaka, India · Delhi, Delhi, Indiayesterday
Similar roles
- Field Service TechnicianKonecranes · Las Palmas de Gran Canaria, Spaintoday
- Senior Frontend Developer (Angular)MEDvidi · Barcelona, Spaintoday
- Senior Backend (NodeJS) EngineerMEDvidi · Barcelona, Spaintoday
- Low-Level Rust DeveloperMWDN · Madrid, MD, Spaintoday
- AI Video CreatorMWDN · Madrid, MD, Spaintoday
- AI Platform EngineerQualifyze · Barcelona, Catalunya [Cataluña], Spain · EUR 50,000–60,000/yrUpdated today