JobHabor
Menu

Gen AI / LLM Engineer (AWS)

TriOptus · Ny, NY, United States

Weak hiring record · median 370 days open

9696

Hiring signal

Actively hiring

Open 20 days · Never reposted · Checked today · How we score

First seen
10 November 2026
Reposted
Not since September 2026
Last checked
Today · still on the employer's board
All reasons
  • 99% of this employer's openings are over 60 days old

In its favour

  • Still listed on the employer's own board
  • Publishes a salary range

Did you apply?

Gen AI / LLM Engineer (AWS) at TriOptus. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

We received direct feedback from the hiring manager that the resumes they are reviewing all look like AI Slop. Majority of what they see are a mile wide and an inch deep. With generic documents and applications with no named sources and long tool lists with zero project outcomes. Moving forward, please submit only candidates who can truly walk through RAG systems they have built, and their recent roles tells a story how what they have accomplished.

Job Description

  • Applied AI Engineer

Overview

  • Client's Fixed Income Credit Complex team is building an enterprisegrade GenAI workflow platform to power document intelligence, embedded productivity assistants, and automated business workflows across Institutional Securities.
  • This is a production engineering role, not a research or prototype track.
  • Client is seeking senior, handson engineers who have designed, built, and operated GenAI systems in production environments.
  • This role contributes to a shared platform used across business lines, with a clear path to owning core GenAI capabilities and standards within Institutional Securities.

What Candidates Will Do

  • Design and evolve reusable GenAI workflow primitives and services used across Institutional Securities workflows.
  • Develop AIpowered assistants embedded into core Institutional Securities applications, leveraging agentic and tool-driven workflows.
  • Define and guide GenAI architecture decisions, including model selection, orchestration patterns, and evaluation strategies.
  • Establish and evolve LLMOps practices, including evaluation harnesses, prompt/version management, monitoring, and regression testing.
  • Design and implement controls for entitlements, data security, and PII handling, including usage of opensource models in regulated environments.
  • Partner with business and platform teams to drive adoption of shared GenAI capabilities across systems and workflows.

What Candidates Will Bring

  • 2 plus years of handson experience building and operating GenAI systems in production
  • 7 plus years of fullstack or platform engineering experience, with strong proficiency in Python.
  • Proven experience designing and operating LLMbased systems using patterns such as RAG, tool/function calling, agentic workflows, and structured outputs.
  • Strong expertise in LLMOps, including evaluation frameworks, prompt/version management, regression testing, observability, and production reliability.
  • Experience building AIfirst document ingestion and extraction pipelines with measurable quality and accuracy.
  • Experience with coding agents (Claude code, Codex, AMP, CoPilot)
  • Advanced experience in retrieval systems, including multistage pipelines, vector search, re-ranking, metadata filtering, and evaluation metrics (e.g., recall/precision tradeoffs, MRR, NDCG).
  • Practical experience debugging and stabilizing systems through realworld failure scenarios, including model regressions, prompt drift, retrieval degradation, and data quality issues.

Nice to Have

  • Experience in Fixed Income, Credit, or broader Institutional Securities workflows.
  • Familiarity with enterprise data governance, security models, and entitlements frameworks.
  • Experience designing reusable internal platforms or shared developer tooling.

More jobs at TriOptus

All 754

Similar roles