Full-Stack Engineer, Agent Evaluation & Reliability
True Talent Solutions Partners · San Francisco · Onsite
Strong hiring record · median 1 days open
- First seen
- 15 November 2026
- Reposted
- 3× since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- This role has been posted 4 times
In its favour
- Posted yesterday
- Still listed on the employer's own board
- Publishes a salary range
About the Role
Join an AI team building infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role combines ownership of core systems with the opportunity to ship product features and work directly with enterprise customers.
What You'll Do
- Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
- Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.
- Own features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.
- Work with customers to understand their systems, diagnose issues, and turn specific needs into reusable product capabilities.
- Contribute across the stack, building product experiences that make underlying systems useful.
What We're Looking For
- At least 2 years of experience building and shipping production systems as a backend or full-stack engineer.
- Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.
- Experience at a fast-paced startup, and a track record of owning projects end-to-end from design through deployment and iteration.
- Hands-on machine learning engineering experience, including model development.
- Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.
- Production experience with agent infrastructure, LLM evaluation, tracing, or agent memory systems is valuable.
Compensation & Benefits
Base salary
$120,000 to $180,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, United States.
Skills
More jobs at True Talent Solutions Partners
All 98- Software Engineer, Mid-Level to Staff+True Talent Solutions Partners · San Francisco · USD 225,000–425,000/yrtoday
- Senior Software Engineer, Autonomous SystemsTrue Talent Solutions Partners · Palo Alto · USD 145,000–275,000/yrtoday
- Product Engineer, Mid-SeniorTrue Talent Solutions Partners · New York · USD 140,000–200,000/yrtoday
- Founding Backend Software EngineerTrue Talent Solutions Partners · San Francisco · USD 225,000–275,000/yrtoday
- Staff Software Engineer, InfrastructureTrue Talent Solutions Partners · San Francisco · USD 200,000–300,000/yrtoday
Similar roles
- AI EngineerAtScale · Boston, MA · USD 150,000–200,000/yrtoday
- Staff Software EngineerOkta · Washington D.C.today
- Staff SDE, NetworkingDragos · United Statestoday
- Staff Software Engineer, Tech FoundationsAirbnb · United States · USD 204,000–255,000/yrtoday
- Advisor Product DeveloperThe Computer Merchant · Dallas, TX · USD 65–70/hrtoday
- Backend EngineerSga · Rockville, MDtoday