
Member of Technical Staff - Evals Research Engineer
NeoSigma · San Francisco, CA
- Software & SaaS
- 2–10 employees
- San Francisco, California
- First seen
- 16 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
About Us
NeoSigma is a product-driven research lab building the intelligence layer that helps close the feedback loop between your customers, products, and AI systems.
We are a small, intensely technical team of researchers and engineers who have trained frontier-scale models and widely used AI products and agents at Parallel Web, Essential AI, MIT, Apple, and Amazon.
We are backed by world-class investors and leaders from Google DeepMind, OpenAI, Decagon and others.
The Role
We are looking for a Backend Engineer to own the systems that
ingest, evaluate, and serve agent behavior data
at production scale. You will work across telemetry ingestion, platform reliability, sandbox infrastructure, and the API surface that customers and integrations build on. Some weeks you will be
deep in distributed systems and query performance
. Other weeks you will ship a
customer-facing feature
across backend, APIs, and the data layer.
What you'll do
- Design and build evaluation frameworks for agentic systems
- Research methods for agent evaluation, reward modeling, reward-hacking, post-training, and self-improving systems
- Develop rubrics, verifiers, reward signals, and benchmarks to measure agent performance, reliability, and generalisation
- Own research streams end-to-end and building infrastructure to ship working systems
- Publish research findings through technical blogs, papers, and open-source contributions
What we look for
- Moving fast with high agency
- Strong foundations in machine learning, deep learning, and computer science
- Hands-on experience with LLM evaluation, agentic systems, reinforcement learning, or post-training
- Strong programming skills in Python and experience building reliable ML research infrastructure
- Strong research taste and the ability to identify and solve complex and meaningful problems
- Comfortable navigating open-ended research problems and quickly translating ideas into working implementations
- High standards for experimental rigor, engineering quality, and clear technical communication
Our Core Values
- Customer Obsession - We start with the customer and work backwards. We aim to earn trust through consistent delivery, thoughtful listening, and by obsessing over customers.
- Intellectual Honesty - We operate with high trust and low ego. Ideas matter more than titles, and we communicate openly and directly while assuming good intent, even in strong disagreement.
- Bias for Action - We set high standards and move quickly to meet them. We prefer building and learning with customers over debating in the abstract, and we iterate based on real feedback.
- Extreme Ownership - We take responsibility for outcomes, not just tasks. Ownership means seeing problems through to completion and ensuring solutions truly work in practice.
Benefits and perks
- Competitive salary plus meaningful equity package
- Comprehensive medical benefits and generous PTO
- Flexible work arrangements
- Direct impact on company direction and technical decisions
- High ownership and the opportunity to make a career-defining impact
- Visa sponsorship
As a founding member, you’ll help define the technical foundation of NeoSigma. Your scope will grow with the company, from owning core systems end-to-end to shaping architecture, hiring, and engineering culture. This role has a natural path toward technical leadership or engineering management as the team scales.
Skills
- OpenAI
- Machine Learning
- Deep Learning
- LLM
- Python
More jobs at NeoSigma
Similar roles
- Cybersecurity Consultant (Remote - Irving, TX; Oklahoma; New Jersey/Pennsylvania/New York Tri-State Area or Northeast Region (New England area)Opportunities · Irving, TX, United States · Morristown, NJ, United States · Woburn, MA, United States +6today
- Data Center Network EngineerMatrix Global · United Statestoday
- Low-Level Rust DeveloperMWDN · Tbilisi, Tbilisi, Georgiatoday
- Sr. Controls EngineerBosch Group · Pineville, NC, United Statestoday
- AI Video CreatorMWDN · Tbilisi, Tbilisi, Georgiatoday
- Senior AI Product Analyst - Voice AI AgentsMEDvidi · Tbilisi, Georgia, Georgiatoday