
Member of Technical Staff — Inference Infrastructure
Causal Labs · San Francisco · Onsite
- Professional Services
- 11–50 employees
- San Francisco
All reasons
- Open 107 days
In its favour
- Still listed on the employer's own board
Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.
To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.
Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.
We look for infrastructure engineers who are excited to tackle unsolved problems. Progress on an LPM is gated by how fast we can evaluate it: large-scale backtesting against decades of physical observations, ensemble generation, and rollout evaluation across model scales.
Responsibilities
Your mission is to make inference so fast and cheap that evaluation never gates research.
- Build high-throughput inference systems for large-scale evaluation, backtesting, and scoring against historical physical observations
- Design and implement techniques that improve latency, throughput, and efficiency for real-time inference
- Optimize the inference stack to fully utilize hardware FLOPs, bandwidth, and memory
- Extend orchestration frameworks (e.g. Kubernetes, Ray, Slurm) for distributed inference and large-batch evaluation sweeps
- Establish standards for reliability, observability, and reproducibility across the inference stack, so every evaluation is trustworthy and repeatable
- Collaborate with researchers to enable high-performance inference for novel architectures as they emerge
What we're looking for
We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.
- Experience building or optimizing inference and serving systems for throughput and latency (e.g. TensorRT)
- Understanding of distributed compute, GPU parallelism, and hardware-aware optimization
- Deep familiarity with deep learning frameworks (e.g. PyTorch, JAX) and their underlying system architectures
- Strong engineering skills: performant, maintainable code and the ability to debug complex codebases
- Bonus: contributions to open-source inference or systems infrastructure (e.g. vLLM, SGLang, Triton)
Skills
- Kubernetes
- Ray
- Slurm
- TensorRT
- Deep Learning
- PyTorch
- JAX
- vLLM
- Triton
More jobs at Causal Labs
- Member of Technical Staff — DevOpsCausal Labs · San Francisco1mo ago
- Member of Technical Staff — Security EngineeringCausal Labs · San Francisco3mo ago
- Member of Technical Staff — Product EngineeringCausal Labs · San Francisco3mo ago
- Member of Technical Staff — Compute ClusterCausal Labs · San Francisco3mo ago
- Member of Technical Staff — Training InfrastructureCausal Labs · San Francisco1y ago
Similar roles
- Member of Technical StaffJobgether · US · USD 180,000–250,000/yryesterday
- Member of Technical Staff - Senior Robotics Software (San Francisco, CA)Tutor Intelligence · San Francisco, CA2d ago
- Member of Technical StaffTrue Talent Solutions Partners · San Francisco, United States · USD 160,000–220,000/yr2d ago
- Member of Technical Staff - Engineering LeadArtificial Intelligence Underwriting · San Franciscotoday
- Member of Technical Staff, ML SystemsTrue Talent Solutions Partners · Menlo Park · USD 180,000–260,000/yryesterday
- Member of Technical Staff, Applied ResearcherTrue Talent Solutions Partners · New Yorkyesterday