Systems Software Engineer

About the company

Our client is a technology company.

The role

Raydar is recruiting for this role on behalf of our client. Work on low-level performance and infrastructure engineering for a production machine learning serving platform. You will tune software for speed and efficiency, run large compute clusters, and speak directly with customers as part of a small, high-ownership team.

What you'll do

• Deliver fast support for newly released open-source models, tuned for low latency and high throughput.
• Improve the model serving stack with techniques such as request batching, caching, decoding strategies and quantization.
• Write and tune low-level GPU kernels across several hardware vendors.
• Design, deploy and operate compute clusters built from mixed hardware.
• Run production inference across a varied fleet, with attention to reliability, observability and cost efficiency at scale.
• Talk with customers and help set the direction of your own work with a high degree of autonomy.

Requirements

What we're looking for

• Deep understanding of how computers work, including architecture, memory hierarchy and operating system internals, beyond application-level coding.
• Backend, infrastructure or systems experience at a well-regarded technology company or an early-stage startup.
• Real enthusiasm for using AI agents and coding tools to improve your own workflow.
• A computer science degree from a strong undergraduate program.
• Clear communication and emotional intelligence, as roughly 10 to 20 percent of the role is customer-facing.
• Comfort working on-site five days a week.

Bonus points

• Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.
• Experience with machine learning inference optimization.
• Familiarity with GPU programming.
• Academic background in low-level systems topics.
• New graduates with strong internships are welcome.

Benefits

Compensation and benefits

Base salary

USD 200,000 to 300,000 per year

• Equity
• Health, dental and vision coverage
• Meals provided
• Unlimited paid time off
• Parental leave

Location and work model

• San Francisco, CA, United States
• On-site, 5 days per week in office
• Full-time