Senior MLOps/LLMOps Engineer

Our Mission

Ivy Partners is a Swiss consulting firm that helps companies navigate strategic, technological, and organizational challenges.

We are committed to providing our employees with a career that supports both their personal and professional growth. We guide them in skill development and offer genuine opportunities for advancement.

As a Senior ML Ops / LLM Ops Engineer at Ivy Partners, you will be responsible for:

• Designing and implementing ingestion pipelines for ML/LLM traffic in production
• Constructing mechanisms for PII redaction and classifying safety/abuse
• Setting architecture of storage, retention policies, and data governance
• Implementing dashboards and query layers for operational debugging
• Developing workflows for eval mining and regression detection
• Integrating autoraters and LLM-as-judge pipelines
• Building automatic triage mechanisms for failure detection
• Ensuring the reliability, observability, and access control of the platform
• Supporting scalable onboarding of multiple tenants
• Making decisions on tooling and hosting (self-hosted vs managed SaaS)

About You

You are our ideal candidate if you

• Have extensive hands-on experience in ML Ops / Data Platform Engineering
• Have proven experience with LLM systems in production
• Possess a strong background in observability, tracing, and evaluation systems
• Have excellent command of production-grade Python
• Are knowledgeable in governance, PII handling, and regulated environments
• Have experience with Azure and/or AWS
• Are familiar with vector databases, eval pipelines, and failure analysis
• Exhibit a pragmatic mindset and technical ownership from end-to-end
• Are capable of operating critical systems with a focus on reliability
• Have experience in multi-tenant SaaS environments
• Have knowledge of SQL and TypeScript for dashboards
• Have interest in modern AI tooling (Claude, OpenAI, GitHub, etc.).

Why Join Ivy Partners?

Care | We care about our employees by creating a supportive environment where everyone is valued and empowered with training and growth prospects.

Trust | We believe in building strong and long-lasting relationships with our clients. Working with us is about establishing a partnership based on trust, professionalism, and transparency at all times.

Innovation | We empower effective digital transformation through a unique blend of innovative technology and creative thinking.

Responsibility | Community is at the heart of everything we do, and we take that responsibility seriously by working hard to create a positive impact.