
Forward Deployed Engineer (German speaking)
Deepset · Berlin · Remote
- Software & SaaS
- 51–200 employees
- Berlin, BE
- First seen
- 16 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
TL;DR
As a Forward Deployed Engineer at deepset, you work embedded inside our most strategic Enterprise and Public Sector customers, as part of their team. You will transform their problems and challenges into production grade solutions and you stay with the customer until those solutions are adopted at scale and delivering measurable value. You are the technical partner the customer relies on day to day, and the bridge between their teams and deepset’s Customer Engineering, Product and Engineering teams.
Why deepset
At deepset, we're on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We're remote-first, flexible, and built on a culture of trust and ownership. You'll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
What you will do
Embed and partner
- Work inside the customer’s team, aligned with their delivery and governance models, ways of working and environments.
- Act as the customer’s trusted AI advisor on use case prioritization, architecture and roadmap, connecting their goals with the Haystack Enterprise Platform (HEP).
- Translate business problems into well-scoped solutions with clear success metrics and a baseline, together with the Value Engineer.
- Anticipate upcoming needs and maintain a customer-specific AI roadmap.
Build and run in production
- Own technical outcomes from PoC to production: agents and orchestration, workflows, RAG pipelines, indexing and embeddings, model optimization, evaluations, cost management, and API and system integrations.
- Bring state-of-the-art approaches to the customer’s hardest problems and turn them into reliable, secure, production-grade systems inside the customer’s environment.
- Monitor solution performance with the customer and resolve issues in the AI layer quickly.
- Reuse and contribute reference architectures and reusable components that make every new engagement faster.
Drive adoption and impact
- Make sure what you build is actually used, with measurable quality and business impact.
- Run structured evaluations and continuously improve retrieval quality, prompts and model behavior based on real usage and feedback.
- Enable the customer team to operate and extend solutions independently: documentation, runbooks, knowledge transfer and training.
Grow the account and the product
- Surface new use cases, teams and stakeholders, and bring them to the account team.
- Prepare the evidence for the contract renewal: value delivered against the baseline agreed at kick-off.
- Share field insights with Product and Engineering to shape HEP.
What you bring to the team
- Native German language skills
- Hands-on experience shipping AI applications to production: RAG, agents, data preprocessing, retrieval and embeddings.
- A track record of building trusted, long-term relationships with technical and business stakeholders, communicating clearly at every level.
- Experience designing and running agent evaluations and improving quality from real usage data.
- Familiarity with agent frameworks and vector databases.
- Strong Python and production engineering practices: testing, CI/CD, code review and observability.
- Experience operating AI solutions in production in enterprise environments: monitoring, troubleshooting and incident handling.
- Solid understanding of enterprise integration: APIs, authentication (OIDC/SAML), security and compliance.
- Close awareness of the state of the art in LLMs and agentic systems, and the judgment to know when it is ready for production.
- Experience scoping and estimating work within long-running engagements: effort, assumptions, risks and deliverables.
Nice to have
- Haystack experience is a big plus
- Forward-deployed or consulting experience on long, embedded engagements
- Basic frontend skills (React, TypeScript) for user-facing workflows
- Fine-tuning experience (PEFT, LoRA)
Benefits
- Remote-first setup with flexible hours & tech of your choice
- 30 days vacation + extra days for family sick leave
- Competitive salary & stock options for every team member
- Monthly sports & mental health support allowance with Oliva
- Annual learning & development budget
- Monthly team socials & in-person meetups
- Dog-friendly Berlin HQ
About us
Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.
Visit us to learn more
deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)
Skills
- Haystack
- LLM
- Retrieval-Augmented Generation
- Embeddings
- Vector Databases
- Python
- OpenID Connect
- SAML
- React
- TypeScript
- GitHub
Similar roles
- Senior Software Engineer, Operations FoundationsWolt - English · Berlin, Germanytoday
- Working Student Software Engineer (f/m/d)Isar Aerospace SE · Parsdorf, Bavaria, Germanytoday
- Senior / Staff Backend Engineer - HEMS Configuration (m/f/d)1KOMMA5° Handwerk · Remote · Hamburg · Berlin +1today
- LLM Engineer — Post-Training (Remote - Germany)EverAI · Germanytoday
- Software Engineer, DataEngelhart · Berlin, Germanytoday
- Head of Software Development (w/m/d)FLEX Capital · Remote · Stuttgarttoday