Senior AI/ML Engineer (m/w/d)
About this role
Who are we?
Recare is one of the leading digital startups in the German healthcare industry and has set itself the task of rethinking healthcare with a platform for digital care coordination. We search, find and coordinate capacities so that the healthcare actors have more time for their patients.
Within a very short time, Recare was able to gather around 75 percent of German acute hospitals as well as more than 26,000 care and rehabilitation facilities on its digital platform. Renowned hospitals and hospital groups such as Vivantes, Sana Kliniken AG, München Klinik, Hannover Medical School and Essen University Hospital are among Recare’s customers and use the Recare platform.
We believe artificial intelligence will transform healthcare more profoundly than any technology since the internet, and we’re building that future today, not tomorrow. While the German healthcare sector has historically focused on the risks of new technologies, we see an unprecedented opportunity to solve the industry’s most pressing challenges with AI. With most German acute hospitals now using the Recare platform, we take our leadership responsibility seriously: we’re helping clinics achieve what once seemed impossible, from automation of administrative workflows with the Recare AI platform to unlocking billions in value through predictive analytics. The potential is real, the technology is ready, and the time is now.
Role & team summary
As a senior member of the AI team, you will work on building cutting-edge agentic systems that work reliably in production environments where privacy and correctness are top priorities. This is a hands-on role: you will own key AI initiatives end to end and work across products, since the hardest problems here span more than one team.
Our team is small but growing fast; we are highly independent and hold ourselves accountable for the quality of our work. Technical excellence is expected, but our ideal colleague shares our passion for building impactful solutions that make it all the way into production. As one of our most experienced engineers, you will mentor others, help shape our AI technical strategy, and work with product and business stakeholders to turn open questions into clear recommendations. We want to improve society, not just brag about building fancy tech!
What you’ll work on
Agentic applications: Build robust chat and generative AI applications on agentic frameworks, designing and optimizing core agent behavior: routing, tool calls, context management, grounding, and instruction-following. Every output is a draft until a clinician releases it, and the system is built for that.
Evaluation: Measure the real value of agentic systems through observability data, custom evaluation metrics, and user feedback, and use those results to improve prompts, models, and system design.
GenAI observability: Set up and improve logging, tracing, metrics, dashboards, and prompt management for our AI systems.
Deployment and integration: Develop and maintain the infrastructure that ships AI agents into REST APIs and web UIs, including containerization, orchestration, and API development.
Safeguarding health data: Embed security best practices and uphold compliance to protect sensitive health information.
Technical direction: Track new AI developments, turn the promising ones into production-ready implementations, and help set the direction of our AI work.
What we’re looking for
8+ years of relevant industry experience, with a strong AI/ML background, at senior level or above.
Hands-on experience designing, shipping, and operating LLM-powered products (RAG, agents) in live production. Research projects and prototypes alone aren’t enough here; we want to hear about systems real users depended on. If your background is in productionizing traditional ML systems rather than LLMs, we still want to hear from you.
Hands-on experience with LLM evaluation, such as golden datasets, LLM-as-a-judge, or offline and online metrics, and with systematically improving prompts and models.
Solid deep learning experience applied to real-world problems, with a focus on system-level integration rather than model training alone.
Strong coding skills across the stack. Ours includes Python, Go, GitHub Actions, and AWS, and you’re comfortable reading and fixing code outside the main codebase.
Proficiency in Python and at least one web framework (FastAPI, Django, Flask, …).
Experience in environments where security and privacy are top priorities, such as PII redaction, LLM guardrails, and GDPR compliance.
Experience leading, mentoring, and supporting other engineers.
Experience shaping technical direction and making well-reasoned recommendations to product and business stakeholders, especially where strategy is still evolving.
Clear communication in English with technical and non-technical people alike, the ability to explain complex topics simply, and a track record of collaborating well across teams.
A solution-driven mindset: you analyze problems thoroughly and then drive them to resolution.
Nice to have: experience in regulated industries such as healthcare or fintech, ideally including AI products certified as medical devices, and German language skills, since our customers are German-speaking.
Not a perfect match on every point? We care more about shared drive and a real sense of mission than about ticking every box. If you want to dedicate yourself to meaningful work alongside a team that feels the same, we’d love to hear from you.
What we offer
Growth: We invest in each person’s development, whether that’s taking ownership of new projects, deepening your technical leadership, or exploring new AI approaches. If you grow, we grow.
Purposeful work: Your work has a real impact on patients, their families, and healthcare professionals.
Company culture: Flat hierarchies, strong team dynamics, and a culture of mutual respect, loyalty, and recognition.
Flexibility: Need to pick up your child from daycare or want to exercise at lunch? We support you, with fully remote work, flexible hours, and workations by arrangement.
Edenred card to use according to your needs.
Your birthday off to celebrate with your loved ones.
Location
We’re a remote team, and the role is fully remote within the European time zone. We’re hiring in Germany (including Berlin), Austria, Poland, France, Italy, Spain, and Portugal.
Find more English Speaking Jobs in Germany on Arbeitnow
