Head of AI Engineering (f/m/x)

neoshare is seeking a Head of AI Engineering (f/m/x) for an IT leadership role based in Frankfurt am Main. In this senior-level position, you will own and evolve the AI engineering function, transforming a 15 to 20 person machine learning team from research-heavy into a high-throughput, production-grade organization that builds AI features for the banking sector.

Key Responsibilities and Leadership

• Hire, mentor, and develop a high-performing team while organizing sub-teams for Core Modeling, AI Platform and Infrastructure, and Integrations.
• Own the LLM gateway, building multi-provider routing with rate limits, fallbacks, and cost tracking, alongside high-performance RAG pipelines.
• Lead end-to-end model and prompt lifecycles, establishing LLMOps and MLOps practices including CI/CD, canary testing, and drift monitoring.
• Implement data privacy, security, and compliance practices such as role-based access control, auditability, and incident response runbooks.

Candidate Requirements

Applicants must hold a Bachelor's degree and bring at least 5 years of experience as a backend engineer, plus 4 years leading AI and ML engineering in production, with 10+ years of total experience ideal. You will need deep architecture expertise in Java or Node.js (NestJS), distributed systems, microservices, and messaging patterns. The role requires hands-on familiarity with LLM orchestration stacks, vector databases, and cloud AI services like AWS Bedrock. Candidates must have proven experience operating systems at scale processing millions of daily API calls, alongside a strong foundation in Kubernetes, Terraform, and MLOps. Fluent German and English are required for daily team collaboration and technical documentation. Market competitive compensation is offered.