LLM / RAG Expert - Agentic AI / Startup

Das ist der Job

This is a hybrid role based in Frankfurt.

Darum lohnt es sich

Working closely with Product, Engineering and Leadership teams, you’ll tackle complex real‑world AI challenges whilst helping establish best practices across scalability, performance, observability and security.

Key responsibilities Design and develop scalable AI applications powered by LLMs Build and optimise Retrieval‑Augmented Generation (RAG) pipelines Develop semantic search capabilities and vector database solutions Implement prompt engineering, agent frameworks and tool‑calling workflows Build data ingestion and embedding pipelines across structured and unstructured datasets Improve model accuracy, retrieval quality, latency and evaluation processes Deploy, monitor and maintain AI systems in cloud environments Collaborate with cross‑functional teams to deliver AI‑driven product features Help define standards around AI governance, security and observability What we're looking for 4+ years of software engineering experience 2+ years working with LLMs, Generative AI or NLP applications Hands‑on experience building production RAG systems Experience with vector databases such as Pinecone, Weaviate, Qdrant, Chroma or FAISS Experience with frameworks including LangChain, LlamaIndex, Haystack or DSPy Strong understanding of embeddings, chunking strategies, retrieval optimisation and prompt engineering Experience integrating AI models from providers such as OpenAI, Anthropic, Cohere or Google Gemini Familiarity with cloud platforms including AWS, GCP or Azure; experience with Docker, Kubernetes, CI/CD pipelines and modern backend architectures Fine‑tuning open‑source models such as Llama, Mistral, DeepSeek or Mixtral; AI Agents and multi‑agent orchestration Graph RAG and knowledge graph implementations LLM evaluation and observability tooling Previous experience within startup or scale‑up environments Open‑source contributions or technical publications Work on genuinely innovative AI products at the forefront of the industry High levels of ownership and technical autonomy Influence product strategy and technical decision‑making Fast‑paced and collaborative environment Competitive salary and equity packages Flexible hybrid working model Long‑term career growth within a rapidly expanding AI business If this sounds interesting and you’d like to learn more, email me with a copy of your CV at smouland@eu-recruit.com.

We're partnered with a very ambitious AI startup that is building next-generation intelligent systems designed to automate complex workflows, unlock value from unstructured data, and deploy AI solutions at scale. As they continue to grow, they're looking for a LLM / RAG Expert to play a key role in the development of their core AI platform.

This is an opportunity to work on cutting‑edge Generative AI products, helping to shape both the technical direction and future capabilities of a rapidly evolving business. Fully remote is not an option right now.

The role You’ll be responsible for designing, developing and deploying production‑grade AI systems powered by Large Language Models, Retrieval‑Augmented Generation (RAG) architectures, vector search technologies and AI agents. By applying to this role you understand that we may collect your personal data and store and process it on our systems.

For more information please see our Privacy Notice (https://eu-recruit.com/about-us/privacy-notice/). #J-18808-Ljbffr