ML & LLM Ops Specialist

The Vienna Insurance Group is the leading insurance group in Central and Eastern Europe (CEE). With around 30,000 employees in more than 50 insurance companies and pension funds in 30 countries, we work daily for around 33 million customers. We do this successfully, which is why the VIG Group has an "A+" rating with a positive outlook. Commitment, competence, and service orientation characterize us on the one hand, and a diverse team with various talents and exciting areas of work in ei... 1 ML & LLM Ops Specialist Vienna 1010, Full-time

Your Tasks

• You work closely with Data Scientists, Data Engineers, subject matter experts, and Product Owners to design robust and long-term scalable GenAI products for the entire group
• You develop, implement, and operate RAG applications, Copilots or assistant systems, agent-based workflows, as well as other LLM-based solutions on Databricks
• You establish end-to-end LLMOps processes, including prompt and model versioning, automated testing, deployment, monitoring, guardrails, and feedback loops
• You develop and operate AI Judges for quality assessment, regression testing, and production monitoring, and calibrate them based on feedback from human experts
• You develop agent-based solutions using Tool and Function Calling, MCP, as well as orchestration frameworks such as LangChain and LangGraph
• You ensure security, governance, reliability, low latency, and cost efficiency, and contribute to the development of reusable components, standards, and documentation

Your Profile

• You have a completed degree in Computer Science, Software Engineering, Business Informatics, Data Science, Artificial Intelligence, or a comparable practical qualification
• You bring very good Python and Software Engineering skills, as well as experience in developing LLM applications from prototype to production use
• You have practical experience with Databricks, MLflow, Model Serving, Vector Search, APIs, and data pipelines
• You possess sound practical knowledge in the areas of RAG, Prompt Engineering, Tool Use, Agent Architectures, stateful workflows, and Human-in-the-Loop processes
• You have experience in developing AI Judges, evaluation datasets, and assessment grids, as well as in their validation based on human assessments
• You have a very good understanding of CI/CD, Observability, Security, Governance, and Responsible AI
• You impress with strong communication and teamwork skills, an independent and solution-oriented way of working, and impeccable English skills; German skills are an advantage

YOUR BENEFITS

Flexible Working

• Hybrid working
• Flexible flextime model
• 37.5 hour week
• Home Office starter kit
• Additional days off (e.g., for new family members, Social Active Day, training days)

Salary and Discounts

• Attractive, market-compliant salary
• Discounted insurance products
• Discounted products at Erste Bank as well as a free debit and credit card
• Numerous cooperations with retail, tourism, gastronomy, and other partners

and much more

Due to legal requirements, we inform you about the monthly minimum collective agreement salary of EUR 3,353.17 gross based on full-time employment (37.5 hours / week). Of course, we offer market-compliant pay. It is important to us that your salary is oriented towards your qualifications and experience, which is why we will discuss the salary together in a personal interview. This full-time position is to be filled as soon as possible.

https://ams.at/su/G4LXM The minimum remuneration for the position as ML & LLM Ops Specialist is 3,353.17 EUR gross per month based on full-time employment. Willingness to overpay.