LLM Platform Engineer/Lead (m/f/d)

Remote from EMEA or Bangalore

Hello 👋 I am Servesh , Co- founder and CTO at Kayzen, and I am now looking for a LLM Platform Engineer/Lead who will be part of our Engineering team. 🙌 But wait, you have not heard of Kayzen before? 😃

Kayzen is a mobile demand-side platform (DSP) dedicated to democratizing programmatic advertising. We enable leading apps, agencies, media buyers, and brands to run programmatic customer acquisition, retargeting, and brand performance campaigns through its self-serve and managed service options. Built on the three core pillars of performance, transparency, and control, Kayzen powers the world’s best mobile marketing teams with bespoke solutions that fuel business growth and deliver a competitive advantage. With an unprecedented scale of 160B+ daily ad requests from 1.6B+ unique users worldwide, we serve up to 1B+ ads per day in 180 countries. Kayzen is accessible through our APIs and user interface.

The Team

The Platform Engineering team owns Real-time bidding (RTB) platform, a Real-time budget system, Real-time event processing, Stream data processing engine and multiple other complex large-scale distributed components and data pipelines. We work closely with data scientists, data analysts, product and business teams. We are responsible for some of the most technically challenging work, for example:

Handling ~2 Million Req/sec in sub-millisecond latency

Handing & managing ~Petabytes of data

Managing distributed systems deployed across multiple data centers

Optimizing JVM and Linux kernel for optimal performance

Managing our own data center spread across the globe consisting of thousand of powerful servers

Working on some of the most challenging problems of Ad-Tech

Sounds interesting. Isn't it?

About the Role

We are looking for an LLM Platform Engineer /Lead who can evangelise AI across the company and build the foundational tooling, frameworks, and workflows that allow teams to ship AI-powered features quickly and safely. This role is ideal for an experienced engineer who understands modern AI capabilities and focuses on developer velocity, reuse, and production readiness rather than training complex models from scratch.

Responsibilities

Design and build internal AI frameworks, SDKs, and shared libraries

Enable teams to integrate AI features with minimal friction

Set up standardized patterns for using LLMs, embeddings, agents, and workflows

Build reusable components for prompt management, evaluation, observability, and safety

Define best practices for AI usage, cost control, and reliability

Evangelise AI internally through documentation, examples, and hands-on guidance

Rapidly prototype AI-powered features and turn them into reusable building blocks

Own AI tooling from experimentation to production

Requirements

AI Tooling & Framework Experience (Core Focus)

Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.)

Experience with RAG pipelines, embeddings, vector databases

Familiarity with prompt engineering, prompt versioning, and evaluation

Experience with AI orchestration frameworks

Good understanding of AI observability, cost monitoring, and failure modes

You’ve shipped at least one LLM-powered feature to production and iterated based on telemetry or user feedback.

Comfortable with embeddings, fine-tuning, vector search, tokenisation, and evaluation methodologies.

Familiar with data lakes/warehouses, feature stores, and streaming/batch ETL ; cloud ( AWS/ GCP/Azure).

Strong Engineering & Platform Skills

Excellent Python skills (required)

Experience building frameworks, platforms, or developer tooling

Strong understanding of APIs, services, and system design

Writes clean, maintainable, production-grade code

Startup Mindset

Bias for shipping and iteration

Can translate AI complexity into simple abstractions

Comfortable with ambiguity and rapid change

Thinks in terms of leverage and reuse , not one-off solutions

Less About

Heavy model training or research

Designing custom ML algorithms

Academic optimisation work

Nice to have

Experience with agent-based systems and tool calling

Experience setting up guardrails, moderation, and safety checks

Familiarity with Docker, cloud infra, and CI/CD

Prior work in platform teams or enablement roles

What do we offer?

Reporting directly to Co-founder & CTO

Direct access to top management and an extremely “visible” role

Exceptional career growth and learning opportunity

A unique opportunity to be part of an experienced team of industry experts and entrepreneurs who bring massive change to the Adtech market

A fun, driven, and multinational team located across Germany, India, UK, Argentina, Ukraine, Turkey, Spain and many more countries

A flexible work-from-home arrangement

A 500-dollar home-office setup budget

A 1000-dollar annual learning and development budget