Engineering Manager - AI Product

Accountabilities Lead, mentor, and develop a small team of AI engineers, fostering a culture of ownership, collaboration, and engineering excellence.

Define the technical vision and architectural direction of the AI product, ensuring high standards for performance, scalability, reliability, and cost efficiency.

Contribute hands-on to the design, implementation, and optimization of production AI systems, including model serving, inference pipelines, retrieval systems, orchestration, and evaluation frameworks.

Oversee the end-to-end AI platform, including GPU infrastructure, model deployment, versioning, embedding pipelines, monitoring, and quality evaluation processes.

Collaborate closely with Product, Infrastructure, Security, and Backend teams to align priorities, deliver integrated solutions, and support strategic business goals.

Conduct regular performance reviews, coaching sessions, and technical mentoring while translating long-term objectives into clear execution plans and ensuring successful project delivery.

Requirements

7+ years of experience in software engineering, including at least 2 years in an engineering management or technical leadership role.

Proven experience building and operating production AI/ML platforms or inference infrastructure, with expertise in model serving, GPU workloads, latency optimization, and cost management.

Strong backend engineering skills, including Python proficiency and experience with distributed systems; knowledge of Go, Rust, or similar languages is considered an advantage.

Hands-on experience with modern LLM technologies, including model APIs, open-weight models, serving frameworks, vector databases, retrieval systems, and prompt or context engineering.

Solid understanding of AI quality evaluation, benchmarking, observability, regression testing, and monitoring for non-deterministic systems.

Experience with cloud environments, preferably AWS, along with Kubernetes, containerization, Infrastructure-as-Code tools, CI/CD pipelines, Linux systems, networking fundamentals, and monitoring solutions.

Excellent communication, leadership, and decision-making skills, with the ability to balance strategic planning, technical execution, and people management.

Benefits

Fully remote position with collaboration across the European time zone.

Opportunity to lead a highly impactful AI product with significant ownership and technical influence.

Hands-on leadership role combining engineering management with active software development.

Exposure to cutting-edge AI technologies, including LLMs, inference infrastructure, GPU computing, and distributed systems.

Close collaboration with cross-functional engineering, infrastructure, product, and security teams.

Career growth through technical leadership, architecture ownership, and strategic decision-making.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether? 

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1