Senior AI Product Engineer

About Nscale

Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As a Nscaler, you'll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do.

About the Role

Nscale is looking for a Senior AI Product Engineer to join our product engineering team. You'll lead technical design and delivery of major features and subsystems — acting as the technical anchor for your team while raising the quality bar across everything the team ships.

At this level, you own substantial portions of Nscale's AI services platform: the API gateway, core AI service capabilities, billing and usage infrastructure, and the developer-facing SDKs and tooling that customers use to build on Nscale. You work on complex, multi-sprint projects and drive them to completion while mentoring the engineers around you.

This role expands beyond delivery into something broader: you become a multiplier for the people around you. That means growing the engineers you work with, shaping how the team approaches hard problems, and taking greater ownership of the technical direction of what you build.

Responsibilities

Lead technical design and end-to-end delivery for major product subsystems and complex features

Own architectural decisions within your team's domain — from API contracts to deployment strategy

Set the quality standard: drive test coverage, observability, reliability, and incident response

Mentor more junior engineers through design reviews, code reviews, and regular pairing

Collaborate cross-functionally with AI platform, infrastructure, and product teams

Identify and proactively address technical debt and scalability constraints before they become blockers

Contribute to hiring by reviewing candidate submissions and participating in interviews

Produce clear design documentation that enables asynchronous decision-making across the team

Requirements

5–8 years of software engineering experience

Deep expertise in backend or full-stack development at scale (Python, TypeScript, Go, or similar)

Proven experience designing and operating API platforms or developer-facing cloud services

Strong track record of owning and delivering complex, multi-sprint projects end-to-end

Experience with cloud-native architecture: Kubernetes, distributed systems, observability stacks

Experience building services with clear control plane / data plane separation; familiarity with cell-based or ring-based architecture patterns for cloud service scalability and fault isolation

Ability to communicate technical decisions clearly to product managers and engineering stakeholders

Sound engineering judgment: knows when to simplify, when to invest, and when to defer

Preferred

Experience building or consuming SDKs, Terraform providers, or extensibility layers for cloud platforms

Familiarity with infrastructure-as-code tooling (Terraform, Pulumi) and how platform teams expose it to customers

Experience building AI-integrated product features (LLM inference APIs, fine-tuning UX, agentic workflows)

Working knowledge of AI/ML infrastructure concepts: serving, evaluation, and model lifecycle management

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.