AI Infrastructure / Product Engineer
Your tasks
- Design and implement repeatable benchmarks and evaluation pipelines to measure AI system performance, including model accuracy, hallucinations, retrieval quality, latency, and operational costs.
- Develop dashboards and monitoring tools that provide clear visibility into system performance, quality trends, and the impact of engineering improvements.
- Transform research prototypes into production-ready retrieval, drafting, document-processing, and agent-based workflows.
- Build and maintain backend services, APIs, and internal tools that support experimentation, testing, evaluation, and the release of product improvements.
- Deploy and operate cloud infrastructure, including databases, monitoring systems, delivery pipelines, and production reliability processes.
- Establish processes for continuously testing, measuring, and improving AI system quality and performance.
- Collaborate with AI researchers to translate experimental findings into practical product capabilities while maintaining a strong focus on user needs.
- Turn ambiguous technical challenges and evolving research concepts into maintainable, reliable, and scalable software solutions.
Requirements
- At least 3 years of professional experience as a software engineer, infrastructure engineer, or product engineer building and deploying production systems.
- Strong proficiency in Python and practical experience deploying applications and services in cloud environments.
- Experience developing APIs, backend services, database integrations, deployment pipelines, and production monitoring systems.
- Hands-on experience building evaluation pipelines, benchmarks, or assessment frameworks for machine learning or AI-powered systems.
- Ability to translate ambiguous requirements, experimental code, and emerging ideas into usable, maintainable production products.
- Interest in or experience with large language models (LLMs), retrieval-augmented generation (RAG), AI agents, model benchmarking, or document automation.
- Strong problem-solving skills and the ability to work effectively across AI research, infrastructure, and product development.
- Full-stack development experience is an advantage.
- Familiarity with technologies such as FastAPI, Docker, React, Next.js, PostgreSQL, and vector databases is a plus.
- Ability to work remotely from within the United States.
What we offer
- Annual base salary: $180,000–$260,000 USD, depending on skills, experience, and role scope.
- Full-time, remote work arrangement within the United States.
- Opportunity to work at the intersection of AI research, infrastructure engineering, and product development.
- The chance to build and improve production AI systems with measurable impact on product quality and reliability.
- Opportunities to work with modern AI technologies, evaluation frameworks, and scalable cloud infrastructure.
How to apply
How Jobgether works We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether?
Other
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.