Incident management / reliability / SRE Evaluator

Accountabilities Evaluate AI-generated documents, spreadsheets, slide decks, and other work products against established incident management, reliability, and SRE quality standards.

Assess generated outputs for technical accuracy, operational rigor, sound judgment, and alignment with real-world reliability practices.

Identify factual, technical, presentation, and reasoning errors that could affect the quality or usefulness of an AI-generated deliverable.

Apply subject-matter expertise to determine whether incident-management and reliability recommendations are practical, complete, and appropriately structured.

Provide clear, concise, and structured written feedback explaining errors, gaps, and opportunities for improvement.

Help establish and apply domain-specific quality criteria and rubrics when evaluating AI outputs.

Collaborate asynchronously with the research team to refine evaluation approaches and improve AI performance.

Complete assigned evaluation projects accurately and within agreed timelines while maintaining professional standards.

Perform work using examples and knowledge that do not require access to confidential or proprietary information from any employer, client, or institution.

Requirements

5+ years of relevant professional experience in incident management, reliability engineering, site reliability engineering (SRE), or closely related disciplines.

Strong practical understanding of incident response, service reliability, operational processes, troubleshooting, and reliability best practices.

Ability to critically evaluate technical work products and distinguish accurate, actionable recommendations from flawed or incomplete reasoning.

Native or professional fluency in English, with strong written communication skills.

Highly proficient with Microsoft Office and Google Workspace, particularly Google Slides and/or PowerPoint.

Excellent attention to detail and the ability to identify factual, technical, aesthetic, and presentation-related issues.

Strong analytical and critical-thinking skills, with the ability to explain technical assessments clearly and objectively.

Ability to work independently and manage deliverables effectively in a fully remote, asynchronous environment.

Preferred: Advanced degree (Master’s or higher) from a reputable institution or equivalent advanced professional expertise.

Comfortable adapting established evaluation criteria and applying consistent judgment across a variety of AI-generated outputs.

Benefits

Compensation: $80–$120 per hour.

Fully remote opportunity for professionals based in the United States.

Flexible work that can generally be completed on your own schedule.

Independent contractor engagement.

Weekly payments through Stripe or Wise based on services rendered.

Opportunity to apply your professional expertise to the development and improvement of AI systems.

Asynchronous collaboration with a research team.

Projects may be extended, shortened, or concluded early depending on project needs and performance.

Work does not require access to confidential or proprietary information from any employer, client, or institution.

Please note: H-1B and STEM OPT candidates cannot be supported for this opportunity.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether? 

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1