LLM QA Contractor

Accountabilities: The LLM QA Contractor will be responsible for evaluating AI outputs and providing structured feedback to support continuous improvement of AI systems. Key responsibilities include:

Reviewing AI-generated responses against source images, delivery instructions, and established quality guidelines.

Verifying factual accuracy, completeness, relevance, and alignment with expected outcomes.

Identifying and categorizing issues such as hallucinations, missing details, incorrect interpretations, or policy concerns.

Providing clear and concise feedback to improve model performance and output quality.

Following Standard Operating Procedures (SOPs), participating in calibration sessions, and maintaining consistency across evaluations.

Managing review activities through annotation platforms, spreadsheets, and other web-based tools.

Escalating unclear cases, guideline gaps, or complex scenarios when required.

Consistently achieving quality, accuracy, and productivity targets within required timelines.

Requirements:

The ideal candidate has experience in quality assurance, content evaluation, or data-focused roles and demonstrates strong analytical and communication skills. Required qualifications and skills include:

Strong attention to detail with a structured and analytical approach to reviewing information.

Previous experience in Content QA, Data Labeling, Trust & Safety, Content Moderation, or similar quality assurance roles.

Excellent visual analysis skills and strong reading comprehension abilities.

Comfortable using web-based tools, spreadsheets, and annotation platforms.

Ability to manage repetitive tasks while maintaining accuracy and consistency.

Strong written communication skills in English.

Ability to responsibly handle confidential and user-generated content.

Reliable, organized, and capable of working independently in a remote environment.

Benefits:

Fully remote work opportunity with flexibility to work from anywhere.

Freelance contract through a service agreement.

Initial 90-day contract with the possibility of extension.

Part-time schedule of approximately 4 hours per day.

Project workload concentrated around two weekly peaks on Mondays and Wednesdays.

Flexible working hours with no requirement to work during Portugal business hours.

Only one hour of overlap required for team status updates on Monday and Wednesday afternoons (Vietnam time).

Competitive compensation of USD 4–5 per hour.

Opportunity to contribute directly to the improvement of AI quality and reliability.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether? 

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1