Senior Test Lead (AI Governance Platform)

The AI Control Tower is running a Proof of Concept (PoC) and subsequent rollout of an AI governance platform, evaluating Holistic AI and Airia LLC against a defined set of functional, technical, and compliance requirements. The QA Specialist owns test strategy, execution, and defect management across this process — ensuring the selected platform performs as required before and after full deployment, and that evidence of that performance is documented and defensible.

Daily tasks

• Translate the AI Control Towers functional and technical requirements into detailed, traceable test cases and scenarios.
• Plan, execute, and document test cycles across the PoC (installation, functional, integration, performance, and security testing).
• Validate vendor self-assessment responses against the requirements checklist and flag gaps or discrepancies.
• Support and verify endpoint installation testing across the pilot user cohort (up to 50% of end users during PoC).
• Test and confirm core governance capabilities — runtime AI governance, risk/impact evaluation, monitoring and observability — behave as specified.
• Log, prioritize, and track defects and issues through resolution, coordinating directly with vendors technical teams.
• Coordinate with dependent teams within RO to align on resource needs and testing dependencies after each submission milestone.
• Contribute to defining the Definition of Done (DoD) and Definition of Ready (DoR) for the team's Kanban board.
• Support User Acceptance Testing (UAT) with the pilot end-user cohort and capture structured feedback.
• Verify that audit trails, logs, and compliance reporting outputs meet Roche's evidentiary and regulatory needs.
• Prepare clear, concise QA status reporting for AI Control Tower stakeholders, procurement, and leadership.

Requirements

Bachelor degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent practical experience). 3+ years of QA / software testing experience, ideally involving enterprise platform rollouts or vendor PoCs. Demonstrated experience writing test plans and test cases directly from functional and technical requirements. Working experience with defect/issue tracking tools (e.g., Jira) and Kanban-based ways of working. Strong analytical skills with high attention to detail and clear written documentation. Fluent English, written and spoken; comfortable working with cross-functional and multi-vendors teams. Test planning, execution, and requirements traceability. Defect management and root-cause coordination with vendors. Stakeholder communication across business, procurement, and technical teams. Structured, evidence-based reporting. Comfort operating with ambiguity in a fast-moving, PoC-stage environment.

Nice to have : Prior exposure to AI/ML systems, AI governance, or model-risk testing. Familiarity with recognized AI governance frameworks Experience in a regulated industry (e.g., pharmaceutical) Experience testing endpoint-deployed software across a large, distributed user base. Agile/Scrum or Kanban delivery experience within a small, cross-functional team.

Must have: Testing, AI, SaaS, QA, Test strategy, Test case, Security, Kanban, User acceptance testing, UAT, Audit, Degree, Jira, Analytical skills

Nice to have: ML, Agile, Scrum