QA Engineer Python

Together with our Partner, an American fitness equipment manufacturer, we are looking for a person to provide services as a QA Engineer (Python).

The project involves building an advanced next-generation training platform, integrating artificial intelligence, wearable device data, and personalized health plans.

WE OFFER:

• A new way to apply with AI Recruiter (AIR) – during the process, you can talk to a virtual recruiter 24/7, without waiting for a phone call. The final decision is always made by the Project Manager.
• Cooperation in a project-based model, with settlement based on stages and acceptance protocols for individual deliverables.
• Support from Connectis regarding administrative and billing matters related to the cooperation.
• Participation in industry events and technological meetups.
• 5,000 PLN for referring friends to our projects.
• Flexible B2B cooperation model.
• 100% remote service delivery.
• Fast and remote process.

Thank you for all applications. We would like to inform you that we will contact selected individuals.

13523/RJ

Daily tasks

• Tracking and reporting quality metrics (coverage, escape rate, flake rate, suit duration) and collaborating on quality incident triage with the client-side QA team.
• Designing testing approaches for non-deterministic AI results, assertions on schemas and contracts, checking invariants, and evaluation on golden sets.
• Logging, tracking, and retesting defects in Jira and maintaining test cases in TestRail with mapping of automated results.
• Integrating test suits with CI/CD pipelines as quality gates for releases, including running cross-device tests on iOS and Android.
• Creating and maintaining tools for test data management, initiating, seeding, and teardown using API helpers.
• Designing, building, and maintaining automated test suits covering mobile E2E, API, and regression tests.

Requirements

• Minimum 3 years of experience in QA, including 1+ year in API test automation on production systems, using Python, pytest, and fixtures, and experience in creating and maintaining test code.
• Practical knowledge of contract testing with Pact (consumer-driven contracts) and API security testing, including authorization boundaries, token handling, malformed/hostile input.
• Knowledge of HTTP, REST, JSON, statuses, headers, and auth tokens, as well as practical experience in API testing using Postman and Swagger/OpenAPI.
• Experience in testing AI/LLM solutions, including working with datasets, golden sets, quality metrics, prompt engineering, regression assessment, hallucinations, and prompt injection, as well as defining criteria for non-deterministic results.
• Knowledge of backend (logs, database queries), Git (branches, pull requests, code reviews), and TestRail (test cases, run tracking).
• Experience working with Android/iOS mobile products.
• Very good knowledge of English (min. C1).

Nice to have:

• Knowledge of Langfuse, LangSmith, or Phoenix, working with traces and attaching evaluations.
• Experience with LangGraph, testing agents as state graphs, both single nodes and full flows.
• Knowledge of Python with Appium, mobile test automation as a complement to API testing.

Must have: Python, HTTP, API testing, REST, JSON, Postman, Swagger, Git, TestRail, LLM

Nice to have: OpenAPI, Langfuse, LangGraph, Appium