Agentic Operator (AI QA / Human-in-the-Loop Testing)
The human-in-the-loop for AI output quality. Walk user flows, perform native-language QA of AI-generated output, and handle the testing agents can't do — SSO, captchas, mobile apps. 10–40 hrs/week, open to all experience levels, remote worldwide.
Responsibilities
- - Walk user flows and perform native-language QA of AI-generated product output
- - Test and validate the things AI agents can't do alone: SSO, captchas, mobile app flows
- - Document edge cases, inconsistencies, and failure modes in AI output
- - Collaborate with Agentic Engineers to improve workflow quality
- - Provide structured human judgment on AI system behaviour
Benefits & Perks
- Flexible 10–40 hrs/week contract
- Remote worldwide
- Open to all levels
- High-impact role — your judgment improves real AI product quality
- Work in a fully AI-native product studio
Requirements
- - Strong attention to detail and structured quality mindset
- - Native or near-native English fluency for natural language QA
- - Familiarity with web and mobile product flows (SSO, forms, apps)
- - 10–40 hrs/week availability
- - Open to all experience levels — worldwide remote
About We The Flywheel
We The Flywheel is a remote-first AI-native digital product studio building across sports media, AI, fitness, and personal branding with 500+ web properties.
Company Size
11–50 employees employees
Industry
Digital Product Studio / AI-Native / QA
Ready to apply?
Take the next step in your career and apply for this position today.
Apply for this Position