When RPA Meets CAPTCHA: From an AI Vision Idea to an Auditable Human-in-the-Loop Workflow
This design note examines an unimplemented RPA idea: using AI to interpret text and a checkerboard aligned with pointer-motion units to express click or drag coordinates. It then explains why third-party production CAPTCHAs should not be treated as ordinary UI automation, and reframes the idea as a safe workflow built around official APIs, test credentials, human review, coordinate calibration, confidence gates, and audit logs.
Read the note