AI test agents, from an automation prototype to live agents
My team built three live QA agents on the infrastructure team's shared agent framework: a test case analyzer, a test case creator, and a mobile data lookup that queries BigQuery directly instead of waiting on dashboards. The analyzer reviews existing test repos against best practices, and the creator writes new tests to the same standard.
They followed an automation prototype I designed, where AI drafts mobile tests and QA acts as the risk assessor and approval gate. It included a 13-file agent framework and a Jira epic with eight to nine child stories. It was first written up as a GitHub extension, but we decided to build on the infrastructure team's live agent setup instead, so the prototype never went to production.
- Impact
- On its first run, the analyzer found security problems in existing tests, including passwords stored in insecure places
- Role
- Designed the automation prototype; my team built the live agents
- Stack
- Appium, Java, TestNG, Bitrise, LambdaTest, GitHub Copilot
- Status
- Three agents built and deployed; the prototype did not ship

