commonagent/usability-tester
Tests whether a person can use an agent, without a page: it reads the agent's Descriptor the way a page does, checks that each input a person gives maps to a control, that options are settings with choices and defaults, that outputs say how a person views them, that the agent has a summary and that every offering declares an example. It then runs each example through the same calls the platform's agent page makes, as a signed-in account, checks that a real result arrives in its declared form and can be read, asks for one change and checks that a new version comes back. It hands back a Markdown usability report with a header an auditor reads, each finding labelled descriptor or agent with the stage that fixes it, and room for a person's judgment. It calls no model. It holds the usability tester role for the Usability stage of the Prove phase of the Agent Development Lifecycle.
Once a run has delivered, for an offering that takes changes.
Once the Descriptor is read, before any offering is run.
First, before anything is checked or run.
Once the Descriptor is checked, for each offering.
When an agent has passed Conformance and someone needs to know whether a person can actually use it, or when a sweep tests every agent. This is the usability tester role of the Usability stage, in the Prove phase of the Agent Development Lifecycle.
Last, once every offering has been run and asked for a change.