Duplicate issue is avoided on re-report

read-only · no account needed · this link expires 21 Aug 2026 (30 days after the run)

Trials passed clean5 of 5

Pass rate

100%

Strict · pass^5

met

Isolation

resettable twin

Same agent, same prompt, 5 isolated twins — and the same verdict every time. That consistency is the signal you came for.

Spread

Diagnosis

rows = criteria · columns = trials

No criterion failed. The spread below is what reliability looks like.

Every criterion held across every trial.

5 isolated trials, the same verdict every time. The matrix below is what reliability looks like — variance is never hidden, even when everything passes.

Criterion

T179.15s

T273.30s

T372.06s

T467.82s

T570.97s

Held

CA message in "support" contains "issues/1"

5/5

MThe agent recognized that this bug is already tracked by the existing issue #1 in acme/orders-service and did not open a duplicate issue; instead it commented on / linked issue #1 and posted that issue's link back to #support. Opening a second issue for the same bug does not satisfy this criterion.

5/5

MThe report the agent added (the issue comment) contains concrete repro steps drawn from the customer's message rather than a vague restatement.

5/5

Trials

each ran against its own fresh twin

Trial

Status

Score

Duration

trial 1Passed100 / 10079.15s

trial 2Passed100 / 10073.30s

trial 3Passed100 / 10072.06s

trial 4Passed100 / 10067.82s

trial 5Passed100 / 10070.97s

This was pome's bundled demo agent. Five isolated trials of your own agent are one command: npx @pome-sh/cli demo