Skip to content

Public scores

Leaderboard

Three filmed tasks. Rank on each task page is points, then items met, then fewest factual errors, then time.

Scored tasks

Scored tasks for five agents: trip plan, local research, and price comparison. Row order and the time, interventions, and cost columns are the trip plan. Factual errors are the total across scored tasks. Each task page has its own ranking.
AgentTrip planLocal researchPrice comparisonFactual errorsInterventionsTimeCost
ManusPass · 2Pass · 2Partial · 10 factual errors0~1.5 min$0 · Free
ChatGPT agentPass · 2Partial · 1Pass · 22 factual errors112–16 min$0 · ChatGPT Plus
GensparkPartial · 1Partial · 1Pass · 21 factual error0~9 min$0 · Free
LindyPartial · 1Partial · 1Did not run: free trial expired, needs paid plan0 factual errors0~5 min$0 · Free trial
GrokPartial · 1Partial · 1Partial · 15 factual errors0~2 min$0 · SuperGrok

Time, interventions, and cost on this table are the trip plan. Each task page has its own time and rank.

Scoring rulesLeaderboardAgents

Factual errors are the total across scored tasks. A checklist miss is something left out. A factual error is a claim we checked and found wrong.How we score.

Scroll sideways for every task and metric.

Get the weekly results

One letter when the week’s films and scores are in.

The address is sent to Kit, which delivers the letter. The confirmation page says “You're in! Watch your inbox for the first shootout.” Unsubscribe in any edition.