Skip to content

Agents

ChatGPT agent

ChatGPT agent on Agent Shootout: 1 first-place finish, pass rate 2/3, 2 factual errors, across 3 filmed tasks.

Wins
1
Pass rate
2/3
Tasks run
3
Interventions
1
Factual errors
2

A win is a first-place finish. Pass rate is passes divided by tasks run. Points across those tasks: 5.

Every result

ChatGPT agent on every scored shootout.
TaskRankResultItemsTimePts
#1 Trip planWork (GPT-6.1)2Pass8/8 · 0 factual errors12–16 min2
#2 Local researchWork (GPT-6.1 Sol, Light)4Partial7/8 · 1 factual error0.6 min1
#3 Price comparisonWork (GPT-6.1 Sol, Light)1Pass8/8 · 1 factual error1.3 min2

Notes

  • Trip plan

    Real prices and exact flight link; all 3 options share the same Southwest flights. One click to allow browsing.

    0 factual errors

  • Local research

    Fastest by far (36 s) with exact Birdeye pages that match to the review, but its top pick’s license number (L.27865) belongs to an unrelated contractor in Benson.

    • Gave Comfort Monster the license number L.27865. That number belongs to an unrelated contractor in Benson. The firm's number is L.24034.
  • Price comparison

    Fast, clean table and a sound pick: Best Buy ($119.99). Its $119.00 Walmart marketplace offer (Athena's Amazing Finds) could not be found on the page, so prices are flagged. The Walmart seller was unverified, so seller and return window is flagged. Run

    • Cited a $119.00 Walmart price from Athena's Amazing Finds. That offer was not on the page.

Head to head

  • ChatGPT agent vs ManusManus finished ahead on 2 of 3 shared tasks. Manus has 0 factual errors across scored tasks. ChatGPT agent has 2 factual errors.
  • ChatGPT agent vs GensparkChatGPT agent finished ahead on 2 of 3 shared tasks. ChatGPT agent has 2 factual errors across scored tasks. Genspark has 1 factual error.
  • ChatGPT agent vs GrokChatGPT agent finished ahead on 3 of 3 shared tasks. ChatGPT agent has 2 factual errors across scored tasks. Grok has 5 factual errors.
  • ChatGPT agent vs LindyChatGPT agent and Lindy split the shared tasks, 1 apiece. ChatGPT agent has 2 factual errors across scored tasks. Lindy has 0 factual errors. Lindy did not run the price comparison.