Head to head
ChatGPT agent vs Grok
ChatGPT agent finished ahead on 3 of 3 shared tasks. ChatGPT agent has 2 factual errors across scored tasks. Grok has 5 factual errors.
Ahead means a better rank on a task both agents ran. Rank is points, then items met, then fewest factual errors, then time.
| Task | ChatGPT agent | Grok |
|---|---|---|
| #1 Trip plan | Pass · 8/8 · 0 factual errorsAhead Rank 2 · 12–16 min · 2 pts | Partial · 6/8 · 1 factual error Rank 5 · ~2 min · 1 pts |
| #2 Local research | Partial · 7/8 · 1 factual errorAhead Rank 4 · 0.6 min · 1 pts | Partial · 5/8 · 1 factual error Rank 5 · ~1.2 min · 1 pts |
| #3 Price comparison | Pass · 8/8 · 1 factual errorAhead Rank 1 · 1.3 min · 2 pts | Partial · 7/8 · 3 factual errors Rank 4 · ~1.2 min · 1 pts |