| A | B | C | D | E | F | G | H | I | |
|---|---|---|---|---|---|---|---|---|---|
1 | Comment here or email jingyuk@cs.cmu.edu to submit your work! Please attach how should the data looks like. | ||||||||
2 | Starting in September 2024, we require submissions to include raw trajectories (per-step observation and predicted action), to enhance transparency on the leaderboard. | ||||||||
3 | Release Date | Model Type | Model | Inputs | Success Rate (%) | Result Source | |||
4 | Human Baseline | Image | 88.70 | VisualWebArena | |||||
5 | 07/2025 | Multimodal (SoM) | Gemini 2.5 Flash | SoM | 54.0 | SGV | |||
6 | 10/2025 | Multimodal (SoM) | GPT-5 | SoM | 52.9 | WALT | |||
7 | 06/2026 | Caption-augmented | GLM-4-32B | Structured DOM Representation | 48.7 | WebChallenger | |||
8 | 09/2025 | Multimodal (SoM) | GPT-5 | SoM + Caption + Image | 36.5 | AWorld | |||
9 | 04/2026 | Multimodal | A3-Qwen3.5-9B | AXTree + Image | 33.7 | Agent-as-Annotators | |||
10 | 10/2024 | Multimodal (SoM) | GPT-4o + R-MCTS | SoM + Caption + Image | 33.7 | ExACT | |||
11 | 06/2024 | Multimodal (SoM) | GPT-4o + Search | SoM + Caption + Image | 26.4 | Tree Search for LM Agents | |||
12 | 11/2024 | Multimodal (SoM) | GPT-4o + WebDreamer | SoM + Caption + Image | 23.6 | WebDreamer | |||
13 | 06/2024 | Multimodal (SoM) | GPT-4o + ICAL | SoM + Caption + Image | 23.4 | ICAL | |||
14 | 06/2024 | Multimodal (SoM) | GPT-4o | SoM + Caption + Image | 19.78 | VisualWebArena | |||
15 | 06/2024 | Caption-augmented | Llama-3-70B + Search | AxTree + Caption | 16.7 | Tree Search for LM Agents | |||
16 | 01/2024 | Multimodal (SoM) | GPT-4V | SoM + Caption + Image | 16.37 | VisualWebArena | |||
17 | 01/2024 | Multimodal | GPT-4V | AXTree + Caption + Image | 15.05 | VisualWebArena | |||
18 | 01/2024 | Caption-augmented | GPT-4 + BLIP-2-T5XL | AxTree + Caption | 12.75 | VisualWebArena | |||
19 | 06/2024 | Multimodal (SoM) | Gemini-Pro-1.5 | SoM + Caption + Image | 11.98 | VisualWebArena | |||
20 | 05/2025 | Image-only | ViGoRL-7B | Image | 11.2 | ViGoRL | |||
21 | 06/2024 | Caption-augmented | Llama-3-70B-Instruct + BLIP-2-T5XL | AxTree + Caption | 9.78 | VisualWebArena | |||
22 | 01/2025 | Multimodal (SoM) | Qwen2-VL + ICAL | SoM + Caption + Image | 8.2 | ICAL | |||
23 | 01/2024 | Text-only | GPT-4 | AXTree | 7.25 | VisualWebArena | |||
24 | 06/2024 | Multimodal (SoM) | Gemini-Flash-1.5 | SoM + Caption + Image | 6.59 | VisualWebArena | |||
25 | 05/2025 | Image-only | ViGoRL-3B | Image | 6.4 | ViGoRL | |||
26 | 01/2024 | Multimodal | Gemini-Pro | AXTree + Caption + Image | 6.04 | VisualWebArena | |||
27 | 01/2024 | Multimodal (SoM) | Gemini-Pro | SoM + Caption + Image | 5.71 | VisualWebArena | |||
28 | 05/2025 | Image-only | Qwen-VL-7B | Image | 5.5 | ViGoRL | |||
29 | 01/2024 | Caption-augmented | Gemini-Pro + BLIP-2-T5XL | AxTree + Caption | 3.85 | VisualWebArena | |||
30 | 01/2024 | Caption-augmented | GPT-3.5 + BLIP-2-T5XL | AxTree + Caption | 2.97 | VisualWebArena | |||
31 | 01/2025 | Multimodal (SoM) | Qwen2-VL | SoM + Caption + Image | 2.9 | ICAL | |||
32 | 01/2024 | Caption-augmented | GPT-3.5 + LLaVa-7B | AxTree + Caption | 2.75 | VisualWebArena | |||
33 | 01/2024 | Text-only | GPT-3.5 | AXTree | 2.20 | VisualWebArena | |||
34 | 01/2024 | Text-only | Gemini-Pro | AXTree | 2.20 | VisualWebArena | |||
35 | 01/2024 | Caption-augmented | Mixtral-8x7b + BLIP-2-T5XL | AxTree + Caption | 1.87 | VisualWebArena | |||
36 | 01/2024 | Text-only | Mixtral-8x7B | AXTree | 1.76 | VisualWebArena | |||
37 | 01/2024 | Text-only | Llama-2-70B | AXTree | 1.10 | VisualWebArena | |||
38 | 01/2024 | Multimodal (SoM) | IDEFICS-80B-Instruct | SoM + Caption + Image | 0.99 | VisualWebArena | |||
39 | 01/2024 | Multimodal | IDEFICS-80B-Instruct | AXTree + Caption + Image | 0.77 | VisualWebArena | |||
40 | 01/2024 | Caption-augmented | Llama-2-70B + BLIP-2-T5XL | AxTree + Caption | 0.66 | VisualWebArena | |||
41 | 01/2024 | Multimodal (SoM) | CogVLM | SoM + Caption + Image | 0.33 | VisualWebArena | |||
42 | 01/2024 | Multimodal | CogVLM | AXTree + Caption + Image | 0.33 | VisualWebArena | |||
43 | |||||||||