ABCDEFGHIJKLMNOPQRSTUVWXYZAA
1
Release DateModelResult SourceModel SizeScreen
Representation		Success Rate
(pass@1)
2
12/2025AutoGLM-Phone-9B-MultilingualOpen-AutoGLM9BScreenshot47.7
3
8/2025AutoGLM-MobileAutoGLM-Mobile9BScreenshot + XML46.8
4
07/2025MobileUseMobileUse72BScreenshot44.2
5
5/2025UI-Genie-AgentUI-Genie-Agent72BScreenshot + XML41.2
6
3/2025V-Droid (Llama8B)V-Droid Paper8BXML38.3
7
10/2024AutoGLM-2024-10AutoGLM-Screenshot + XML36.2
8
10/2024GPT-4o-2024-11-20AndroidLab-Screenshot31.2
9
10/2024GPT-4o-2024-11-20AndroidLab-XML25.4
10
10/2024LLaMA3.1-8B(ft)AndroidLab8BXML23.9
11
10/2024GLM4-9B(ft)AndroidLab9BXML21.0
12
10/2024Gemini-1.5-ProAndroidLab-XML18.8
13
10/2024Gemini-1.5-ProAndroidLab-Screenshot16.7
14
15
16
17
Email xu-yf23@mails.tsinghua.edu.cn to submit your result!
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100