-
Notifications
You must be signed in to change notification settings - Fork 0
/
index.html
185 lines (182 loc) · 6.25 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
<!DOCTYPE html>
<html>
<head>
<link rel="stylesheet" type="text/css" href="css/bootstrap.css">
<link rel="stylesheet" type="text/css" href="css/style.css">
<link href="https://fonts.googleapis.com/css?family=Raleway:100,200,300,400,500,600,700,800,900" rel="stylesheet">
<link rel="stylesheet" href="css/fontAwesome.css">
<title> META-GUI - Towards Multi-modal Conversational Agents on Mobile GUI </title>
</head>
<body>
<header class="header">
<div class="container clearfix">
<div class="left-container">
<a href="#"> META-GUI </a>
</div>
<div class="right-container">
<ul class="nav-menu clearfix">
<li>
<a href="#"> Home </a>
<li>
</ul>
</div>
</div>
</header>
<section class="banner">
<div class="container clearfix">
<h1> META-GUI </h1>
<span> Towards Multi-modal Conversational Agents on Mobile GUI </span>
<a href="https://huggingface.co/datasets/X-LANCE/META-GUI" class="download-hyperlink"><button class="download-button">
<i class="fa fa-arrow-circle-o-down" aria-hidden="true"></i> Download
</button>
</a>
</div>
</section>
<section class="main-content">
<div class="container clearfix">
<div class="row">
<div class="col-md-5">
<div class="info-container">
<span class="info-title">
<i class="fa fa-info-circle" aria-hidden="true"></i>
What is META-GUI?
</span>
<p>
META-GUI is a dataset for training a <strong>M</strong>ulti-modal conv<strong>E</strong>rsa<strong>T</strong>ional <strong>A</strong>gent on mobile <strong>GUI</strong>. It consists of 1125 dialogues, 4684 dialogue turns and 18337 data points in total. Each data point contains screenshot history, action history, dialogue history, items appeared on the current screen and actions to be performed.
</p>
<button class="action-button" style="display: none;">
Button 1
</button>
<button class="inverse-button" style="display: none;">
Button 2
</button>
<span class="info-title">
<i class="fa fa-star-o" aria-hidden="true"></i>
News
</span>
<p class="row">
<span class="news-date col-md-2"> Oct 6, 2022 </span>
<span class="news-context"> Our paper is accepted by EMNLP 2022, dataset and baseline are listed below. </span>
<span class="news-context"> Dataset is available on </span>
<a href="https://huggingface.co/datasets/X-LANCE/META-GUI" class="download-link">
<i class="fa fa-amazon" aria-hidden="true"></i>
Download from huggingface
</a>
<span class="news-context"> Baseline is available on </span>
<a href="https://github.com/X-LANCE/META-GUI-baseline" class="download-link">
<i class="fa fa-github" aria-hidden="true"></i>
META-GUI Baseline
</a>
</p>
<span class="info-title">
<i class="fa fa-question-circle-o" aria-hidden="true"></i>
Contact Us
</span>
<p>
If you have any questions about this dataset, please contact
<a href="mailto:[email protected]">[email protected]</a>,
<a href="mailto:[email protected]">[email protected]</a> or
<a href="mailto:[email protected]">[email protected]</a>
</p>
</div>
</div>
<div class="col-md-7">
<div class="info-container">
<span class="info-title">
<i class="fa fa-bar-chart" aria-hidden="true"></i>
Leaderboard
</span>
<p>
Three metrics, i.e. Action Completion Rate (CR), Turn Completion Rate, and Reply BLEU score, are used to evaluate on the test set of META-GUI. Please refer to the paper to find more details about evaluation metrics.
</p>
<table class="leader-board">
<tbody>
<tr>
<th> Rank </th>
<th> Model </th>
<th> Action CR </th>
<th> Turn CR </th>
<th> Reply BLEU score </th>
</tr>
<tr>
<td>
1
<span>
Oct 06, 2022
</span>
</td>
<td>
m-BASH
<p> Shanghai Jiao Tong University </p>
<a class='link' href='https://arxiv.org/abs/2205.11029'> (Sun et al., EMNLP'22) </a>
<a class='link' href='https://github.com/X-LANCE/META-GUI-baseline'> code </a>
</td>
<td class="stat"> 82.74 </td>
<td class="stat"> 56.88 </td>
<td class="stat"> 63.11 </td>
</tr>
<tr>
<td>
2
<span>
Oct 06, 2022
</span>
</td>
<td>
BERT
<p> Shanghai Jiao Tong University </p>
<a class='link' href='https://arxiv.org/abs/2205.11029'> (Sun et al., EMNLP'22) </a>
<a class='link' href='https://github.com/X-LANCE/META-GUI-baseline'> code </a>
</td>
<td class="stat"> 78.42 </td>
<td class="stat"> 52.08 </td>
<td class="stat"> 62.19 </td>
</tr>
<tr>
<td>
3
<span>
Oct 06, 2022
</span>
</td>
<td>
LayoutLM
<p> Shanghai Jiao Tong University </p>
<a class='link' href='https://arxiv.org/abs/2205.11029'> (Sun et al., EMNLP'22) </a>
<a class='link' href='https://github.com/X-LANCE/META-GUI-baseline'> code </a>
</td>
<td class="stat"> 67.76 </td>
<td class="stat"> 38.12 </td>
<td class="stat"> 50.43 </td>
</tr>
<tr>
<td>
4
<span>
Oct 06, 2022
</span>
</td>
<td>
LayoutLMv2
<p> Shanghai Jiao Tong University </p>
<a class='link' href='https://arxiv.org/abs/2205.11029'> (Sun et al., EMNLP'22) </a>
<a class='link' href='https://github.com/X-LANCE/META-GUI-baseline'> code </a>
</td>
<td class="stat"> 64.48 </td>
<td class="stat"> 36.88 </td>
<td class="stat"> 58.20 </td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</section>
<section class="footer clearfix">
<a href="http://x-lance.sjtu.edu.cn/"> SJTU X-LANCE Lab<a>
</section>
<script src="js/jquery-1.11.2.min.js"></script>
<script type="text/javascript" src="js/footer.js"></script>
</body>
</html>