-
Notifications
You must be signed in to change notification settings - Fork 4
/
Changelog
365 lines (258 loc) · 11.4 KB
/
Changelog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
2024-12-18 Danyang Zhang <[email protected]>
v4.1
Fixed a few essential bugs.
* (cache_until mechanism): The roles of waiting nodes and notifier nodes
in cache_until mechanism are in reverse. Fixed.
* android_env/components/task_manager.py
* (Event sources resetting): Event sources are not correctly reset during
task resetting. Fixed.
* android_env/components/task_manager.py
* (Events resetting): Events may be triggered mistakenly by the stale
emulator status owing to the delay of emulator. Fixed.
* android_env/components/coordinator.py
* android_env/environment.py
Fixed minor bugs.
* (Requirements of Gymnasium and dm-env): Gymnasium and dm-env are marked
as optional dependences, however they are imported in the wrappers module
as required sections. Fixed.
* android_env/wrappers/__init__.py
* (Crash when meeting unseen special tokens): The old behavior will crash
when meeting special tokens from the tokenizer. Now the new behavior is to
ignore them directly.
* android_env/components/task_manager.py
Migrated logging system from absl to the embedded logging module.
Updated the template toolkit to enable non-automatic concatenation of
sub-task commands.
2024-07-14 Danyang Zhang <[email protected]>
v4.0
Fixed bugs
Minor updates
2024-06-21 Danyang Zhang <[email protected]>
Enabled UTF-8 input
* android_env/components/adb_controller.py
* android_env/components/coordinator.py
* android_env/components/simulators/base_simulator.py
* android_env/components/simulators/emulator/emulator_simulator.py
* android_env/components/simulators/remote/remote_simulator.py
* android_env/components/simulators/remote/daemon.py
* android_env/components/task_manager.py
Updated server.py with new flags to work with RemoteSimulator
* tools/annotation-tool/backend/server.py
2024-06-18 Danyang Zhang <[email protected]>
Added cache_until field for event slots to enable more flexible control of
event clearing, so that now one can temporarily cache the flag and value
of an event for a while until the waited events are ready as well.
* android_env/proto/task.proto
* android_env/components/event_listeners.py
* android_env/components/task_manager.py
Added null_listener for convinience if one wants to calculate some
intermediate value without sending it to a real slot.
* android_env/proto/task.proto
* android_env/components/task_manager.py
2024-06-10 Danyang Zhang <[email protected]>
v4.0b1
Added ADB action to VhIoWrapper and TapActionWrapper
* android_env/wrappers/vh_io_wrapper.py
* android_env/wrappers/tap_action_wrapper.py
Added adb_output component to the observation
* android_env/components/specs.py
* android_env/components/coordinator.py
* android_env/components/simulators/base_simulator.py
* android_env/wrappers/vh_io_wrapper.py
* android_env/wrappers/tap_action_wrapper.py
2024-05-31 Danyang Zhang <[email protected]>
Added long click action to VhIoWrapper and TapActionWrapper.
* android_env/wrappers/vh_io_wrapper.py
* android_env/wrappers/tap_action_wrapper.py
Updated triggering rule of episode_end: now can pass a None through the
value to suppress the triggering.
* android_env/components/task_manager.py
2024-05-22 Danyang Zhang <[email protected]>
v4.0b
Added ADB action type.
* android_env/components/action_type.py
* android_env/components/specs.py
* android_env/components/coordinator.py
* android_env/components/simulators/base_simulator.py
Applied image compression before transferring in RemoteSimulator.
Currently, JPEG and PNG are supported.
* android_env/components/simulators/remote/daemon.py
* android_env/components/simulators/remote/remote_simulator.py
Enabled fuzzy match for text events. Enabled threshold triggering for
fuzzy match modes.
* android_env/proto/task.proto
* android_env/components/event_listeners.py
* android_env/components/task_manager.py
Migrated from dm_env to interfaces, so that we can distinguish successful,
failed, and truncated episode ends. Migrated from Gym to Gymnasium.
* New protocols
* android_env/interfaces/timestep.py
* android_env/interfaces/specs.py
* android_env/interfaces/env.py
* android_env/interfaces/__init__.py
* Updated basic interfaces
* android_env/components/coordinator.py
* android_env/components/task_manager.py
* android_env/components/specs.py
* android_env/environment.py
* Migrated wrappers
* android_env/wrappers/base_wrapper.py
* android_env/wrappers/discrete_action_wrapper.py
* android_env/wrappers/flat_interface_wrapper.py
* android_env/wrappers/float_pixels_wrapper.py
* android_env/wrappers/gym_wrapper.py
* android_env/wrappers/image_rescale_wrapper.py
* android_env/wrappers/last_action_wrapper.py
* android_env/wrappers/recorder_wrapper.py
* android_env/wrappers/tap_action_wrapper.py
* android_env/wrappers/vh_io_wrapper.py
* Updated examples and tools
* examples/run_human_agent.py
* examples/run_random_agent.py
* tools/annotation-tool/backend/server.py
* New wrapper for back-compatibility
* android_env/wrappers/dmenv_wrapper.py
* android_env/wrappers/__init__.py
2024-04-30 Danyang Zhang <[email protected]>
v3.6
Updated documents.
2024-03-25 Danyang Zhang <[email protected]>
Fixed bugs
* (Bugs caused by new remote_path arg): android_env/environment.py
* (Typos, bugs w.r.t. new episode end event, removed reset steps which
cause AVD haulting): demos/openmoneybox.add_billings.textproto
* (Bugs w.r.t null VH from OS): android_env/wrappers/vh_io_wrapper.py
Updated new types of ADB operations for SetupStep
* android_env/proto/adb.proto
* android_env/components/setup_step_interpreter.py
Updated new modifiers
* tools/templates.toolkits/modifiers.py
* tools/templates.toolkits/modifiers-zh.lhs
* tools/templates.toolkits/modifiers-en.lhs
Updated syntax of .task config files
* tools/templates.toolkits/parse.py
2024-03-11 Danyang Zhang <[email protected]>
Added remote_path parameter to load_remote functions.
* android_env/loader.py
* android_env/utils.py
* android_env/environment.py
2023-12-10 Danyang Zhang <[email protected]>
v3.5
* Fixed a vulnerability of axios dependency of annotation-tool frontend
* Updated mechanism to stablize the screen showing on the web interface of
annotation-tool
* Added new commandline options to annotation-tool
2023-12-10 Danyang Zhang <[email protected]>
v3.4
Improvement of RemoteSimulator
* Fixed bugs of install_apk action caused by different paths on local and
remote machine
* android_env/components/simulators/remote/remote_adb_controller.py
* Updated with action batch function to reduce total time delay of a
composite action
* android_env/environment.py
* android_env/components/coordinator.py
* android_env/components/simulators/base_simulator.py
* android_env/components/simulators/emulator/emulator_simulator.py
* android_env/components/simulators/remote/daemon.py
* android_env/components/simulators/remote/remote_simulator.py
* Added resizing function to reduce transferred bits
* android_env/components/simulators/remote/daemon.py
* android_env/components/simulators/remote/remote_simulator.py
* android_env/loader.py
2023-12-10 Danyang Zhang <[email protected]>
v3.3
Minor updates to platform.
* android_env/wrappers/tap_action_wrapper.py: Reconditioned
TapActionWrapper to support SCROLL, TYPE actions.
* android_env/wrappers/vh_io_wrapper.py: Fixed several bugs.
* android_env/components/tools/easyocr_wrapper.py: Updated a new argument
to enable construct a wrapper based on an existing EasyOCR reader.
Miscellaneous.
* (Updated command line arguments to visualize_pickle.py)
* tools/annotation-tool/pkl_tools/visualization.py
* tools/annotation-tool/pkl_tools/visualize_pickle.py
2023-12-01 Danyang Zhang <[email protected]>
v3.2
Enabled multiple check methods for ResponseEvent
Fixed bugs w.r.t. ResponseEvent
Updated episode end event slots by making it triggered only when the
returned value is True
* android_env/proto/task.proto
* android_env/components/event_listeners.py
* android_env/components/task_manager.py
* android_env/components/sbert_holder.py
* android_env/loader.py
Updated annotation tool to support ResponseEvent
* tools/annotation-tool/backend/server.py
* tools/annotation-tool/frontend/src/components/ImageSimulator.vue
* tools/annotation-tool/frontend/src/components/Session.vue
2023-11-29 Danyang Zhang <[email protected]>
v3.1
Optimized management of VH check and screen check.
* (Dedicated thread): Separated VH check from DumpsysThread into a
dedicated ViewHierarchyAnalyzerThread
* android_env/components/vh_analyzer_thread.py
* android_env/components/dumpsys_thread.py
* android_env/components/app_screen_checker.py
* (Flexible control of invocation): Enabled several methods to control
invocation for time-consuming screen check and VH check. Updated new
parameters of load and load_remote functions.
* android_env/components/task_manager.py
* android_env/components/coordinator.py
* android_env/loader.py
Migrated the branch of annotation tool to the master branch. The original
annotation tool branch is deprecated.
* android_env/wrappers/__init__.py
* android_env/wrappers/recorder_wrapper.py
* tools/annotation-tool/backend/server.py
Fixed bugs w.r.t. EasyOCRWrapper, screen check, template tool, etc.
* android_env/components/tools/easyocr_wrapper.py: Fixed bugs.
* tools/templates.toolkits/modifiers.py: Fixed error of remove_howto modifier.
* (Fixed bugs of AndroidEnv.add_task)
* android_env/environment.py
* tools/annotation-tool/backend/server.py
* android_env/components/coordinator.py: Fixed type error of response
component in the action dict.
* (Supplemented several logging lines)
2023-10-31 Danyang Zhang <[email protected]>
v3.0
* (VH node specification): Migrated VH node specification to
Mobile-Env-customized CSS selector (me-selector).
* (Repeatability control for event slots): Added repeatability control to
event slots.
2023-09-21 Danyang Zhang <[email protected]>
v2.1
Added RemoteSimulator to support place Android Simulator to another remote
machine with KVM enabled.
Remote versions of simulator, adb controller, and log stream:
* android_env/components/simulators/remote/remote_simulator.py
* android_env/components/simulators/remote/remote_adb_controller.py
* android_env/components/simulators/remote/remote_log_stream.py
Daemon running on the remote simulator machine:
* android_env/components/simulators/remote/daemon.py
Remote version of load function:
* android_env/loader.py: added load_remote function.
2023-08-22 Danyang Zhang <[email protected]>
Document updated.
* Changelog: Added this file.
* TODO.md: Added it to note the future development plan.
Supplemented several demo of task definitions.
* demos/classic_2048.m.textproto
* demos/accessibility_forwarder_clock_set_timer.m.textproto
* demos/systemui_egg_land_default.m.textproto
* demos/openmoneybox.add_billings.textproto
2023-08-17 Danyang Zhang <[email protected]>
Updated two scripts for certificate unpinning to adapt to new version of
Android Simulator.
* tools/frida_setup.sh
* tools/syscert_setup.exp
2023-06-30 Danyang Zhang <[email protected]>
v2.0
* (New type of event source): Added ResponseEvent to support triggering
events from response to human user (RHU). See the updated documents.
* docs/env-usage-zh.md
* docs/task-definition-zh.md
* docs/env-usage-en.md
* docs/task-definition-en.md
* (PyPI release): Released on PyPI as mobile-env-rl.