-
Notifications
You must be signed in to change notification settings - Fork 0
/
thresh.yml
91 lines (79 loc) · 2.21 KB
/
thresh.yml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
template_name: info-loss
template_label: Information Loss
template_description: Annotating information loss in text simplification.
instructions: |
1. Read both the original and simplified text
2. Compare the two texts and highlight
- Omissions from the original, and
- Imprecise/fuzzy concepts in the simplification
3. For each highlight, write a Q/A pair that re-introduces the information in lay language.
Please refer to the full guidelines for examples.
font_size:
source: 14
target: 14
interface_text:
typology:
source_label: "Original"
target_label: "Simplification"
display:
- side-by-side
- text-side-by-side
- disable-lines
# "Edits" are our units of annotations. First, edits are selected, then annotated.
edits:
- name: omission
label: "Omission"
enable_input: true
enable_output: false
type: multi_span
color: red
icon: fa-circle-minus
annotation:
- name: question
label: "Question"
question: "A question that would elicit the omitted information."
options: textarea
required: true
- name: answer
label: "Answer"
question: "The answer to the question"
options: textarea
required: true
- name: comment
label: "Comment"
question: "Comment (optional)"
options: textbox
required: false
- name: concept
label: "Fuzzy Concept"
enable_input: true
enable_output: true
type: multi_span
color: orange
icon: fa-flask
annotation:
- name: question
label: "Question"
question: "A question that would make the concept more concrete."
options: textarea
required: true
- name: answer
label: "Answer"
question: "The answer to the question."
options: textarea
required: true
- name: comment
label: "Comment"
question: "Comment (optional)"
options: textbox
required: false
- name: comment
label: "Comment"
color: gray
icon: fa-ellipsis
annotation:
- name: comment_text
label: "Comment"
question: "Any remarks regarding the annotation of this sample?"
options: textarea
required: true