Skip to content

Commit

Permalink
add more data and record
Browse files Browse the repository at this point in the history
  • Loading branch information
tangxiangru committed Jun 2, 2022
1 parent d3f4852 commit 565dd20
Show file tree
Hide file tree
Showing 44 changed files with 429 additions and 0 deletions.
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 1-5 .csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 12:34:05 PM AST","AAQATZZDPD9DW","5","Summary 4","Summary 3","Summary 1","Summary 2","Summary 4","Summary 1","Summary 1","Summary 4","Summary 4","Summary 3","No"
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 11-15.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/09 7:02:44 AM AST","A35UPRWU1QWP2F","4","Summary 1","Summary 4","Summary 4","Summary 3","Summary 4","Summary 1","Summary 4","Summary 1","Summary 3","Summary 4","No comments"
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 16-20.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 12:30:52 PM AST","A1TIZIFU19WTDU","5","Summary 3","Summary 4","Summary 3","Summary 4","Summary 1","Summary 4","Summary 1","Summary 2","Summary 2","Summary 3","Thank you, I hope I did this right the first time and that is why you are asking me to complete it again! Good luck with your research. "
6 changes: 6 additions & 0 deletions interval_test/bws/BWS 21-25.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/09 3:18:04 PM AST","A175ZK7MB3GR5Y","5","Summary 1","Summary 2","Summary 4","Summary 3","Summary 1","Summary 2","Summary 2","Summary 1","Summary 4","Summary 3","I hope this new attempt to complete this survey works better than the last attempt. Thank you for letting me try again."
"2021/05/09 10:37:57 PM AST","A1XQI8HC0E56OX","5","Summary 1","Summary 4","Summary 1","Summary 3","Summary 2","Summary 3","Summary 3","Summary 4","Summary 4","Summary 3","I was requested to submit this form again via email (The Requester included this note:
We want you to attempt the same form a second time and will be giving you $2 bonus if you complete it. Link: {https://forms.gle/cyYZ19p9RPMYy4q78}.)

The HIT no longer exists in the MTurk database, so I cannot submit a HIT, but I am including this note so that I will be compensated. Thank you!"
3 changes: 3 additions & 0 deletions interval_test/bws/BWS 26-30 .csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 12:33:30 PM AST","ACKG8OU1KHKO2","5","Summary 4","Summary 2","Summary 2","Summary 3","Summary 2","Summary 4","Summary 3","Summary 2","Summary 1","Summary 4",""
"2021/05/09 7:09:45 AM AST","A34SUZWGLXIWM8","5","Summary 4","Summary 1","Summary 1","Summary 2","Summary 1","Summary 4","Summary 4","Summary 2","Summary 2","Summary 1","No problems."
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 31-35.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 4:49:21 PM AST","AVD6HMIO1HLFI","5","Summary 2","Summary 1","Summary 2","Summary 1","Summary 4","Summary 3","Summary 3","Summary 4","Summary 1","Summary 3",""
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 41-45.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/09 9:06:54 PM AST","A2Y0WNHMT4PZ4C","5","Summary 4","Summary 3","Summary 1","Summary 2","Summary 3","Summary 2","Summary 4","Summary 2","Summary 1","Summary 2","Section 3 - all the monetary amounts were inaccurate as well as the number of homes effected. I chose #3 as my most factual even though the fine amount is incorrect but the rest of it was more accurate than the others."
4 changes: 4 additions & 0 deletions interval_test/bws/BWS 46-50.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 8:46:47 PM AST","A256FHXGSY0E5D","5","Summary 3","Summary 1","Summary 4","Summary 3","Summary 1","Summary 4","Summary 2","Summary 3","Summary 1","Summary 4",""
"2021/05/08 10:54:13 PM AST","A2F1AA15HG0FRU","5","Summary 3","Summary 2","Summary 2","Summary 1","Summary 1","Summary 4","Summary 1","Summary 3","Summary 2","Summary 4",""
"2021/05/09 6:09:52 PM AST","A37GOI3N77WX21","5","Summary 4","Summary 3","Summary 3","Summary 4","Summary 1","Summary 2","Summary 2","Summary 1","Summary 3","Summary 4","Great survey!"
4 changes: 4 additions & 0 deletions interval_test/bws/BWS 6-10.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 1:22:58 PM AST","AFRJKS3Z3H4CA","5","Summary 3","Summary 1","Summary 4","Summary 2","Summary 2","Summary 3","Summary 3","Summary 1","Summary 1","Summary 3","none"
"2021/05/08 2:39:24 PM AST","A2KBATQUTW8J5G","5","Summary 4","Summary 1","Summary 3","Summary 2","Summary 1","Summary 3","Summary 4","Summary 1","Summary 1","Summary 2","Thank you for the bonus opportunity. The task went well and there were no errors."
"2021/05/11 9:12:45 AM AST","AYUP53XD4O2LZ","5","Summary 4","Summary 1","Summary 2","Summary 4","Summary 4","Summary 3","Summary 3","Summary 4","Summary 1","Summary 2","no"
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 61-65.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 11:34:30 PM AST","A3KFFIBJZVM0J2","5","Summary 1","Summary 3","Summary 3","Summary 1","Summary 1","Summary 3","Summary 4","Summary 2","Summary 2","Summary 4","I'm not sure why I've been asked to complete the same tasks as I completed previously, for the same articles"
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 66-70.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 5:07:11 PM AST","A1VAL7L9L79IN0","5","Summary 3","Summary 2","Summary 1","Summary 3","Summary 1","Summary 3","Summary 3","Summary 2","Summary 2","Summary 4","No"
3 changes: 3 additions & 0 deletions interval_test/bws/BWS 71-75.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 2:01:24 PM AST","A2CWJRAEFZ44HU","5","Summary 3","Summary 2","Summary 3","Summary 1","Summary 4","Summary 1","Summary 4","Summary 3","Summary 2","Summary 4","reading english football news is like reading cuneiform tablets i have no idea what they're saying"
"2021/05/08 5:39:14 PM AST","A350SLJRMBIFM4","5","Summary 3","Summary 4","Summary 2","Summary 1","Summary 4","Summary 2","Summary 4","Summary 3","Summary 1","Summary 4","Thanks!"
3 changes: 3 additions & 0 deletions interval_test/bws/BWS 76-80.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 12:35:31 PM AST","A1P6OXEJ86HQRM","5","Summary 2","Summary 1","Summary 4","Summary 2","Summary 4","Summary 2","Summary 2","Summary 4","Summary 1","Summary 4","n/a"
"2021/05/08 7:28:55 PM AST","A1YTNGH5SMM2CJ","5","Summary 2","Summary 4","Summary 4","Summary 1","Summary 4","Summary 2","Summary 1","Summary 4","Summary 1","Summary 4","The questions were clear and I experienced no problems."
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 81-85.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/09 1:34:41 PM AST","A35CRYBHUZZZHO","5","Summary 4","Summary 1","Summary 3","Summary 1","Summary 1","Summary 3","Summary 4","Summary 2","Summary 2","Summary 4","No"
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 91-95.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/08 3:16:13 PM AST","A3RVHUY67SVXQV","5","Summary 4","Summary 1","Summary 2","Summary 3","Summary 3","Summary 4","Summary 1","Summary 3","Summary 2","Summary 4","I received an email that said I was to complete this form again, with only a link to the form and no link to an MTurk page to input any codes."
2 changes: 2 additions & 0 deletions interval_test/bws/BWS 96-100.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
"Timestamp","Turker ID","How well do you understand the instructions?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Which is the most factually consistent summary?","Which is the least factually consistent summary?","Any comments?"
"2021/05/11 2:52:50 PM AST","A2WVCXVSE0YGML","5","Summary 2","Summary 4","Summary 4","Summary 1","Summary 3","Summary 2","Summary 1","Summary 2","Summary 2","Summary 4","That was an interesting —and still difficult task— good luck with your research!"
26 changes: 26 additions & 0 deletions interval_test/bws_average_diff.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
{
"AAQATZZDPD9DW": 0.3,
"AFRJKS3Z3H4CA": 0.2,
"A2KBATQUTW8J5G": 0.1,
"AYUP53XD4O2LZ": 0.7,
"A35UPRWU1QWP2F": 0.4,
"A1TIZIFU19WTDU": 0.3,
"A175ZK7MB3GR5Y": 0.3,
"A1XQI8HC0E56OX": 0.5,
"ACKG8OU1KHKO2": 0.4,
"A34SUZWGLXIWM8": 0.2,
"AVD6HMIO1HLFI": 0.4,
"A2Y0WNHMT4PZ4C": 0.1,
"A256FHXGSY0E5D": 0.3,
"A2F1AA15HG0FRU": 0.2,
"A37GOI3N77WX21": 0.5,
"A3KFFIBJZVM0J2": 0.5,
"A1VAL7L9L79IN0": 0.6,
"A2CWJRAEFZ44HU": 0.6,
"A350SLJRMBIFM4": 0.4,
"A1P6OXEJ86HQRM": 0.2,
"A1YTNGH5SMM2CJ": 0.4,
"A35CRYBHUZZZHO": 0.5,
"A3RVHUY67SVXQV": 0.7,
"A2WVCXVSE0YGML": 0.3
}
1 change: 1 addition & 0 deletions interval_test/bws_output.json

Large diffs are not rendered by default.

Loading

0 comments on commit 565dd20

Please sign in to comment.