kappa is 0.668457920080161
PA is 0.784275184275184
PE is 0.349329002891657
3 HELLO
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said utt1 utt2
annotator # 9 said
annotator # 10 said
4 Hi
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt3
annotator # 4 said
annotator # 5 said
annotator # 6 said utt3
annotator # 7 said
annotator # 8 said utt3
annotator # 9 said
annotator # 10 said
6 Ok
annotator # 0 said utt5
annotator # 1 said utt5
annotator # 2 said utt5
annotator # 3 said utt5
annotator # 4 said utt5
annotator # 5 said utt5
annotator # 6 said utt5
annotator # 7 said utt5
annotator # 8 said utt5
annotator # 9 said
annotator # 10 said utt5
8 I'm afraid I didn't understand you.
annotator # 0 said utt7
annotator # 1 said utt7
annotator # 2 said utt7
annotator # 3 said utt7
annotator # 4 said utt7
annotator # 5 said utt7
annotator # 6 said utt7
annotator # 7 said utt7
annotator # 8 said utt7
annotator # 9 said
annotator # 10 said utt7
9 WHERE ARE THE PEOPLE
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt8
annotator # 4 said
annotator # 5 said
annotator # 6 said utt8
annotator # 7 said utt8
annotator # 8 said
annotator # 9 said
annotator # 10 said
10 There are 2 groups-of-people at Exodus, 2 at Calypso, 2 at
Barnacle and 1 at Abyss
annotator # 0 said utt9
annotator # 1 said utt9
annotator # 2 said utt9
annotator # 3 said utt9
annotator # 4 said utt9
annotator # 5 said utt9
annotator # 6 said utt9
annotator # 7 said utt9
annotator # 8 said utt9
annotator # 9 said
annotator # 10 said utt9
12 There are 2 trucks and 1 helicopter at Delta
annotator # 0 said utt11
annotator # 1 said utt11
annotator # 2 said utt11
annotator # 3 said utt11
annotator # 4 said utt11
annotator # 5 said utt11
annotator # 6 said utt11
annotator # 7 said utt11
annotator # 8 said utt11
annotator # 9 said
annotator # 10 said utt11
13 USE A TRUCK [missed: TO] GET THE PEOPLE FROM CALYPSO
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt12
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
15 Ok
annotator # 0 said utt13 utt14
annotator # 1 said utt13 utt14
annotator # 2 said utt13 utt14
annotator # 3 said utt13 utt14
annotator # 4 said utt13 utt14
annotator # 5 said utt13 utt14
annotator # 6 said utt13 utt14
annotator # 7 said
annotator # 8 said utt13 utt14
annotator # 9 said
annotator # 10 said utt13 utt14
17 I'm afraid I didn't understand you.
annotator # 0 said utt16
annotator # 1 said utt16
annotator # 2 said utt16
annotator # 3 said utt16
annotator # 4 said utt16
annotator # 5 said utt16
annotator # 6 said utt16
annotator # 7 said utt16
annotator # 8 said utt16
annotator # 9 said
annotator # 10 said utt16
18 HOW_LONG
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt17
annotator # 4 said utt17
annotator # 5 said
annotator # 6 said utt17
annotator # 7 said utt17
annotator # 8 said
annotator # 9 said
annotator # 10 said
19 WILL THAT TAKE
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt17
annotator # 4 said
annotator # 5 said
annotator # 6 said utt17
annotator # 7 said utt17
annotator # 8 said
annotator # 9 said
annotator # 10 said
20 It will take 6 hours and 54 minutes
annotator # 0 said utt18 utt19
annotator # 1 said utt18 utt19
annotator # 2 said utt18 utt19
annotator # 3 said utt18 utt19
annotator # 4 said
annotator # 5 said utt18 utt19
annotator # 6 said utt18 utt19
annotator # 7 said utt18 utt19
annotator # 8 said utt18 utt19
annotator # 9 said
annotator # 10 said utt18 utt19
22 I'm sorry, but that input didn't make sense to me.
annotator # 0 said utt21
annotator # 1 said utt21
annotator # 2 said utt21
annotator # 3 said utt21
annotator # 4 said utt21
annotator # 5 said utt21
annotator # 6 said utt21
annotator # 7 said utt21
annotator # 8 said utt21
annotator # 9 said
annotator # 10 said utt21
23 WHAT IF WE WENT ALONG THE COAST INSTEAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt22
annotator # 4 said utt22
annotator # 5 said
annotator # 6 said utt22
annotator # 7 said utt22
annotator # 8 said
annotator # 9 said
annotator # 10 said
24 That option would take 8 hours and 52 minutes
annotator # 0 said utt23
annotator # 1 said utt23
annotator # 2 said utt23
annotator # 3 said utt23
annotator # 4 said utt24
annotator # 5 said utt23
annotator # 6 said utt23
annotator # 7 said utt23
annotator # 8 said utt23
annotator # 9 said
annotator # 10 said utt23
25 I [I mistakenly inserted] FORGET IT
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt24
annotator # 5 said utt23
annotator # 6 said utt23
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
26 Ok
annotator # 0 said utt25
annotator # 1 said utt25
annotator # 2 said utt25
annotator # 3 said utt25
annotator # 4 said utt25
annotator # 5 said utt25
annotator # 6 said utt25
annotator # 7 said utt25
annotator # 8 said utt25
annotator # 9 said
annotator # 10 said utt25
28 Ok
annotator # 0 said utt27
annotator # 1 said utt27
annotator # 2 said utt27
annotator # 3 said utt27
annotator # 4 said utt27
annotator # 5 said utt27
annotator # 6 said utt27
annotator # 7 said utt27
annotator # 8 said utt27
annotator # 9 said
annotator # 10 said utt27
29 LET'S USE A HELICOPTER INSTEAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said
annotator # 5 said
annotator # 6 said utt27
annotator # 7 said
annotator # 8 said utt27
annotator # 9 said
annotator # 10 said
30 Alright
annotator # 0 said utt29
annotator # 1 said utt29
annotator # 2 said utt29
annotator # 3 said utt29
annotator # 4 said utt29
annotator # 5 said utt29
annotator # 6 said utt29
annotator # 7 said utt29
annotator # 8 said utt29
annotator # 9 said
annotator # 10 said utt29
33 I'll get right on it
annotator # 0 said utt31
annotator # 1 said utt31 utt32
annotator # 2 said utt31 utt32
annotator # 3 said utt31 utt32
annotator # 4 said utt31 utt32
annotator # 5 said utt31 utt32
annotator # 6 said utt31 utt32
annotator # 7 said utt31 utt32
annotator # 8 said utt31 utt32
annotator # 9 said
annotator # 10 said utt31 utt32
35 Ok
annotator # 0 said utt34
annotator # 1 said utt34
annotator # 2 said utt34
annotator # 3 said utt34
annotator # 4 said utt34
annotator # 5 said utt34
annotator # 6 said utt34
annotator # 7 said utt34
annotator # 8 said utt34
annotator # 9 said
annotator # 10 said utt34
37 Your wish is my command
annotator # 0 said utt36
annotator # 1 said utt36
annotator # 2 said utt36
annotator # 3 said utt36
annotator # 4 said utt37
annotator # 5 said utt36
annotator # 6 said utt36
annotator # 7 said utt36
annotator # 8 said utt36
annotator # 9 said
annotator # 10 said utt36
39 Alright
annotator # 0 said utt38
annotator # 1 said utt38
annotator # 2 said utt38
annotator # 3 said utt38
annotator # 4 said utt38
annotator # 5 said utt38
annotator # 6 said utt38
annotator # 7 said utt38
annotator # 8 said utt38
annotator # 9 said
annotator # 10 said utt38
40 THAT LOOKS GOOD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt39
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
41 No problem
annotator # 0 said utt40
annotator # 1 said utt40
annotator # 2 said utt40
annotator # 3 said utt40
annotator # 4 said utt40
annotator # 5 said utt40
annotator # 6 said utt40
annotator # 7 said utt40
annotator # 8 said utt40
annotator # 9 said
annotator # 10 said utt40
43 The highlighted actions may need to be revised.
annotator # 0 said utt42
annotator # 1 said
annotator # 2 said
annotator # 3 said utt42
annotator # 4 said utt42
annotator # 5 said
annotator # 6 said utt42
annotator # 7 said
annotator # 8 said utt42
annotator # 9 said
annotator # 10 said
44 Ok
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt43
annotator # 5 said utt42
annotator # 6 said utt42
annotator # 7 said utt42
annotator # 8 said
annotator # 9 said
annotator # 10 said utt42
45 SEND_A [A mistakenly inserted] TRUCK TWO
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt38
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
46 ALONG THE COAST INSTEAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt38
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
47 Sorry, I don't know how to do that.
annotator # 0 said utt45 utt46
annotator # 1 said utt45 utt46
annotator # 2 said utt45 utt46
annotator # 3 said utt45 utt46
annotator # 4 said utt45 utt46
annotator # 5 said utt45 utt46
annotator # 6 said utt45 utt46
annotator # 7 said utt45 utt46
annotator # 8 said utt45 utt46
annotator # 9 said
annotator # 10 said utt45 utt46
48 SEND TRUCK TWO
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt47
annotator # 4 said utt47
annotator # 5 said
annotator # 6 said utt47
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
49 ALONG THE COAST INSTEAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt47
annotator # 4 said utt47
annotator # 5 said
annotator # 6 said utt47
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
50 Done
annotator # 0 said utt48 utt49
annotator # 1 said utt48 utt49
annotator # 2 said utt48 utt49
annotator # 3 said utt48 utt49
annotator # 4 said utt48 utt49
annotator # 5 said utt48 utt49
annotator # 6 said
annotator # 7 said utt48 utt49
annotator # 8 said utt48 utt49
annotator # 9 said
annotator # 10 said utt48 utt49
51 HAVE THE OTHER TRUCK STOP AT SOUTH_DELTA INSTEAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt47
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
52 Alright
annotator # 0 said utt51
annotator # 1 said utt51
annotator # 2 said utt51
annotator # 3 said utt51
annotator # 4 said utt51
annotator # 5 said utt51
annotator # 6 said utt51
annotator # 7 said utt51
annotator # 8 said utt51
annotator # 9 said
annotator # 10 said utt51
54 Pardon me?
annotator # 0 said utt53
annotator # 1 said utt53
annotator # 2 said utt53
annotator # 3 said utt53
annotator # 4 said utt53
annotator # 5 said utt53
annotator # 6 said utt53
annotator # 7 said utt53
annotator # 8 said utt53
annotator # 9 said
annotator # 10 said utt53
55 UNLOAD
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt54
annotator # 4 said utt54
annotator # 5 said
annotator # 6 said utt54
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
56 THE PEOPLE
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt54
annotator # 4 said
annotator # 5 said
annotator # 6 said utt54
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
57 Fine
annotator # 0 said utt56
annotator # 1 said utt55 utt56
annotator # 2 said utt55 utt56
annotator # 3 said utt55 utt56
annotator # 4 said utt55 utt56
annotator # 5 said utt55 utt56
annotator # 6 said utt55 utt56
annotator # 7 said utt55 utt56
annotator # 8 said utt55 utt56
annotator # 9 said
annotator # 10 said utt55 utt56
59 Alright
annotator # 0 said utt58
annotator # 1 said utt58
annotator # 2 said utt58
annotator # 3 said utt58
annotator # 4 said utt58
annotator # 5 said utt58
annotator # 6 said utt58
annotator # 7 said utt59
annotator # 8 said utt58
annotator # 9 said
annotator # 10 said utt58
62 I don't understand your reference to the people left
annotator # 0 said utt60
annotator # 1 said utt60 utt61
annotator # 2 said utt60 utt61
annotator # 3 said utt60 utt61
annotator # 4 said utt60 utt61
annotator # 5 said utt60 utt61
annotator # 6 said utt60 utt61
annotator # 7 said utt60 utt61
annotator # 8 said utt61
annotator # 9 said
annotator # 10 said utt60 utt61
63 WHERE ARE THE PEOPLE
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt62
annotator # 4 said utt62
annotator # 5 said
annotator # 6 said utt62
annotator # 7 said utt62
annotator # 8 said
annotator # 9 said
annotator # 10 said
64 There are 2 groups-of-people at Delta
annotator # 0 said utt63
annotator # 1 said utt63
annotator # 2 said utt63
annotator # 3 said utt63
annotator # 4 said utt63
annotator # 5 said utt63
annotator # 6 said utt63
annotator # 7 said utt63
annotator # 8 said utt63
annotator # 9 said
annotator # 10 said utt63
65 WHERE ARE ALL THE PEOPLE
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt64
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
66 There are 6 groups-of-people at Delta and 1 at South Delta
annotator # 0 said utt65
annotator # 1 said utt65
annotator # 2 said utt65
annotator # 3 said utt65
annotator # 4 said utt65
annotator # 5 said utt65
annotator # 6 said utt65
annotator # 7 said utt65
annotator # 8 said utt65
annotator # 9 said
annotator # 10 said utt65
69 There are no people at South Delta
annotator # 0 said utt68
annotator # 1 said utt67 utt68
annotator # 2 said utt68
annotator # 3 said utt67 utt68
annotator # 4 said
annotator # 5 said utt67 utt68
annotator # 6 said utt67 utt68
annotator # 7 said utt67 utt68
annotator # 8 said utt67 utt68
annotator # 9 said
annotator # 10 said utt67 utt68
70 USE THE HELICOPTER TO GET THE PEOPLE AT SOUTH_DELTA TO DELTA
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said
annotator # 4 said utt69
annotator # 5 said
annotator # 6 said
annotator # 7 said
annotator # 8 said
annotator # 9 said
annotator # 10 said
71 Your wish is my command
annotator # 0 said utt70
annotator # 1 said utt70
annotator # 2 said utt70
annotator # 3 said utt70
annotator # 4 said
annotator # 5 said utt70
annotator # 6 said utt70
annotator # 7 said utt70
annotator # 8 said utt70
annotator # 9 said
annotator # 10 said utt70
73 Simulation succeeded in 94 percent of 250 runs.
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt72
annotator # 4 said
annotator # 5 said
annotator # 6 said utt72
annotator # 7 said utt72
annotator # 8 said
annotator # 9 said
annotator # 10 said
74 7 percent of the plan failure points were a move action with truck
two resulting in a breakdown.
annotator # 0 said
annotator # 1 said
annotator # 2 said
annotator # 3 said utt72
annotator # 4 said
annotator # 5 said
annotator # 6 said utt72
annotator # 7 said utt72
annotator # 8 said
annotator # 9 said
annotator # 10 said
k 11 and N 74
PJ^3 is 4.0047972724898e-07 vark is -0.00114283392466578 z is 19.7734527931327
sig is .000005 or greater
kappa is 0.668457920080161
PA is 0.784275184275184
PE is 0.349329002891657