kappa is 0.395489017869096
PA is 0.768304668304668
PE is 0.616722708860301
utt-num None Signal-non-understanding Correct-misspeaking SU-Acknowledge SU-Repeat-rephrase SU-Completion
1 | | | | | | S: Welcome to trips 97 version 3 point 2.
2 | | | | | | S: I'm ready to start.
3 | | | | | | U: HELLO
4 10 | | | 1 | | | S:Hi
5 | | | | | | U: SHOW_ME A MAP OF PACIFICA
6 5 | | | 6 | | | S:Ok
7 | | | | | | U: CLEAR [CLEAR should be: WHERE ARE] THE PEOPLE
8 1 | 10 | | | | | S:I'm afraid I didn't understand you.
9 9 | | | 1 | 1 | | U:WHERE ARE THE PEOPLE
10 9 | | | 2 | | | S:There are 2 groups-of-people at Exodus, 2 at Calypso, 2 at
Barnacle and 1 at Abyss
11 | | | | | | U: WHERE ARE THE TRANSPORTS
12 9 | | | 2 | | | S:There are 2 trucks and 1 helicopter at Delta
13 | | | | | | U: USE A TRUCK [missed: TO] GET THE PEOPLE FROM CALYPSO
14 | | | | | | U: TO DELTA
15 4 | | | 7 | | | S:Ok
16 | | | | | | U: IT [IT mistakenly inserted] HOW_LONG WILL A [A should be THAT] TAKE
17 1 | 10 | | | | | S:I'm afraid I didn't understand you.
18 9 | | | 1 | 1 | | U:HOW_LONG
19 9 | | | 1 | 1 | | U:WILL THAT TAKE
20 9 | | | 2 | | | S:It will take 6 hours and 54 minutes
21 | | | | | | U: WHAT IF WE WENT ALONG [missed: THE] COAST INSTEAD
22 1 | 10 | | | | | S:I'm sorry, but that input didn't make sense to me.
23 9 | | | 1 | 1 | | U:WHAT IF WE WENT ALONG THE COAST INSTEAD
24 9 | | | 2 | | | S:That option would take 8 hours and 52 minutes
25 10 | | | 1 | | | U:I [I mistakenly inserted] FORGET IT
26 5 | | | 6 | | | S:Ok
27 | | | | | | U: USE THE OTHER TRUCK [missed: TO] GET THE PEOPLE AT EXODUS TO DELTA
28 6 | | | 5 | | | S:Ok
29 | | | | | | U: LET'S USE A HELICOPTER INSTEAD
30 6 | | | 5 | | | S:Alright
31 | | | | | | U: NOW SEND TRUCK ONE
32 | | | | | | U: TO BARNACLE
33 6 | | | 5 | | | S:I'll get right on it
34 | | | | | | U: PICK UP THE PEOPLE THERE
35 5 | | | 6 | | | S:Ok
36 | | | | | | U: GO ON TO ABYSS
37 6 | | | 5 | | | S:Your wish is my command
38 | | | | | | U: AND TAKE THE PEOPLE THERE TO DELTA
39 5 | | | 6 | | | S:Alright
40 | | | | | | U: THAT LOOKS GOOD
41 4 | | | 7 | | | S:No problem
42 | | | | | | U: DELTA_BRIDGE IS OUT
43 10 | | | 1 | | | S:The highlighted actions may need to be revised.
44 5 | | | 6 | | | S:Ok
45 | | | | | | U: SEND_A [A mistakenly inserted] TRUCK TWO
46 | | | | | | U: ALONG THE COAST INSTEAD
47 7 | 4 | | | | | S:Sorry, I don't know how to do that.
48 9 | | | 1 | 1 | | U:SEND TRUCK TWO
49 9 | | | 1 | 1 | | U:ALONG THE COAST INSTEAD
50 7 | | | 4 | | | S:Done
51 | | | | | | U: HAVE THE OTHER TRUCK STOP AT SOUTH_DELTA INSTEAD
52 4 | | | 7 | | | S:Alright
53 | | | | | | U: UNLOAD A [A should be THE] PEOPLE
54 1 | 10 | | | | | S:Pardon me?
55 9 | | | 1 | 1 | | U:UNLOAD
56 10 | | | 1 | | | U:THE PEOPLE
57 4 | | | 7 | | | S:Fine
58 | | | | | | U: USE THE HELICOPTER [missed TO] GET THE PEOPLE FROM SOUTH_DELTA TO DELTA
59 5 | | | 6 | | | S:Alright
60 | | | | | | U: WHERE ARE THE PEOPLE
61 | | | | | | U: LEFT [LEFT mistakenly inserted]
62 1 | 10 | | | | | S:I don't understand your reference to the people left
63 8 | | | 1 | 2 | | U:WHERE ARE THE PEOPLE
64 9 | | | 2 | | | S:There are 2 groups-of-people at Delta
65 10 | | | | 1 | | U:WHERE ARE ALL THE PEOPLE
66 8 | | | 2 | | 1 | S:There are 6 groups-of-people at Delta and 1 at South Delta
67 | | | | | | U: USE THE HELICOPTER
68 | | | | | | U: TO GET THE PEOPLE FROM SOUTH_DELTA TO DELTA
69 8 | 1 | | 2 | | | S:There are no people at South Delta
70 10 | | | | | 1 | U:USE THE HELICOPTER TO GET THE PEOPLE AT SOUTH_DELTA TO DELTA
71 7 | | | 4 | | | S:Your wish is my command
72 | | | | | | U: [user selects simulate plan from a menu]
73 9 | | | 2 | | | S:Simulation succeeded in 94 percent of 250 runs.
74 9 | | | 2 | | | S:7 percent of the plan failure points were a move action with truck
two resulting in a breakdown.
N = 74 k = 11
PJ^3 is 0.456331549631238 vark is 0.00268293851411438 z is 7.63535208680347
sig is .000005 or greater
kappa is 0.395489017869096
PA is 0.768304668304668
PE is 0.616722708860301