Derived from Sweetser, nlu/domains/scheduler/scheduler.dev with tags replaced by concrete words. The notation for each sentence is:
Sentence
Sentences with unknown word errors use the format:
parse time number of parses
Correctly selected?-correctly interpreted?
Sentence
don't know word 'unknown'
What happens at two? 6550 1 C-0 What's happpening at two? 28651 1 C-0 At two, what's going on? 13950 0 Who's speaking at the linguistics presentation? 79705 3 0-0 Where is the linguistics presentation? 84342 6 C-C Where is Marie's event? 26789 1 C-C When is the linguistics presentation? 92353 6 C-C Can you tell me where the linguistics presentation is? 104651 4 C-0 Who is speaking in the park? 76770 3 C-0 What room is the linguistics presentation in? 68980 12 C-C How do I find the linguistics presentation? don't know word 'how' Where is Marie? 3144 1 C-C What's happening in the park? 13249 1 C-0 Who's the speaker for the linguistics presentation? 50733 7 C-C Who's speaking at two in the park? 55600 6 0-0 When is Marie speaking 8613 1 C-0 when is a linguistics presentation 28301 6 C-C when is the linguistics presentation over 145479 18 0-0 when is the linguistics presentation done 205084 18 0-0 when does Marie's event end 4877 0 Does Marie speak with Marie 3786 1 C-0 does Marie speak in the park 5879 1 C-0 where will Marie speak at two 13379 3 0-0 are there any others with Marie don't know word any goodbye mabel 441 0 the first event 1192 1 C-0 that's all, thanks don't know word all when does Marie speak 3786 1 C-0 who does Marie speak with 4667 1 C-0 when does that event end 7180 1 C-0 when will Marie be in the park 25687 6 0-0 can you tell me when Marie is giving the linguistics presentation 101506 4 C-0 what's today's date 17025 2 C-0 what time is it mabel 14932 0 can you recommend anything 3175 1 C-0 Hi there 230 1 C-C Hi Mabel 511 0 what is your name don't know the word 'name'
This set contains sentences with controlled ambiguity. At the time of testing, speaker was singly defined, robot was doubly defined, and which had the wh feature, but not the hold predicate. The format used is:
Phrase
time
speaker 390 the speaker 631 the fun speaker 991 speaker in the room 2253 the speaker in the room 3105 the speaker in the fun room 4036Single Lexical Ambiguity
robot 621 the robot 1041 the fun robot 2033 robot in the room 4176 the robot in the room 6449 the robot in the fun room 7481Wh-raising
which 271 which speaker 1112 which fun speaker 1913 which speaker in room 6699, 2 which speaker in the room 9023 which speaker in the fun room 11516