LSDSem'17 Shared Task

Our shared task is the Story Cloze Test. This test is one of the recent proposed frameworks on learning commonsense/procedural knowledge, which introduces a new evaluation for story understanding and script learning. In this test the system reads a four-sentence story along with two alternative endings, then it is tasked with choosing the correct ending to the story. Story Cloze Test requires systems to link various levels of semantics to commonsense knowledge for successful narrative understanding. We encourage using a variety of resources and any training corpora of your choice, not only the ROCStories, for tackling the Story Cloze Test.

News!

15 February 2017: Congrats to the UW team for winning the 1st Story Cloze Test challenge! Stay tuned for the report paper on our conclusions.
2 February 2017: We had 8 teams submit their system results by last night! We are looking forward to learning about your ideas.
3 January 2017: Happy new year! 🎊 We are excited to announce that we have 17 teams registered to compete in the Story Cloze shared task! Just a reminder that the teams will be judged on their performance on the Test Set Spring 2016. You can submit your system results at any time on CodaLab.
29 December 2016: We have now closed the registeration. If you're still interested in participating, please contact nasrinm@cs.
12 December 2016: The softconf submission page is up. You can submit system description papers which are up to 4 pages, excluding references and supplementary material.
10 December 2016: An additional ~53K ROCStories has been released, which can be accessed here. The participants can choose to use any training data of their choice, and do not have to use the additional stories.
18 November 2016: Now you can register for participation in the shared task. Registeration deadline is Dec 15 2016. The shared task will be conducted via our CodaLab challenge page. You can submit your system results to the leaderboard of Test Set Spring 2016 anytime before Feb 1 2017.
10 November 2016: Story Cloze Test is now the shared task for the LSDSem'17 Workshop. Checkout the workshop details here.

Visit ROCStories page for more information about the Story Cloze Test.

More information regarding the Shared Task will be provided in the news section!. Any questions? Please contact: nasrinm [at] cs [dot] rochester [dot] edu.