Homeworks (Please see guidelines on TA's homepage)
Text: Jurafsky and Martin, Speech and Language Processing, 2nd edition - currently only available online.
Recommended: Manning and Schuetze, Foundations of Statistical Natural Language Processing
| On | we will cover | which means that after class you will understand | if before class you have read |
|---|---|---|---|
| 9/4 | Introduction | programming for nlp | |
| 9/6 | Probability Theory | independence, information theory | |
| 9/11 | Linguistic Essentials | X-bar | JM 12 |
| 9/13 | N-grams | deleted interpolation | JM 4 |
| 9/18 | N-grams | Good Turing | JM 4 |
| 9/20 | Hidden Markov Models | viterbi, forward-backward | JM 6 |
| 9/25 | Part of Speech Tagging | EM, transformation-based learning | JM 5; grad: johnson |
| 9/27 | Signal Processing for Speech | fourier, MFCC | morgan 6, 7, 20 |
| 10/2 | Approaches to Speech Recognition | putting it all together | JM 9 |
| 10/4 | Large Vocabulary Speech Recognition | beam search, rescoring | Jelinek ch 5 |
| 10/9 | Large Vocabulary Speech Recognition | multistack decoding, A* | Jelinek ch 6 |
| 10/11 | Context Free Grammars | infinite trees | JM 13 |
| 10/16 | Parsing | charts, agendas | JM 14 |
| 10/18 | Real-World Parsing | inside-outside, lexicalization | |
| 10/23 | Real-World Parsing, Language Formalisms | Swiss German | JM 15; grad: charniak 05 |
| 10/25 | Review | ||
| 10/30 | Midterm | ||
| 11/1 | Midterm Solutions | ||
| 11/6 | Word Sense Disambiguation | bootstrapping | JM 20 |
| 11/8 | Machine Translation | source-channel | JM 25 |
| 11/13 | Machine Translation | model 1, 2, 3 | JM 25; brown 93 |
| 11/15 | Machine Translation | decoding | germann et al. |
| 11/20 | Machine Translation | syntax-based MT | yamada & knight 01 |
| 11/27 | Machine Translation | syntax-based decoding | galley 2004, chiang 05 |
| 11/29 | Machine Translation | inversion transduction grammar | |
| 12/4 | Machine Translation | what's in a translation rule | |
| 12/6 | Discriminative Methods | max-margin parsing | collins 02, taskar 04 |
| 12/11 | Something fun | ||
| 12/13 | Review | come to class with questions! |