Computer Science 246/446

Mathematical Foundations of Artificial Intelligence

Spring 2011

Instructor: Dan Gildea office hours Wed 2-3pm
TA: Young Chol Song office hours Mon 2-3pm
Location: Tu/Th 11:05am-12:20pm, CSB 601

Homeworks

Required text: Christopher M. Bishop, Pattern Recognition and Machine Learning.

The following are useful references in addition to the reading material assigned for each class:

  • Stuart Russell and Peter Norvig, Artificial Intelligence, A Modern Approach.
  • Trevor Hastie, Robert Tibshirani, Jerome Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction.
  • Larry Wasserman, All of Statistics, 2004.
Readings not taken from Bishop are available in the box in the CS mailroom.

Syllabus

Onwe will coverwhich means that after class you will understandif before class you have read
1/13 Probability Theory independence, bayes rule bishop 1.2
1/18 Information Theory entropy, kl-distance, coding bishop 1.6
1/20 Probabilistic Inference priors on continuous variables bishop 2.2
1/25 Probabilistic Inference priors: bayesian reasoning, MAP bishop 3.4
1/27 Perceptron, Backpropagation the chain rule bishop 5.1, 5.2, 5.3
2/1 Support Vectors the kernel trick bishop 6.1, 6.2
2/3 Support Vectors the wolfe dual bishop 7.1
2/8 Probabilistic Inference polytree bishop 8.4
2/10 Expectation Maximization latent variable clustering bishop 9
2/15 Sampling Markov Chain Monte Carlo bishop 11.2
2/17 Sampling Gibbs Sampling bishop 11.3
2/22 Learning Theory probably approximately correct kearns&vazirani 1
2/24 Learning Theory VC dimension kearns&vazirani 2, 3
3/1 Eigenvectors least squares, PCA bishop 12.1
3/3 Independent Component Analysis source separation bishop 12.4.1
3/15 Review
3/17 Midterm
3/22 Midterm Solutions
3/24 Logistic Regression maximum entropy bishop 4.3
3/29 Optimization LBFGS Nocedal 8.1, 9.1
3/31 Hidden Markov Models forward-backward bishop 13.2
4/5 Particle Filters slam Thrun et al. ch 4
4/7 Reinforcement Learning q-learning ballard 11
4/12 Reinforcement Learning partial observability Thrun et al. ch 15
4/14 Games nash equilibrium morris 115-131
4/19 Games learning to co-operate
4/21 Something Fun
4/26 Review come to class with questions!
Final Exam: Friday May 6, 8:30-11:30am.

Grading

  • Final exam: 35%
  • Homeworks: 35%
  • Midterm: 25%
  • Class participation: 5%
gildea @ cs rochester edu
April 13, 2011