Class meeting for 10-605 Deep Learning

This is one of the class meetings on the schedule for the course Machine Learning with Large Datasets 10-605 in Fall_2016.

Slides

• TBD

Readings

• Automatic differentiation:
  • William's notes on automatic differentiation.
  • Domke's blog post - clear but not much detail

http://colah.github.io/posts/2015-08-Backprop/ - another nice blog post

http://homes.cs.washington.edu/~naveenks/files/2009_Cranfield_PPT.pdf - ok slide deck

http://www.bcl.hamilton.ie/~barak/papers/toplas-reverse.pdf - clearest paper I found so far

https://github.com/HIPS/autograd - similar project

http://arxiv.org/pdf/1502.05767v2.pdf - survey paper I haven't really looked at