Difference between revisions of "Class Meeting for 10-710 09-06-2011"
From Cohen Courses
Jump to navigationJump to search| (6 intermediate revisions by 3 users not shown) | |||
| Line 3: | Line 3: | ||
=== HMMs, MaxEnt Taggers, and MEMMs === | === HMMs, MaxEnt Taggers, and MEMMs === | ||
| − | * Slides to | + | * [http://www.cs.cmu.edu/~wcohen/10-710/09-07-hmm-to-memm.pptx Slides in Powerpoint] |
| + | * [http://www.cs.cmu.edu/~wcohen/10-710/09-07-hmm-to-memm.pdf Slides in PDF] | ||
=== Required Readings === | === Required Readings === | ||
| Line 13: | Line 14: | ||
The Borthwick et al paper I discussed last Thursday is | The Borthwick et al paper I discussed last Thursday is | ||
* [[borthwick_1998_exploiting_diverse_knowledge_sources_via_maximum_entropy_in_named_entity_recognition | {{MyCiteconference| booktitle = Proceedings of the sixth workshop on very large corpora| coauthors = J. Sterling, E. Agichtein, R. Grishman| date = 1998| first = A.| last = Borthwick| pages = 152–160| title = Exploiting diverse knowledge sources via maximum entropy in named entity recognition}}]] | * [[borthwick_1998_exploiting_diverse_knowledge_sources_via_maximum_entropy_in_named_entity_recognition | {{MyCiteconference| booktitle = Proceedings of the sixth workshop on very large corpora| coauthors = J. Sterling, E. Agichtein, R. Grishman| date = 1998| first = A.| last = Borthwick| pages = 152–160| title = Exploiting diverse knowledge sources via maximum entropy in named entity recognition}}]] | ||
| + | |||
| + | === Background Readings === | ||
| + | |||
| + | |||
| + | * [http://www.morganclaypool.com/doi/abs/10.2200/S00361ED1V01Y201105HLT013 <i>LSP</i>]: section 3.4 and appendix D through D.2. To understand why these models are often called "max ent," read appendix C. | ||
| + | * Max ent for NLP: [http://acl.ldc.upenn.edu/J/J96/J96-1002.pdf Berger et al., 1996, "A Maximum Entropy Approach to Natural Language Processing"] ([[Paper::Berger et al 1996 a maximum entropy approach to natural language processing|Wiki]]) | ||
| + | * Max ent for NLP: [http://acl.ldc.upenn.edu/W/W96/W96-0213.pdf Ratnaparkhi, 1996, "A Maximum Entropy Model for Part-of-Speech Tagging"] | ||
| + | * Max ent for language modeling: [http://acl.ldc.upenn.edu/H/H93/H93-1021.pdf Lau et al., 1993, "Adaptive Language Modeling Using the Maximum Entropy Principle"] ([[Paper::Lau et al HLT 1993| Wiki]]) | ||
Latest revision as of 00:35, 29 September 2011
This is one of the class meetings on the schedule for the course Structured Prediction 10-710 in Fall 2011.
HMMs, MaxEnt Taggers, and MEMMs
Required Readings
No additional readings from Thursday, but I will focus on this paper:
The Borthwick et al paper I discussed last Thursday is
Background Readings
- LSP: section 3.4 and appendix D through D.2. To understand why these models are often called "max ent," read appendix C.
- Max ent for NLP: Berger et al., 1996, "A Maximum Entropy Approach to Natural Language Processing" (Wiki)
- Max ent for NLP: Ratnaparkhi, 1996, "A Maximum Entropy Model for Part-of-Speech Tagging"
- Max ent for language modeling: Lau et al., 1993, "Adaptive Language Modeling Using the Maximum Entropy Principle" (Wiki)
