Difference between revisions of "MUC"
From Cohen Courses
Jump to navigationJump to search| Line 1: | Line 1: | ||
| − | + | These [[Category::Dataset|datasets]] were created by MUC, the Message Understanding Conference. | |
| + | |||
| + | The conference was not as important as the work needed to get into the conference. It was novel in that participants had to complete in the task in order to gain admission. The performance measure used in the tasks is F1, the geometric mean of precision and recall. | ||
Table partially taken from [http://en.wikipedia.org/wiki/Message_Understanding_Conference] | Table partially taken from [http://en.wikipedia.org/wiki/Message_Understanding_Conference] | ||
| Line 20: | Line 22: | ||
|| Mil. reports | || Mil. reports | ||
|| Fleet Operations | || Fleet Operations | ||
| − | || | + | || Template extraction (1 template; 10 slots) |
|- | |- | ||
|| MUC-3 | || MUC-3 | ||
| Line 26: | Line 28: | ||
|| News reports | || News reports | ||
|| Terrorist activities in Latin America | || Terrorist activities in Latin America | ||
| − | || | + | || Template extraction (1 template; 18 slots) |
|- | |- | ||
|| MUC-4 | || MUC-4 | ||
| Line 32: | Line 34: | ||
|| News reports | || News reports | ||
|| Terrorist activities in Latin America | || Terrorist activities in Latin America | ||
| − | || | + | || Template extraction (1 template; 24 slots) |
|- | |- | ||
|| MUC-5 | || MUC-5 | ||
| Line 38: | Line 40: | ||
|| News reports | || News reports | ||
|| Corporate Joint Ventures, Microelectronic production | || Corporate Joint Ventures, Microelectronic production | ||
| − | || | + | || Template extraction (11 templates; 47 slots total) Some templates were nested |
|- | |- | ||
|| [http://www.cs.nyu.edu/cs/faculty/grishman/muc6.html MUC-6] | || [http://www.cs.nyu.edu/cs/faculty/grishman/muc6.html MUC-6] | ||
| Line 56: | Line 58: | ||
==References== | ==References== | ||
| − | [http://www-nlpir.nist.gov/related_projects/muc/muc_data/muc_data_index.html] | + | [http://www-nlpir.nist.gov/related_projects/muc/muc_data/muc_data_index.html General information on MUC] |
[http://acl.ldc.upenn.edu/C/C96/C96-1079.pdf A history of the MUC conference] | [http://acl.ldc.upenn.edu/C/C96/C96-1079.pdf A history of the MUC conference] | ||
Revision as of 19:16, 25 September 2011
These datasets were created by MUC, the Message Understanding Conference.
The conference was not as important as the work needed to get into the conference. It was novel in that participants had to complete in the task in order to gain admission. The performance measure used in the tasks is F1, the geometric mean of precision and recall.
Table partially taken from [1]
| Conference | Year | Text Source | Topic (Domain) | Task |
| MUC-1 | 1987 | Mil. reports | Fleet Operations | Open ended |
| MUC-2 | 1989 | Mil. reports | Fleet Operations | Template extraction (1 template; 10 slots) |
| MUC-3 | 1991 | News reports | Terrorist activities in Latin America | Template extraction (1 template; 18 slots) |
| MUC-4 | 1992 | News reports | Terrorist activities in Latin America | Template extraction (1 template; 24 slots) |
| MUC-5 | 1993 | News reports | Corporate Joint Ventures, Microelectronic production | Template extraction (11 templates; 47 slots total) Some templates were nested |
| MUC-6 | 1995 | News reports | Negotiation of Labor Disputes and Corporate Management Succession | |
| MUC-7 | 1997 | News reports | Airplane crashes, and Rocket/Missile Launches |
