ANERcorp
From Cohen Courses
Revision as of 15:15, 29 November 2010 by PastStudents (talk | contribs)
training and testing corpus annotated corpus manually annotated news wire and other web sources person location organization miscellaneous other
more than 150K tokens in which 11% of them are NE.
the corpus has been used in several papers the data is in standard CONLL format
In Arabic one word may written in several forms. In order to normalize these differences and decrease the data sparseness, the data has been normalized by reducing different forms of words are reduced into one form.
The corpus consists of 316 articles which have been selected from news wire and other type web sources.
- Person 39%
- Location 30.4%
- Organization 20.6%
- Miscellaneous 10%
