KBP at TAC

Knowledge Base Population (KBP) is a evaluation track at Text Analysis Conference (TAC), with the goal of explore extraction ability of automated systems to discover information about named entities with reference to an external knowledge source.

The evaluation will provide an initial (or reference) knowledge base, along with a document collection that systems are to use to learn from. Attributes (a.k.a., “slots”) derived from Wikipedia infoboxes are used to create the reference knowledge base, as the evaluation dataset.

Task Description

Task Description for Knowledge-Base Population at TAC 2011

Entity Linking

In the Entity Linking task, given a query that consists of a name string and a background document ID, the system is required to provide the ID of the Knowledge Base entry to which the name align to, for example, your system is given a query like:

<query id="EL000304">
 <name>Barnhill</name>
 <docid>eng-NG-31-100578-11879229</docid>
</query>

And your system should refer to the correct name entity of Barnhill in knowledge base.

Slot Filling

Slot Filling task requires mining information about entities from free text. It can be viewed as more traditional Information Extraction (IE), or alternatively, as a Question Answering (QA) task, where the questions are static but the targets change.