Finding new information via robust entity detection

Francisco Iacobelli*, Nathan Nichols, Lawrence A Birnbaum, Kristian J Hammond

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Journalists and editors work under pressure to collect relevant details and background information about specific events. They spend a significant amount of time sifting through documents and finding new information such as facts, opinions or stakeholders (i.e. people, places and organizations that have a stake in the news). Spotting them is a tedious and cognitively intense process. One task, essential to this process, is to find and keep track of stakeholders. This task is taxing cognitively and in terms of memory. Tell Me More offers an automatic aid to this task. Tell Me More is a system that, given a seed story, mines the web for similar stories reported by different sources and selects only those stories which offer new information with respect to that original seed story. Much like a journalist, the task of detecting named entities is central to its success. In this paper we briefly describe Tell Me More and, in particular, we focus on Tell Me More's entity detection component. We describe an approach that combines off-the-shelf named entity recognizers (NERs) with WPED, an in-house publicly available NER that uses Wikipedia as its knowledge base. We show significant increase in precision scores with respect to traditional NERs. Lastly, we present an overall evaluation of Tell Me More using this approach.

Original languageEnglish (US)
Title of host publicationProactive Assistant Agents - Papers from the AAAI Fall Symposium, Technical Report
Pages32-37
Number of pages6
StatePublished - 2010
Event2010 AAAI Fall Symposium - Arlington, VA, United States
Duration: Nov 11 2010Nov 13 2010

Publication series

NameAAAI Fall Symposium - Technical Report
VolumeFS-10-07

Other

Other2010 AAAI Fall Symposium
CountryUnited States
CityArlington, VA
Period11/11/1011/13/10

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Finding new information via robust entity detection'. Together they form a unique fingerprint.

Cite this