publication . Conference object . 2013

Time-Aware Chi-squared for Document Filtering over Time

Kenter, T.; Graus, D.; Meij, E.; de Rijke, M.;
Open Access English
  • Published: 01 Jan 2013
  • Publisher: Microsoft Research
Abstract
Document filtering over time is applied in tasks such as tracking topics in online news or social media. We consider it a classification task, where topics of interest correspond to classes, and the feature space consists of the words associated to each class. In streaming settings the set of words associated with a concept may change. In this paper we employ a multinomial Naive Bayes classifier and perform periodic feature selection to adapt to evolving topics. We propose two ways of employing Pearson's χ2 test for feature selection and demonstrate their benefit on the TREC KBA 2012 data set. By incorporating a time-dependent function in our equations for χ2 we provide an elegant method for applying different weighting and windowing schemes. Experiments show improvements of our approach over a non-adaptive baseline, in a realistic settings with limited amounts of training data.
Communities
  • CLARIN
  • Digital Humanities and Cultural Heritage DH-CH communities : CLARIN
Funded by
NWO| SPuDisc: Searching Public Discourse
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300176811
,
EC| LIMOSINE
Project
LIMOSINE
Linguistically Motivated Semantic aggregatIon engiNes
  • Funder: European Commission (EC)
  • Project Code: 288024
  • Funding stream: FP7 | SP1 | ICT
,
EC| PROMISE
Project
PROMISE
Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation
  • Funder: European Commission (EC)
  • Project Code: 258191
  • Funding stream: FP7 | SP1 | ICT
,
NWO| Semantic Search in E-Discovery
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300168486
,
NWO| Building Rich Links to Enable Television History Research
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300153702
Download from
Open Access
NARCIS
Conference object . 2013
Providers: NARCIS
Any information missing or wrong?Report an Issue