publication . Conference object . 2014

Evaluating intuitiveness of vertical-aware click models

Aleksandr Chuklin; Ke Zhou; Anne Schuth; Floor Sietsma; Maarten de Rijke;
Open Access English
  • Published: 03 Jul 2014
  • Country: Netherlands
Abstract
Modeling user behavior on a search engine result page is important for understanding the users and supporting simulation experiments. As result pages become more complex, click models evolve as well in order to capture additional aspects of user behavior in response to new forms of result presentation. We propose a method for evaluating the intuitiveness of vertical-aware click models, namely the ability of a click model to capture key aspects of aggregated result pages, such as vertical selection, item selection, result presentation and vertical diversity. This method allows us to isolate model components and therefore gives a multi-faceted view on a model's performance. We argue that our method can be used in conjunction with traditional click model evaluation metrics such as log-likelihood or perplexity. In order to demonstrate the power of our method in situations where result pages can contain more than one type of vertical(e.g., Image and News) we extend the previously studied Federated Click Model such that it models user clicks on such pages. Our evaluation method yields non-trivial yet interpretable conclusions about the intuitiveness of click models, highlighting their strengths and weaknesses.
Persistent Identifiers
Sustainable Development Goals (SDG)
3. Good health
Subjects
free text keywords: Search engine, Information retrieval, Selection (linguistics), Click path, Key (cryptography), Computer science, Presentation, media_common.quotation_subject, media_common, Image (mathematics), Federated search
Communities
  • CLARIN
  • Digital Humanities and Cultural Heritage DH-CH communities : CLARIN
Funded by
NWO| Modeling and Learning from Implicit Feedback in Information Retrieval
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300171779
,
NWO| Digging archaeology data: image search and markup (DADAISM)
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300186891
,
NWO| SPuDisc: Searching Public Discourse
Project
  • Funder: Netherlands Organisation for Scientific Research (NWO) (NWO)
  • Project Code: 2300176811
,
EC| LIMOSINE
Project
LIMOSINE
Linguistically Motivated Semantic aggregatIon engiNes
  • Funder: European Commission (EC)
  • Project Code: 288024
  • Funding stream: FP7 | SP1 | ICT
,
EC| VOX-POL
Project
VOX-POL
Virtual Centre of Excellence for Research in Violent Online Political Extremism
  • Funder: European Commission (EC)
  • Project Code: 312827
  • Funding stream: FP7 | SP1 | SEC
Download fromView all 3 versions
Open Access
NARCIS
Conference object . 2014
Open Access
NARCIS
Conference object . 2014
Providers: NARCIS
Any information missing or wrong?Report an Issue