A Visual and Interactive Environment for IR Experimental Evaluation
Gianmaria Silvello (silvello <at> dei (point) unipd (point) it)
University of Padua
Le mercredi 14 août 2013 à 11 h 30
Salle 3195, Pavillon André-Aisenstadt
Information retrieval is a research field strongly rooted in experimentation where new and better ways to measure and interpret the behavior of a system are key to scientific and technological advancement. This talk focuses on an innovative visual analytics environment which aims at easing and making more effective the experimental evaluation process. This environment supports and improves two typical phases of the experimental evaluation process, namely performance analysis and failure analysis. These analyses are conducted also via a new metric called Cumulative Relative Position (CRP) which measures the weariness caused to the user by the ranking of a system under exam. User weariness is expressed as the amount of misplacement in the rank position of relevant documents, as this pairs with the idea of having forced the user to deviate from an ideal path which would have provided him/her with the expected flow of information causing no weariness.
Suivez ce lien pour vous inscrire à la liste de diffusion RALI-OLST.
Liste de tous les séminaires pour l'année :1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024