Séminaires RALI-OLST

A Visual and Interactive Environment for IR Experimental Evaluation

Gianmaria Silvello (silvello <at> dei (point) unipd (point) it)

University of Padua

Wednesday 14 August 2013 at 11:30 AM

Salle 3195, Pavillon André-Aisenstadt


Information retrieval is a research field strongly rooted in experimentation where new and better ways to measure and interpret the behavior of a system are key to scientific and technological advancement. This talk focuses on an innovative visual analytics environment which aims at easing and making more effective the experimental evaluation process. This environment supports and improves two typical phases of the experimental evaluation process, namely performance analysis and failure analysis. These analyses are conducted also via a new metric called Cumulative Relative Position (CRP) which measures the weariness caused to the user by the ranking of a system under exam. User weariness is expressed as the amount of misplacement in the rank position of relevant documents, as this pairs with the idea of having forced the user to deviate from an ideal path which would have provided him/her with the expected flow of information causing no weariness.



Join with Zoom at this url.
Meeting ID: 916 9097 5818, 𝑷𝒂𝒔𝒔𝒄𝒐𝒅𝒆: 343273.
Phone numbers: https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile: +14388097799,,91690975818#,,,,,,0#,,343273#


To receive weekly talk announcements, please send an e-mail to majordomo@iro.umontreal.ca. Simply write a message containing the single line 'subscribe ralli' (without the quotes).

See all the weekly talks for the year:

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021