Evaluating Personal Search Workshop | ECIR2011, 18 April 2011, Dublin, Ireland

Guinness Storehouse - workshop venue

Evaluating Personal Search Workshop
[Half day workshop]

Personal Search refers to the process of searching within one’s personal space of digital information, e.g., searching one’s desktop or mobile phone for required data items or information. This workshop aims to bring together researchers interested in working towards standardized evaluation approaches for the personal search space. Due to the large space that this covers, as a first step towards overall standardized personal search evaluation this workshop will focus on evaluation for the textual elements within personal desktop collections and known item keyword queries for these elements. 

News Updates

* Workshop report available in SIGIR forum

* Workshop proceedings available online

* Join the evaluating personal search google group for workshop discussion and general discussion on evaluation in the personal information access space.

Paper Submissions

The workshop is now accepting paper submissions. Short position papers (max. 2 pages) describing creative use of / modifications to provided datasets and approaches or ideas / challenges for the domain are invited. Submissions should be in ACM SIGIR format. LaTeX and Word templates are available at http://www.acm.org/sigs/publications/proceedings-templates (for LaTeX, use the "Option 2" style). Papers should be anonymised and submitted in pdf format through the EasyChair system http://www.easychair.org/conferences/?conf=eps2011 no later than midnight Pacific Daylight Time on February 28, 2011 February 21, 2011. See the workshop call for papers for further details.

Datasets

Jinyoung Kim and Bruce Croft have created simulated desktop collections and user queries. Interested participants can use these resources prior to the workshop in various ways -- analyzing the characteristics of the data, evaluating various retrieval methods using the queries and result sets, suggesting a better data set for evaluating personal search, etc. See the datasets page for further information and details on how to obtain the datasets.