Workshop Objectives

A key outcome of the recent SIGIR 2010 workshop on Desktop Search was the need to develop a consortium of people to work on reaching the goal of standardized, repeatable, cross comparable evaluation methods for the PS space. Potentially through a TREC track. The goal of this workshop is to act as a first step towards this objective. The workshop will focus on standardized evaluation for the textual elements within personal desktop collections and known item keyword queries for these elements. By bringing together people interested in this challenge, we intend forming a strategy for repeatable evaluation in this space and bringing this strategy to fruition post workshop. It is planned that a consortium of people be formed at the workshop for this post workshop activity. The goals of the workshop are then to:

• Bring together different approaches on personal search evaluation
• Clarify the most important challenges to overcome
• Select one (or more) method as a group
• Discuss plans for collaboration
• Begin discussion on establishing a TREC (or TREC-like) Track for personal search.