Liadh Kelly

Computer Science Department, Maynooth University, Ireland
liadh.kelly (AT) mu.ie

 

Liadh is a lecturer in the Department of Computer Science at Maynooth University. She holds a PhD in Computer Science from Dublin City University, Ireland on the development of novel retrieval algorithms for personal lifelogs (see iCLIPS); a MSc (research) on personalised web page recommendation from University College Dublin (UCD), Ireland; and a BSc (hons) degree in Computer Science also from UCD.


Research Interests: lie in the applied artificial intelligence space -> intelligent search, multimodal information access and retrieval, ubiquitous computing -> context sensitive retrieval, evaluation methodologies.


Current Evaluation Methodology Development Initiatives

CLEF eHealth Evaluation

EvalUMAP (Towards comparative evaluation in user modeling, adaptation and personalization)


Select Research Projects


Lifelogs Project - iCLIPS

iCLIPS recorded 20 months of SenseCam, PC, laptop, and mobile phone activity, along with tweets, digital photographs, GPS and bluetooth data, for 3 subjects. It also recorded 1 month of biometric response data for these 3 subjects. (more details)

Principle research areas: lifelog creation; item linking; annotating items with rich sources of automatically derived context data; the role of biometrics in lifelog item retrieval; retrieval algorithm development; and user (lifelogger) memory oriented suggestive interface development. (more details)

eHealth Project - Khresmoi

Khresmoi developed a multilingual multimodal search and access system for biomedical information and documents. It addresses the challenges of searching medical data, including information available on the internet, as well as 2D and 3D radiology images in hospital archives, for laypeople, general practitioners (GPs) and radiologists. The system allows text querying in several languages, in combination with image queries. Results can be translated using a machine translation tool specifically trained on medical text. (more details)


Conference Organisation

CLEF eHealth Evaluation Lab 2020 - Lab co-chair

EvalUMAP Shared Task 2020 - Shared task co-chair

CLEF eHealth Evaluation Lab 2019 - Lab co-chair

UMAP EvalUMAP Workshop 2019 - Programme co-chair

National Data Analytics for Smart Farming Workshop 2019 - Programme co-chair

Evaluation of Personalized Information Retrieval 2019 - Medical Search Task - Task co-leader

CLEF eHealth Evaluation Lab 2018 - Lab co-chair

CLEF Conference 2017 - Programme co-chair

CLEF eHealth Evaluation Lab 2017 - Lab co-chair

UMAP EvalUMAP Workshop 2017 - Programme co-chair

UMAP EvalUMAP Workshop 2016 - Programme co-chair

Living Labs for IR Evaluation (LL4IR) Lab at CLEF 2016 - Lab co-chair

CLEF eHealth Evaluation Lab 2016 - Lab co-chair

Living Labs for IR Evaluation (LL4IR) Lab at CLEF 2015 - Lab co-chair

CLEF eHealth Evaluation Lab 2015 - Lab co-chair

ShARe/CLEF eHealth Evaluation Lab 2014 - Lab co-chair

ShARe/CLEF eHealth Evaluation Lab 2014 - Task 3: User-Centred Health Information Retrieval - Task co-leader

SIGIR Medical Information Retrieval Workshop 2014 - Programme co-chair

Living Labs Challenge Workshop 2014 - Programme co-chair

International Conference on Computational Linguistics (COLING) 2014 - Publications co-chair

CIKM Living Labs for Information Retrieval Evaluation Workshop 2013 - Programme co-chair

BCS-IRSG Future Directions in Information Access Symposium (FDIA) 2013 - Programme co-chair

ShARe/CLEF eHealth Evaluation Lab 2013 - Task 3: Information Retrieval to Address Patients' Questions when Reading Clinical Reports - Task co-leader

Annual International ACM SIGIR Conference 2013 - Publications co-chair

Annual International ACM SIGIR Conference 2013 - Tutorial committee

Annual International ACM SIGIR Conference 2012 - Tutorial committee

BCS-IRSG Future Directions in Information Access Symposium (FDIA) 2011 - Programme co-chair

ECIR Evaluating Personal Search Workshop 2011 - Programme co-chair

SIGIR Desktop Search Workshop 2010 - Programme co-chair


Publications

Google Scholar

2019

Conlan, Owen and Fraser, Kieran and Kelly, Liadh and Yousuf, Bilal (2019) A User Modeling Shared Challenge Proposal. In Proceedings of the 10th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September 2019.

Kelly, Liadh and Suominen, Hanna and Goeuriot, Lorraine and Neves, Mariana and Kanoulas, Evangelos and Li, Dan and Azzopardi, Leif and Spijker, Rene and Zuccon, Guido and Scells, Harrisen and Palotti, Joao (2019) Overview of the CLEF eHealth Evaluation Lab 2019. In Proceedings of the 10th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2019.

Pasi, Gabriella and Jones, Gareth J. F. and Goeuriot, Lorraine and Kelly, Liadh and Marrara, Stefania and Sanvitton, Camilla (2019) Overview of the CLEF 2019 Personalised Information Retrieval Lab (PIR-CLEF 2019). In Proceedings of the 10th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2019.

Hopfgartner, Frank and Balog, Krisztian and Lommatzsch, Andreas and Kelly, Liadh and Kille, Benjamin and Schuth, Anne and Larson, Martha (2019) Continuous Evaluation of Large-scale Information Access Systems: A Case for Living Labs. In: Ferro, N. and Peters, C (eds). CLEF@20 - 20 Years of CLEF: How to do Evaluation in a Changing World. Berlin: Springer Verlag.

Suominen, Hanna and Kelly, Liadh and Goeuriot, Lorraine (2019) The scholarly impact of CLEF eHealth 2012–2017 labs. In: Ferro, N. and Peters, C (eds). CLEF@20 - 20 Years of CLEF: How to do Evaluation in a Changing World. Berlin: Springer Verlag.

Kelly, Liadh and Yousuf, Bilal (2019) EvalUMAP2019: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization Space Workshop. Proceedings of the 3rd EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 27th Conference on User Modeling, Adaptation and Personalization (UMAP), June, 2019, Larnaca, Cyprus.

Kelly, Liadh and Goeuriot, Lorraine and Suominen, Hanna and Neves, Mariana and Kanoulas, Evangelos and Spijker, Rene and Azzopardi, Leif and Li, Dan and Jimmy and Palotti, Joao and Zuccon, Guido (2019) CLEF eHealth 2019 Evaluation Lab. In Proceedings of 41st European Conference on Information Retrieval (ECIR 2019), April 2019, Cologne, Germany.

Mooney, Peter and Kelly, Liadh (2019) How do we Transition to Smart Farming in Ireland?. Blog post in National Rural Network, March 2019.

Conlan, Owen and Fraser, Kieran and Kelly, Liadh and Yousuf, Bilal (2019) Proposal for a Shared Challenge in the UMAP Space. White paper, February 2019.

2018

Suominen, Hanna and Kelly, Liadh and Goeuriot, Lorraine and Névéol, Aurélie and Ramadier, Lionel and Robert, Aude and Kanoulas, Evangelos and Spijker, Rene and Azzopardi, Leif and Li, Dan and Jimmy and Palotti, Joao and Zuccon, Guido (2018) Overview of the CLEF eHealth Evaluation Lab 2018. In Proceedings of the 9th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2018.

Jimmy and Zuccon, Guido and Palotti, Joao and Goeuriot, Lorraine and Kelly, Liadh (2018) Overview of the CLEF 2018 Consumer Health Search Task. CLEF 2018 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2018.

Suominen, Hanna and Kelly, Liadh and Goeuriot, Lorraine (2018) Scholarly Influence of the Conference and Labs of the Evaluation Forum eHealth Initiative: Review and Bibliometric Study of the 2012 to 2017 Outcomes. Journal of Medical Information Retrieval Research Protocols, July 2018.

Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Leveling, Johannes and Lupu, Mihai and Palotti, Joao and Zuccon, Guido (2018) An Analysis of Evaluation Campaigns in ad-hoc Medical Information Retrieval: CLEF eHealth 2013 and 2014. Springer Information Retrieval Journal, May 2018.

2017

Cappellato, Linda and Ferro, Nicola and Goeuriot, Lorraine and Gonzalo, Julio and Jones, Gareth J. F. and Kelly, Liadh and Lawless, Seamus and Mandl, Thomas (2017) Report on CLEF 2017: Experimental IR Meets Multilinguality, Multimodality, and Interaction. SIGIR Forum 51(3), December 2017.

Goeuriot, Lorraine and Kelly, Liadh and Suominen, Hanna and Névéol, Aurélie and Robert, Aude and Kanoulas, Evangelos and Spijker, Rene and Palotti, Joao and Zuccon, Guido (2017) CLEF 2017 eHealth Evaluation Lab Overview. In Proceedings of the 8th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2017.

Palotti, Joao and Zuccon, Guido and Jimmy, Jimmy and Pecina, Pavel and Lupu, Mihai and Goeuriot, Lorraine and Kelly, Liadh and Hanbury, Allan (2017) CLEF 2017 Task Overview: The IR Task at the eHealth Evaluation Lab - Evaluating Retrieval Methods for Consumer Health Search. CLEF 2017 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2017.

Conlan, Owen and Kelly, Liadh and Koidl, Kevin and Lawless, Séamus and Staikopoulos, Athanasios (2017) EvalUMAP: Towards Comparative Evaluation in User Modelling, Adaptation and Personalization. In Proceedings of the PIR-CLEF Workshop, CLEF 2017 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2017.

Jones, Gareth J. F. and Lawless, Séamus and Gonzalo, Julio and Kelly, Liadh and Goeuriot, Lorraine and Mandl, Thomas and Cappellato, Linda and Ferro, Nicola (2017). Proceedings of Experimental IR Meets Multilinguality, Multimodality, and Interaction - 8th International Conference of the CLEF Association, CLEF 2017, September, 2017, Dublin, Ireland.

Conlan, Owen and Kelly, Liadh and Koidl, Kevin and Lawless, Séamus and Staikopoulos, Athanasios (2017) EvalUMAP2017: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization Space Workshop. In Proceedings of the 2nd EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 25th Conference on User Modeling, Adaptation and Personalization (UMAP), July, 2017, Bratislava, Slovakia.

Conlan, Owen and Kelly, Liadh and Koidl, Kevin and Lawless, Séamus and Staikopoulos, Athanasios (2017) EvalUMAP2017: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization Space Workshop. Proceedings of the 2nd EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 25th Conference on User Modeling, Adaptation and Personalization (UMAP), July, 2017, Bratislava, Slovakia.

2016

Kelly, Liadh (2016) Research-Centres Centred Living Lab. In Proceedings of CLEF 2016 LL4IR & NewsREEL: New Ideas Track, September, 2016.

Kelly, Liadh and Goeuriot, Lorraine and Suominen, Hanna and Névéol, Aurélie and Palotti, Joao and Zuccon, Guido (2016) Overview of the CLEF eHealth Evaluation Lab 2016. In Proceedings of the 7th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2016.

Suominen, Hanna and Zhou, Liyuan and Goeuriot, Lorraine and Kelly, Liadh (2016) Task 1 of the CLEF eHealth Evaluation Lab 2016: Handover Information Extraction. CLEF 2016 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2016.

Névéol, Aurélie and Bretonnel Cohen, Kevin and Grouin, Cyril and Hamon, Thierry and Lavergne, Thomas and Kelly, Liadh and Goeuriot, Lorraine and Rey, Grégoire and Robert, Aude and Tannier, Xavier and ZweigenBaum, Pierre (2016) Clinical Information Extraction at the CLEF eHealth Evaluation lab 2016. CLEF 2016 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2016.

Zuccon, Guido and Palotti, Joao and Goeuriot, Lorraine and Kelly, Liadh and Lupu, Mihai and Pecina, Pavel and Mueller, Henning and Budaher, Julie and Deacon, Anthony (2016) The IR Task at the CLEF eHealth Evaluation Lab 2016: User-centred Health Information Retrieval. CLEF 2016 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2016.

Kelly, Liadh (2016) Living Labs for UMAP Evaluation. In Proceedings of the EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 24th Conference on User Modeling, Adaptation and Personalization (UMAP), July, 2016, Halifax, Canada.

Conlan, Owen and Kelly, Liadh and Koidl, Kevin and Lawless, Séamus and Levacher, Killian and Staikopoulos, Athanasios (2016) EvalUMAP2016: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization Space Workshop. In Proceedings of the EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 24th Conference on User Modeling, Adaptation and Personalization (UMAP), July, 2016, Halifax, Canada.

Conlan, Owen and Kelly, Liadh and Koidl, Kevin and Lawless, Séamus and Levacher, Killian and Staikopoulos, Athanasios (2016) EvalUMAP2016: Towards Comparative Evaluation in the User Modelling, Adaptation and Personalization Space Workshop. Proceedings of the EvalUMAP Workshop - Towards Comparative Evaluation in User Modeling, Adaptation and Personalization, held in conjunction with the 24th Conference on User Modeling, Adaptation and Personalization (UMAP), July, 2016, Halifax, Canada.

Goeuriot, Lorraine and Kelly, Liadh and Zuccon, Guido and Palotti, Joao (2016) Building Evaluation Datasets for Consumer-Oriented Information Retrieval. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC), May, 2016, Portorož, Slovenia.

Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Mueller, Henning and Zobel, Justin (2016) Medical information retrieval: introduction to the special issue. Information Retrieval Journal, Springer, April, 2016.

Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Mueller, Henning and Zobel, Justin (2016) Special Issue of the Information Retrieval Journal - Medical Information Retrieval. Springer, April, 2016.

2015

Schuth, Anne and Balog, Krisztian and Kelly, Liadh (2015) Overview of the CLEF Living Labs for Information Retrieval Evaluation (LL4IR) Lab 2015. CLEF 2015 - 6th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2015.

Goeuriot, Lorraine and Kelly, Liadh and Hanlen, Leif and Suominen, Hanna and Névéol, Aurélie and Palotti, Joao and Zuccon, Guido (2015) Overview of the CLEF eHealth Evaluation Lab 2015. CLEF 2015 - 6th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September, 2015.

Schuth, Anne and Balog, Krisztian and Kelly, Liadh (2015) Extended Overview of the CLEF Living Labs for Information Retrieval Evaluation (LL4IR) Lab 2015. CLEF 2015 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2015.

Suominen, Hanna and Hanlen, Leif and Goeuriot, Lorraine and Kelly, Liadh and Jones, Gareth J.F. and Zhou, Liyuan (2015) Task 1a of the CLEF eHealth Evaluation Lab 2015: Clinical Speech Recognition. CLEF 2015 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2015.

Névéol, Aurélie and Goeuriot, Lorraine and Kelly, Liadh and Grouin, Cyril and Hamon, Thierry and Zweigenbaum, Pierre (2015) Task 1b of the CLEF eHealth Evaluation Lab 2015: Clinical Named Entity Recognition. CLEF 2015 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2015.

Palotti, Joao and Zuccon, Guido and Goeuriot, Lorraine and Kelly, Liadh and Hanbury, Allan and Jones, Gareth J.F. and Lupu, Mihai and Pecina, Pavel (2015) CLEF eHealth Evaluation Lab 2015, Task 2: User-centred health information retrieval. CLEF 2015 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2015.

2014

[alphabetical] Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Mueller, Henning and Zobel, Justin (2014) Report on the SIGIR 2014 Workshop on Medical Information Retrieval (MedIR). SIGIR Forum 48(2), December 2014.

[alphabetical] Balog, Krisztian and Kelly, Liadh and Schuth, Anne (2014) Head First: Living Labs for Ad-hoc Search Evaluation. In Proceedings of the 23rd ACM International Conference on Information and Knowledge Management (CIKM 2014), November 2014, Shanghai, China.

[alphabetical, by category] Kelly, Liadh and Goeuriot, Lorraine and Suominen, Hanna and Schrek, Tobias and Leroy, Gondy and Mowery, Danielle L. and Velupillai, Sumithra and Chapman, Wendy W. and Martinez, David and Zuccon, Guido and Palotti, Joao (2014) Overview of the ShARe/CLEF eHealth Evaluation Lab 2014. CLEF 2014 - 5th Conference and Labs of the Evaluation Forum, Lecture Notes in Computer Science (LNCS), Springer, September 2014.

[alphabetical, by category] Suominen, Hanna and Schreck, Tobias and Leroy, Gondy and Hochheiser, Harry and Goeuriot, Lorraine and Kelly, Liadh and Mowery, Danielle L. and Nualart, Jaume and Ferraro, Gabriela and Keim, Daniel (2014) Task 1 of the CLEF eHealth Evaluation Lab 2014: visual-interactive search and exploration of eHealth data. CLEF 2014 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2014.

[alphabetical, by category] Mowery, Danielle L. and Velupillai, Sumithra and South, Brett R. and Christensen, Lee and Martinez, David and Kelly, Liadh and Goeuriot, Lorraine and Elhadad, Noemie and Pradhan, Sameer and Savova, Guergana and Chapman, Wendy W. (2014) Task 2: ShARe/CLEF eHealth Evaluation Lab 2014. CLEF 2014 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2014.

[alphabetical, by category] Goeuriot, Lorraine and Kelly, Liadh and Lee, Wei and Palotti, Joao and Pecina, Pavel and Zuccon, Guido and Hanbury, Allan and Jones, Gareth J.F. and Müller, Henning (2014) ShARe/CLEF eHealth Evaluation Lab 2014, Task 3: User-centred health information retrieval. CLEF 2014 Evaluation Labs and Workshop: Online Working Notes, CEUR-WS, September, 2014.

[alphabetical] Goeuriot, Lorraine and Hanbury, Allan and Hegarty, Brendan and Hodmon, John and Kelly, Liadh and Kriewel, Sascha and Lupu, Mihai and Markonis, Dimitris and Pecina, Pavel and Schneller, Priscille (2014) D7.3 Meta-analysis of the second phase of empirical and user-centered evaluations. Public Technical Report, Khresmoi Project, August 2014.

[alphabetical] Goeuriot, Lorraine and Kelly, Liadh and Leveling, Johannes (2014) An Analysis of Query Difficulty for Information Retrieval in the Medical Domain. In Proceedings of the ACM Special Interest Group on Information Retrieval Conference (SIGIR 2014), July 2014, Gold Coast, Australia.

[alphabetical] Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Mueller, Henning and Zobel, Justin (2014) MedIR'14: Medical Information Retrieval Workshop. In Proceedings of the ACM Special Interest Group on Information Retrieval Conference (SIGIR 2014), July 2014, Gold Coast, Australia.

[alphabetical] Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Mueller, Henning and Zobel, Justin (2014) MedIR'14: Medical Information Retrieval Workshop. Proceedings of the SIGIR 2014 Workshop on Medical Information Retrieval, July 2014, Gold Coast, Australia.

Bois, Rémi and Leveling, Johannes and Goeuriot, Lorraine and Jones, Gareth and Kelly, Liadh (2014) Porting a Summarizer to the French Language. In Proceedings of Traitement Automatique du Langage Naturel (TALN), July 2014, Marseille, France.

[alphabetical] Balog, Krisztian and Elsweiler, David and Kanoulas, Evangelos and Kelly, Liadh and Smucker, Mark D. (2014) Report on the CIKM Workshop on Living Labs for Information Retrieval Evaluation. SIGIR Forum 48(1), June 2014.

Li, Wei and Roberts, Angus and Petrak, Johann and Dolamic, Ljiljana and Jones, Gareth and Kelly, Liadh and Goeuriot, Lorraine (2014) D1.8 - Report on results of the WP1 second evaluation phase. Public Technical Report, Khresmoi Project, June 2014.

[alphabetical, by category] Goeuriot, Lorraine and Chapman, Wendy and Jones, Gareth J.F and Kelly, Liadh and Leveling, Johannes and Salanterä, Sanna (2014) Building Realistic Potential Patients' Queries for Medical Information Retrieval Evaluation. In Proceedings of the LREC workshop on Building and Evaluating Resources for Health and Biomedical Text Processing, May 2014, Reykjavik, Iceland.

Kelly, Liadh and Dungs, Sebastian and Kriewel, Sascha and Hanbury, Allan and Goeuriot, Lorraine and Jones, Gareth J.F. and Langs, Georg and Müller, Henning (2014) Khresmoi Professional: Multilingual, Multimodal Professional Medical Search. In Proceedings of 36th European Conference on Information Retrieval (ECIR 2014), April 2014, Amsterdam, The Netherlands.

[alphabetical, by category] Schneller, Priscille and Choukri, Khalid and Gobeill, Julien and Kelly, Liadh and Langs, Georg and Markonis, Dimitrios and Pecina, Pavel and Pentchev, Konstantin and Pletneva, Natalia and Roberts, Angus (2014) D6.2 - Public version and updated report on the KHRESMOI data collection. Public Technical Report, Khresmoi Project, 28 February 2014.

[alphabetical, by category] Pecina, Pavel and Dušek, Ondřej and Goeuriot, Lorraine and Hajič, Jan and Hlaváčová, Jaroslava and Jones, Gareth J.F. and Kelly, Liadh and Leveling, Johannes and Mareček, David and Novák, Michal and Popel, Martin and Rosa, Rudolf and Tamchyna, Aleš and Urešová, Zdeňka (2014) Adaptation of machine translation for multilingual information retrieval in the medical domain. Artificial Intelligence in Medicine, Elsevier, February 2014.

2013

Kelly, Liadh and et al (2013) D7.1.2 - Updated user-centered and empirical evaluation strategy and recommendations. Confidential Technical Report, Khresmoi Project, 31 December 2013.

[alphabetical] Balog, Krisztian and Elsweiler, David and Kanoulas,  Evangelos and Kelly, Liadh and Smucker, Mark D. (2013) CIKM 2013 Workshop on Living Labs for Information Retrieval Evaluation, In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM 2013), November 2013, San Francisco, USA.

[alphabetical] Balog, Krisztian and Elsweiler, David and Kanoulas,  Evangelos and Kelly, Liadh and Smucker, Mark D. (2013) Proceedings of the CIKM 2013 Workshop on Living Labs for Information Retrieval Evaluation, 1 November 2013, San Francisco, USA. (workshop website)

[alphabetical, by category] Suominen, Hanna and Salanterä, Sanna and Velupillai, Sumithra and Chapman, Wendy W. and Savova, Guergana and Elhadad, Noemie and Pradhan, Sameer and South, Brett R. and Mowery, Danielle L. and Jones, Gareth J.F. and Leveling, Johannes and Kelly, Liadh and Goeuriot, Lorraine and Martinez, David and Zuccon, Guido (2013) Overview of the ShARe/CLEF eHealth Evaluation Lab 2013, CLEF 2013, September 2013, Valencia, Spain.

[alphabetical, by category] Goeuriot, Lorraine and Jones, Gareth J.F. and Kelly, Liadh and Leveling, Johannes and Hanbury, Allan and Müller, Henning and Salanterä, Sanna and Suominen, Hanna and Zuccon, Guido (2013) ShARe/CLEF eHealth Evaluation Lab 2013, Task 3: Information Retrieval to Address Patients' Questions when Reading Clinical Reports, CLEF online working notes, September 2013, Valencia, Spain.

[alphabetical, by category] Azzopardi, Leif and Kelly, Liadh and Castells, Pablo and Fernández-Luna, Juan M. and Huete, Juan F. (2013) Proceedings of the Fifth BCS-IRSG Symposium on Future Directions in Information Access (FDIA 2013). 3 September 2013, Granada, Spain. (symposium website)

[alphabetical] Aswani, Niraj and Beckers, Thomas and Birngruber, Erich and Boyer, Célia  and Burner, Andreas and Bystroň, Jakub and Choukri, Khalid and Cruchet, Sarah and Cunningham, Hamish and Dědek, Jan and Dolamic, Ljiljana and Donner, René and Dungs, Sebastian and Eggel, Ivan and Foncubierta, Antonio and Fuhr, Norbert and Funk, Adam and Garcia Seco de Herrera, Alba and Gaudinat, Arnaud and Georgiev, Georgi and Gobeill, Julien and Goeuriot, Lorraine and Gomez, Paz and Greenwood, Mark and Gschwandtner, Manfred and Hanbury, Allan and Hajič, Jan and Hlaváčová, Jaroslava and Holzer, Markus and Jones, Gareth and Jordan, Blanca and Jordan, Matthias and Kaderk, Klemens and Kainberger, Franz and Kelly, Liadh and Kriewel, Sascha and Kritz, Marlene and Langs, Georg and Lawson, Nolan and Markonis, Dimitrios and Martinez, Iván and Momtchev, Vassil and Masselot, Alexandre and Mazo, Hélčne and Müller, Henning and Pecina, Pavel and Pentchev, Konstantin and Peychev, Deyan and Pletneva, Natalia and Pottecher, Diana and Roberts, Angus and Ruch, Patrick and Samwald, Matthias and Schneller, Priscille and Stefanov, Veronika and Tinte, Miguel Angel and Urešová,  Zdeňka and Vargas, Alejandro and Vishnyakova, Dina (2013) Khresmoi – multilingual semantic search of medical text and images, MedInfo 2013, August 2013, Copenhagen, Denmark.

Goeuriot, Lorraine and Kelly, Liadh and Kriewel, Sascha and Jones, Gareth J.F. and Rodriguez, Ivan Martinez and Garcia,  Miguel Angel Tinte and Pecina, Pavel and Tamchyna, Ales and Donner, René (2013) D3.4 Report on user input for updating resources. Public Technical Report, Khresmoi Project, August 2013.

Goeuriot, Lorraine and Kelly, Liadh and Leveling, Johannes and Mougard, Hugo and Jones, Gareth J.F. and Pecina, Pavel and Hajič, Jan (2013) D4.5 Report on query expansion techniques. Public Technical Report, Khresmoi Project, August 2013.

[alphabetical] Goeuriot, Lorraine and Hamon, Olivier and Hanbury, Allan and Jones, Gareth J.F. and Kelly, Liadh and Robertson, Joshua (2013) D7.2 Meta-analysis of the first phase of empirical and user-centered evaluations. Public Technical Report, Khresmoi Project, August 2013.

Goeuriot, Lorraine and Kelly, Liadh and Jones, Gareth J.F. (2013) Test Collections for Medical Information Retrieval Evaluation. In Proceedings of the SIGIR 2013 Health Search and Discovery HSD workshop, July 2013, Dublin, Ireland.

Kelly, Liadh and Hanbury, Allan and Jones, Gareth J.F. and Goeuriot, Lorraine and Müller, Henning (2013) Khresmoi Professional: Multilingual Semantic Search for Medical Professionals. In Proceedings of the SIGIR 2013 Health Search and Discovery HSD workshop, July 2013, Dublin, Ireland.

Goeuriot, Lorraine and Kelly, Liadh and Jones, Gareth, J.F. and Zuccon, Guido and Suominen, Hanna and Hanbury, Allan and Muller, Henning and Leveling, Johannes (2013) Creation of a New Medical Information Retrieval Evaluation Benchmark Targeting Patients Needs. In Proceedings of The Fifth International Workshop on Evaluating Information Access (EVIA 2013) - A Satellite Workshop of NTCIR-10, June 2013, Tokyo, Japan.

Kelly, Liadh and Leveling, Johannes and McQuillan, Shane and Kriewel, Sascha and Goeuriot, Lorraine and Jones, Gareth J.F. (2013) D4.4 - Report on summarization techniques. Public Technical Report, Khresmoi Project, 28 February 2013.

2012

Leveling, Johannes and Goeuriot, Lorraine and Kelly, Liadh and Jones, Gareth J.F. (2012) DCU@TRECMed 2012: Using ad-hoc baselines for domain-specific retrieval. In: Medical Records Track, Text Retrieval Conference (TREC 2012), November 2012, Gaithersburg, USA.

Kelly, Liadh and Goeuriot, Lorraine and Jones, Gareth (2012) Global Empirical Evaluation Strategy (Investigating Khresmoi System Effectiveness). Khresmoi Newsletter 4, October 2012.

Kelly, Liadh and Goeuriot, Lorraine and Jones, Gareth J.F. and Hanbury, Allan (2012) Considering subjects and scenarios in large-scale user-centered evaluation of a multilingual multimodal medical search system. In: CLEFeHealth 2012 workshop - Cross-Language Evaluation of Methods, Applications, and Resources for eHealth Document Analysis, 18 September 2012, Rome, Italy.

Aswani, Niraj and Kelly, Liadh and Greenwood, Mark and Roberts, Angus and Samwald, Matthias and Pletneva, Natalia and Jones, Gareth and Goeuriot, Lorraine (2012) D1.3 - Report on results of the WP1 first evaluation phase. Public Technical Report, Khresmoi Project, 30 August 2012.

[alphabetical] Beckers, Thomas and Dungs, Sebastian and Fuhr, Norbert and Goeuriot, Lorraine and Ignalski, Jessica and Jordan, Matthias and Kelly, Liadh and Kriewel, Sascha (2012) D3.2 - Report on results of the WP3 first evaluation phase. Public Technical Report, Khresmoi Project, 30 August 2012.

[alphabetical] Aswani, Niraj and Beckers, Thomas and Birngruber, Erich and Boyer, Célia and Burner, Andreas and Bystron, Jakub and Choukri, Khalid and Cruchet, Sarah and Cunningham, Hamish and Dedek, Jan and Dolamic, Ljiljana and Donner, René and Dungs, Sebastian and Eggel,Ivan and Foncubierta, Antonio and Fuhr, Norbert and Funk, Adam and Garcia Seco de Herrera, Alba and Gaudinat, Arnaud and Georgiev, Georgi and Gobeill, Julien and Goeuriot, Lorraine and Gomez, Paz and Greenwood, Mark and Gschwandtner, Manfred and Hanbury, Allan and Hajic, Jan and Hlavácová, Jaroslava and Holzer, Markus and Jones, Gareth and Jordan, Blanca and Jordan, Matthias and Kaderk, Klemens and Kainberger, Franz and Kelly, Liadh and Kriewel, Sascha and Kritz, Marlene and Langs, Georg and Lawson, Nolan and Markonis, Dimitrios and Martinez, Iván and Momtchev, Vassil and Masselot, Alexandre and Mazo, Hélčne and Müller, Henning and Pecina, Pavel and Pentchev, Konstantin and Peychev, Deyan and Pletneva, Natalia and Pottecher, Diana and Roberts, Angus and Ruch, Patrick and Samwald, Matthias and Schneller, Priscille and Stefanov, Veronika and Tinte, Miguel Angel and Urešová, Zdenka and Vargas, Alejandro and Vishnyakova, Dina (2012) Khresmoi - Multimodal Multilingual Medical Information Search. In: Proceedings of Medical Informatics Europe 2012 (MIE 2012), Village of the Future, 26-29 August 2012, Pisa, Italy.

[alphabetical] Goeuriot, Lorraine and Hanbury, Allan and Jones, Gareth J. F. and Kelly, Liadh and Kriewel, Sascha and Martinez, Ivan Rodriquez and Muller, Henning and Tinte, Miguel A. (2012) Supporting Collaborative Improvement of Resources in the Khresmoi Health Information System. In: The Collaborative Resource Development and Delivery LREC Workshop, 27 May 2012, Istanbul, Turkey.

[alphabetical] Goeuriot, Lorraine and Jones, Gareth and Kelly, Liadh and Kriewel, Sascha and Pecina, Pavel (2012) D3.1 - Report on and prototype of the translation support. Public Technical Report, Khresmoi Project, 10 May 2012.

Byrne, Daragh and Kelly, Liadh and Jones, Gareth J.F. (2012) Multiple multimodal mobile devices: Lessons learned from engineering lifelog solutions. In: Handbook of Research on Mobile Software Engineering: Design, Implementation and Emergent Applications.

Kelly, Liadh and Bunbury, Paul and Jones, Gareth J.F. (2012) Evaluating Personal Information Retrieval. In: ECIR 2012 - 34th European Conference on Information Retrieval, 1-5 April 2012, Barcelona, Spain.

2011

Kelly, Liadh and Kim, Jinyoung and Elsweiler, David (2011) Report on Evaluating Personal Search Workshop. SIGIR Forum, 45 (2). pp. 81-86.

Kelly, Liadh (2011) Context driven retrieval algorithms for semi-structured personal lifelogs. PhD thesis, Dublin City University.

Kelly, Liadh and Azzopardi, Leif (2011) Proceedings of the Fourth BCS-IRSG Symposium on Future Directions in Information Access (FDIA 2011). 31 August 2011, Koblenz, Germany. (symposium website)

Kelly, Liadh and et al (2011) D7.1.1 - User-centered and empirical evaluation strategy and recommendations. Confidential Technical Report, Khresmoi Project, 31 August 2011.

Kelly, Liadh and Jones, Gareth J.F. (2011) Towards 'Cranfield' test collections for personal data search evaluation. In: ECIR 2011 Workshop on Evaluating Personal Search, 18 April 2011, Dublin, Ireland.

[alphabetical] Elsweiler, David and Kelly, Liadh and Kim, Jinyoung (2011) Proceedings of the ECIR 2011 Workshop on Evaluating Personal Search. 18 April 2011, Dublin, Ireland. (workshop website)

2010

[alphabetical] Elsweiler, David and Jones, Gareth J.F. and Kelly, Liadh and Teevan, Jaime (2010) Workshop on Desktop Search. SIGIR Forum, 44 (2). pp. 28-34. ISSN 0163-5840

Kelly, Liadh and Jones, Gareth J.F. (2010) An exploration of the utility of affective response in SenseCam archives. In: SenseCam Symposium 2010, 16-17 September 2010, Dublin, Ireland.

Chen, Yi and Kelly, Liadh and Jones, Gareth J.F. (2010) Supporting episodic memory from personal lifelog archives using SenseCam and contextual cues. In: SenseCam Symposium 2010, 16-17 September 2010, Dublin, Ireland.

Kelly, Liadh and Jones, Gareth J.F. (2010) An exploration of the utility of GSR in locating events from personal lifelogs for reflection. In: iHCI 2010 - 4th Irish Human Computer Interaction Conference, 2-3 September 2010, Dublin, Ireland. ISBN 1872327885

Salway, Andrew and Kelly, Liadh and Skadiņa, Inguna and Jones, Gareth J.F. (2010) Portable extraction of partially structured facts from the web. In: IceTAL 2010 - 7th International Conference on Natural Language Processing, 16-18 August 2010, Reykjavik, Iceland. ISBN 978-3-642-14769-2

Chen, Yi and Kelly, Liadh and Jones, Gareth J.F. (2010) Memory support for desktop search. In: Desktop Search Workshop at SIGIR 2010, 23 July 2010, Geneva, Switzerland.

[alphabetical] Elsweiler, David and Jones, Gareth J.F. and Kelly, Liadh and Teevan, Jaime (2010) Proceedings of the SIGIR 2010 Workshop on Desktop Search. 23 July 2010, Geneva, Switzerland. (workshop website)

Kelly, Liadh and Jones, Gareth J.F. (2010) Biometric response as a source of query independent scoring in lifelog retrieval. In: ECIR 2010 - 32nd European Conference on Information Retrieval, 28-31 March 2010, Milton Keynes, UK. ISBN 978-3-642-12274-3

2009

Kelly, Liadh and Byrne, Daragh and Jones, Gareth J.F. (2009) The role of places and spaces in lifelog retrieval. In: PIM 2009 - Personal Information Management, 7-8 November, 2009, Vancouver, Canada.

Kelly, Liadh and Jones, Gareth J.F. (2009) Examing the utility of biometric response for SenseCam archive browsing. In: SenseCam Symposium, 16-17 October 2009, Chicago, USA.

Kelly, Liadh and Jones, Gareth J.F. (2009) Examining the utility of affective response in search of personal lifelogs. In: 5th Workshop on Emotion in Human-Computer Interaction, held at the 23rd BCS HCI Group conference 2009, 1 September 2009, Cambridge, UK.

2008

Jones, Gareth J.F. and Gurrin, Cathal and Kelly, Liadh and Byrne, Daragh and Chen, Yi (2008) Information access tasks and evaluation for personal lifelogs. In: 2nd International workshop on Evaluating Information Access (EVIA), 16 December 2008, Tokyo, Japan.

Kelly, Liadh and Chen, Yi and Fuller, Marguerite and Jones, Gareth J.F. (2008) A study of remembered context for information access from personal digital archives. In: IIiX 2008 - 2nd international symposium on Information interaction in context , 14-17 October 2008, London, UK. ISBN 978-1-60558-310-5

Kelly, Liadh (2008) Context and linking in retrieval from personal digital archives. In: SIGIR 2008 - 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 20-24 July 2008, Singapore. ISBN 978-1-60558-164-4

Fuller, Marguerite and Kelly, Liadh and Jones, Gareth J.F. (2008) Applying contextual memory cues for retrieval from personal information archives. In: PIM 2008 - Personal Information Management in conjunction with CHI 2008 Workshop, 5-6 April 2008, Florence, Italy.

2007

Kelly, Liadh (2007) Searching Heterogeneous Human Digital Memory Archives. In: K-Space Jamboree Workshop, 14 September 2007, Berlin, Germany.

Kelly, Liadh and Jones, Gareth J.F. (2007) Venturing into the labyrinth: the information retrieval challenge of human digital memories. In: Workshop on Supporting Human Memory with Interactive Systems, 4 September 2007, Lancaster, UK.

Kelly, Liadh (2007) The information retrieval challenge of human digital memories. In: BCS IRSG Symposium: Future Directions in Information Access 2007, 28-29 August 2007, Glasgow, Scotland.