I am a co-director of the Human Modeling Group at DCU and a co-investigator at the INSIGHT Centre for Data Analytics and the Adapt Centres at DCU. My research is in the areas of Multimedia Information Retrieval, Digital Memories and Mobile Device Access. My PhD research was on methods of exploiting linkage densities in WWW graphs to improve ranking in Search Engine results. Since my PhD I have worked within the CDVP initially developing multimedia search engines for image and video. My research Interests can be summarised under the following headings:

  • Human Digital Memories - capturing, storing, understanding, searching, filtering, recommending and providing ubiquitous access to personal digital memories and personal multimedia collections. My work has focused on sensecam data, but also GPS and human sensing data. I have gathered a personal sensecam archive for 15 years (Oct 2021).
  • Multimedia Information Retrieval - indexing and retrieval of Multimedia data (video and image data). I have been heavily involved in the development of the Físchlár digital video suite (Físchlár-News, Físchlár-TREC, Físchlár-Sheffield and Físchlár-Nursing).
  • Mobile Access - developing search engines to support access to multimedia content on mobile devices is a challenge that I am addressing through the iAD project.
  • WWW search - Large scale search for WWW data, being the subject of my PhD thesis, is still an area of great interest to me.
  • Person and Environmental Sensing -sensing the person and the environment; developing search infrastructures and retrieval strategies to deal with such sensor streams.

Research Team (Jan 2021)

  • Dajung Jung, RA, Ai-mediated social interaction
  • Manoj Kesavalu, PhD Student, Software Engineering
  • Khiem Tu Le, PhD Student, Deep Lifelog Systems
  • Tu Van Ninh, PhD Student, VR-mediated Health Interventions
  • Ahmed Alateeq, PhD Student, Spoken Interactive Interfaces
  • Ly Duyen Tran, PhD Student, Interactive Lifelog Retrieval
  • Duy Manh Nguyen, PhD Student, Personal Knowledge Graphs
  • Nhu Nguyen Thao, PhD Student, Lifelog Systems
  • Mai Boi Quach, PhD Student, Lifelog Systems
  • Naushad Alam, PhD Student, Lifelog Systems

Graduated/Graduating PhDs

  • Niamh Caprani, PhD in HCI issues of access to Lifelogs. Graduated in 2013.
  • Zhengwei Qiu, Phd in Multimodal Access to Lifelogs. Graduated in 2013.
  • David Scott, PhD in New Ranked List approaches for Digital Video Retrieval. Graduated in 2013.
  • Peter Tiernan, Phd in Pedagocial aspects of Video in the Classroom. Graduated in 2015.
  • Lijuan Zhou, PhD in Enhanced Linkage and Retrieval models for Lifelogs. Graduated in 2016.
  • Zhenxing Zhang, PhD in Semantic Extraction from UGC digital video. Graduated in 2017
  • Tengqi Ye, PhD in Transfer Learning for Lifelong Visual Annotation. Graduated in 2018
  • Zaher Hinbarji, PhD in Informational Lifelogging and Dynamic Authentication. Graduated in 2018
  • Aaron Duane, PhD in VR access to Lifelogs. Graduated in 2019
  • Rashmi Gupta, PhD in Lifelog Retrieval. Graduated in 2021
  • Liting Zhou, PhD in Lifelog Causality. Graduates in 2021.
  • Liting Zhou, PhD, Causality-inspired Lifelog Retrieval Systems. Graduating 2022.

Previously supervised:

  • Dr. Jiang Zhou, PostDoc on the KidsCam project
  • Dr. Rami Albatal, Postdoc on INSIGHT, focus on Lifelogging.
  • Brian Moynagh, , PhD in Personal Sensing Fusion
  • Stefan Terziyeski, PhD in Lifelog Data Analytics
  • Moohamad Hinbarji, Lifelogging Infrastructure
  • Jinlin Guo, PhD in Video Semantics for annotation generation.
  • Yang Yang, Interaction and Interface design for personal life archives
  • Yun Jin, Energy and Fatigue detection from wearable sensors
  • Na Li, Liestyle activity monitoring for the LifeLens project.
  • Dr Frank Hopfgartner, Postdoc working on content-access to MM content. (2011-2012)
  • Dr Colum Foley, Postdoc working on Collaborative Approaches to Video Retrieval (2010-2011)
  • Dr Paul Ferguson, Postdoc working on content-access to MM content. (2010)
  • Dr Dave Sadlier, Postdoc working on event detection from MM video streams (2010)
  • Dr Sorin Sav, Postdoc working on Content-based video retrieval (2009)
  • HongYi Wang, Research Assistant working on audio analysis for Semantic Annotation & Interaction Development

  • Active Projects (Investigator / Co-Investigator)

  • Lifelogging for Reading (2020-2022). Exploring the potential of lifelogging tools to assist a learner when reading new content.
  • Active Peers AI (2021-2022). Enterprise Ireland IPFS project to explore the commercial potential of integrating personal recommendation into professional service provision.
  • VR Reminiscence Therapy (2018-2021) SFI/Adapt project exploring how reminiscence therapy can integrate lifelogging tools in a VR-mediated setting to enhance the therapy benefits.

Previous Projects

Principal Investigator Projects Vizier AAL (2016-2020). EU AAL collaborative project with academia and industry to develop and evaluate new sensing technology for assistive living of elders.
• NSF i-Corps Programme (2017).
Source: SFI. A specialised training programme to define the commercial potential of lifelogging research.

  • EyeAware (2013-2014). Source: SFI. Developing new assistive technologies using lifelogging tools, using large-scale datasets and machine learning.
  • Information Access Disruptions (2008-2014). Source: Norwegian Research Council. To develop and evaluate extreme precision search and recommendation solutions that support effective multi-modal access to multimedia content.
  • LifeLens (2012-2013). Source: Enterprise Ireland. The aim of this project is to develop lifelogging technologies to address market requirements in the fields of personalised healthcare and market research.
  • MemoryMesh - Cognitive Psychology Linking for E-memories (2011-2015) Source: Science Foundation Ireland. This project developed new organising and linking technologies for e-memories to encode life experience digitally and support retrieval and link traversal.
  • MyEnergy (2011-2012). Source: Enterprise Ireland. The aim of this project is to develop unobtrusive, accurate measurement of user activities in everyday environments. This project employs Artificial Intelligence and machine learning to mine knowledge from wearable sensor streams to better understand user context.
  • MyMoments (2011-2011). Source: Enterprise Ireland. A project to evaluate the commercial feasibility of the ongoing Human Digital Memory research within HMA & CLARITY.
  • SFI Stokes Lectureship (2007-2012). Source : Science Foundation Ireland. The Science Foundation Ireland Stokes Professorship and Lectureship Programme is designed to support the strategic planning for increasing the number of research active faculty members in Irish Universities. The first five years of my lectureship at DCU is sponsored by a SFI Stokes award.

Co-Investigator Projects
  • MetaLabs (2011 - 2012). Source: NDRC : National Digital Research Centre. Aim: Working with commercial partners, the aim is to enhance the utility of online video by automatic annotation and semantic segmentation of video content. This is a commercialisation project.
  • InsideOut (2009 - 2010). Investigator.. My focus on sensor middleware.
  • Real-World Video Analysis (2009 - 2010). Investigator of a project to deploy content analysis of video content to real-world security installations.
  • Financial Sentiment. Investigator (2008 — 2009) of a team of three people (two postdocs and one research assistant) in developing sentiment analysis technologies for financial planning.

Previous Projects (Researcher)
  • Digital TV Search (2007 - 2008). Project Manager, Researcher & Principal Negotiator - of a team of five people - deploying video search technologies on TVs for a major multinational.
  • Context-aware Photo Search (2006 - 2007). Project Manager & Researcher - of a team of four - developing context-aware photo management tools for a major multinational.
  • Mediassist (2003 - 2006). Postdoctoral Researcher - working on methods to automatically organise personal photo collections.
  • Físchlár II (2001 - 2003). PhD Student & Postdoc - working on techniques to search, filter, alert and summarise video news programmes.