Aiden Roger Doherty BSc, PhD – Researcher

aiden_oct_2009

Research Interests

Awards Received

Publications

Research Visits

Press Coverage

 

About Me

Contact Details

CLARITY-logo-small-copy

BHF_logo.png

*** Link to Green Gold... documentary on RTÉ 1 last week ... see 18 mins into video ***

 

*** Link to my presentation at the globe forum on Smart Grid feedback ***

 

*** Link to Globe Forum profile ***

 

*** DCU/CLARITY SenseCam Browser (+ source code!) now available!!! ***

 

*** CLARITY Environmental Sensor Portal ***

 

*** CLARITY Environmental Sensor Data REST APIs ***

 

*** CLARITY Home Energy Browser (to view data from one location, use user name & password of “n205” ***

*** Organising Committee of SenseCam 2010 - Second Annual SenseCam Symposium ***

 

*** SenseCam Wiki ***

 

*** Link to CLARITY SenseCam work featured on Newstalk 106FM in Ireland ***

 

*** News article on my participation in Globe Forum ***

 

*** Link to my BHF Health Promotion Research page in Oxford ***

 

*** My LinkedIn profile ***

 

Research Interests

My primary research interest is in the area of passive/non-intrusive personal life recording, predominantly in the sense of having a visual diary of oneself. Why this area? Well in preliminary studies carried out by neuroscientists in the memory clinic of Addenbrooke’s Hospital in Cambridge, U.K., it has been shown that reviewing images of one’s life may be very beneficial for those with significant memory difficulties. Indeed in a very recent study using fMRI scans Dr. Emma Berry and her research colleagues in Addenbrooke’s have noted that SenseCam images appear to provide exceptionally strong memory cues. This work has received attention in Science Magazine, and also Time Magazine, among other places. The SenseCam, now rebranded as the Vicon Revue, is available for purchase!!

 

A big problem that memory researchers and clinical/cognitive neuropsychologists are having with this device is coping with the incredible volume of images generated. As a result subjects were encouraged to only wear the SenseCam for certain events, rather than the whole day – where unexpected interesting events could take place. However in my PhD thesis I detail a number of automated processes to summarise the 700k+ images per year generated by the SenseCam.

 

I am of the firm belief that the most exciting research happens when people from completely diverse backgrounds work together. My own visual information management research has resulted in a software distribution to a number of SenseCam memory researchersLeeds, Duke University, Toronto, UIUC, and CMU. This software has also been distributed to Utrecht, Tampere, and Limerick universities.

 

Indeed I am currently in close collaboration with Dr. Chris Moulin and Katalin Pauly-Takacs in Leeds on investigating the effectiveness and strength of retrieval cues offered by automatically “cherry-picked” SenseCam images. We are conducting these studies with Dr. Cathal Gurrin who has the most extensive know collection of SenseCam images.

 

Furthermore a major theme of CLARITY is multi-disciplinary research, where I interact with sports scientists, chemists, hardware engineers, etc. Recently I was working with Microsoft Research in Redmond, WA, USA on a highly related project whereby we were leveraging the ubiquity of the cell phone to encourage people to log more of their physiological data. Currently medical practitioners only get to see us in one snapshot in time every year or so, which makes it difficult to make an objective decision on one’s well-being. By making it easier, and fun, for people to regularly record their physiological activities (through using the cell phone, which we’ve all got), I believe that we’ll be able to make much more informed and proactive (rather than reactive) decisions on our health and well-being. This is an exciting area of research which is only going to become more and more prevalent, and a video of the presentation I gave in Redmond gives a good overview of the current start of the art.

 

For those who are particularly interested in this area of recording life’s activities, a video of my presentation at the SAMT conference gives a pretty good overview of work completed thus far in processing SenseCam images, and also detailing exciting future directions. Please do keep an eye on the SenseCam wiki where various approaches to these (and other!) problems will be addressed in detail.

 

Some of my PhD work was recently broadcast on a BBC television science program, and also shown around 23 minutes into this lecture given by Jim Gemmell & Gordon Bell in the Computer History Museum. In my time I have also developed research interests in other aspects of multimedia indexing & searching, home energy monitoring, sports & personal health applications, eyetracking devices to evaluate interfaces, brain wave readers, and data mining.

 

Awards Received

 

July 2010

Received Health Research Board & EU Marie Curie Funding for a three year Postdoctoral Fellowship with Oxford University and CLARITY DCU

December 2007

Received Full Microsoft Ireland Postgraduate Scholarship award within Dublin City University School of Computing

September 2005

Received Postgraduate Accommodation Scholarship from Office of the Vice-President for Research in Dublin City University

October 2005

Received Government of Ireland scholarship from the Irish Research Council for Science, Engineering and Technology (IRCSET)

July 2005

‘Valedictorian’ speaker at my BSc graduation ceremony.

 

4x Invention Disclosures

Related to Lifelogging. Doherty A.R, Kelly P, Gurrin C, Smeaton A.F. and O’Connor N.E. (in submission) 2010.

 

Related to Energy Monitoring. Doherty A.R, Zhengwei Qiu, Cathal Gurrin and Smeaton A.F. (in submission) 2009.

 

Related to Tennis. Healy G, O’Huiginn B, Coyle S, Doherty A.R, Connaghan D, O’Connor N.E, Smeaton A.F, Smyth B, and Diamond D. (in submission) 2009.

 

Related to Lifelogging. Doherty A.R, Smeaton A.F, and Byrne D. (in submission) 2009.

 

 

33x Peer Reviewed Publications

Caprani, N., Doherty, A.R., Smeaton, A.F., O'Connor, N.E. and Gurrin, C. (2011) Design Considerations for a Touchscreen Visual Lifelog In: MMM2011: The 17th International Conference on MultiMedia Modeling, January 5-7, 2011, Taiwan.

Proceedings of the second annual SenseCam symposium (SenseCam 2010). Berry E, Byrne D, Doherty A.R, Gurrin G, and Smeaton A.F. (Eds.) Proceedings of the second annual SenseCam symposium (SenseCam 2010), Dublin, Ireland, 16th-17st September 2010, ISBN 1872-327-915.

 

Correlating Multimodal Physical Sensor Information with Biological Analysis in Ultra Endurance Cycling. May G, Doherty A.R, Smeaton A.F. and Warrington G. SENSORS 2010, vol 10, no. 8, pp 7216-7235 (Journal Impact factor = 1.821, rank 31/70Chemistry,Analytical, 12/22Electrochemistry, & 11/56Instruments & Instrumentation).

 

Automatically Assisting Human Memory: A SenseCam Browser. Doherty A.R, Moulin C, and Smeaton A.F. Memory: Special Issue on SenseCam: The Future of Everyday Research? Taylor and Francis 2010. (in press) (Journal Impact factor = 1.580)

 

Green Multimedia: Informing People of their Carbon Footprint through Two Simple Sensors. Doherty A.R, Ziu Z, Foley C, Lee H, Gurrin G, and Smeaton A.F. ACM Multimedia 2010, Firenze, Italy, 25-29th October 2010.

 

The Colour of Life: Novel Visualisations of Population Lifestyles. Kelly P, Doherty A.R, Smeaton A.F, Gurrin G, and O’Connor N. ACM Multimedia 2010, Firenze, Italy, 25-29th October 2010.

 

Effects of Environmental Colour on Mood: A Wearable Life Colour Capture Device. Doherty A.R, Kelly P, Smeaton A., O’Flynn B., Curran P, O’Connor N, and O’Mathuna C. ACM Multimedia 2010, Firenze, Italy, 25-29th October 2010.

 

Smart Tablecloths – Ambient Feedback of Domestic Electricity Consumption. Mitchell E, Coyle S, Doherty A.R, O’Connor N, Smeaton A.F. and Diamond D. iHCI 2010: Demo paper in Irish Human Computer Interaction Conference, Dublin, Ireland, 2-3rd September 2010.

 

Physiological, Haematological and Performance Characteristics of Ultra Endurance Cyclists Competing in the Inaugural Race Around Ireland. May G.C, Dolan E, Fitzpatrick P.A, Doherty A.R, Smeaton A.F, and Warrington G. ACSM-2010: 57th Annual Meeting of the American College of Sports Medicine – World Congress on Exercise is Medicine, Baltimore, MY, USA, 1-5th June 2010.

 

DCU at NTCIR-8 GeoTime. Qiu Z, Gurrin C, Doherty A.R, and Smeaton A.F. NTCIR-8: Information Retrieval, Question Answering, and Cross-Lingual Information Access, Tokyo, Japan, 15-18th June 2010.

 

Proceedings of the Information Access for Personal Media Archives Workshop (IAPMA 2010). Doherty A.R, Gurrin G, Jones G.F, and Smeaton A.F. (Eds.) Proceedings of a Workshop held at the European Conference in Information Retrieval, Milton Keynes, U.K., 28th-31st March 2010, ISBN 1872-327-869.

 

Term Weighting Approaches for Mining Significant Locations from Personal Location Logs. Qiu Z, Gurrin C, Doherty A.R, and Smeaton A.F. CIT 2010, 10th IEEE International Conference on Computer and Information Technology, Bradford, U.K., 19th June – 1st July 2010.

 

Designing a Touch-Screen SenseCam Browser to Support an Aging Population. Caprani N, Doherty A.R, Lee H, Smeaton A.F., O’Connor N, and Gurrin C CHI’10 – 28th ACM Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, 10-15 April 2010.

 

Beyond Shot Retrieval: Searching for Broadcast News Items Using Language Models of Concepts. Aly R, Doherty A.R, Hiemstra D, and Smeaton A.F. ECIR’10 – 32nd European Conference on Information Retrieval, Milton Keynes, U.K., 28-31 March 2010.

 

Automatically Augmenting Lifelog Events using Pervasively Generated Content from Millions of People. Doherty A.R, and Smeaton A.F. SENSORS 2010, vol 10, no. 3, pp 1423-1446 (Journal Impact factor = 1.821, rank 31/70Chemistry,Analytical, 12/22Electrochemistry, & 11/56Instruments & Instrumentation).

 

Utilising Contextual Memory Retrieval Cues and the Ubiquity of the Cell Phone to Review Lifelogged Physiological Activities. Doherty A.R, Tolle K and Smeaton A.F. IMCE’09 - International Workshop on Interactive Multimedia for Consumer Electronics, Beijing, China, 23 October 2009.

 

An Investigation into Event Decay from Large Personal Media Archives. Doherty A.R, Gurrin C and Smeaton A.F. EIMM’09 – 1st ACM International Workshop on Events in Multimedia, Beijing, China, 23 October 2009.

 

Everyday Concept Detection in Visual Lifelogs: Validation, Relationships and Trends. Byrne D, Doherty A.R, Snoek C.G.M, Jones G.F, and Smeaton A.F. Multimedia Tools and Applications Journal, (in press) 2009.

 

Video Shot Boundary Detection: Seven Years of TRECVid Activity. Smeaton A.F, Over P and Doherty A.R. Journal of Computer Vision and Image Understanding, (in press) 2009. (Journal Impact Factor = 2.220, rank 25/94Computer Science, Artificial Intelligence, & 47/229Engineering, Electrical & Electronic)

 

Data Collection Methods for Analyzing Task-Based Information Access in Molecular Medicine. Kumpulainen S, Jarvelin K, Serola S, Doherty A.R, Byrne D, Smeaton A.F, and Jones G. MobiHealthInf 2009 - 1st International Workshop on Mobilizing Health Information to Support Healthcare-related Knowledge Work, Porto, Portugal, 16 January 2009.

 

Validating the Detection of Everyday Concepts in Visual Lifelogs. Byrne D, Doherty A.R, Snoek C.G.M, Jones G.F, and Smeaton A.F. SAMT 2008 – 3rd International Conference on Semantic and Digital Media Technologies, Koblenz, Germany, 3-5 December 2008. (Here’s a video of my presentation)

 

Combining Image Descriptors to Effectively Retrieve Events from Visual Lifelogs. Doherty A.R, Ó Conaire C, Blighe M, Smeaton A.F. and O’Conner N. MIR 2008 – ACM International Conference on Multimedia Information Retrieval, Vancouver, Canada, 30-31 October 2008.

 

The SenseCam as a Tool for Task Observation. Byrne D, Doherty A.R, Smeaton A.F., Kumpulainen S and Jarvelin K. HCI 2008 – 22nd BCS HCI Group Conference, Liverpool, U.K., 1-5 September 2008.

 

Constructing a SenseCam Visual Diary as a Media Process. Lee H, Smeaton A.F, O’Connor N, Jones G, Blighe M, Byrne D, Doherty A.R. and Gurrin C. Multimedia Systems Journal, Special Issue on Canonical Processes of Media Production, Vol. 14, No. 6, 2008.

 

Keyframe Detection in Visual Lifelogs. Blighe M, Doherty A.R, Smeaton A.F., and O’Connor N. PETRA 2008 – 1st International Conference on Pervasive Technologies Related to Assistive Environments, Athens, Greece, 15-19 July 2008.

 

Investigating Keyframe Selection Methods in the Novel Domain of Passively Captured Visual Lifelogs. Doherty A.R, Byrne D, Smeaton A.F., Jones G, and Hughes M. CIVR 2008 – ACM International Conference on Image and Video Retrieval, Niagara Falls, Canada, 7-9 July 2008.

 

Combining Face Detection and Novelty to Identify Important Events in a Visual Lifelog. Doherty A.R, and Smeaton A.F. CIT 2008 – Conference on Computer and Information Technology, Workshop on Image- and Video-based Pattern Analysis and Applications, Sydney, Australia, 8-11 July 2008.

 

Structuring and Augmenting a Visual Personal Diary. Doherty A.R, and Smeaton A.F. VGV08 – Irish Graduate Student Symposium on Vision, Graphics and Visualisation, Dublin, Ireland, 5 June 2008.

 

Automatically Segmenting Lifelog Data into Events. Doherty A.R, and Smeaton A.F. WIAMIS 2008 - 9th International Workshop on Image Analysis for Multimedia Interactive Services, Klagenfurt, Austria, 7-9 May 2008.

 

Using Bluetooth and GPS Metadata to Measure Event Similarity in SenseCam Images. Byrne D, Lavelle B, Doherty A.R, Jones G and Smeaton A.F. IMAI'07 - 5th International Conference on Intelligent Multimedia and Ambient Intelligence, Salt Lake City, Utah, USA, 18-24 July 2007.

 

Multimodal Segmentation of Lifelog Data. Doherty A.R, Smeaton A.F, Lee K and Ellis D. RIAO 2007 - Large-Scale Semantic Access to Content (Text, Image, Video and Sound), Pittsburgh, PA, USA, 30 May - 1 June 2007.

 

Retrieval of Similar Travel Routes Using GPS Tracklog Place Names. Doherty A.R, Gurrin C, Jones G and Smeaton A.F. SIGIR 2006 - Conference on Research and Development on Information Retrieval, Workshop on Geographic Information Retrieval, Seattle, Washington, 6-11 August 2006.

 

Automated Broadcast Media Monitoring. Curran K and Doherty A.R. CCNC 2006- IEEE Conference on Consumer, Communications and Networking Conference, Las Vegas, Nevada, 8-10 January 2006.

 

16x Invited Talks/Seminars/Papers

AAL research.  Creating the future technologies in Ireland - challenges and realities. Doherty A.R. Presentation at Collaborative Networks in AAL & Connected Health, Dundalk, Ireland, 2-3 September 2010.

 

Information Access for Personal Media Archives. Doherty A.R., Gurrin C, Jones G.J.F and Smeaton A.F. SIGIR Forum Newsletter, Volume 44, Number 1, pp33-37, June 2010.

 

Energy Monitoring in Homes. Ruzzelli A, Doherty A.R. Invited Talk as part of ESB Sustainability Week, Dublin, Ireland, 25 March 2010.

 

Managing Home Electricity Consumption Data. Doherty A.R. Guest Lecture as part of MSc in Electronic Commerce (Business) module in the business school, Dublin City University, Ireland, 15 February 2010.

 

Human Digital Memories. Doherty A.R. Seminar as part of undergraduate “Digital World” module in the school of computing, Dublin City University, Ireland, 10 November 2009.

 

Three years of SenseCam images - observations on cued recall. Doherty A.R, Pauly-Takacs K, Gurrin G, Moulin C and Smeaton A.F. SenseCam 2009 Symposium at the 39th annual meeting of the Society for Neuroscience: Neuroscience 2009, Chicago, USA, 16-17 October 2009.

 

Managing a Life of Lifelogged SenseCam Images. Doherty A.R. Invited Talk to the MemoryLane Research Team, Luleå University of Technology, Luleå, Sweden, 18 August 2009.

 

Utilising the Ubiquity of the Cell Phone to Record Physiological Activities. Doherty A.R. Seminar at the Health & Wellbeing External Research Group, Microsoft Research, Redmond, WA, USA, 23 April 2009. (Here’s a video of my presentation)

 

Utilising Wearable Sensor Technology to Provide Effective Memory Cues. Doherty A.R, and Smeaton A.F. ERCIM News (76), pp 48-49, January 2009.

 

Providing Effective Memory Retrieval Cues through Automatic Structuring and Augmentation of a Lifelog of Images. Doherty A.R. Seminar at the Multimedia Information Retrieval Group, Yahoo! Research, Barcelona, Spain, 11 December 2008.

 

Automatically Providing Effective Memory Retrieval Cues. Doherty A.R, and Smeaton A.F. Seminar at the Cognitive Psychology Research Group, University of Leeds, U.K., 11 November 2008.

 

Lifelogging. Doherty A.R. Seminar as part of undergraduate “Digital World” module in the school of computing, Dublin City University, Ireland, 20 October 2008.

 

Evaluating the Multi-Media Augmentation of LifeLog Events. Doherty A.R. Seminar at the Department of Information Studies, University of Tampere, Finland, 07 March 2008.

 

Automated Management of More than One Million LifeLog Images. Doherty A.R. Seminar at the School of Computing and Intelligent Systems in the University of Ulster, Derry, Northern Ireland, 21 December 2007. (Picture 1, Picture 2, Picture 3)

 

Automatic Structuring and Augmentation of a LifeLog of Images. Doherty A.R. Seminar at the Informedia group in Carnegie Mellon University, Pittsburgh, PA, USA, 29 May 2007.

 

8x Other Published Works

Summarisation & Visualisation of Large Volumes of Time-Series Sensor Data. Zhengwei Qiu, Cathal Gurrin, Aiden Doherty, Alan F. Smeaton. In: China-Ireland International Conference on Information and Communications Technologies(CIICT), Wuhan, China, 10-12 October 2010.

 

The Colour of Life: Interacting with SenseCam Images on Large Multi-touch Display Walls. Philip Kelly, Anil Kumar, Aiden R. Doherty, Hyowon Lee, Alan F. Smeaton, and Noel E. O'Connor. IN :The Second Annual SenseCam Symposium, Dublin, Ireland, 16-17 September 2010.

 

Turning Raw SenseCam Accelerometer Data into Meaningful User Activities. Zhengwei Qiu, Aiden R. Doherty, Cathal Gurrin, and Alan F. Smeaton. IN :The Second Annual SenseCam Symposium, Dublin, Ireland, 16-17 September 2010.

 

Utilising the Simplicity of Touch to Enable Older People Review their SenseCam Images Independently. Caprani N, Doherty A.R, Lee H, Smeaton A.F, and O’Connor N. SenseCam 2009 – SenseCam Symposium 2009, Chicago, USA, 16-17 October 2009.

 

Utilising Contextual Memory Retrieval Cues and the Ubiquity of the Cell Phone to Review Lifelogged Physiological Activities. Doherty A.R, Tolle K. TechFest’09 – Microsoft Research TechFest: The & in R&D, Redmond, WA, USA, 24-25 February 2009.

 

Organising a Large Quantity of Lifelog Images. Doherty A.R and Smeaton A.F. SSMS 2008 – Summer School on Multimedia Semantics – Analysis, Annotation, Retrieval, and Applications, Crete, Greece, 1-5 September 2008.

 

SenseCam Visual Diaries Generating Memories for Life. Smeaton A.F, O’Connor N, Jones G, Gaughan G, Lee H, Gurrin C. Memories for Life Colloquium 2006, British Library Conference Centre, London, U.K., 12 December 2006.

 

Intelligent Image Processing Techniques for Structuring a Visual Diary. Doherty A.R and Smeaton A.F. SSMS 2006 – Summer School on Multimedia Semantics – Analysis, Annotation, Retrieval, and Applications, Chalkidiki, Greece, 4-8 September 2006.

 

9x Program Committees

 

6x Reviewing Activities

 

11x Research Visits

 

Other Activities

  • Completed DCU INVENT Ryan Academy Tech Venture Business Start-up programme. Here’s a picture at the end of the course!
  • Mentor of 5 Masters final year projects: Stream Processing with IBM InfoSphere Streams, An Interactive System to Monitor Dietry Habits (Universidad Autonoma de Madrid Escuela Politecnica (Spain) & DCU); Mosaicing of SenseCam Images; Capture and Analysis of Multisensor Data for Application to Human Digital Memory Systems; and SenseCam Social Landmark Detection using Bluetooth (all DCU)
  • Mentor of 2 undergraduate final year projects: iLifeLog – Context Aware Reminder and LifeLog Archive; and LifeMap (all DCU)
  • Mentor of 3 ODCSSS undergraduate summer internship projects: Interactive Browsing for a Visual Diary; Using Multiple Sensors to determine Posture; and Online Sharing of Environmental Data to Enhance Awareness.
  • Mentor of 2 CLARITY graduate summer internship projects: My Diet Record--Monitor your calorie intake and expenditure over time, Utilising the Simplicity of Touchscreen Technology to Increase In-Home Energy Awareness

 

5x Other Conferences Attended

  • ACM Multimedia 2006 – Santa Barbara, CA, USA
  • SIGIR 2006 – Conference on Research & Development on Information Retrieval, Seattle, WA, USA
  • ECIR 2006 – European Conference on Information Retrieval, London, U.K.
  • AIC 2005 – Adaptive Information Cluster Annual Conference, Dublin, Ireland
  • IRCSET Symposium 2005Dublin, Ireland

 

4x Other Events Attended

Workshops

  • Memories For Life 2009 – University of Southampton, U.K.
  • CARPE 2006 – Capture, Archival and Retrieval of Personal Experiences in Santa Barbara, CA, USA
  • PIM 2006 – Personal Information Management in Seattle, WA, USA

 

Tutorials

The Study and Practice of Personal Information Management in Seattle, WA, USA. 2006

 

Press Coverage

 

About Me

I’m a researcher in CLARITY: Centre for Sensor Web Technologies in Dublin City University, and in the British Heart Foundation Health Promotion Research Group in the Department of Public Health In the University of Oxford. My PhD was under the supervision of Prof. Alan Smeaton in personal life recording.

 

Here’s a brief synopsis of my life so far. I grew up in Malin Head in Donegal, where I attended St. Mary’s National School. Thereafter I attended Carndonagh Community School to study for both my Junior and Leaving Cert (equivalent to high school) exams. After my enjoyable time there, I completed my undergraduate degree in the Magee campus of the University of Ulster. At the ripe old age of 24 I have recently completed my PhD in the Centre for Digital Video Processing and CLARITY:Centre for Sensor Web Technologies in Dublin City University.

 

During my PhD I was funded by the Irish Research Council for Science, Engineering and Technology under the National Development Plan, also known as the Embark Initiative. This is an excellent initiative and I would strongly encourage potential PhD students to consider applying for this source of funding. In addition to this my research was supported by Science Foundation Ireland (SFI) as part of the Adaptive Information Cluster (AIC). I also received a Microsoft Postgraduate Research Scholarship within the School of Computing in Dublin City University. In addition to this funding I was a recipient of a Postgraduate Accommodation Scholarship from the Office of the Vice-President for Research in Dublin City University, which funded accommodation in the first year of my PhD studies.

 

As part of my work in CLARITY, I spent 3 months at the start of 2009 working with the Health and WellBeing team in the external research department of Microsoft Research in Redmond, WA, USA. There I worked on a lifelogging related project which will hopefully have some impact in personal health monitoring.

 

 

Personal Interests

I am a real sports fanatic. I enjoy going swimming, to the gym, freestyling with a football or tennis ball, anything to clear the head really!

 

Gaelic Games are my real passion, and I played for many years with my local club, CLG Málainn. I designed the club’s initial website back in 2000. I also served as PRO for a period of time.

 

Other sports that I follow closely are soccer, rugby and formula 1 motor racing, and I’d have a passing interest in pretty much everything else that passes for sport.

 

 

Contact Details

Aiden Roger Doherty,

CLARITY: Centre for Sensor Web Technologies,

Research & Engineering Building, Room S101

Dublin City University,

Glasnevin,

Dublin 9,

Ireland

 

Tel: +353 -1 -700 6840

E-mail: aiden.doherty@dcu.ie

 

Travel Calendar