DataShare spotlight: Human MotionLess Dataset (HuMoLs) and the creative potential of research data

For the second installment of the spotlight on DataShare blog posts, I would like to showcase a fascinating item containing videos of people not doing anything!

The dataset in question is titled “Human MotionLess Dataset (HuMoLs)” and was created by researchers Longfei Chan, Muhammad Ahmed Raza and Robert Fisher, who are based in the School of Informatics’ Institute of Perception Action and Behaviour. While on the face of it, people being still might not seem very dynamic, the research behind this dataset is trying to solve a difficult problem with a very useful outcome. Simply put, how do you tell when someone is lying still because they are doing something like sleeping, or if it is because they are unwell or have fallen? The videos in this dataset aim to try and train healthcare monitoring systems to help determine whether it is the former or the latter of these possibilities, with the priority being to uncover any critical medical conditions or to analyse chronic conditions.

A selection of still images taken from the videos in the dataset.

What struck me while reviewing the videos for submission was that beyond the usefulness of these videos to the research project, there was the potential for them to be adapted creatively. The videos have a deliberately “uncanny valley” aspect, due to using AI to deepfake participant’s faces in order to preserve their anonymity. The amusingly odd character to the videos made me imagine them being used in an Adam Curtis documentary, or in an Aphex Twin music video. Possibly even in an Adam Curtis documentary with Aphex Twin music over the top of it.

This raises the fascinating idea that there are rich sources of research data stored in open access repositories that could have a life beyond being reproducible, but could also be reused, repurposed and remixed into creative new pieces, adding value to both the research itself, and to the repositories where the affiliated data is stored. To demonstrate this possibility, I have edited some of the videos together, see below, and set them to music. The piece of music, “Redolescence” by Other Lands, has a dreamlike quality to it which both complements and recontextualises the videos into something beyond their originally intended use.

What other audio and visual materials are there contained in research data repositories waiting to be repurposed in a creative manner? Time (and much more talented creators than me) will tell!

The full dataset can be found on DataShare: Human MotionLess Dataset (HuMoLs)

The paper which the dataset supports: OPPH: A Vision-Based Operator for Measuring Body Movements for Personal Healthcare

Permission to use the music featured in this video was kindly granted by Gavin Sutherland, performing here under his artist name of Other Lands. The album which contains this track can be purchased on Bandcamp: Other Lands – Riddle of the Mode 

Leave a Reply

Your email address will not be published. Required fields are marked *