Emotions Halo

An experimental emotion-responsive installation exploring the intersection of machine learning, generative design, and human expression

This is a prototype I helped design and build for Second Story's '2S Lab'. This was a working prototype that was an experiment in understanding whether an exhibit of sorts could generate an experience based on a person's emotions.

My role in this was to build a framework that included the emotion recognition software (which was finalized as an offline Tensorflow/OpenCV data-flow), building out the data capture and translation network framework in TouchDesigner, and finally creating the sound and visuals design that corresponded to the six emotions that we parsed from viewers expressions that were captured via a hidden camera inside the 'Halo'.

Project Documentation


Emotion Recognition System

System overview and visualization

Installation Demo 1

Live participant interaction

Installation Demo 2

Real-time emotion mapping

Installation Demo 3

Complete interaction cycle