Emotions Halo
An experimental emotion-responsive installation exploring the intersection of machine learning, generative design, and human expression
This is a prototype I helped design and build for Second Story's '2S Lab'. This was a working prototype that was an experiment in understanding whether an exhibit of sorts could generate an experience based on a person's emotions.
My role in this was to build a framework that included the emotion recognition software (which was finalized as an offline Tensorflow/OpenCV data-flow), building out the data capture and translation network framework in TouchDesigner, and finally creating the sound and visuals design that corresponded to the six emotions that we parsed from viewers expressions that were captured via a hidden camera inside the 'Halo'.
Project Documentation
Emotion Recognition System
System overview and visualization
Installation Demo 1
Live participant interaction
Installation Demo 2
Real-time emotion mapping
Installation Demo 3
Complete interaction cycle