Data Visualization Biometrics Interactive Art Machine Learning

Emotions Halo

Emotion-Responsive Installation — ML, Generative Design & Human Expression

Client Second Story / 2S Lab
Year 2019
Role Designer & Developer
Tools TouchDesigner, TensorFlow, OpenCV, Biometric Sensors

This is a prototype I helped design and build for Second Story's '2S Lab'. This was a working prototype that was an experiment in understanding whether an exhibit of sorts could generate an experience based on a person's emotions.

My role in this was to build a framework that included the emotion recognition software (which was finalized as an offline Tensorflow/OpenCV data-flow), building out the data capture and translation network framework in TouchDesigner, and finally creating the sound and visuals design that corresponded to the six emotions that we parsed from viewers expressions that were captured via a hidden camera inside the 'Halo'.

Project Documentation

Emotion Recognition System

System overview and visualization

Installation Demo 1

Live participant interaction

Installation Demo 2

Real-time emotion mapping

Installation Demo 3

Complete interaction cycle