Experiments
The Joy of Making
Is creativity defined by the tool, the process, or the feeling of being alive while making something?
Tools: Stretch Robot, Python, OpenCV, dlib, Webcam, DALL·E, Paint, Sponge
Overview
The Joy of Making is an interactive installation where participants begin a painting with a robot, then complete it by hand. As they move between the two, a facial-recognition system captures subtle emotional shifts, translating them into a visual record of each creative session.
Rather than focusing on the final output, the project surfaces the often-invisible emotional experience of making - exploring how technology reshapes not what we create, but how it feels to create.
Insights
- •Participants had varied reactions to the machine - some found it creatively generative, others felt more present without it. These differences suggest technology isn't replacing art, but introducing new ways of engaging with it.
- •There is no single "better" way to create - only different experiences of making.
- •The experience of making can be as meaningful as the artifact itself.
Audience Experience
A participant enters a space dressed as an artist's studio - a table covered in art supplies, art books for inspiration, and ambient lo-fi music playing in the background. The experience unfolds in four parts:
Part 1
Consent & Calibration
The participant is informed that their facial expressions will be tracked during both sessions, that no facial images will be stored, and that only emotional state categories - neutral, happy, or angry - will be logged. They complete a brief calibration, making each expression while the system registers their baseline.
Part 2
Painting with Technology
The participant has four minutes to paint using the Stretch robot, with the guidance that they can paint whatever emotion they feel in the moment. We give the participant a quick hands-on tutorial on how to use the Stretch controller. They guide the robot's arm with a controller, directing the sponge across a large sheet of paper mounted on an easel.
Part 3
Painting by Hand
A new facial tracking session begins. The participant has four minutes to finish their painting, entirely by hand. No guidance, no controller, no robot. Just paint, sponge, and paper.
Part 4
Creation of Emotional Color Auras
The two emotional auras (human and machine) are developed, and we walk the participant through what we were tracking with their facial expressions - yellow for happy, red for angry, green for neutral. Participants can also see the outputs of other participants - not just their paintings, but their emotional auras, to see which sessions produced more agitation, more happiness, more flatness.
Participant Outputs
The visual style of the final output is inspired by aura portrait photography, which renders a person's emotional state or inner energy as fields of color and light.
1 / 7
Live Installation
Consent & Calibration
Painting with Stretch Robot
Painting by Hand
