Aw, They Have Your Eyes
Projection Mapped Family

In this interactive projection mapping piece, I created a sculptural "family" from foam cones and spheres, brought to life with live-tracked facial features. As viewers approached, their facial features were mapped in real time onto the sculpted characters, creating a surreal connection between audience and object. This piece explores identity, connection, and the fusion of digital presence with tangible form.

  • Digital
    Chatgpt
    MadMapper
    P5
    Projector

    Physical
    Joint Compound
    Fabric
    Acrylic Paint
    Clay

  • Projection Mapping
    Coding
    Ai Prompting
    Sculpture

  • Professor Josh Miller

The Code

I used ChatGPT to write my code. I started with the prompt:

“How would I write code for p5 to track someone's face. The face would then be separated by features and projection mapped in the real world. For example, the camera would track an eye, cut it out, then project it?”

Using the code it gave me I kept modifying it to be exactly what I wanted.

Using p5.js and Syphon, I wrote and refined code (with the help of ChatGPT) to track a viewer’s face via webcam—isolating features like eyes and mouth, then repositioning them to the corners of the screen for projection. These were piped into MadMapper, where I aligned them with a physical sculpture made from foam, wire, clay, and fabric. The abstract figures, initially playful in form, took on a familial personality as I added handmade legs, pants, and shoes.

The Creative Process

Previous
Previous

Is it Real or is it Crayon?

Next
Next

Off My Rocker