INTERACTIVE COMPUTING
A combination of digital and physical computing projects.
Magic Mirrors
After spending 2019-2021 heavily focused on making AR face filters, I continued exploring using the viewer’s face as a crucial component of engaging with my work without the mediation of phones. This led to an iteration of the “Magic Mirror” theme, digital artwork that allows the user to affect the visuals through face detection.
Untitled Mirror, shown at The Lowercase in August 2023. (Playcanvas + Tracking JS)
Creature, showcased at the June 2024 Artifice exhibition. (Unity + OpenCV)
I really believe that technology should be used in harmony with our biology, which is why using features like face and body tracking that encourages user movement in the physical world is so important in my practice.
Fill the Void, shown at the Johnson&Johnson data art conference summer 2022. (p5.js and ml5.js )
Debugging of Fill the Void during development.
Debugging of Untitled Mirror during development.
Interactive Live Visuals
Live audio and webcam-responsive visuals created using Touchdesigner.
Haptic Glove Prototype
The first version of this glove was built using 3 flex potentiometers and 1 FSR sensor to send input from an Arduino Uno to a p5.js sketch. The first demo of the project can be seen here.
I then adapted this glove for wireless communication via Bluetooth by replacing the Arduino Uno with the Arduino Nano 33 BLE microcontroller. The fabrication and demo of this most recent version of the glove can be seen above.
Pressure Sensor Synthesizer Necklace Prototype
This necklace was created using DIY velostat + conductive fabric pressure sensors and connected to MaxMSP via the Adafruit Flora microcontroller.
Documentation of the construction process for this project.
p5.js Projects
Mona Lisa
This is the first game I ever developed by coding via javascript in p5. The objective of the game is to move the bottom piece of the frame to bounce the fly to the jelly. The controller is linked to the A and D keys on the keyboard and the moving objects use square collision detection.
This game can be played here.
Dinner at the palladium
This is the second keyboard-controlled game I built using p5. It was inspired by the joint Jean-Michel Basquiat and Andy Warhol exhibit which took place in 1985 at the Palladium. I wanted to bring the work of my two favorite 20th century artists alive by allowing the user to use the W,A,S,D keys to move Basquiat's dinosaur icon to collect some food items commonly found in Andy's prints.
This game can be played here
Race to Moonchella
This was a team project created by Junyang Ma, myself and Tina Zhou. In this game, the player controls a performer on their way to Coachella 2020 on the moon.
The game implements the Perlin Noise algorithm and can be played here.
