For the final project, Rebecca and I want to combine our projects, pitch-manipulating gloves and a micro controlled visualizer, together. We touched therapeutic resolutions to the mind and body in both of our projects.

Somatic experiences

Collectively, we want our goal to be strengthening body awareness. Both a tool for simple interaction and performance, we want our project to have versatility.

Questions to answer:

  • Is the interface understandable to the participant with minimal instruction? Do they know what to do by looking at, listening to, or touching the interface?
  • Can someone besides you use it?
  • Can it be started, stopped, and reset without your intervention
  • Make the interaction iterative. In other words, it’s not just one action by the participant, but they read the interface, take action, read the device’s response, and take another action, in a continued loop.

Iterations on iterations

Our initial idea consisted a pair of gloves creating sound, the left hand controlling bass and the right hand controlling a melody. As the melody changes, the visual is manipulated adjacent to the sound.

Rebecca's initial idea for her glove project was "creating a musical instrument that also functions as a paintbrush". This transformed into pitch-tuning gloves creating a Perlin noise bezier curve that was controlled by mouseX and mouseY.

We decided to continue pursuing 'musical gloves', keeping the physicality. And we want to pair it with a visual performance, which could be a brush, manipulating waves, etc.

Potential new sensors

Next Steps

  • Challenges includes purchasing another Arduino to create a pair of gloves and learning how to implement Bluetooth LE to avoid problems with long wires.
  • Creating a NEW interactive visual utilizing Touch Designer and connecting serialport
  • Finalizing the idea of our 'musical instrument' gloves, which hand controls what?

Touch Designer Resources

Particles tracking mouse

Particle displacement

Generative design

Cool reads on digital performance live art

Digital interactive art in public space and the effect of public art on the community

The Development of an Audio-Visual Language for Digital Music Performance