I am the teaching assistant of this class. I give lectures and workshops that help students explore untraditional music and using technology to create alter instruments.
I am from Hsinchu, a city in Taiwan known for its strong winds. As someone with allergies, I often face heightened symptoms during seasonal transitions or when air pollution intensifies. In particular, in Hsinchu, the wind is an ever-present force—whether it’s the discomfort of air currents or the invisible presence of PM2.5 particles, these phenomena significantly impact my quality of life. However, these elements are not immediately perceivable by the naked eye or through sound, and the presence of wind cannot be immediately visualized. This invisibility compels us to rely on technological means to reveal their true nature.
In response to this, I aim to create a new approach to represent these invisible weather phenomena. By transforming wind speed, PM2.5, and other environmental elements into an interactive experience that engages the senses, I hope to allow viewers to intuitively feel the changes in the air and weather. This is not merely a cold, data-driven presentation; instead, it’s an approach that enables emotional resonance with these invisible forces. My work seeks to not only present air pollution and wind speed in a simple manner but also to encourage understanding, awareness, and engagement with these unseen elements, reminding us of how we can interact more sensitively with these natural forces in our daily lives.
In creating this wind chime project, I researched how to combine physical effects with gesture control. I used p5.js for the visual effects and integrated ml5.js for gesture recognition, allowing the audience to trigger the wind chime's movement and sound through hand gestures, enhancing interactivity and immersion.
This piece explores the modern existential crisis of feeling lost amid a multitude of choices and societal expectations. The running metaphor captures the unease of not knowing where we are heading but feeling compelled to keep moving forward. The artwork allows the audience to confront these themes in an immersive and personal way, highlighting the endless, often fruitless, pursuit of belonging.
To simulate realistic motion, I used Matter.js, which provided gravity, elasticity, and friction, making the wind chime’s swaying appear more natural. However, I encountered challenges with gesture accuracy and physical movement. After refining the gesture recognition and adjusting parameters in Matter.js, I was able to improve stability and make the swaying more fluid.