Inspiration

I am from Hsinchu, a city in Taiwan known for its strong winds. The strong winds and air pollution here have a significant impact on my allergies. Wind and PM2.5 are not directly perceivable, so I aim to transform these invisible phenomena into an interactive sound experience, allowing viewers to intuitively feel the changes in air and weather. This is not just a data presentation; it’s about creating emotional resonance with these invisible forces, increasing their understanding and awareness of these issues.

Process

In creating this wind chime project, I integrated the Open Weather API to adjust the wind chime's sound based on weather and air quality. Using p5.js's sound module, I altered sound effects like distortion and reverb depending on local environmental conditions, giving the piece an added layer of interactivity and relevance.

In the early stages of creation, I tested the combination of gesture triggers and Matter.js.

To enhance the overall experience, I combined physical effects with gesture control using p5.js for visuals and ml5.js for gesture recognition, allowing the audience to trigger the chime’s movement and sound. To simulate realistic motion, I used Matter.js for gravity, elasticity, and friction, making the swaying appear more natural. After refining the gesture recognition and adjusting parameters, I improved stability and fluidity.

Reflection

I hope to transform this work into a fully realized physical interactive installation in the furture. By transitioning from digital art to a physical piece, the audience will be able to engage with the work in a more direct and complete way. I plan to incorporate sensors that measure real-world environmental factors such as wind speed, temperature, and air quality, and these data will control the movement and sound of the wind chimes.