04
This project explores the combination of sound with tactile perception to further diminish the overreliance on vision. Touch and sound are not only subjective experiences of humans but also shared experiences among diverse life forms and environments on Earth. In this mode of thinking, we can regard touch and sound as non-anthropocentric modes of perception to reexamine and understand the materiality and perceptual experiences of everyday life.
Experimental design for separating the senses of sight, touch and hearing as experiencers and observers.
A critical look at the dominance of vision and exploration of the other senses to question the value of cognitive (epistemological) frameworks.
Type : Personal
Tech : Touchdesigner; Mediapipe; Max/Msp
Time : 04.2024
Interactive
Tech : Touchdesigner; Mediapipe; Max/Msp
Time : 04.2024
Interactive
Wear headphones to touch and hear the sounds generated in real-time by the touch.
Wear headphones to hear the sounds but cannot see the content
being played on the screen. (The purpose is to reduce visual
distractions).
Real-time hearing of the sounds produced by touch can help the experiencer perceive the effects and influences of touch more intuitively, encouraging them to actively engage in the touching process, thereby enhancing their sense of participation and interaction and deepening their understanding and cognition of touch experiences. Through the dual perception of touch and hearing, experiencers can have a more comprehensive experience of the characteristics and sensations of touch, thus deepening their understanding of touch.
The observer can act as an external observer and participant, experiencing the touch sensations of the experiencer through sound, thereby deepening their understanding of the relationship between touch and sound. By only hearing the sound and not seeing the touching process, observers can focus more attentively on perceiving the sounds generated by touch, thereby providing a richer and more immersive auditory experience. Through auditory perception alone, observers can concentrate more on the sounds produced by touch and glean more information and perceptions about the touch experience.
Observers use rich imagination and perception to describe the tactile experiences they sense. These descriptions share a cross-sectional similarity in nature with the actual touched objects
Although observers find it challenging to accurately guess what the experiencer is specifically touching, they can express their sensations with greater imagination through the sounds they hear. This indicates that touch, as a mode of perception, has the ability to convey rich information. Even in situations where observers cannot directly observe the touched objects, the sounds produced by touch can still evoke their imagination and perception, resulting in concrete and vivid sensations and descriptions.