Making Sense of Decentralized TUIs: A Modular Sound-Centric Approach

This studio invites participants to explore tangible and embodied interaction beyond standalone interfaces into interconnected ecologies of smart objects, focusing on sound as a primary design element. Through a series of hands-on experimentations, participants will prototype with a modular toolkit, exploring how sound can move beyond simple notification functions to create rich and adaptive soundscapes. Drawing from the practices of digital lutherie and sound design, in particular mapping and interaction design strategies, participants will learn how to map sensor data to sound using interactive machine learning techniques based on artificial neural networks. This studio explores sustainable practices by adopting a modular approach to create adaptable systems, while promoting community engagement, open source contributions, and wider accessibility.

@inproceedings{DiMaggio2025,
  title = {Making Sense of Decentralized TUIs: A Modular Sound-Centric Approach},
  author = {Maggio, Francesco Di and Hengeveld, Bart and Funk, Mathias},
  booktitle = {TEI '25: 19th International Conference on Tangible, Embedded, and Embodied Interaction},
  publisher = {ACM},
  year = {2025},
  doi = {10.1145/3689050.3708332}
}