Description: SoundRise 2.0 is an application developed in React JS with the aid of Web Audio API, designed to help people with communication difficulties, especially children. The application provides an intuitive interface that allows the user to practise speech therapy voice exercises independently. The interface consists of a sun that symbolises the user’s voice and is animated according to the tonal and timbral characteristics of the voice itself: it analyses these vocal characteristics and displays a correspondent visual feedback in real time.
This application is the result of years of study and research by the CSC (Centro di Sonologia Computazionale). For years, the CSC has aimed to promote learning activities that encourage children, by considering physical actions as an integral part of cognition, through the use of technological enhancement.
During these years, a number of prototypes have been developed and then shelved. The last update of Soundrise aims to develop an application maintainable over time, undertaking a reactivation process previously designed at CSC for the preservation and reactivation of artefacts.
Website https://soundrise-82999.web.app/
Authors: Giada Zuccolo (developer); Riccardo Fila (developer); Stefano Giusto (developer); Marco Randon (developer); Gabriele Turetta (developer); Alessandro Fiordelmondo (supervisor, repository); Antonio Rodà (supervisor); Federico Avanzini (supervisor); Sergio Canazza (superivsor); Serena Zanolla (supervisor); Raul Masu (supervisor)
Date Created 2012
Last Update 2024
Flowchart - Audio feature extraction to graphical feedback The application captures audio features from your voice using the device’s microphone and utilizes them to generate graphical feedback.
The audio features of your voice are mapped to the movement of a sun on the screen.
With the timber we consider only the five italian vowels
link vowels-colors
[a] ⇒ rosso;
[O] ⇒ arancione;
[E] ⇒ verde;
[i] ⇒ blu;
[u] ⇒ grigio
The vowels are extracted through an algorithm of Linear Predictive Coding (LPC) using defined vowel formants
| title | SoundRise: studio e progettazione di un'applicazione multimodale interattiva per la didattica basata sull'analisi di feature vocali |
|---|---|
| author | Stefano Giusto |
| date | 2012-07-17 |
| type | thesis |
| link | https://hdl.handle.net/20.500.12608/15800 |
| bibtex | @article{giusto2012soundrise,title={SoundRise: studio e progettazione di un'applicazione multimodale interattiva per la didattica basata sull'analisi di feature vocali},author={Giusto, Stefano},year={2012}} |
| title | SoundRise: sviluppo e validazione di un'applicazione multimodale interattiva per la didattica basata sull'analisi di feature vocali |
|---|---|
| author | Marco Randon |
| date | 2012-07-17 |
| type | thesis |
| link | https://hdl.handle.net/20.500.12608/15833 |
| bibtex | @article{randon2012soundrise,title={SoundRise: sviluppo e validazione di un'applicazione multimodale interattiva per la didattica basata sull'analisi di feature vocali},author={Randon, Marco},year={2012}} |
| title | Soundrise 2.0: Sviluppo di un'interfaccia grafica interattiva in Three.js per supportare persone con disabilità uditive |
|---|---|
| author | Gabriele Turetta |
| date | 2023 |
| type | thesis |
| link | https://hdl.handle.net/20.500.12608/44069 |
| bibtex | @article{turettasoundrise,title={Soundrise 2.0: Sviluppo di un'interfaccia grafica interattiva in Three. js per supportare persone con disabilit{`a} uditive},author={TURETTA, GABRIELE}} |
| title | Soundrise 2.0: Sviluppo di un modello di riconoscimento timbrico per un sistema di assistenza web dedicato a persone con disabilità uditive |
|---|---|
| author | Riccardo Fila |
| date | 2023 |
| type | thesis |
| link | https://hdl.handle.net/20.500.12608/53325 |
| bibtex | @article{filasoundrise,title={SOUNDRISE 2.0: Sviluppo di un modello di riconoscimento timbrico per un sistema di assistenza web dedicato a persone con disabilit{`a} uditive},author={FILA, RICCARDO}} |
| title | A New Sunrise for Speech Therapy: Development of SoundRise 2.0 Application |
|---|---|
| author | Giada Zuccolo |
| date | 2023 |
| type | thesis |
| link | https://hdl.handle.net/20.500.12608/60413 |
| bibtex |
| title | Longevity in NIME research: a case study using time-based media art preservation models |
|---|---|
| author | Alessandro Fiordelmondo, Giada Zuccolo, Sergio Canazza, and Raul Masu |
| date | 2024 |
| type | conference paper |
| link | https://zenodo.org/records/13904858 |
| bibtex |
This repository serves as a tool for preserving the application and research project.
The repository follows the guideline of the Multilevel Dynamic Preservation (MDP) model (https://www.frontiersin.org/articles/10.3389/frsip.2023.1183294/full)