Using audio for data anomalies

Question

Hello everyone!

I'm searching for Kyma files (and any other recommended materials) for the use of audio to provide perception of data.

A bit more detail if you're interested:

My name is Tom Tolleson and I'm new to the Kyma community. In addition to my desire to use Kyma for sound design, I also work in data science and use many open source tools (ggplot, Shiny, etc.) for data visualization. I'm planning a study of data comprehension with visualization vs. audio representation. The data is data collected for conservation efforts.

There's a fair bit of infomration online regarding the use of audio cues for detecting anomalies in data. However, I've found some papers that Carla Scaletti has articipated in:

https://www.spiedigitallibrary.org/conference-proceedings-of-spie/1459/0000/Using-sound-to-extract-meaning-from-complex-data/10.1117/12.44397.short?SSO=1

There's plenty for me to review. However, if anyone has actively participated in this application of Kyma and has any information that could help guide or suppport me that would be great.

Thanks and regards,

Tom

Answer 1

Hi Tom,

There are some additional papers and videos on my personal site:

http://carlascaletti.com/sounds/data-sonification/

You can export time series data as a tab-separated-value text file and read it in the Kyma WaveEditor using the Generate>From Data File option in the sidebar (see Jon Bellona's INSIGHTS article for step-by-step instructions on how to do this).

Other approaches (which you can see in the KISS video), include reading data from text files and mapping them to Sound parameter values using Script or MIDIVoice.

Comments

Wow. This is enormously helpful. Thanks so much! I had no idea you could generate from a data file.

This gives me a real head start on my work. Thanks again!