SCRAP Hack Summer '23

Conversation data visualization & sonification

August 14, 2023 by Mark

Every year, my lab takes time for a hackathon outside of our normal research. You can read more about these hacks and the philosophy behind them here This summer, inspired by a Gordon Research Conference I recently attended, the lab's goal was to develop new ways to visualize, and sonify (i.e., make sound out of) conversation data. In the video below, you can see and hear how we achieved this with respect to conversational turn-taking dynamics, head orientation annotations, the acoustic properties of frequently used words, and the meaning of people's utterances. Data visualizations and sonifications like these will help us to explore and better understand the data we are collecting from conversation experiments in the lab.