Skip to content

Data Sonification

April 11, 2007

Although it would likely be a waste of time, I have always been tempted to somehow turn geologic data I have collected into sound. It is commonplace to convert data into visual representations by which qualitative patterns are evaluated by simply looking at it (e.g., maps). Less common is converting data into sound and listening for patterns. The idea of turning data into sound for analysis is certainly not new (e.g., the Geiger counter was invented in the first decade of the 20th century), but the application of sonification to varied data types across scientific disciplines has seen more activity in the last couple of decades.

It is important to make the distinction between music and sound. A separate, but related, discussion would deal with the potential for creating new kinds of avant-garde music within this realm (check out here [1] and here [2]), but that’s not what I’m talking about. Data sonification is simply the auditory equivalent of data visualization. Yes, some visual data is certainly striking in its beauty, but aesthetic value and scientific value are mutually exclusive. In recent years, data sonification has been applied especially in biomedical disciplines (e.g., here and here), but what about the geosciences?

What data types in geoscience would be amenable to being listened to? One answer to why we haven’t seen the value of data sonification demonstrated in this regard is because it has none. This approach can most easily be applied with time series data (and potentially ‘thickness series’ data as I discuss below) but what about spatial information? My intuition is that turning spatial data into something that one can listen to would create something extremely difficult to interpret.

The two figures below show a waveform (top) and associated sonogram (bottom) for an eruption event at Mt. Etna (click on the image to go to the webpage for those figures, here for the home page [3], or here for a BBC report about the project in general [4]).

I listened to some of the data from the above project and I have to say I was underwhelmed. It should be noted, however, that I am currently sitting in a room where clicking, whooshing, and otherwise white-noiseing of a magical machine that knows when a zircon was born is overpowering all other sound. Additionally, this particular dataset is a gradual and subtle crecsendo…all-in-all, not a very exciting pattern. That being said, one of the objectives of what they are doing is to figure out a workflow.

Being a sedimentary geologist, I measure and describe a lot of vertical sections of stratigraphic successions that are exposed in outcrop or part of wellbore data (e.g., core, logs) for the subsurface. At right is an example of a measured section from outcrop. How might we go about sonifying this? From my perspective, I would want attributes such as lithology, grain size, bed thickness, prominent sedimentary structures, presence/absence of trace fossils, and so on captured in the data. The question is: would doing this add any value to the process of recognizing and then interpreting observed (heard) patterns?

Perhaps the value might be when multiple sections are combined? I don’t know. This is one of those topics that is perfect for a blog because I’d like to hear what people think. Do you think your particular type of data could be converted to sound and be of any use?

Further reading (and some listening) on the web:
(1) Article from Feb 2007 SF Chronicle about Stanford music professor turning data into sound
(2) Heart Chamber Orchestra
(3) Mt. Etna Volcano Sonification: Listening to Seismograms
(4) BBC News report about Mt. Etna project
(5) A Spatialized Meterological Data Sonification Project (PDF)

Advertisements
4 Comments leave one →
  1. Chuck permalink
    April 20, 2007 3:52 am

    Record the different “thock” sounds the defferent strata make when hammered.

  2. January 13, 2008 5:45 pm

    I’m taking a seminar on computer music composition this quarter, and one of the chapters in our textbook is about taking data from some non-music field and converting it to sound. We haven’t gotten to that point yet (the class hasn’t even met properly yet!), but as soon as I saw it in there, I started thinking of how I could work some earthquakes into my final project for the class. I’m guessing that might be more straightforward than trying to turn stratigraphic layers into sound, since there’s no converting to waveforms involved. I’m hoping there will be some other way to use seismic data (or your Etna data) than just plunking the waveform into a sound editor directly, particularly since the plunking has already been done. I have a feeling this is a topic that’s going to be turning up in my blog as the class progresses.

    For the vertical stratigraphic successions, I suppose you could flip it on its side, trace the contour, and turn that into a waveform. People have done that sort of thing with city skylines or mountain range silhouettes. But maybe you could take the values for lithology, grain size, bed thickness, and so on, and set them up as attack, sustain, and decay values for sound envelopes, one envelope per layer.

  3. January 14, 2008 9:14 am

    Julian … keep me posted on that seminar … I have tons of strat section data … at some point, when I have the time, I may consult you on things I can do with it with respect to “sonifying” it

  4. January 21, 2008 3:05 am

    Belatedly, I’ll definitely keep you posted. So far, we’re still in the “here’s how to use this software” phase of the class, though.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s