What Does Data Sound Like?

Indeed, scientists at NASA suggest that by converting data into sound they may be able to scan vast data sets in a matter of minutes.

Last week I asked Jody Avirgan, FiveThirtyEight’s podcast host, “What does data sound like?”Avirgan pointed to one of his stories: “Can You Taste The Algorithm In This Arugula?” in which he explored “how farms big and small are using data to control sunlight, nutrients, air circulation and more.

” In the video he looks out over a field of greens and asks “Where is the data?” Getting an interviewee to point out how data manifests itself in the phisical world — the sound of shades closing automatically to control temperatures, or sprinklers turngin on in tresposen to sensors — is one way give voice to the data.

Sound and data are not so far apart and there have been some really interesting attempts by newsrooms and artists to turn data into songs and sounds.

I call these acoustic infographics.

U.

S.

Home Prices, Sung As Opera : NPRNPR’s Planet Money team turned to opera to illustrate the Case-Shiller home price index.

“You can see the boom and bust all in one simple graph,” write Jacob Goldstein and David Kestenbaum.

“But when we go on the radio to talk about home prices, a graph isn’t much good to us — nobody can see it.

So we converted the Case-Shiller graph into musical notes.

”U.

S.

Home Prices, Sung As OperaThe Case-Shiller home price index is a powerful way to look at the story of housing in America.

You can see the boom…www.

npr.

orgAn Olympic Musical: New York TimesKevin Quealy (a graphics editor at the New York Times) has a great Tumblr of charts and infographics, which is where I found a few audio infographics related to the Olympics.

The NYT graphics team and Amanda Cox worked map the finishes of close races with sound.

This was based on a project Cox did for the 2010 winter Olympics.

Fractions of a Second: An Olympic MusicalAt the Olympics, the blink of an eye can be all that separates the gold medalist from the 10th-place finisher.

In some…www.

nytimes.

comAbove is Amanda Cox’s original audio infographic and below is one of the new videos she made with the New York Times for the London games.

There are many more versions and videos over at the Kevin Quealy’s Tumblr.

Using Brain Wave Data to Convert a Seizure to Song: Brian FooThere has been a lot of discussion about virtual reality and empathy, but artist Brian Foo believes that turning data into songs can also spark empathy.

He writes about his project, Rhapsody in Grey, “This song generates a musical sequence using EEG brain wave data of an anonymous epilepsy patient.

It examines the periods before, during, and after a seizure.

The goal is to give the listener an empathetic and intuitive understanding of the brain’s neural activity during a seizure.

”Hearing Colors: RadiolabIt’s no surprise that RadioLab has toyed with the form.

In the segment below they use a choir to represent the light spectrum, specifically that of a rainbow.

The voices in the choir represent the various colors, and the hosts explore how different animals see a rainbow based on what colors they can see.

However, being that this is radio, we get to hear how the rainbow would sound, rather than see it.

Colors(Adam Cole/WNYC) Our world is saturated in color, from soft hues to violent stains.

How does something so intangible…www.

radiolab.

orgListening to Radioactive Decay: The Radioactive OrchestraJihii Jolly pointed me to this examples.

She writes in her post about the infographic, that visualizing how energy moves is difficult.

Enter the Radioactive Orchestra.

“The Radioactive Orchestra was developed into an online application for anybody, where users can pick up to five isotope frequencies, place them on virtual mixing board and edit their pitch and tempo.

A visual music video of sorts is also automatically played to the left of the mixing board.

These beats can then be saved and shared.

”Singing The Euro Zone Crisis: MarketplaceThe complicated financial system and recent debt crisis in the European Union is tough enough to explain in print — how do you do it on radio?.Marketplace from American Public Media decided to use a Barbershop Quartet.

If the eurozone were a barbershop quartetJeremey Hobson: Well whatever happens in Greece, one solution to the debt crisis you're likely to hear more about is…www.

marketplace.

orgAlgorithms as AudiblizationThe person who created the video below calls it an “audibilization.

” Here is how he describes it: “This audibilization is just one of many ways to generate sound from running sorting algorithms.

Here on every comparison of two numbers (elements) I play (mixing) sin waves with frequencies modulated by values of these numbers.

There are quite a few parameters that may drastically change resulting sound.

”Follow Josh Stearns on Twitter or subscribe to the Local Fix for a weekly dose of innovation and community engagement for newsrooms.

Originally published at storify.

com in 2014, updated in 2016.

Thoughts on Media is a community publication, curated by ReadThisThing.

Follow us on Medium or check out our newsletter.

.. More details

Leave a Reply