Sonifikation in der Musik

Gordon Monro

What Are You Really Thinking?

2004 / Sidney / Parameter Mapping / EEG-Data

"The call for sonifications issued in connection with ICAD2004

presented a challenge to the scientific and artistic community: to

convert to sound 36 channels of data (mostly electro

encephalograms, but also heartbeat, respiration and other data)

recorded while a subject was listening to a piece of music.

The sonification presented here, entitled "What are you

really thinking?" attempts to use essentially all the data given

on the ICAD2004 website.

For this sonification, a distinction was made between the

scalp signals, the 26 data channels recorded from various

locations on the scalp of the subject, and the non-scalp signals,

including the recordings made near the eyes (the "eye signals"),

the masseter muscle signal, the electro-dermal signal, breathing

and heartbeat.

Each scalp signal is considered as a sound source and

converted to a stream of notes, as explained below. Most of

the non-scalp signals control aspects of the streams of notes, but

do not generate sound directly. However, the heartbeat signal is

also used as a sound source.

The streams of notes are spatialised according to the

coordinates of the scalp electrode positions, but with

modifications due to the eye signals.

The main aspect of the sonification is the representation of

scalp EEG activity as pitches directly corresponding to the

frequencies occurring in the scalp signals."



Ausschnitt anhören (00:30)

ยป whatareyouthinking.mp3



Listening to the Mind Listening








© 2018