A seminal collection of "Auditory Display of Information" was
published by SFI well over a decade ago:
Auditory Display:
Sonification, Audification, And Auditory Interfaces (Santa Fe
Institute Studies in the Sciences of Complexity Proceedings)
I have my own take on how to approach the problem of encoding
abstract information into perceptual spaces, of which sound is one
key component (second only/sometimes to visuals).
My colleague and partner in
Musification,
Dr. Panaiotis, has a
patent (pending) in Musical Textures as an approach to Data
Musification wherein statistical variations in data can be encoded
in relevant variations in components of algorithmically generated
music.
My own area of research is focused on the development and
application of metaphors for Perceptualization (including Visual and
Aural). Music offers a well developed systematization of sound up
to and including pre-existing metaphorical mappings from musical
components (volume, pitch, tempo, tambor, etc.) to target domains
such as atmospheric phenomena(weather), inhabited landscapes(jungle,
forest, desert), and even urbanscapes or factoryscapes.
While many have approached sonification (encoding information into
volume and frequency) directly, in a way similar to much
visualization (using simple hue ramps, geometric primitives, etc.)
it is key to effective perceptualization (especially of abstract
data sets) that the encodings be consistent and apropos of some
system which the user already has an intuitive understanding. In
visualization, even simple hue ramps tend to appeal to an intuitive
experience... some applications of the spectrum appeal to our
common-sense understanding of blue being cool (like water) and red
being hot (like fire) even though the physical interpretation of
blackbody radiaition would suggest the opposite.
We published a bit of work in this area when applied to
Network
Monitoring for Security... we are working on systems for
Musification of Molecular Dynamics, streams of patient data in an
ICU and in the context of education (
Nephron).
What kind of data/systems are you thinking about sonifying? Do you
have an approach in mind already? It is a very broad and
underexplored field in my experience.
- Steve
LAVA-Synergy
4200 W. Jemez rd
Los Alamos, NM 87544
www.lava3d.com
s...@lava3d.com
505-920-0252