Path: utzoo!utgpu!news-server.csri.toronto.edu!rpi!zaphod.mps.ohio-state.edu!mips!news.cs.indiana.edu!ux1.cso.uiuc.edu!yoyodyne!kalman
From: kalman@yoyodyne.ncsa.uiuc.edu (Laura Kalman)
Newsgroups: comp.human-factors
Subject: Re: Audio feedback from GUI's
Summary: Research in Sonification at NCSA
Keywords: sonification
Message-ID: <1991Jun24.040533.1246@ux1.cso.uiuc.edu>
Date: 24 Jun 91 04:05:33 GMT
References: <677335592.6205@minster.york.ac.uk>
Sender: usenet@ux1.cso.uiuc.edu (News)
Followup-To: kalman@yoyodyne.ncsa.uiuc.edu
Organization: National Center for Supercomputing Applications at Urbana Illinois
Lines: 57

Hi!

I am currently working as the human factors/interface designer on a
sonification software tool at the National Center for Supercomputing
Applications. Historically NCSA tools have revolved around visualizing
numerical data streams generated from large simulations, but because these
simulations often generate more data sets than that which can be displayed via
three dimensional images (height, width, color), we are trying to couple
visualization with sonification.

Basically, sonification is an attempt to provide interactive access to
additional data dimensions through sound.  It is sort of a novel approach to 
using sound in the sense that we have data that we need to "hear", we just
don't know the best way to "play" it, (i.e. interactive mouse playback,
continuous data stream playback), or the best way to create sound from it
(i.e. sound mapping parameters which are intuitive but maintain data 
integrity).

I have come up with a number of different ideas, ranging from simple mouse
exploration to supplementing virtual reality simulations, but I am more than
willing to open it up for general discussion.  If contributing to this type of
human factors/research application is something that appeals to general
interest, I could post more specific details surrounding our immediate research
goals and include a list of the current features for comments, concerns and
criticisms.  There are a vast number of human factors (sound perception of
musical playback vs. everyday sound, etc), and interface issues surrounding 
this project and I would be more than happy to implement original suggestions,
test user response, and post results to the net.

NCSA is a not-for-profit organization which supplies scientists and industrial
researchers with free software tools simply for the advancement of science.  
All the tools developed at NCSA are available public domain, therefore no one
here will derive any direct financial benefit from contributed ideas.  However,
in all fairness I must warn any contributors that all source code is eventually
made available through anonymous ftp to anyone with network access.  As a
result, I have no control over who might incorporate these ideas into future
commercial packages, especially if they are brilliant ideas.  On a more
positive note, I will gladly and openly recognize any original contributions
in the NCSA software release notes.

I thought a practical exercise in the creative application of sound in a
research environment might be interesting to explore as a group effort. 
Since a mojority of the issues surrounding the audible icons are also directly
applicable to sonification, it seems that the theoretical complications for
sound have already been lightly discussed.  This might be a way to develop
our theoretical discussion into tangible research results.  I don't remember
reading about any restrictions regarding this type of activity in the charter,
but I thought I'd check it out with the "real life" readership before posting
more details.

So now that you know about me, let me know if this sort of ground level 
interface research/sound application appeals to you...

Thanks for your time,

Laura
kalman@yoyodyne.ncsa.uiuc.edu