Re: Sonified Debugger vs. Screenreader Question

  • From: "Andreas Stefik" <stefika@xxxxxxxxx>
  • To: programmingblind@xxxxxxxxxxxxx
  • Date: Thu, 22 Nov 2007 12:18:44 -0800

Will is next:

Will asked:

> Did you develop these techniques or someone else?  A large part of my
> research career thus far has been centered around communication, conceptual
> knowledge, and how people identify objects or other sensory stimuli.  So,
> I'd be interested to read a paper or two on these new techniques.  They
> sound interesting.

The paper I mentioned on IEEE gives a brief overview of the technique,
although it was written nearly a year ago, and we've gone leaps and
bounds beyond it now. Even the tool presented in that paper has been
replaced completely. It's a new technique, far as I know, that I've
been developing with a psychologist for the last year or so. The
latest work I have, which describes it in great detail, is in my
dissertation, although the draft I have of that chapter isn't quite
ready for human consumption yet, let alone being ready for a pub.

So, since that chapter won't be done for another month or two, here's
a brief description of the technique, which I've named Artifact
Encoding:

Give participants a long stream of audio, with gaps at various
positions, which gives them time to write down, or otherwise indicate,
information about the audio. Each piece of audio represents
information about a computer program. Each piece of audio must be
identified, and since in programming any individual piece can affect
previous, or future pieces, participants must identify all information
about the audio, including the relationships between future, and past,
audio. Once that's finished, you have a record of participants'
answers, which are encoded into a string. We then run these strings
through a complicated set of algorithms, which end up telling you a
plethora of information about how well that audio was understood.

Then, basically, the audio with the highest comprehension scores, if
they don't have any bad comprehension side effects, which happens
sometimes, get tossed into our tool.

So there is chapter 4 of my dissertation in one paragraph. I hope that
was intelligible!

Do you have any papers on "how people identify objects or other
sensory stimuli?" I'd love to read one of yours as well. Are you in
psych, comp sci, or some kind of hybrid? (HCI?)

Andreas
__________
View the list's information and change your settings at 
//www.freelists.org/list/programmingblind

Other related posts: