[access-uk] Re: Live camera soundscapes with a talking real-time object recognizer

  • From: Peter Meijer <feedback@xxxxxxxxxxxxxxxxxxx>
  • To: access-uk@xxxxxxxxxxxxx
  • Date: Sun, 17 Feb 2019 09:24:08 +0100

Hi Barry,

Yes you caught a typo: I meant to write that object recognition confidence is spoken as a probability number between 0 and 1. For those unfamiliar with The vOICe for Android vision app: after starting it you turn your phone to landscape orientation and find the Options menu button near the top right of the main screen. In that menu, one of the first entries is labeled "Say object names", which is what turns the real-time talking object recognizer on to complement the raw visual soundscapes that convey the live camera view.

> I'm looking forward to an Apple version of this app

No such version is currently planned. The vOICe for Android runs not only on smartphones but also on various brands and types of Android smart glasses, for fully hands-free use while the camera in the glasses automatically tracks your head movements. Apple sells no smart glasses yet, and it is unknown when they will catch up.

However, a simplified version of The vOICe is platform independent and runs as a web app inside your browser. That version also works on an iPhone with iOS 11+ and Safari, and you can try it online at

   https://www.seeingwithsound.com/webvoice/webvoice.htm

No need to install anything here, but you need to give the web app permission to use your camera and then press the Start button of The vOICe web app. The web app does not include visual object recognition, color identification and so on, and only sounds the raw soundscapes of your live camera view.

Best regards,

Peter


The vOICe for Android on Smart Glasses
https://www.seeingwithsound.com/android-glasses.htm

The vOICe for Android
https://www.seeingwithsound.com/android.htm
https://play.google.com/store/apps/details?id=vOICe.vOICe


On 17-Feb-19 1:51, Barry Hill (Redacted sender barry.hill3 for DMARC) wrote:

We live in a fantastic time where technology is supporting vi people more and more.  I'm 
looking forward to an Apple version of this app.  One thing, was it a typo when you wrote 
" between 0 an 1"?

Cheers

Barry


-----Original Message-----
From: access-uk@xxxxxxxxxxxxx <access-uk@xxxxxxxxxxxxx> On Behalf Of Peter 
Meijer
Sent: Saturday, February 16, 2019 10:18 AM
To: access-uk@xxxxxxxxxxxxx
Subject: [access-uk] Live camera soundscapes with a talking real-time object 
recognizer

Hi All,

One of my long-standing goals has been to combine "raw vision" from The vOICe 
soundscapes, representing your live camera view, with "semantic vision" from a talking 
object recognizer interpreting that same live camera view. The soundscapes are very general and can 
convey any visual scene, but learning to interpret them can be about as challenging as learning a 
foreign language.
Object recognition on the other hand is much more limited, but as easy as 
having your own foreign language interpreter with you. The two approaches are 
complementary, and The vOICe for Android 2.33 now offers a first hybrid 
combination. The experimental object recognizer is still limited and therefore 
by default turned off, but you can easily toggle it on and off from the Options 
menu, just like the talking color identifier. The vOICe for Android is 
available on Google Play at

     https://play.google.com/store/apps/details?id=vOICe.vOICe

Every recognized object is spoken along with a number between 0 an 1 indicating 
recognition confidence. Hopefully future object recognition engines will become 
more powerful, so for now take this as a proof of concept of where things are 
heading. I'd love to learn of your use cases!

Have fun!

Peter


The vOICe for Android
https://www.seeingwithsound.com/android.htm
https://play.google.com/store/apps/details?id=vOICe.vOICe
** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq



---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq


** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq

Other related posts: