[access-uk] Re: Live camera soundscapes with a talking real-time object recognizer

  • From: Peter Meijer <feedback@xxxxxxxxxxxxxxxxxxx>
  • To: access-uk@xxxxxxxxxxxxx
  • Date: Sun, 17 Feb 2019 10:41:27 +0100

Hi Barry,

> Between zero and one?  I don't understand that.

Probabilities are by convention scaled to lie between 0 and 1. When you say that you are 100 percent certain of something, then you are actually saying that for 100 out of 100 times ("per cent") something is true, and 100 / 100 is... 1. :-)

So a probability 0 means not having the foggiest idea, and the value 1 means absolute certainty. The object recognizer automatically filters out recognitions with very low probabilities, so you will not get readings like "keyboard 0.05".

Peter


The vOICe for Android on Smart Glasses
https://www.seeingwithsound.com/android-glasses.htm

The vOICe for Android
https://www.seeingwithsound.com/android.htm
https://play.google.com/store/apps/details?id=vOICe.vOICe

On 17-Feb-19 9:50, Barry Hill (Redacted sender barry.hill3 for DMARC) wrote:

Between zero and one?  I don't understand that.  I thought the typo might have 
been that it was between zero and ten.




-----Original Message-----
From: access-uk@xxxxxxxxxxxxx <access-uk@xxxxxxxxxxxxx> On Behalf Of Peter 
Meijer
Sent: Sunday, February 17, 2019 8:24 AM
To: access-uk@xxxxxxxxxxxxx
Subject: [access-uk] Re: Live camera soundscapes with a talking real-time 
object recognizer

Hi Barry,

Yes you caught a typo: I meant to write that object recognition confidence is spoken as a 
probability number between 0 and 1. For those unfamiliar with The vOICe for Android 
vision app: after starting it you turn your phone to landscape orientation and find the 
Options menu button near the top right of the main screen. In that menu, one of the first 
entries is labeled "Say object names", which is what turns the real-time 
talking object recognizer on to complement the raw visual soundscapes that convey the 
live camera view.

  > I'm looking forward to an Apple version of this app

No such version is currently planned. The vOICe for Android runs not only on 
smartphones but also on various brands and types of Android smart glasses, for 
fully hands-free use while the camera in the glasses automatically tracks your 
head movements. Apple sells no smart glasses yet, and it is unknown when they 
will catch up.

However, a simplified version of The vOICe is platform independent and runs as 
a web app inside your browser. That version also works on an iPhone with iOS 
11+ and Safari, and you can try it online at

     https://www.seeingwithsound.com/webvoice/webvoice.htm

No need to install anything here, but you need to give the web app permission 
to use your camera and then press the Start button of The vOICe web app. The 
web app does not include visual object recognition, color identification and so 
on, and only sounds the raw soundscapes of your live camera view.

Best regards,

Peter


The vOICe for Android on Smart Glasses
https://www.seeingwithsound.com/android-glasses.htm

The vOICe for Android
https://www.seeingwithsound.com/android.htm
https://play.google.com/store/apps/details?id=vOICe.vOICe


On 17-Feb-19 1:51, Barry Hill (Redacted sender barry.hill3 for DMARC) wrote:
We live in a fantastic time where technology is supporting vi people more and more.  I'm 
looking forward to an Apple version of this app.  One thing, was it a typo when you wrote 
" between 0 an 1"?

Cheers

Barry


-----Original Message-----
From: access-uk@xxxxxxxxxxxxx <access-uk@xxxxxxxxxxxxx> On Behalf Of
Peter Meijer
Sent: Saturday, February 16, 2019 10:18 AM
To: access-uk@xxxxxxxxxxxxx
Subject: [access-uk] Live camera soundscapes with a talking real-time
object recognizer

Hi All,

One of my long-standing goals has been to combine "raw vision" from The vOICe 
soundscapes, representing your live camera view, with "semantic vision" from a talking 
object recognizer interpreting that same live camera view. The soundscapes are very general and can 
convey any visual scene, but learning to interpret them can be about as challenging as learning a 
foreign language.
Object recognition on the other hand is much more limited, but as easy
as having your own foreign language interpreter with you. The two
approaches are complementary, and The vOICe for Android 2.33 now
offers a first hybrid combination. The experimental object recognizer
is still limited and therefore by default turned off, but you can
easily toggle it on and off from the Options menu, just like the
talking color identifier. The vOICe for Android is available on Google
Play at

      https://play.google.com/store/apps/details?id=vOICe.vOICe

Every recognized object is spoken along with a number between 0 an 1 indicating 
recognition confidence. Hopefully future object recognition engines will become 
more powerful, so for now take this as a proof of concept of where things are 
heading. I'd love to learn of your use cases!

Have fun!

Peter


The vOICe for Android
https://www.seeingwithsound.com/android.htm
https://play.google.com/store/apps/details?id=vOICe.vOICe
** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq



---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq


** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq


** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq


** To leave the list, click on the immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=unsubscribe]
** If this link doesn't work then send a message to:
** access-uk-request@xxxxxxxxxxxxx
** and in the Subject line type
** unsubscribe
** For other list commands such as vacation mode, click on the
** immediately-following link:-
** [mailto:access-uk-request@xxxxxxxxxxxxx?subject=faq]
** or send a message, to
** access-uk-request@xxxxxxxxxxxxx with the Subject:- faq

Other related posts: