dearJulius.com Write For Us

AR technology helps the blind navigate by making objects 'talk'

SHARE:


By Jon Fingas, Engadget

If you're blind, finding your way through a new area can sometimes be challenging. In the future, though, you might just need to wear a headset. Caltech researchers have developed a Cognitive Augmented Reality Assistant (CARA) that uses Microsoft's HoloLens to make objects "talk" to you. CARA uses computer vision to identify objects in a given space and say their names -- thanks to spatialized sound, you'll know if there's a chair in front of you or a door to your right. The closer you are, the higher the pitch of an object's voice.

This could quickly become overwhelming, so the team created a trio of modes modes. The most intuitive option, spotlight mode, has objects speak their names only when you're looking at them. If you'd rather get a sense of what the room is like before moving, a scan mode will name everything in view of the HoloLens' cameras. And if you have somewhere specific to be, a target mode lets you focus on just one object.


The technology is very young and not particularly accessible when it requires an expensive AR headpiece. Early results are promising, at least. Scientists conducted successful tests where blind volunteers found their way through a Caltech building using CARA to tell them where to turn, where the stairs were and even when there were hand rails. In the long-term, the goal is to make CARA-equipped headsets useful in many places. You could visit a store for the first time and navigate the aisles as if you're a regular.

COMMENTS



Note: If you think this story need more information or correction, feel free to comment below your opinion and reaction.
Like & Follow to Stay Updated ...

Name

AI,3,Amazon,1,Apple,5,Emoji,1,Facebook,17,Games,35,Google,7,Instagram,6,Science,205,Security,4,Social Media,24,Tech,242,Technology,1080,Tesla,5,Twitter,4,
ltr
item
Technology - U.S. Daily News: AR technology helps the blind navigate by making objects 'talk'
AR technology helps the blind navigate by making objects 'talk'
https://i.ytimg.com/vi/vAGybwLb3kg/hqdefault.jpg
https://i.ytimg.com/vi/vAGybwLb3kg/default.jpg
Technology - U.S. Daily News
https://tech.dailynews.us.com/2018/11/ar-technology-helps-blind-navigate-by.html
https://tech.dailynews.us.com/
https://tech.dailynews.us.com/
https://tech.dailynews.us.com/2018/11/ar-technology-helps-blind-navigate-by.html
true
4191228214535516123
UTF-8
Loaded All Posts Not found any posts VIEW ALL Read More Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS PREMIUM CONTENT IS LOCKED STEP 1: Share. STEP 2: Click the link you shared to unlock Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy