{"id":3487,"date":"2020-11-01T20:46:59","date_gmt":"2020-11-01T20:46:59","guid":{"rendered":"https:\/\/techclot.com\/index.php\/2020\/11\/01\/facebook-research-is-developing-ar-glasses-that-help-deaf-people-hear-better\/"},"modified":"2020-11-01T20:46:59","modified_gmt":"2020-11-01T20:46:59","slug":"facebook-research-is-developing-ar-glasses-that-help-deaf-people-hear-better","status":"publish","type":"post","link":"https:\/\/techclot.com\/index.php\/2020\/11\/01\/facebook-research-is-developing-ar-glasses-that-help-deaf-people-hear-better\/","title":{"rendered":"Facebook research is developing AR glasses that help deaf people hear better"},"content":{"rendered":"

Facebook research is developing AR glasses that help deaf people hear better<\/a><\/p>\n

<\/div>\n

Usually, the news that a research lab is being turned into a bar would suggest that it has failed and its researchers are throwing in the towel. But in the case of Facebook Reality Labs Research, a lab dedicated (in part) to coming up with creative new ways to improve hearing for members of the deaf or hard of hearing community, it showed that its work was paying off.<\/p>\n

Facebook\u2019s stated mission is to help people connect and communicate with one another. This is why, while it might seem off-mission to tackle this project, it actually fits perfectly into the company\u2019s core competencies.<\/p>\n

<\/figure>\n

The problem Facebook has been trying to tackle is how to improve audio pickup for individuals in noisy environments. Although many people with hearing loss, depending on its severity, find it possible to hear and interact in one-on-one situations in quiet locations, noisy environments like bars or busy social settings can be a whole lot tougher. With that in mind, Facebook has been exploring how it can combine beamforming technology, deep learning, noise cancellation, and \u2014 perhaps most surprisingly \u2014 augmented reality (AR) to improve this situation.<\/p>\n

In a recent project, Facebook scientists have been exploring how augmented reality glasses could help determine which sounds people want to amplify by looking at, well, where they\u2019re looking. By matching a person\u2019s focus, in terms of what they\u2019re looking at, to audio inputs, AR glasses can figure out which sounds a person wants to hear and which they don\u2019t \u2014 and then dial up or down the sound channels accordingly. As part of its experiments in this area, Facebook turned the workspace where much of this investigation is carried out into a fake bar to explore how it would work in a place with multiple noisy sound inputs.<\/p>\n

<\/figure>\n

\u201cMany people with hearing loss don\u2019t use hearing aids \u2014 in part \u2014 because they don\u2019t work well in everyday situations like a noisy restaurant, a conversation involving multiple people at a loud party, or in a moving car,\u201d Thomas Lunner<\/a>, research lead for Facebook\u2019s Hearing Science lab, told Digital Trends. \u201cIn conducting our enhanced hearing research for AR glasses, we realized that some of the discoveries we were making could be relevant to solving this problem. In [our new research], we show how augmented reality could supplement the hearing aid, through a system that understands what you want to listen to, isolates and enhances the sounds you want to hear, and reduces distracting background noise. By then sending the enhanced AR-processed signal to the hearing aid, you also get a system that adjusts for your unique hearing ability.\u201d<\/p>\n

Playing to Facebook Research\u2019s strengths<\/h2>\n

Lunner is no novice when it comes to this area of research. He\u2019s a renowned hearing scientist whose work laid the basis for what became the world\u2019s first digital hearing aid in 1995. This research, while still in early stages, taps into a number of areas of research for Facebook, such as image recognition, natural language processing, and a whole lot more.<\/p>\n

\u201cHearing sciences is an area we\u2019re just starting to explore, so this technology is not available on any of our products, but we\u2019re very excited about the possibilities with AR glasses,\u201d Lunner continued. \u201cWe think they could one day help to deliver all sorts of enhancements, including helping anyone who has hearing loss or just has trouble understanding people at a party.\u201d<\/p>\n

<\/figure>\n

Michael Abrash<\/a>, chief scientist at Facebook Reality Labs, told Digital Trends that he believes that both augmented and virtual reality could have profound implications (and applications) in the accessibility space.<\/p>\n

\u201cAR and VR have enormous potential to benefit everyone, but they have especially high potential for people with varying physical abilities,\u201d Abrash said. \u201cFor example, AR glasses may one day be able to enhance contrast in order to help people with poor vision see better, and may be able to provide visual feedback about ambient sounds and speech to the hearing impaired. As another example, we believe that VR \u2014 and eventually AR \u2014 will one day be able to create ultra-realistic virtual spaces and avatars that will enable those with mobility challenges to teleport to the office or to their grandmother\u2019s living room.\u201d<\/p>\n

<\/figure>\n

Facebook is, of course, best known for its social network. But just like Google parent company Alphabet, which explores self-driving cars, mapping systems and drone deliveries<\/a> alongside search, Facebook is interested in far more than just news feeds and timelines. In the past, it has shown considerable interest in both VR and AR \u2014 with everything from its acquisition of Oculus<\/a> to the creation of the Spark AR Studio<\/a>. Facebook still has yet to show its hand when it comes to a lot of this technology. Still, if this work is anything to go by, it seems that Facebook could be using its considerable power for good when it comes to the future of connecting people.<\/p>\n

A paper describing the work, titled \u201cPotential of Augmented Reality Platforms to Improve Individual Hearing Aids and to Support More Ecologically Valid Research,\u201d was recently published in the journal Ear & Hearing<\/a>.<\/p>\n

\n\t\tEditors’ Recommendations\t<\/h4>\n

\t\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t<\/span><\/p>\n

\t\t\t\t\t
\n\t\t\t\t<\/span><\/p>\n

\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t<\/span>
\n\t\t\t\t\t\t<\/span><\/p>\n

Published at Sun, 01 Nov 2020 15:56:15 +0000<\/p>\n","protected":false},"excerpt":{"rendered":"

Facebook research is developing AR glasses that help deaf people hear better Usually, the news…<\/p>\n","protected":false},"author":12,"featured_media":3488,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[61],"tags":[],"class_list":["post-3487","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-augmented-virtual-reality"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/techclot.com\/wp-content\/uploads\/2020\/11\/facebook_hearing_ar5-1200x9999.png?fit=1200%2C800&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3orZX-Uf","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts\/3487","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/comments?post=3487"}],"version-history":[{"count":0,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts\/3487\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/media\/3488"}],"wp:attachment":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/media?parent=3487"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/categories?post=3487"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/tags?post=3487"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}