Menu
Researchers hack Sony headset to simulate autism

Researchers hack Sony headset to simulate autism

The work is aimed at helping people understand what it's like to live with ASD

Japanese researchers want to show people what it's like to have autism by using an augmented reality headset that distorts imagery of people nearby. The researchers mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

Japanese researchers want to show people what it's like to have autism by using an augmented reality headset that distorts imagery of people nearby. The researchers mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

Japanese researchers want to show people what it's like to have autism by using a headset that distorts imagery of people nearby.

The researchers from Osaka University and the University of Tokyo mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

The webcam's video is relayed to the screens, but when the simulation's image-processing program is activated, the faces of people become washed out and fuzzy, making their expressions impossible to see.

White dots like swirling snow also appear on the screens in response to loud noise, distorting the high-contrast image. Earphones linked to a microphone in the webcam also relay a distorted audio signal.

The effect is aimed at simulating the vision and hearing of people with autism spectrum disorder (ASD), who can experience sensory overload and deficit. They can also struggle to understand the emotional states of others.

Based on augmented reality techniques, the image processing is done in a separate computer that receives the webcam's signal by Wi-Fi and then wirelessly transmits the altered image to the Sony headset.

The researchers published a paper on the concept of the autism headset at a conference of the Institute of Electrical and Electronics Engineers (IEEE) last year.

"We hypothesize that (people without autism) experiencing an artificial ASD perceptual system would have the same difficulty with environment recognition and taking action," the researchers wrote.

They are planning to publish more detailed papers of the experimental device, said Yukie Nagai, an associate professor at Osaka University's Emergent Robotics Lab.

The work follows a prototype video game developed in 2013 called Auti-Sim that presented the player with a distorted playground and loud screams. The developers, however, did not claim to present a scientifically accurate portrayal of autism.

Tim Hornyak covers Japan and emerging technologies for The IDG News Service. Follow Tim on Twitter at @robotopia.

Follow Us

Join the New Zealand Reseller News newsletter!

Error: Please check your email address.

Tags popular scienceconsumer electronicsOsaka UniversityUniversity of Tokyosony

Slideshows

Top 50 defining moments of the New Zealand channel in 2016

Top 50 defining moments of the New Zealand channel in 2016

Reseller News looks back on a tumultuous 12 months for the New Zealand channel, assessing the fallout from a year of sizeable industry change. Whether it be local or global mergers and acquisitions, distribution deals or job changes, the channel that started the year differs somewhat to the one set to finish it - Reseller News assesses the key moments that made 2016.​

Top 50 defining moments of the New Zealand channel in 2016
​Hewlett Packard Enterprise honours high achieving NZ channel

​Hewlett Packard Enterprise honours high achieving NZ channel

Hewlett Packard Enterprise honoured its top performing Kiwi partners at the second running of its HPE Partner Awards in New Zealand, held at a glitzy ceremony in Auckland. Recognising excellence across eight categories - from distributors to resellers - the tech giant celebrated its first year as a standalone company, following its official split from HP in 2015.

​Hewlett Packard Enterprise honours high achieving NZ channel
Nutanix treats channel partners to Christmas cruise

Nutanix treats channel partners to Christmas cruise

Nutanix recently took to the seas for a Christmas Cruise around Sydney Harbour with its Australia and New Zealand staff, customers and partners to celebrate a stellar year for the vendor. With the sun out, they were all smiles and mingled over drinks and food.

Nutanix treats channel partners to Christmas cruise
Show Comments