Menu
Facebook takes a guess at what's in pictures to help visually impaired

Facebook takes a guess at what's in pictures to help visually impaired

May contain peanuts: Facebook's computer vision system uses a trained neural network to guess what a picture represents

With images an ever-growing proportion of what we share on social networks, Facebook fears that users with visual impairments may be missing out.

Beginning Tuesday, the company is tweaking its timelines so that users of screen readers can hear not just the text on a page, but also a brief description of what any images may contain. Until now, they've heard only the name of the person who posted the photo.

To describe the images, Facebook built a computer vision system with a neural network trained to recognize a number of concepts, including places and the presence of people and objects. It analyzes each image for the presence of different elements, and then composes a short sentence describing it that is included in the web page as the "alt" text of the image.

Users might hear, for example, "Image may contain: two people, smiling, sunglasses, sky, tree, outdoor."

Facebook hedges its description with "may contain", but for more than half the photos on its site, the company reckons it can identify at least one relevant concept with 80 percent accuracy or better.

The new feature is only available in English for now, and can be accessed via the screen reader function on iOS devices.

Here's a video illustrating how the image description function works.

Subscribe here for up-to-date channel news

Follow Us

Join the New Zealand Reseller News newsletter!

Error: Please check your email address.

Tags Facebook

Featured

Slideshows

StorageCraft celebrates high achievers at its inaugural A/NZ Partner Awards

StorageCraft celebrates high achievers at its inaugural A/NZ Partner Awards

Revealed at a glitzy bash in Sydney at the Ivy Penthouse, the first StorageCraft Partner Awards locally saw the vendor honour its top-performing partners with ASI Solutions, SMBiT Pro, Webroot, ACA Pacific and Soft Solutions New Zealand taking home the top awards. Photos by Maria Stefina.

StorageCraft celebrates high achievers at its inaugural A/NZ Partner Awards
Kiwi resellers make a splash on Synnex and Lenovo RotoVegas road trip

Kiwi resellers make a splash on Synnex and Lenovo RotoVegas road trip

​Synnex and Lenovo hosted 18 resellers for an action-packed weekend adventure in RotoVegas, taking in white water rafting on the Kaituna River, as well as quad biking and dinner at Stratosfare​, overlooking Lake Rotorua at the top of Mount Ngongotaha​. Photos by Synnex.

Kiwi resellers make a splash on Synnex and Lenovo RotoVegas road trip
Show Comments