Menu
Facebook takes a guess at what's in pictures to help visually impaired

Facebook takes a guess at what's in pictures to help visually impaired

May contain peanuts: Facebook's computer vision system uses a trained neural network to guess what a picture represents

With images an ever-growing proportion of what we share on social networks, Facebook fears that users with visual impairments may be missing out.

Beginning Tuesday, the company is tweaking its timelines so that users of screen readers can hear not just the text on a page, but also a brief description of what any images may contain. Until now, they've heard only the name of the person who posted the photo.

To describe the images, Facebook built a computer vision system with a neural network trained to recognize a number of concepts, including places and the presence of people and objects. It analyzes each image for the presence of different elements, and then composes a short sentence describing it that is included in the web page as the "alt" text of the image.

Users might hear, for example, "Image may contain: two people, smiling, sunglasses, sky, tree, outdoor."

Facebook hedges its description with "may contain", but for more than half the photos on its site, the company reckons it can identify at least one relevant concept with 80 percent accuracy or better.

The new feature is only available in English for now, and can be accessed via the screen reader function on iOS devices.

Here's a video illustrating how the image description function works.


Follow Us

Join the New Zealand Reseller News newsletter!

Error: Please check your email address.

Tags Facebook

Featured

Slideshows

Tight lines as Hooked on Lenovo catches up at Great Barrier Island

Tight lines as Hooked on Lenovo catches up at Great Barrier Island

​Ingram Micro’s Hooked on Lenovo incentive programme recently rewarded 28 of New Zealand's top performing resellers with a full-on fishing trip at Great Barrier Island for the third year​ in a row.

Tight lines as Hooked on Lenovo catches up at Great Barrier Island
Inside the AWS Summit in Sydney

Inside the AWS Summit in Sydney

As the dust settles on the 2017 AWS Summit in Sydney, ARN looks back an action packed two-day event, covering global keynote presentations, 80 breakout sessions on the latest technology solutions, and channel focused tracks involving local cloud stories and insights.

Inside the AWS Summit in Sydney
Channel tees off on the North Shore as Ingram Micro hosts annual Cure Kids Charity golf day

Channel tees off on the North Shore as Ingram Micro hosts annual Cure Kids Charity golf day

Ingram Micro hosted its third annual Cure Kids Charity Golf Tournament at the North Shore Golf Club in Auckland. In total, 131 resellers, vendors and Ingram Micro suppliers enjoyed a round of golf consisting of challenges on each of the 18 sponsored holes, with Team Philips taking out the top honours.

Channel tees off on the North Shore as Ingram Micro hosts annual Cure Kids Charity golf day
Show Comments