Menu
Facebook's Caffe2 AI tools come to iPhone, Android, and Raspberry Pi

Facebook's Caffe2 AI tools come to iPhone, Android, and Raspberry Pi

Your smartphone may soon be able to recognize objects in images without accessing the cloud

IDG

IDG

New intelligence can be added to mobile devices like the iPhone, Android devices, and low-power computers like Raspberry Pi with Facebook's new open-source Caffe2 deep-learning framework.

Caffe2 can be used to program artificial intelligence features into smartphones and tablets, allowing them to recognize images, video, text, and speech and be more situationally aware.

It's important to note that Caffe2 is not an AI program, but a tool allowing AI to be programmed into smartphones. It takes just a few lines of code to write learning models, which can then be bundled into apps.

The release of Caffe2 is significant. It means users will be able to get image recognition, natural language processing, and computer vision directly on their phone. That task is typically offloaded to remote servers in the cloud, with smartphones then connecting to it.

Mobile devices are getting more artificial intelligence capabilities. More phones are being bundled with Amazon's Alexa and Google Assistant, while Apple's Siri has been a staple in the iPhone for years. Samsung's Galaxy S8 smartphones are due to get the Bixby voice assistant, which should make using the handsets much easier.

Caffe2 can work within the power constraints of mobile devices. It works with mobile hardware to speed up AI applications and create neural networks.

Caffe2 takes advantage of the computing power of new mobile hardware to speed up deep-learning tasks. For example, in smartphones, Caffe2 will harness the computing power of Adreno GPUs and Hexagon DSPs on Qualcomm's Snapdragon mobile chips.

The new machine-learning framework succeeds Caffe, which excelled at image recognition. Caffe was mainly used for machine learning in data centers, and Caffe2 is a complete overhaul so it can work on mobile devices.

"We're committed to providing the community with high-performance machine learning tools so that everyone can create intelligent apps and services," Facebook said in a blog entry on the Caffe2 website.

Caffe2 could also be used to create chatbots. The Caffe2 website has some pre-trained models that could be used to create learning models.

Before this announcement, it was already possible to create deep learning models on mobile devices through Google's TensorFlow. TensorFlow could be ported to devices like drones to add image recognition to cameras. Like with TensorFlow, the code in Caffe2 can be easily ported between multiple environments.

The open-source framework is also a lot faster than the original Caffe. Benchmarks by Intel, Qualcomm, and Nvidia boast significant speed boosts compared to Caffe and other machine-learning frameworks.

There are other machine-learning frameworks like Theano and Microsoft's Cognitive Toolkit (CNTK). Companies deploying machine learning sometimes mix and match frameworks depending on applications.

But the major appeal of Caffe2 still remains tied to mega data centers. For example, servers with GPUs are used to create the rich data sets needed for image recognition. Image recognition involves the classification and labeling of pixels, which can help identify an object accurately. The learning model gets more accurate as more data is fed. That's especially handy in applications like self-driving cars, which need to identify objects to avoid collisions.

Nvidia claims that Caffe2 will be significantly faster than on its high-end GPUs than the original Caffe. Some Nvidia GPUs designed for machine learning have low-level floating computing capabilities, instrumental in creating a powerful neural network to make accurate assumptions.

Facebook is expected to share more details on Caffe2 on Wednesday during the F8 conference being held in San Jose, California.


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Featured

Slideshows

The making of an MSSP: a blueprint for growth in NZ

The making of an MSSP: a blueprint for growth in NZ

Partners are actively building out security practices and services to match, yet remain challenged by a lack of guidance in the market. This exclusive Reseller News Roundtable - in association with Sophos - assessed the making of an MSSP, outlining the blueprint for growth and how partners can differentiate in New Zealand.

The making of an MSSP: a blueprint for growth in NZ
Reseller News Platinum Club celebrates leading partners in 2018

Reseller News Platinum Club celebrates leading partners in 2018

The leading players of the New Zealand channel came together to celebrate a year of achievement at the inaugural Reseller News Platinum Club lunch in Auckland. Following the Reseller News Innovation Awards, Platinum Club provides a platform to showcase the top performing partners and start-ups of the past 12 months, with more than ​​50 organisations in the spotlight.​​​

Reseller News Platinum Club celebrates leading partners in 2018
Meet the top performing HP partners in NZ

Meet the top performing HP partners in NZ

HP has honoured its leading partners in New Zealand during 2018, following 12 months of growth through the local channel. Unveiled during the fourth running of the ceremony in Auckland, the awards recognise and celebrate excellence, growth, consistency and engagement of standout Kiwi partners.

Meet the top performing HP partners in NZ
Show Comments