Menu
Facebook makes its Big Sur AI server design available to anyone

Facebook makes its Big Sur AI server design available to anyone

The server uses powerful GPUs and will be released through the Open Compute Project

Facebook is releasing the hardware design for a server it uses to train artificial intelligence software, allowing other companies exploring AI to build similar systems.

Code-named Big Sur, Facebook uses the server to run its machine learning programs, a type of AI software that "learns" and gets better at tasks over time. It's contributing Big Sur to the Open Compute Project, which it set up to let companies share designs for new hardware.

One common use for machine learning is image recognition, where a software program studies a photo or video to identify the objects in the frame. But it's being applied to all kinds of large data sets, to spot things like email spam and credit card fraud.

Facebook, Google and Microsoft are all pushing hard at AI, which helps them build smarter online services. Facebook has released some open-source AI software in the past, but this is the first time it's released AI hardware.

Big Sur relies heavily on GPUs, which are often more efficient than CPUs for machine learning tasks. The server can have as many as eight high-performance GPUs that each consume up to 300 watts, and can be configured in a variety of ways via PCIe.

Facebook said the GPU-based system is twice as fast as its previous generation of hardware. "And distributing training across eight GPUs allows us to scale the size and speed of our networks by another factor of two," it said in a blog post Thursday.

One notable thing about Big Sur is that it doesn't require special cooling or other "unique infrastructure," Facebook said. High performance computers generate a lot of heat, and keeping them cool can be costly. Some are even immersed in exotic liquids to stop them overheating.

Facebook Big Sur Facebook

An image of Big Sur shows a large airflow unit inside the server 

Big Sur doesn't need any of that, according to Facebook. It hasn't released the hardware specs yet, but images show a large airflow unit inside the server that presumably contains fans that blow cool air across the components. Facebook says it can use the servers in its air-cooled data centers, which avoid industrial cooling systems to keep costs down.

Like a lot of other Open Compute hardware, it's designed to be as simple as possible. OCP members are fond of talking about the "gratuitous differentiation" that server vendors put in their products, which can drive up costs and make it harder to manage equipment from different vendors.

"We've removed the components that don't get used very much, and components that fail relatively frequently — such as hard drives and DIMMs — can now be removed and replaced in a few seconds," Facebook said. All the handles and levers that technicians are supposed to touch are colored green, so the machines can be serviced quickly, and even the motherboard can be removed within a minute. "In fact, Big Sur is almost entirely tool-less --the CPU heat sinks are the only things you need a screwdriver for" Facebook says.

It's not sharing the design to be altruistic: Facebook hopes others will try out the hardware and suggest improvements. And if other big companies ask server makers to build their own Big Sur systems, the economies of scale should help drive costs down for Facebook.

Machine learning has come to the fore lately for a couple of reasons. One is that large data sets used to train the systems have become publicly available. The other is that powerful computers have gotten affordable enough to do some impressive AI work.

Facebook pointed to software it developed already that can read storiesanswer questions about an image, play games, and learn tasks by observing examples. "But we realized that truly tackling these problems at scale would require us to design our own systems," it said.

Big Sur, named after a stretch of picturesque California coastline, uses GPUs from Nvidia, including its Tesla Accelerated Computing Platform.

Facebook said it will to triple its investment in GPUs so that it can bring machine learning to more of its services.

"Big Sur is twice as fast as our previous generation, which means we can train twice as fast and explore networks twice as large," it said. "And distributing training across eight GPUs allows us to scale the size and speed of our networks by another factor of two."

Google is also rolling out machine learning across more of its services. "Machine learning is a core, transformative way by which we’re rethinking everything we’re doing," Google CEO Sundar Pichai said in October

Facebook didn't say when it would release the specifications for Big Sur. The next OCP Summit in the U.S. takes place in March, so it might say more about the system more then. 


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Brand Post

What to expect from your IT Distributor

Whether you’re just starting out or you’ve been around since before the dot com rollercoaster, choosing the right distribution partner can be a pivotal factor in your success. This definitive guide outlines the traits that every IT partner needs to look for in their IT Distributor.

Featured

Slideshows

Meet the winners of the 2020 Reseller News Innovation Awards

Meet the winners of the 2020 Reseller News Innovation Awards

Reseller News honoured the standout players of the New Zealand channel in front of more than 500 technology leaders in Auckland on 21 October, recognising the achievements of top partners, start-ups, vendors, distributors and individuals.

Meet the winners of the 2020 Reseller News Innovation Awards
Meet the Reseller News 30 Under 30 Tech Awards 2020 winners

Meet the Reseller News 30 Under 30 Tech Awards 2020 winners

This year’s Reseller News 30 Under 30 Tech Awards were held as an integral part of the first entirely virtual Emerging Leaders​ forum, an annual event dedicated to identifying, educating and showcasing the New Zealand technology market’s rising stars. The 30 Under 30 Tech Awards 2020 recognised the outstanding achievements and business excellence of 30 talented individuals​, across both young leaders and those just starting out. In this slideshow, Reseller News honours this year's winners and captures their thoughts about how their ideas of leadership have changed over time.​

Meet the Reseller News 30 Under 30 Tech Awards 2020 winners
Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security

Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security

This exclusive Reseller News Exchange event in Auckland explored the challenges facing the partner community on the cloud security frontier, as well as market trends, customer priorities and how the channel can capitalise on the opportunities available. In association with Arrow, Bitdefender, Exclusive Networks, Fortinet and Palo Alto Networks. Photos by Gino Demeer.

Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security
Show Comments