As Nvidia expands in AI, Intel defends turf

As Nvidia expands in AI, Intel defends turf

Competition set to increase during next 18-24 months

Nvidia dominates chips for training computers to think like humans, but it faces an entrenched competitor in a major avenue for expansion in the artificial intelligence (AI) chip market: Intel.

Nvidia chips dominate the AI training chip market, where huge amounts of data help algorithms "learn" a task such how to recognise a human voice, but one of the biggest growth areas in the field will be deploying computers that implement the "learned" tasks.

Intel dominates data centres where such tasks are likely to be carried out.

“For the next 18 to 24 months, it's very hard to envision anyone challenging Nvidia on training," said Jon Bathgate, analyst and tech sector co-lead at Janus Henderson Investors.

But Intel processors already are widely used for taking a trained artificial intelligence algorithm and putting it to use, for example by scanning incoming audio and translating that into text-based requests, what is called "inference."

Intel's chips can still work just fine there, especially when paired with huge amounts of memory, said Bruno Fernandez-Ruiz, chief technology officer of Nexar, an Israeli start-up using smartphone cameras to try to prevent car collisions.

That market could be bigger than the training market, said Abhinav Davuluri, an analyst at Morningstar, who sees an inference market of US$11.8 billion by 2021, versus US$8.2 billion for training.

Intel estimates that the current market for AI chips is about US$2.5 billion, evenly split between inference and training.

Nvidia, which posted an 89 per cent rise in profit last week, hasn't given a specific estimate for the inference chip market but CEO Jensen Huang said on an earnings call with analysts that he believes it "is going to be a very large market for us."

Nvidia sales of inference chips are rising. In May, the company said it had doubled its shipments of them year-over-year to big data centre customers, though it didn't give a baseline.

Earlier this month, Alphabet’s Google Cloud unit said it had adopted Nvidia's inference chips and would rent them out to customers.

But Nvidia faces a headwind selling inference chips because the data centre market is blanketed with the CPUs Intel has been selling for 20 years.

Intel is working to persuade customers that for both technical and business reasons, they should stick with what they have.

Take Taboola, a New York-based company that helps web publishers recommend related content to readers and that Intel has touted as an example of how its chips remain competitive.

The company uses Nvidia's training chips to teach its algorithm to learn what to recommend and considered Nvidia's inference chips to make the recommendations. Speed matters because users leave slow-loading pages.

But Taboola ended up sticking with Intel for reasons of speed and cost, said Ariel Pisetzky, the company's vice president of information technology.

Nvidia's chip was far faster, but time spent shuffling data back and forth to the chip negated the gains, Pisetzky said.

Second, Intel dispatched engineers to help Taboola tweak its computer code so that the same servers could handle more than twice as many requests.

"My options were, you already have the servers. They're in the racks," he said. "Working with Intel, I can now cut back my new server purchases by a factor of two because I can use my existing servers two times better."

Nvidia has been working to solve those challenges. The company has rolled out software this year to make its inference chips far faster to help overcome the issue of moving data back and forth.

And it announced a new family of chips based on a technology called Turing earlier this week that it says will be 10 times faster still, Huang said on the analyst call.

“We are actively working with just about every single Internet service provider in the world to incorporate inference acceleration into their stack," Huang said.

He gave the example that "voice recognition is only useful if it responds in a relatively short period of time. And our platform is just really, really excellent for that."

(Reporting by Stephen Nellis; Editing by Peter Henderson and Lisa Shumaker)

Follow Us

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags intelnvidia



How MSPs can capitalise on integrating AI into existing services

How MSPs can capitalise on integrating AI into existing services

​Given the pace of change, scale of digitalisation and evolution of generative AI, partners must get ahead of the trends to capture the best use of innovative AI solutions to develop new service opportunities. For MSPs, integrating AI capabilities into existing service portfolios can unlock enhancements in key areas including managed hosting, cloud computing and data centre management. This exclusive Reseller News roundtable in association with rhipe, a Crayon company and VMware, focused on how partners can integrate generative AI solutions into existing service offerings and unlocking new revenue streams.

How MSPs can capitalise on integrating AI into existing services
Access4 holds inaugural A/NZ Annual Conference

Access4 holds inaugural A/NZ Annual Conference

​Access4 held its inaugural Annual Conference in Port Douglass, Queensland, for Australia and New Zealand from 9-11 October, hosting partners from across the region with presentations on Access4 product updates, its 2023 Partner of the Year awards and more.

Access4 holds inaugural A/NZ Annual Conference
Show Comments