Menu
HP extends R programming language for big data use

HP extends R programming language for big data use

Distributed R can be used to analyze data across multiple file servers

Hewlett-Packard has devised a way to run programs written in the R statistical programming language against data sets that span more than one server, potentially paving the way for large-scale, real-time predictive analytics.

"Historically, big data has been focused on the past," said Jeff Veis, HP vice president of marketing for the company's big data business group. The new software will allow organizations to "anticipate breaking trends" by using very large data sets, he said.

While various commercial packages offer ways to run R on computer clusters, HP's new Distributed R is the first to offer this capability in an open source package, Veis said.

With millions of users worldwide, the open-source R is one of the most widely used programming languages specifically designed for statistical computing and predictive analytics, alongside SAS, MatLab, Mathematica and a number of Python libraries.

R has been a challenge to use with large data sets, though, because it runs as a single thread on a computer.

This approach limits the amount of data that can be analyzed. As a result, data scientists will often analyze samples from a very large data set, rather than the entire data set, potentially reducing the accuracy of the results.

The new HP package includes a set of algorithms, created by HP Labs, for running an R program across multiple computers simultaneously, allowing billions of rows of data to be analyzed. This approach allows the entire data set to be analyzed.

HP primarily created Distributed R to run on its Vertica column-oriented analytic database system, which was created to facilitate analysis of terabytes of data.

Distributed R, released under the GPL version 2 open source license, can work with other databases and data processing platforms in addition to Vertica, such as Hadoop. It is fully compatible with the R Studio and R console developer tools.

Microsoft recently set out to acquire one of the leading R commercial vendors, Revolution Analytics.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags softwareapplicationsHewlett-Packardapplication developmentdata miningLanguages and standards

Featured

Slideshows

EDGE 2018: Kiwis kick back with Super Rugby before NZ session

EDGE 2018: Kiwis kick back with Super Rugby before NZ session

New Zealanders kick-started EDGE 2018 with a bout of Super Rugby before a dedicated New Zealand session, in front of more than 50 partners, vendors and distributors on Hamilton Island.​

EDGE 2018: Kiwis kick back with Super Rugby before NZ session
EDGE 2018: Kiwis assess key customer priorities through NZ research

EDGE 2018: Kiwis assess key customer priorities through NZ research

EDGE 2018 kicked off with a dedicated New Zealand track, highlighting the key customer priorities across the local market, in association with Dell EMC. Delivered through EDGE Research - leveraging Kiwi data through Tech Research Asia - more than 50 partners, vendors and distributors combined during an interactive session to assess the changing spending patterns of the end-user and the subsequent impact to the channel.

EDGE 2018: Kiwis assess key customer priorities through NZ research
Show Comments