Menu
Pivotal sets the stage for open-source in-memory computing

Pivotal sets the stage for open-source in-memory computing

Pivotal has released the source code for much of its GemFire distributed in-memory database

Following through on a promise to open-source its data analysis software, Pivotal has released the source code that powers its GemFire in-memory database.

Opening up the code could give enterprise customers more input into what new features are added into future versions. For Pivotal, the move provides an entry to those corporate clients that have adopted policies of using open-source software whenever possible, said Roman Shaposhnik, Pivotal's director of open source.

The company also hopes the software, released under the name Project Geode, will find a wider user base, one looking for big data analysis technologies speedier than Hadoop or Spark, Shaposhnik said.

Releasing the code is the first step in Pivotal's plan, formulated earlier this year, to open-source components of the company's Big Data Suite, which includes GemFire. Later this year, the company plans to release the code for its Pivotal Hawq SQL engine for Hadoop and the Pivotal Greenplum Database .

Not all of GemFire is being open-sourced. The company is holding back some advanced features for its commercial edition, such as the ability to stage continuous queries and establish wide-area network connectivity between clusters. Those who pay for the commercial edition will also receive enterprise-level support.

GemFire is distributed in-memory software, which provides a way to hold large amounts of data in the working memory of multiple servers, or nodes. GemFire can balance data across hundreds of nodes, potentially managing terabytes of data.

With this design, GemFire can provide enterprise applications with low-latency access to datasets that are too large to be crammed into the memory of a single server. The software provides all the reliability properties offered by traditional relational databases, which are commonly characterized as ACID (atomicity, consistency, isolation and durability). It includes fail-over capabilities, so the system will remain responsive should one or several individual nodes fail.

Independent software vendor GemStone developed GemFire more than a decade ago, and the code base has grown to more than 1 million lines of code. VMware acquired GemStone in 2010. The technology was transferred to Pivotal, a spin-off company created in 2013 to collect and integrate the growing collection of data analysis technologies owned by VMware and its parent company EMC.

GemFire was originally developed to power mission-critical applications in the financial industry and has been used for large-scale critical operations such as stock trading, financial payments, and ticket sales. Pivotal estimates the software is used to execute more than 10 million transactions a day.

GemFire is one of a number of in-memory databases on the market, said Curt Monash, head of IT analyst firm Monash Research. Alternatives include SAP's HANA, Tibco's ActiveSpace, and AeroSpike's and MemSQL's eponymous databases. Tachyon, the open-source memory-pooling software currently under development for Spark and Hadoop, may also interest enterprises, Monash said.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags databasessoftwareapplicationsPivotal

Brand Post

How to become the best IT MSP

This article provides guidance for managed service providers (MSPs) that want to grow their business. It is also useful for any IT service provider looking to move from the break-fix model to managed IT services.

Featured

Slideshows

Reseller News Innovation Awards 2019: meet the winners

Reseller News Innovation Awards 2019: meet the winners

Reseller News honoured the standout players of the New Zealand channel in front of more than 480 technology leaders in Auckland on 23 October, recognising the achievements of top partners, emerging entrants and innovative start-ups.

Reseller News Innovation Awards 2019: meet the winners
Malwarebytes shoots the breeze with channel, prospects

Malwarebytes shoots the breeze with channel, prospects

A Kumeu, Auckland, winery was the venue for a Malwarebytes event for partner and prospect MSPs - with some straight shooting on the side. The half-day getaway, which featured an archery competition, lunch and wine-tasting aimed at bringing Malwarebytes' local New Zealand and top and prospective MSP partners together to celebrate recent local successes, and discuss the current state of malware in New Zealand. This was also a unique opportunity for local MSPs to learn about how they can get the most out of Malwarebytes' MSP program and offering, as more Kiwi businesses are targeted by malware.

Malwarebytes shoots the breeze with channel, prospects
Show Comments