Menu
Amazon super-sizes instances to lure Hadoop users to Web Services

Amazon super-sizes instances to lure Hadoop users to Web Services

The company has launched 12 new virtual servers that can be used for image processing and financial analytics

Amazon Web Services hopes to entice more Hadoop users to its Elastic MapReduce service with new virtual servers, one of which has 262GB of memory and 6.4TB of storage for big-data analytics.

On Tuesday, the company launched 12 new virtual servers or instances that organizations can use to run their applications using Elastic MapReduce clusters. Potential applications include Web indexing, data mining, log file analysis, financial analysis, scientific simulation and bioinformatics research.

Hadoop is an open-source platform that allows for the distributed processing of large data sets across clusters of computers. The MapReduce framework assigns work to nodes in the cluster.

Amazon's compute-optimized c3.8xlarge virtual server is aimed at tasks such as image processing. It has 32 vCPUs (virtual CPUs), 64GB of memory, two times 320GB of SSD storage and 10Gbps network connectivity. The price tag is US$0.270 per hour, plus from $1.680 for the corresponding EC2 (Elastic Compute Cloud) server.

The storage-optimized i2.8xlarge instance type is a good fit for analytics applications Impala, Spark and HBase, Amazon said. It has 32 vCPUs , 262GB of memory, eight times 800GB of SSD storage, and 10Gbps network connectivity. The cost is $0.270 per hour and from $6.820 per hour for the EC2 capacity.

One effective way to determine the most appropriate instance type is to launch several small clusters and benchmark them, according to Amazon.

In total, Amazon now has 25 Elastic MapReduce servers for users to choose between, which cost from $0.011 to $0.270 per hour plus the charge for EC2. Users are limited to 20 servers across all their clusters in the standard configuration. Those that want more need to ask Amazon for permission.

On Tuesday, Amazon also lowered the cost of existing virtual Elastic MapReduce servers by 27 percent to 61 percent. The price change is part of a general price drop that Amazon announced last week after Google cut the cost of its services.

The price war between public cloud providers shows no signs of abating, as Microsoft on Monday cut Azure pricing and also introduced a new basic service configuration.

Users who want to run Hadoop in a hosted environment have alternatives to Amazon's Elastic MapReduce, including running Microsoft's HDInsight on top of the company's Azure cloud and Rackspace's Cloud Big Data Platform.

An HDInsight system includes a head node and one or more compute nodes, and Microsoft offers one size of each type. The head node is available in the Extra Large (A4) size and costs $0.64 per hour, while the compute node runs on the Large (A3) virtual server and is priced at $0.32 per hour. The latter has 4 vCPUs and 7GB of memory, according to Microsoft.

Rackspace has joined forces with Hadoop specialist Hortonworks to offer a service that can compete with Amazon. The Cloud Big Data Platform is currently in a so-called Limited Availability program, which is the last step before Rackspace makes a service generally available. Prospective users have two options: a shared virtual server with 2 vCPUs, 7.5GB of memory and 1.3TB of storage or a dedicated node with 16 vCPUs, 60GB of memory and 11TB of storage. They cost $0.37 per hour or $2.96 per hour, respectively.

The thinking behind all these offerings is to take care of deployment and maintenance, making it easier for organizations to start using Hadoop. Companies can then focus on the core task, analyzing and extracting value from large amounts of data.

Send news tips and comments to mikael_ricknas@idg.com


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags cloud computinginternetManaged ServicesAmazon Web ServicesSoftware as a serviceInfrastructure services

Brand Post

What to expect from your IT Distributor

Whether you’re just starting out or you’ve been around since before the dot com rollercoaster, choosing the right distribution partner can be a pivotal factor in your success. This definitive guide outlines the traits that every IT partner needs to look for in their IT Distributor.

Featured

Slideshows

Meet the Reseller News 30 Under 30 Tech Awards 2020 winners

Meet the Reseller News 30 Under 30 Tech Awards 2020 winners

This year’s Reseller News 30 Under 30 Tech Awards were held as an integral part of the first entirely virtual Emerging Leaders​ forum, an annual event dedicated to identifying, educating and showcasing the New Zealand technology market’s rising stars. The 30 Under 30 Tech Awards 2020 recognised the outstanding achievements and business excellence of 30 talented individuals​, across both young leaders and those just starting out. In this slideshow, Reseller News honours this year's winners and captures their thoughts about how their ideas of leadership have changed over time.​

Meet the Reseller News 30 Under 30 Tech Awards 2020 winners
Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security

Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security

This exclusive Reseller News Exchange event in Auckland explored the challenges facing the partner community on the cloud security frontier, as well as market trends, customer priorities and how the channel can capitalise on the opportunities available. In association with Arrow, Bitdefender, Exclusive Networks, Fortinet and Palo Alto Networks. Photos by Gino Demeer.

Reseller News Exchange Auckland: Beyond the myths — how partners can master cloud security
Reseller News welcomes industry figures at 2020 Hall of Fame lunch

Reseller News welcomes industry figures at 2020 Hall of Fame lunch

Reseller News welcomed 2019 inductees - Leanne Buer, Ross Jenkins and Terry Dunn - to the fourth running of the Reseller News Hall of Fame lunch, held at the French Cafe in Auckland. The inductees discussed the changing face of the IT channel ecosystem in New Zealand and what it means to be a Reseller News Hall of Fame inductee. Photos by Gino Demeer.

Reseller News welcomes industry figures at 2020 Hall of Fame lunch
Show Comments