Menu
Hottest job? Data scientists say they're still mostly digital 'janitors'

Hottest job? Data scientists say they're still mostly digital 'janitors'

Upcoming priorities include a focus on machine learning, this report suggests

Data scientists are considered to have the hottest job right now, but a new study suggests they're little more than "digital janitors" who spend most of their time cleaning data to prepare it for analysis.

That's according to CrowdFlower, a crowdsourcing company, which surveyed 80 data scientists with varying levels of experience.

While an advanced degree is usually required for the position, a full 60 percent of respondents said they spend most of their time cleaning and organizing data, leaving little for analytical tasks like building training sets and refining algorithms.

"You have your hardest-to-hire resource spending most of their time cleaning data," said Lukas Biewald, CrowdFlower's cofounder and CEO. "It's a humongous waste for organizations."

Cleaning and organizing data, as it turns out, is also data scientists' least favorite part of the job, according to more than half of CrowdFlower's respondents.

That makes for an unhappy combination, but data scientists remain undaunted: More than 80 percent said they're happy at work.

CrowdFlower's findings also confirm that there's a shortage of data scientists in the business world. In last year's survey, 79 percent of respondents said there was a shortage; this year, that figure was up to 83 percent.

Want to land a data scientist job for yourself? The most in-demand skills, according to CrowdFlower, are SQL, Hadoop, Python, Java, R, Hive, MapReduce, NoSQL, Pig and SAS.

Coming up next is machine learning, which was singled out as especially important by more than half of the respondents CrowdFlower surveyed.

"Over the last couple of years every CEO has been asking, 'what's our big data strategy?'" Biewald said. "They need to start asking about machine learning."

Follow Us

Join the New Zealand Reseller News newsletter!

Error: Please check your email address.

Featured

Slideshows

Educating from the epicentre - Why distributors are the pulse checkers of the channel

Educating from the epicentre - Why distributors are the pulse checkers of the channel

​As the channel changes and industry voices deepen, the need for clarity and insight heightens. Market misconceptions talk of an “under pressure” distribution space, with competitors in that fateful “race for relevance” across New Zealand. Amidst the cliched assumptions however, distribution is once again showing its strength, as a force to be listened to, rather than questioned. Traditionally, the role was born out of a need for vendors and resellers to find one another, acting as a bridge between the testing lab and the marketplace. Yet despite new technologies and business approaches shaking the channel to its very core, distributors remain tied to the epicentre - providing the voice of reason amidst a seismic industry shift. In looking across both sides of the vendor and partner fences, the middle concept of the three-tier chain remains centrally placed to understand the metrics of two differing worlds, as the continual pulse checkers of the local channel. This exclusive Reseller News Roundtable, in association with Dicker Data and rhipe, examined the pivotal role of distribution in understanding the health of the channel, educating from the epicentre as the market transforms at a rapid rate.

Educating from the epicentre - Why distributors are the pulse checkers of the channel
Kiwi channel reunites as After Hours kicks off 2017

Kiwi channel reunites as After Hours kicks off 2017

After Hours made a welcome return to the channel social calendar last night, with a bumper crowd of distributors, vendors and resellers descending on The Jefferson in Auckland to kickstart 2017. Photos by Maria Stefina.

Kiwi channel reunites as After Hours kicks off 2017
Arrow exclusively introduces Tenable Network Security to A/NZ channel

Arrow exclusively introduces Tenable Network Security to A/NZ channel

Arrow Electronics introduced Tenable Network Security to local resellers in Sydney last week, officially launching the distributor's latest security partnership across Australia and New Zealand. Representing the first direct distribution agreement locally for Tenable specifically, the deal sees Arrow deliver security solutions directly to mid-market and enterprise channel partners on both sides of the Tasman.

Arrow exclusively introduces Tenable Network Security to A/NZ channel
Show Comments