"Everybody's asking, 'How do you identify these people? What skills do you look for? What is their degree?' " says Greta Roberts, CEO of Talent Analytics, which makes software designed to help employers correlate employees' skills and innate characteristics to business performance.
Roberts, Phillips and other experts say the skills most often mentioned in connection with big data jobs include math, statistics, data analysis, business analytics and even natural language processing. And although titles aren't always consistent from employer to employer, some, such as data scientist and data architect, are becoming more common.
A Curious Mind Is Key
As companies search for big data talent, they're tending to target application developers and software engineers more than IT operations professionals, says Josh Wills, senior director of data science at Cloudera, which sells and supports a commercial version of the open-source Hadoop framework for managing big data.
That's not to say IT operations specialists aren't needed in big data. After all, they build the infrastructure and support the big data systems.
"This is where the Hadoop guys come in," says D.J. Patil, data scientist in residence at Greylock Partners, a venture capital firm. "Without these guys, you can't do anything. They are building incredible infrastructure, but they are not necessarily doing the analysis."
IT staffers can quickly learn Hadoop through traditional classes or by teaching themselves, he notes. Burgeoning training programs at the major Hadoop vendors are proof that many IT folks are doing so.
That said, most of the jobs emerging in big data require knowledge of programming and the ability to develop applications, as well as an understanding of how to meet business needs.
The most important qualifications for these positions aren't academic degrees, certifications, job experience or titles. Rather, they seem to be soft skills: a curious mind, the ability to communicate with nontechnical people, a persistent -- even stubborn -- character and a strong creative bent.
Patil has a Ph.D. in applied mathematics. Sacheti has a Ph.D. in agricultural and resource economics. According to Patil, the qualities of curiosity and creativity matter more than one's field of study or level of academic credential.
"These are people who fit at the intersection of multiple domains," he says. "They have to take ideas from one field and apply them to another field, and they have to be comfortable with ambiguity."
Wills, for example, took a circuitous path to the role of data scientist. After graduating from Duke University with a bachelor's degree in math, he pursued a graduate degree in operations research at the University of Texas on and off while working for a series of companies before dropping out to take a job at Google in 2007. (He notes that he did eventually complete that master's degree.) Wills worked at Google as a statistician and then as a software engineer before moving to Cloudera and assuming his data science title.
Sign up for CIO Asia eNewsletters.