Predictive Analytics for HR
March 29, 2009
Human Resources has long been looked at as a touchy-feely business. The stereotype of its practitioners is that they give warm and fuzzy answers to most business queries. While they put Talent Management as a priority, yet they lack the analytical tools to be able to deliver the agenda. As Zach Thomas of Forrester says, “Forward-looking analytics that push well beyond traditional metrics are the cornerstone of this effort. But siloed systems, inconsistent data, and a lack of benchmarks and tools have made this increasingly difficult to achieve. To address this problem and become more strategic, HR professionals must get their arms around the data, identify key performance indicators (KPIs), settle on a technology approach, and infuse the data into their organization.”
With HR professionals increasingly turning to Predictive Analytics (“PA”), all that is set to change. The Wikipedia says Predictive Analysis uses different techniques that will analyze historical and current data to make predictions about the future behavior. PA answers what will happen, when. It is like having an astrologer for the business – not someone who is a fake and who pretends to know, but, someone who can actually save you, or make you, money. Imagine HR being able to predict which new hire has the highest probability of turning out to be a top performer and then using the organizations resources to nurture that talent. Data Mining is usually a post mortem of data to gain insights about the past. It is reactive. PA classifies the person in a group or in terms of a trait and then makes predictions in a context. Whether it is in decisions around hiring effectiveness, predicting success of employees or even using it to decide whom to layoff, Predictive Analytics is helping corporations make data-driven, fact-based decisions. The field is not without its controversies. You will see soon enough why I say that.
I got interested in this area when I spoke to Atanu Basu, the CEO of DataInfoCom whose company uses data and analytics to help companies make better decisions in Customer Service, Field Service, Marketing, Logistics, Supply Chain, etc. Atanu Basu’s LinkedIn profile lists his interest as Predictive Analytics, Operations Research, Decision Support, Root Cause Analyses, Optimization, What-If Simulation among other things. He is based out of Austin, Texas, USA. Here is how the phone conversation went.

Abhijit: Organizations routinely analyze attrition data to find trends. For example if the attrition data shows that most employees tend to leave this company in x years. Most organizations track such metrics. So what is different in using PA?
Atanu: Predictive Analytics is not really about trending. PA takes multiple, pertinent datasets and business rules into account, and then uses mathematical techniques to make contextual and actionable predictions. Metrics focus on tracking what was. Analytics can extend this to what will be and what if. For example: if you build job descriptions based on how the top performers deliver the job, you will move it beyond traditional metrics. Looking at quality of hire, time to productivity, etc. is possible when you use analytics.
Abhijit: So using metrics is like saying who didn’t perform, while analytics can help you predict who will perform and why will s/he perform! Correct?
Atanu: Exactly!! Say you just went to a doctor and she just took your blood pressure; that would be just one piece of data. During the conversation the doctor asks you about your eating habits, smoking and drinking habits, exercise routine, family history of illnesses, stress levels on the job or in the marriage, and so on and so forth. Suddenly the doctor has a more complete picture about your health and the possible items that may be affecting your health in different ways; she can now use this improved, fact-based understanding to predict your chances of getting diabetes or heart trouble – for example – in near future and the possible root causes for this upcoming illness.
Abhijit: How do I use PA to get better understanding of say, attrition?
Atanu: Just knowing that 10% of the employees leave does not make that data actionable. You need to know which 10% of the employees leave and why do they leave? For starters, it may help to classify people into different groups, where each group is defined by a specific set of characteristics with respect to attrition – Predictive Analytics can do this segmentation for you, using the data and knowledge already residing in your organization. It can tell you which group has the greatest probability of leaving, which group has the next highest probability, etc. A process of predictive Root Cause Analysis can then identify, quantify, and rank the primary drivers responsible for attrition among each ‘at risk’ group. That’s much more actionable than a blanket statement such as 10% of employees will leave every year. You can similarly use PA to predict top performers, aggressive behavior in the workplace, etc.
Abhijit: What do organizations need to do to start doing Predictive Analytics?
Atanu: Step 1 is to realize that you probably already have – or can acquire – the data on many influencers that affect your HR-related priorities. Capture and organize the characteristics that you believe could be relevant; you already know what they are. The reality is you are more ready to use PA than you may think; you already know your business, PA will sit on top of your data and your understanding to make accurate, actionable, and timely predictions leading and put you in the driver’s seat. PA by itself can’t do much (if anything at all) for you; it only becomes powerful when you “partner” with it. Start small; hire a Statistician in your HR team to make sense of the data you already have. Just knowing that 10% employees leave is just not useful.
Abhijit: Stephen Baker recently wrote in Business Week about how communication patterns are being used in organizations to take decisions. Companies use e-mails and instant messenger conversation patterns to decide who are the key influencers. What about privacy of the individual?
Atanu: Privacy is what you think you have. What you think of as “controversial applications” are now fairly commonplace applications. Electronic data sleuthing is big business. Everyone is constantly leaving electronic trails. Companies legally can access what the employees have been communicating using the company’s time and resources. So be aware of it. Companies can help by doing a full disclosure on terms of employment and not wait for employees to read the fine print. That’s the proper way to start an employee-employer relationship anyway.
Abhijit: Who else is using Predictive Analytics in big way?
Atanu: The government. The media are eager to find out the ‘who-why-how’ answers for the security related mishaps of the past, and rightfully so. Governments are trying to do something much, much more difficult, i.e., to predict and preempt these tragedies. Much easier said than done, of course. At the airports in many countries, for instance, the security cameras and computers match your photograph with databases, analyze your patterns of walking, gestures, etc. to predict how likely you are to indulge in aggressive activities or behavior.
Abhijit: What if that prediction is wrong? An innocent person could end up behind bars.
Atanu: Incorrect profiling is a huge issue and most travelers have suffered inconveniences because of it, especially for the first few years after September 11 (2001). As any government spokesman will tell you, the terrorist has to be lucky just once, but, the government has to be lucky every time. The technologies are improving at a rapid pace, especially with leading Universities, large corporations, and startups getting into the mix. Did you know that CIA has been running a venture fund now, In-Q-Tel? There will continue to be some instances of “false positives” i.e., when an innocent person ends up being wrongly profiled; though the trend seems to be decreasing. When the lives of millions of people are at stake, you just have to build in that probability.













yep – i have seen this before. thanks
well an good article on PA.Keep posting such enhancing material.
Fascinating reading…but HR and PA seem a long way off for many Indian businesses and organisations…There seems to be some sort of learning curve where ERP or systems linked to Finance or Revenues/Profits seem to be the first… followed by CRM…systems which can help boost/build revenue second…PA for HR does seem to be part of organisations’ planned approach for IT integration with businesses and decision making.
I have read about IBM adopting HR PA but there does not yet seem to be:
a) a wide spread understanding of the need for such systems
b) availability of vendors and systems for organisations to choose from
This reminds me of Isaac Asimov’s psychohistory (see his Foundation series) – where using the law of mass action one is able to predict how a society (or a large group of people) will behave in future. Looks like soon fiction will turn to reality.
[...] post is by Abhijit Bhaduri who interviews a Predictive Analytics expert on how PA can help HR be more effective and touches on other issues like employee data [...]
Interestin, I had thought of doing some work on talent acquisition and retention on similar lines and it is taking shape slowly.
Shall discuss with you in detail at your convenience.
Thanks for sharing the thoughts on PA. Definitely some insightful information – and its really heartening to see that more and more organizations are recognizing that HR attributes like absenteeism, attrition and other employee characteristics can be measured, and that HR is not all pink-and-fluffy stuff.
well and it is nice article.Keep working on such article
I agree that there is a lot of data with HR, which lies unused. PA can help in doing a deeper study that surface level observations like 10% attrition.
I would love to read more on this subject! Thanks for the initial push!
Very nice article..informative..
King Solomon said 2000 years ago…..
I would like to know much more about it!!!
I feel this encapsulates the future of HR in a much more convincing way than what is discussed in various seminars and conferences…
However, I feel HR itself should get the quantitative tools in place rather than hire a statistics expert.
Truly very informative….
Clearly there is much more between and beyond that 10% attrition rate…
Regards,
Saikat Saha
HR professionals are increasingly turning to Predictive Analytics…
The Wikipedia says Predictive Analysis uses different techniques that will analyze historical and current data to make predictions about the future behavior. PA answers what will happen, when. It is like having an astrologer for the business – not so…
I would like to know what is the process of doing a Predictive Analysis.
@moumitasarkar89 Predictive analytics is going to be the differentiator Try this http://bit.ly/aYo87M
RT @abhijitbhaduri: @moumitasarkar89 Predictive Analytics is going to be the differentiator. Try this http://bit.ly/aYo87M
RT @abhijitbhaduri: @moumitasarkar89 Predictive analytics is going to be the differentiator Try this http://bit.ly/aYo87M
[...] and altering our behavior — at work, at the mall, and in bed.” While doing the post on Predictive Analytics for HR Atanu had recommended that read this book and sent me the link on Businessweek on The Rise of The [...]