Features
Michael Silverman, 16 Nov 2011
Employee engagement surveys, staff surveys, people surveys, call them what you want: let’s face it – they’re rubbish.
Most people are generally critical of such surveys and I find this to be true amongst people who participate in them, people who run surveys in-house and even people who work for external providers. I do know some senior leaders who like them, especially when they have some crude employee engagement target linked to their bonus, but that's another matter.
The harsh truth is that the vast majority of employee surveys are poorly designed (or rather, not designed at all). The industry seems to have converged on just one type of question format - the Agree/Disagree Likert Scale. Rensis Likert was one of the big players in management thinking and in 1932 he proposed an approach for measuring people's attitudes. If he were alive today, whilst no doubt he would be happy to hear his name still being banded about, he'd probably be a little embarrassed.
Yet Likert could not have foreseen that senior leaders' whimsical need for social comparison, external providers' need to build their benchmarking databases and a general incompetence in questionnaire design would conspire together with such terrible consequences. All organisations are different, so it doesn't make sense to ask very general and standardized questions, all on the same scale, just to get some meaningless external comparisons. This approach can only ever provide very vague feedback. It's no wonder managers find action planning so difficult - they don't really have much to go on.
It's popular nowadays for organisations to brand surveys with misleading straplines like "Have your say!" "It's your Shout!" or "Talkback!" (sometimes even when there are no open-ended questions). Are these surveys really giving employees a say? I don't think so. Accurately and quickly extracting insights from written data has been a huge stumbling block for HR. Most organisations are terrible at analyzing unstructured textual data. Some of the UK's biggest companies are still manually reading and coding just ten per cent of all the comments they receive - the remaining 90 per cent are consigned to the feedback graveyard. That's not a survey, that's a lottery. Why HR has largely ignored advances in text analytics over the last decade is a mystery to me.
The fact that participants rarely get to see their colleagues' comments from a survey also causes a certain indifference to open-ended questions. After all, who's going to read it? Someone in a data-inputting warehouse in India? The unfortunate person who's looking after the survey this year? Big deal. Not only does this cause fewer responses to open-ended questions, it also means that people are less likely to give considered responses (compared to if they knew their comment would be posted online for other people to evaluate, for example).
When the Internet appeared, surveys were simply transferred from the material to the electronic world - and nothing has really changed. However, the whole premise of a "survey" is starting to look outdated. Digital technologies and social media are providing - dare I say it - more 'engaging' ways of gathering feedback from people.
The crucial thing here is that employee research is becoming multi-directional: it's not just about employees filling in surveys in isolation, it's about employees collaborating with each other, harnessing the wisdom of crowds and then distilling the essence of those conversations. In this way, a level of insight can be achieved that has not been previously possible.
Of course, there will be plenty of pitfalls to avoid, and challenges to overcome, as these developments become more widespread. However, the HR community must first acknowledge that organisations have become so obsessed with scores on employee surveys that it is actually distracting them from what they were supposed to be doing in the first place - listening to their people.
Michael Silverman, is a director at Silverman Research
12 comments on this article |
Richard Lambert 16 Nov 2011
Michael That was an interesting read. As a fan of the Likert scale, I can strongly agree with some of what you say and strongly disagree with some other comments you make. Firstly, let me reveal my hand. I am a supplier of employee research services to organisations. Yes, I design and conduct employee surveys for my clients. I agree with you that some organisations are only interested in conducting a survey because it is something that they have been tasked with. The tick-box exercise of a survey is indeed its own tick-box exercise. They do a survey because they have to. I avoid these clients like the plague. It really is no fun working to create a bespoke survey for a client who then has no interest whatsoever in using the data, the analysis, the interpretation to take meaningful action. I got stung by this once (a long time ago) - never again. So, I agree that surveys can indeed be rubbish. But only if the organisation doesn't care in the first place. If the company really wants to use the data to act strategically to improve morale, satisfaction, "employee engagement", then that's when they reap the rewards, see the value and get their return on investment. I'm all for using new advances in technology, completely agree that sampling open-ended replies is a nonsense - you have to read and analyse them all ! There is so much evidence of improvement in business performance being linked to positive results from this type of survey. It's difficult to argue against (and I don't want to). I'm a big fan of the Govt backed Employee Engagement Taskforce and really hope they can make the differences that they are positioning to deliver. Thanks for inspiring me to respond on a Wednesday morning ! Richard Lambert http://moraleatworksurvey.co.uk/
Tanya Harris 16 Nov 2011
Michael, thanks for your comments, I have a question for Richard, I live overseas therefore not familiar with the Govt backed Employee Engagement Taskforce. My question is, if data collection does not involve likert scale or open questions then how does the employee Engagement Taskforce gather feedback. Look forward to finding out more. Tanya Harris
Jon Ingham 16 Nov 2011
Interestingly there have been some conversations within the Engagement Taskforce's 'guru group' (which I'm on although I've not managed to attend any of their meetings) about HR's focus on engagement surveys distracting it from focusing on what it needs to do to improve engagement. You'll find some of my comments on this here: http://strategic-hcm.blogspot.com/2011/06/my-presentation-with-employee.html I do therefore tend to agree with Michael that more intuitive and collaborative ways of understanding engagement are likely to be more useful.
ANDREW POWLES 16 Nov 2011
I think for me it depends as to whether employers see it through a transactional or transformational lens. So if its purely about acting on employee feedback through the surveys, it's not good but if its about engagement as a way of running and doing the business with people at the heart of delivery and heart of strategy then it feels diferent
Isabel Wu 17 Nov 2011
Thank you Michael for the article. Unfortunately it's not just the surveys that the HR community is obsessed with; it's also scores on work output, on competencies, on employee inputs - it is a quest to find that seemingly just-elusive score that will finally reveal the secret to understanding employees. I look forward to the day when HR will finally recognise that people are complex, emotional, sometimes difficult and will not always fit into tidy boxes. Isabel Wu www.metamanagement.net.au
Jaime Johnson 17 Nov 2011
Organisations are complex systems, emotional, sometimes difficult and will not always fit into tidy boxes too! Each organisation is as different as all the individuals that make up the organisation. And this is where I agree - Michael – a one size fits all approach to surveying where an organisation can see how it compares against the ‘Best’ is never going to pick up on the issues and strengths of an individual organisation or its specific departments. I think this is true for many HR solutions – they need to be relevant, the organisation from the top down needs to be committed, and the feedback needs to be provided in such a way that organisations and individual managers can take actions forward. Jaime Johnson www.surveyinitiative.co.uk
Nicholas J Higgins 17 Nov 2011
In an age where I hear Likert's name mispronounced many times, it's perhaps not surprising that many measurement techniques and organisation surveys are poorly applied. However surveys designed and applied properly are one of the best tools at management's (and HR's) disposal. As part of a management process to elicit structured feedback to improve day to day people management, and thus individual engagement/productivity - they're invaluable. Yes, it's sad to see them when used as a tick-box exercise but I would prefer an organisation to conduct a survey than not at all. It's all part of the 'educating management' challenge. That's the focus. Let's not get too distracted with various media processes. Focus on the objective.......
Jane Sunley 18 Nov 2011
Whilst Michael Silverman makes some interesting points; employee surveys can provide vast amounts of business critical information - IF the organisation devotes the time to ask the right questions and then, vitally, actually do something with the information. In our experience people make surveys far too complex and spend too much time worrying about benchmarking them against others. Our view is that the best benchmark is against oneself i.e. how have we improved, what’s changed and so on. By thinking about what actually matters to business performance and employee happiness it’s possible to limit the number of questions and therefore shorten the exercise whilst achieving better data. It’s also important to remember that an employee opinion survey is just that – an opportunity to harness ideas, feedback and feelings. The people on the front-line know your customers and your business better than anyone; why stifle their opportunity to tell you exactly what they think by only asking a set of closed questions. One of our favourites, which we actively encourage clients to include, is ‘If you were CEO for the day, what would you do?’ Yes some offer silly suggestions; however we have also seen a huge number of ideas being acted upon; saving the organisation time and money whilst improving engagement. And that’s the key – acting upon and communicating the results. You don’t have to go into the detail; however a top-line overview of the findings, what will change as a result, how and when. And if suggestions cannot be enacted; an honest reason why. Only then will your people recognise the benefit of completion and take the time and effort required to answer. Jane Sunley - CEO, learnpurple (www.learnpurple.com)
Michael Silverman 18 Nov 2011
Hi All – thanks for all the comments. Let me say a bit more on some of the points raised. I agree that that there is nothing worse than an organisation that feels obliged to conduct a survey. My issue though is that no matter how good the survey, or how strong the motivation of senior management, the traditional survey has its limits. I’d wager that positive business results can largely be attributed to senior managements’ motivation to make a difference to people’s experience of work, irrespective of any survey. A lot of organisations succeed in spite of surveys, not because of them. For brave organisations, there are now better methods of generating insight. http://www.hrmagazine.co.uk/hr/opinion/1020310/considered-responses-authentic-voices-ensure-generate-insights-quality I haven’t taken a great deal of notice to the Employee Engagement Taskforce to be honest, although the some discussions I have read have not been too favourable. I read very closely the 2009 Mcleod Review - “Engaging for success”. I didn’t know what to make of it really, although some bits were good. I hope the output of the taskforce is more practical and embraces the massive role that social media has to play in this area. As Jon says – collaborative tools are likely to be fruitful for engagement. Tanya - I think the employee engagement task force is collecting a lot of qualitative data (interviews/discussion groups, case studys etc). I don’t know if they’re doing a survey – I hope not! As Nicholas refers to, I can confirm that Rensis Likert would introduce himself as "Lick-ert" as opposed to “Like-ert.”
Chris McGivern 22 Nov 2011
Not sure I buy this generalised swipe at surveys, Likert scales and those who use them. Or that added comments aren't taken notice of. Of course, you reap what you sow if you only use standard questions and don't tailor a survey to the needs of the organisation. Nothing new there. The essential truth is that anyone (within limits) can run a survey and get a set of numbers back. So let's not kid ourselves that we're talking hi-tech. The real challenge is getting leaders and managers to sit down with employees and work out new and better ways to run organisations. That call for a different mindset, not agonising about survey scales or textual analysis: that means focusing on the survey PROCESS rather than not getting hung up on the technical aspects. What matters is whether surveys lead to change for the better, not what kind of scales you use. And what's wrong with them, anyway??
Alan Jones 29 Nov 2011
I have no doubt that many organisations will conduct surveys just because they think they ought to, or because they can at least hide behind the false premise that they do in fact value employee opinions. But this is not the case for everyone. I am managing director of Cascade HR, a company that I believe truly depends upon the commitment and hard work of its employees. Our culture is clearly defined and people are recruited not only because of the qualifications and skills that they can demonstrate, but because of their attitude and personality too. If we’ve worked hard to recruit the right people, it makes no sense not to listen to them, and involve them in shaping the business going forward. They’re at the heart of everything we do, and we could not grow, or deliver our desired level client satisfaction without them. Surveys that are effectively designed, applied, interpreted and communicated, are incredibly valuable, and we will continue to use them because we know the positive effects that they can have.
Latest Issue - February 2012
If the UK were a company, what should its people policy be? Here are some strategic HR approaches to help CEO David Cameron and his board identify UK...
A & D Media © Copyright 2011, All Rights Reserved
Send to a friend