Monday, 8 April 2013

'Figuring out what they're after': a common thread between assessment performance and job performance?

A while back we shared a review of the Ability To Identify Criteria (ATIC), suggesting that difference in how people perform on a selection process like an interview is due partly how good they are at figuring out what the process wants to hear. The article suggested that this may not be entirely bad, as ATIC appears to have a role in job performance as well. Now the authors have published empirical work looking closer at this issue. Their data suggests that figuring out situational demands may have a very substantial hand in both selection and job performance, and may even be the major link between the two.

First author Anne Jansen and colleagues (principally from University of Zürich) recruited 124 participants into a simulated assessment process, pitched as a way to give them experience of job selection. Participants were incentivised to do well, with the top two candidates each day financially rewarded, and had to pay a small fee to enter the process. This encouraged motivated participation that was more in line with real selection experiences. Participants were informed of the job description ahead of time, and on assessment day, turned up in groups of 12 to undertake interviews, a cognitive test, presentations and group discussions, observed by multiple assessors (Occupational Psychology MSc students).

After each exercise, participants were asked to document their hunch of what dimensions it was trying to measure; this was compared to answers given by the assessors beforehand, with close matches leading to higher situational demand/ATIC scores. No such information was explicitly provided (otherwise ATIC becomes redundant) so participants had to rely on indirect cues, such as the job descriptions, reading between the lines of instructions, being sensitive to what assessors seemed to be attuned to. In addition, each participant gave authorisation for their real-work supervisors to be contacted online to give feedback on their real job performance; in total, 107 responded.

Overall assessment centre scores correlated with job performance, with a relationship of .21. Both AC scores and job performance also correlated with the ATIC scores for participants: someone who was savvy in figuring out what the AC asked of them did better in the AC, and also did better in the workplace. Jansen's team constructed a statistical model in which cognitive ability fed ATIC, which itself strongly contributed to performance on assessments and in the workplace. Once all of these factors were accounted for, assessment performance itself was no predictor of workplace performance. This suggests, at the least, that ATIC and the factors that sit behind it are a substantial underpinning of how assessments adequately predict workplace performance.

One way to look at this is the growing identification of 'just another factor': IQ, EI, resilience, practical intelligence - that researchers argue counts in the workplace. But actually, this line of research advocates a shift in perspective. It asks us to accept that performance doesn't just depend on the resources you bring to the job, but to your perception of what the job is. This interactionist perspective is less concerned with raw capability and more about orientation. And it raises new considerations: in jobs where orientation is clear-cut - four duties, get on with it - shouldn't we be minimising it in selection? Whereas at the other extreme, could applicants for jobs with high ambiguity be tasked with finding their own way through the application process?

ResearchBlogging.orgJansen A, Melchers KG, Lievens F, Kleinmann M, Brändli M, Fraefel L, & König CJ (2013). Situation assessment as an ignored factor in the behavioral consistency paradigm underlying the validity of personnel selection procedures. The Journal of applied psychology, 98 (2), 326-41 PMID: 23244223

Further reading: The original review is

ResearchBlogging.orgKleinmann, M., Ingold, P., Lievens, F., Jansen, A., Melchers, K., & Konig, C. (2011). A different look at why selection procedures work: The role of candidates' ability to identify criteria Organizational Psychology Review, 1 (2), 128-146 DOI: 10.1177/2041386610387000


  1. This is really interesting research. When we coach people in career transitions, we usually advise candidates to really get to know what the assessment process is looking for, and if you have it, let them see it! However, we also advise against lying or only giving what they want to hear, because that could lead to successful interview for a job you really are not suited to. Thanks for the blog!

  2. You're welcome. Sounds like a good approach for candidates to take. There is research that suggests that applicants naturally just try to give recruiters what they are looking for, which we covered here last year:
    It may be of interest.

    Work from home theory is fast gaining popularity because of the freedom and flexibility that comes with it. Since one is not bound by fixed working hours, they can schedule their work at the time when they feel most productive and convenient to them. Women & Men benefit a lot from this concept of work since they can balance their home and work perfectly. People mostly find that in this situation, their productivity is higher and stress levels lower. Those who like isolation and a tranquil work environment also tend to prefer this way of working. Today, with the kind of communication networks available, millions of people worldwide are considering this option.

    Women & Men who want to be independent but cannot afford to leave their responsibilities at home aside will benefit a lot from this concept of work. It makes it easier to maintain a healthy balance between home and work. The family doesn't get neglected and you can get your work done too. You can thus effectively juggle home responsibilities with your career. Working from home is definitely a viable option but it also needs a lot of hard work and discipline. You have to make a time schedule for yourself and stick to it. There will be a time frame of course for any job you take up and you have to fulfill that project within that time frame.

    There are many things that can be done working from home. A few of them is listed below that will give you a general idea about the benefits of this concept.

    This is the most common and highly preferred job that Women & Men like doing. Since in today's competitive world both the parents have to work they need a secure place to leave behind their children who will take care of them and parents can also relax without being worried all the time. In this job you don't require any degree or qualifications. You only have to know how to take care of children. Parents are happy to pay handsome salary and you can also earn a lot without putting too much of an effort.

    For those who have a garden or an open space at your disposal and are also interested in gardening can go for this method of earning money. If given proper time and efforts nursery business can flourish very well and you will earn handsomely. But just as all jobs establishing it will be a bit difficult but the end results are outstanding.

    Freelance can be in different wings. Either you can be a freelance reporter or a freelance photographer. You can also do designing or be in the advertising field doing project on your own. Being independent and working independently will depend on your field of work and the availability of its worth in the market. If you like doing jewellery designing you can do that at home totally independently. You can also work on freelancing as a marketing executive working from home. Wanna know more, email us on and we will send you information on how you can actually work as a marketing freelancer.

    Internet related work
    This is a very vast field and here sky is the limit. All you need is a computer and Internet facility. Whatever field you are into work at home is perfect match in the software field. You can match your time according to your convenience and complete whatever projects you get. To learn more about how to work from home, contact us today on workfromhome.otr214422@gmail.comand our team will get you started on some excellent work from home projects.

    Diet food
    Since now a days Women & Men are more conscious of the food that they eat hence they prefer to have homemade low cal food and if you can start supplying low cal food to various offices then it will be a very good source of income and not too much of efforts. You can hire a few ladies who will help you out and this can be a good business.

    Thus think over this concept and go ahead.