ACSPRI Conferences, RC33 Eighth International Conference on Social Science Methodology

Font Size:  Small  Medium  Large

Reassessing the effect of survey characteristics on Common Method Variance in Emotional and Social Intelligence Competencies Assessment

Joan Manuel Batista-Foguet

Building: Law Building
Room: Breakout 4 - Law Building, Room 106
Date: 2012-07-10 11:00 AM – 12:30 PM
Last modified: 2012-06-08


Reviewers of papers in business research often reject papers that use a single method for data collection, arguing that the results cannot be trusted on account of Common Method Variance (CMV). This idea is inspired by Campbell and Fiske (1959). Recently, management journals ORM among others devoted particular attention to this problem. In that issue, it transpires that it is not so clear what CMV is and how great its effect is. In this context we will report on a within-subject, split-ballot multi-trait multi-method experimental design for estimating CMV for a specific method (length of response scale) and the effect of a common data collection method (self-reporting of behavior) related to Emotional and Social Competencies.
Results show that there is indeed CMV, but the effect of this common variance is much smaller than the effect of the random errors. The design of this study allows some nuances to the Lance et al (2010) conclusions of that these two effects cancel each other out. This study agrees with previous research suggesting that random errors should receive at least as much or even more reviewer attention than CMV.