The Role of Sampling in Strategic Management Research on Performance: A Two-Study Analysis

Abstract

Strategic management researchers often note the inability of many phenomena to consistently explain organizational performance. Using a two-study format, we examine the possibility that sampling practices may contribute to this inability. We chronicle sampling practices within 437 studies investigating the determinants of organizational performance published between 1980 and 1999 in the Academy of Management Journal, Administrative Science Quarterly, Journal of Management, Organization Science, and Strategic Management Journal. Our results reveal that fewer than one in five studies rely on a random sample and that researchers offer little a priori acknowledgement of sample limitations. Although the first study suggests that sampling issues have been problematic, it cannot offer direct evidence. Thus, in the second study, we examine the effect of sample selection on empirical results by testing one popular relationship from the strategy literature (chief executive officer duality and performance) using fou...