Abstract:Nowadays, management researchers commonly rely on statistical significance when testing the moderation effects. However, statistical significance is not equivalent to practical significance. This study has four purposes. First, this study described the difference between the statistical significance and the practical significance of the moderation effect. Second, this study applied the method of bibliometrics to analyze the published studies between 2011 and 2023 with reported moderation effects in four top-tier management journals in China, i.e., Journal of management world, Nankai Management Review, Acta Psychologica Sinica and Chinese Journal of Management. The results show that Chinese management researchers have paid more attention to the practical significance of the moderation effect, but the magnitude of the practical significance reported was not substantial. Third, we further introduced two analytical strategies for evaluating the practical significance of moderation effects: Deviation R-square (ΔR2) and the absolute discrepancies between the dependent variable’s predicted values from two regression models. Finally, this study illustrated the two analytical strategies for testing the practical significance of the moderation effects using the raw data of a recently published study.
郑璐,王丽娜,龙立荣,孟繁兴,Alexander Scott English. 管理研究中的调节效应:从统计显著到实际显著[J]. 管理学报, 2025, 22(11): 2005-.
ZHENG Lu,WANG Lina,LONG Lirong,MENG Fanxing,Alexander Scott English. The Moderation Effect in Management Research:from Statistical Significance to Practical Significance. Chinese Journal of Management, 2025, 22(11): 2005-.