别让你的李克特量表长成视觉模拟量表:理解反应类别数量与测量误差之间的关系
Don't Let Your Likert Scales Grow Up To Be Visual Analog Scales: Understanding the Relationship Between Number of Response Categories and Measurement Error
AI总结:
本文通过模拟研究反应类别数量与测量误差的关系,发现当测量误差随类别数增加时存在明确最优值,并警示将李克特量表转为VAS会显著降低信度,改标度后须重新验证。
摘要:
视觉模拟量表(VAS)可以广义地理解为反应标度为0-100的项目,由于数字化评估的便利性,其使用近年来激增。然而,关于VAS量表的使用在测量意义上是否最优,目前尚无共识。换句话说,自李克特(Likert)提出以其名字命名的量表以来的90多年里,该领域仍不知道如何为给定项目确定最优的反应选项数量。在当前工作中,我们通过一系列模拟研究最优的反应类别数量。我们发现,当一个项目的测量误差不依赖于反应类别数量时,不存在真正的最优值;相反,信度随反应选项数量的增加而提高,然后趋于平稳。然而,在更现实的假设下,即一个项目的测量误差随反应类别数量的增加而增大,我们发现存在一个明确的最优值,该最优值取决于误差增加的速度。如果测量误差随反应类别数量增加而增大,那么将任何李克特量表项目转换为VAS都将导致信度急剧下降。最后,如果研究者确实想要改变一个已经过验证的测量工具的反应标度,他们必须重新验证新的测量工具,因为该量表的测量误差很可能会发生变化。
英文摘要:
The use of Visual Analog Scales (VAS), which can be broadly conceptualized as items where the response scale is 0-100, has surged recently due to the convenience of digital assessments. However, there is no consensus as to whether the use of VAS scales is optimal in a measurement sense. Put differently, in the 90+ years since Likert introduced his eponymous scale, the field does not know how to determine the optimal number of response options for a given item. In the current work, we investigate the optimal number of response categories using a series of simulations. We find that when the measurement error of an item is not dependent on the number of response categories, there is no true optimum; rather, reliability increases with number of response options and then plateaus. However, under the more realistic assumption that the measurement error of an item increases with the number of response categories, we find a clear optimum that depends on the rate of that increase. If measurement error increases with the number of response categories, then conversion of any Likert scale item to VAS will result in a drastic decrease in reliability. Finally, if researchers do want to change the response scale of a validated measure, they must re-validate the new measure as the measurement error of the scale is likely to change.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。