考生有话说:理解语言测试中使用AI的影响
Test-takers have a say: understanding the implications of the use of AI in language tests
AI总结:
本研究通过访谈和调查英语考生,从考生视角实证分析语言测试中采用AI的影响,发现AI可提升公平性等认知但也可能引发可靠性等方面的不信任,为利益相关者决策提供参考。
摘要:
语言测试从听、说、读、写四个方面衡量一个人的语言使用能力。这类测试在学术、职业和移民领域发挥着不可或缺的作用,教育机构、职业认证机构和政府等实体利用它们评估候选人的语言 proficiency(熟练程度)。近期人工智能(AI)和自然语言处理学科的进展,促使语言测试提供方探索AI在语言测试中的潜在适用性,催生了围绕语言教学与学习的变革性活动模式。然而,由于人们对AI的可信度存在担忧,了解将AI融入语言测试的影响势在必行。这一认知将使利益相关者能够做出明智的决策,从而保障社群福祉和测试的公正性。为了解语言测试中使用AI的担忧和影响,我们对英语考生进行了访谈和调查。据我们所知,这是首项旨在从考生视角识别语言测试中采用AI的影响的实证研究。我们的研究揭示了考生的认知和行为模式。具体而言,我们发现AI融入可能提升考生对公平性、一致性和可及性的认知。反之,它可能引发考生在可靠性和交互性方面的不信任,进而影响考生的行为和福祉。这些见解有助于更好地理解潜在的社会影响,并协助利益相关者就语言测试中使用AI做出明智决策。
英文摘要:
Language tests measure a person's ability to use a language in terms of listening, speaking, reading, or writing. Such tests play an integral role in academic, professional, and immigration domains, with entities such as educational institutions, professional accreditation bodies, and governments using them to assess candidate language proficiency. Recent advances in Artificial Intelligence (AI) and the discipline of Natural Language Processing have prompted language test providers to explore AI's potential applicability within language testing, leading to transformative activity patterns surrounding language instruction and learning. However, with concerns over AI's trustworthiness, it is imperative to understand the implications of integrating AI into language testing. This knowledge will enable stakeholders to make well-informed decisions, thus safeguarding community well-being and testing integrity. To understand the concerns and effects of AI usage in language tests, we conducted interviews and surveys with English test-takers. To the best of our knowledge, this is the first empirical study aimed at identifying the implications of AI adoption in language tests from a test-taker perspective. Our study reveals test-taker perceptions and behavioral patterns. Specifically, we identify that AI integration may enhance perceptions of fairness, consistency, and availability. Conversely, it might incite mistrust regarding reliability and interactivity aspects, subsequently influencing the behaviors and well-being of test-takers. These insights provide a better understanding of potential societal implications and assist stakeholders in making informed decisions concerning AI usage in language testing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。