arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.20394cs.SE
收藏

理解与采纳:通过一系列实验评估语言工作台

Comprehension vs. Adoption: Evaluating a Language Workbench Through a Family of Experiments

CNR–ISTI(意大利国家研究委员会信息系统技术研究所);University of Milan(米兰大学);University College Dublin(都柏林大学学院)

Giovanna Broccia, Maurice H. ter Beek, Walter Cazzola, Luca Favalli, Francesco Bertolotti, Alessio Ferrari

AI总结:

本文通过实验评估Neverlang语言工作台的可理解性和用户接受度,发现其使用简便性仍存在问题,但高可理解性并不必然提升用户接受度。

摘要:

语言工作台是使编程语言及其生态系统定义、重用和组合的工具,旨在简化语言开发。为了促进语言设计师采用这些工具,用于定义其他语言的语言的可理解性是一个重要的评估方面。此外,考虑到语言工作台是相对新的工具,用户接受度在评估过程中成为关键因素。当前文献经常忽视用户为中心的方面,如可理解性和接受度,在评估此类工具时被忽略。本文通过一系列实验评估Neverlang,一个模块化的语言工作台,以填补这一空白。研究采用定制的Method Evaluation Model (MEM)来评估Neverlang的元语言和程序的可理解性,以及用户接受度在感知使用简便性、感知有用性和使用意图方面的表现。它还调查了这些维度之间的关系。实验在三个迭代中进行,涉及学术界参与者。结果表明,用户对Neverlang的元语言有充分的理解,特别是其语法,对有用性的感知较为积极,并表示使用该工具的意愿。然而,结果也表明Neverlang的使用简便性仍是一个挑战。此外,感知使用简便性和有用性是否低或高,会影响用户的使用意愿。令人惊讶的是,没有发现可理解性与用户接受度之间的显著相关性。值得注意的是,元语言的更高可理解性并不一定带来更高的接受度,突显了理解与采纳之间的复杂相互作用。

英文摘要:

Language workbenches are tools that enable the definition, reuse, and composition of programming languages and their ecosystems, aiming to streamline language development. To facilitate their adoption by language designers, the comprehensibility of the language used to define other languages is an important aspect to evaluate. Moreover, considering that language workbenches are relatively new tools, user acceptance emerges as a crucial factor to be accounted for during their assessment. Current literature often neglects user-centred aspects like comprehensibility and acceptance in the assessment of this breed of tools. This paper addresses this gap through a family of experiments assessing Neverlang, a modular language workbench. The study adopts a tailored version of the Method Evaluation Model (MEM) to evaluate the comprehensibility of Neverlang's meta-language and programs, as well as user acceptance in terms of perceived ease of use, perceived usefulness, and intention to use. It also investigates the relationships among these dimensions. The experiments were conducted in three iterations involving participants from academia. The results reveal that users demonstrate sufficient comprehension of Neverlang's meta-language, particularly concerning its syntax, express a favourable perception of its usefulness, and indicate their intention to use it. However, the results also indicate that Neverlang's ease of use remains a challenge. Additionally, variations in the perceived ease of use and perceived usefulness, whether low or high, influence the users' intention to use the tool. Surprisingly, no significant correlation is found between comprehensibility and user acceptance. Notably, higher comprehensibility of the meta-language does not necessarily translate into greater acceptance, underscoring the complex interplay between comprehension and adoption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑