虚拟现实软件测试的特征
Characterizing Virtual Reality Software Testing
摘要:
虚拟现实(Virtual Reality,VR)是一种为用户提供独特的实时体验的新兴技术。VR技术已经在各种场景中提供了革命性的用户体验(例如,培训、教育、产品/架构设计、游戏、远程会议/旅游等)。然而,测试VR应用程序是具有挑战性的,因为它们的性质需要物理交互,并且依赖于硬件系统。尽管最近VR技术及其使用场景取得了进步,但我们对VR应用测试仍然知之甚少。为了填补这一知识空白,我们对包括28个工业项目在内的97个开源VR应用进行了实证研究。我们的分析发现,74.2%的VR项目没有进行任何测试,而对于进行测试的VR项目,与其他项目类别相比,功能方法与测试方法的比例中位数较低。此外,我们还发现了有关VR代码覆盖率测量的工具支持问题,我们能够生成的代码覆盖率和断言密度结果也相对较低,平均值分别为15.63%和17.69%。最后,通过对来自4个VR应用的220个测试用例和来自4个非VR应用的281个测试用例的人工分析,我们确定了VR应用需要特定类别的测试用例来确保VR应用的质量属性。我们相信,我们的研究结果构成了一个呼吁行动的VR开发社区,以改善测试方面,并为软件工程研究人员提供方向,以开发先进的技术,自动测试用例生成和测试质量分析的VR应用程序。
英文摘要:
Virtual Reality (VR) is an emerging technique that provides a unique real-time experience for users. VR technologies have provided revolutionary user experiences in various scenarios (e.g., training, education, product/architecture design, gaming, remote conference/tour, etc.). However, testing VR applications is challenging due to their nature which necessitates physical interactivity, and their reliance on hardware systems. Despite the recent advancements in VR technology and its usage scenarios, we still know little about VR application testing. To fill up this knowledge gap, we performed an empirical study on 97 open-source VR applications including 28 industrial projects. Our analysis identified that 74.2% of the VR projects evaluated did not have any tests, and for the VR projects that did, the median functional-method to test-method ratio was low in comparison to other project categories. Moreover, we uncovered tool support issues concerning the measurement of VR code coverage, and the code coverage and assertion density results we were able to generate were also relatively low, as they respectively had averages of 15.63% and 17.69%. Finally, through manual analysis of 220 test cases from four VR applications and 281 test cases from four non-VR applications, we identified that VR applications require specific categories of test cases to ensure VR application quality attributes. We believe that our findings constitute a call to action for the VR development community to improve testing aspects and provide directions for software engineering researchers to develop advanced techniques for automatic test case generation and test quality analysis for VR applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。