基于观察的单元测试生成在Meta的应用
Observation-based unit test generation at Meta
AI总结:
TestGen通过从应用执行观察中刻划单元测试,在Meta大规模部署,已落地518个测试,发现5702个故障,并能为86%的类生成测试。
摘要:
TestGen自动生成单元测试,这些测试是从应用执行期间观察到的复杂对象的序列化观察中刻划出来的。我们描述了TestGen在Meta的开发与部署过程。特别是,我们聚焦于开发过程中克服的可扩展性挑战,以便在工业界大规模部署基于观察的测试刻划。到目前为止,TestGen已将518个测试落地到生产环境中,这些测试在持续集成中已执行了9,617,349次,发现了5,702个故障。Meta目前正在进行更广泛的部署。我们的评估显示,当从4,361个可靠的端到端测试中刻划观察时,TestGen能够为端到端测试覆盖的至少86%的类生成测试。对16个Kotlin Instagram应用启动阻塞任务的测试表明,TestGen测试本可以在其中13个任务成为启动阻塞之前捕获它们。
英文摘要:
TestGen automatically generates unit tests, carved from serialized observations of complex objects, observed during app execution. We describe the development and deployment of TestGen at Meta. In particular, we focus on the scalability challenges overcome during development in order to deploy observation-based test carving at scale in industry. So far, TestGen has landed 518 tests into production, which have been executed 9,617,349 times in continuous integration, finding 5,702 faults. Meta is currently in the process of more widespread deployment. Our evaluation reveals that, when carving its observations from 4,361 reliable end-to-end tests, TestGen was able to generate tests for at least 86\% of the classes covered by end-to-end tests. Testing on 16 Kotlin Instagram app-launch-blocking tasks demonstrated that the TestGen tests would have trapped 13 of these before they became launch blocking.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。