arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.16244cs.LGcs.CV
收藏

关于合成数据的等价性、替代性与灵活性

On the Equivalency, Substitutability, and Flexibility of Synthetic Data

Rutgers University(罗格斯大学);Roblox(罗布乐思公司)

Che-Jui Chang, Danrui Li, Seonghyeon Moon, Mubbasir Kapadia

AI总结:

本研究实证探讨合成数据在真实场景中的有效性,系统分析其与真实数据的等价性、替代性及生成器灵活性,实验证明合成数据可提升性能并替代60%-80%真实数据,同时灵活生成器有助于弥合域差距。

摘要:

我们从实证角度研究合成数据在真实世界场景中的有效性。利用合成数据训练感知模型已成为社区广泛采用的关键策略,因其具备高效性、可扩展性、完美标注和低成本等优势。尽管优势已被证实,但鲜有研究关注如何高效生成合成数据集以解决真实世界问题,以及合成数据能在多大程度上减少真实世界数据收集的工作量。为回答这些问题,我们系统性地研究了合成数据的几个有趣特性——合成数据与真实数据的等价性、合成数据对真实数据的替代性,以及合成数据生成器弥合域差距的灵活性。利用M3Act合成数据生成器,我们在DanceTrack和MOT17上进行了实验。结果表明,合成数据不仅提升模型性能,还展现出对真实数据的替代性,60%至80%的替换率下性能无损失。此外,我们对合成数据分布对下游性能影响的研究揭示了灵活数据生成器在缩小域差距以提升模型适应性方面的重要性。

英文摘要:

We study, from an empirical standpoint, the efficacy of synthetic data in real-world scenarios. Leveraging synthetic data for training perception models has become a key strategy embraced by the community due to its efficiency, scalability, perfect annotations, and low costs. Despite proven advantages, few studies put their stress on how to efficiently generate synthetic datasets to solve real-world problems and to what extent synthetic data can reduce the effort for real-world data collection. To answer the questions, we systematically investigate several interesting properties of synthetic data -- the equivalency of synthetic data to real-world data, the substitutability of synthetic data for real data, and the flexibility of synthetic data generators to close up domain gaps. Leveraging the M3Act synthetic data generator, we conduct experiments on DanceTrack and MOT17. Our results suggest that synthetic data not only enhances model performance but also demonstrates substitutability for real data, with 60% to 80% replacement without performance loss. In addition, our study of the impact of synthetic data distributions on downstream performance reveals the importance of flexible data generators in narrowing domain gaps for improved model adaptability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑