arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.15531astro-ph.IMastro-ph.CO
收藏

cp3-bench:用于基准测试符号回归算法的工具,并以宇宙学数据测试

cp3-bench: A tool for benchmarking symbolic regression algorithms tested with cosmology

Mattias E. Thing, Sofie M. Koksbang

AI总结:

本文提出cp3-bench工具,用于比较12种符号回归算法,并在28个宇宙学数据集上测试,发现多数算法表现不佳,强调特征维度和数据精度的重要性,建议根据具体任务选择算法。

摘要:

我们介绍了cp3-bench,这是一个用于比较符号回归算法的工具,我们将其公开发布在https://github.com/CP3-Origins/cp3-bench。目前,cp3-bench包含12种符号回归算法,这些算法可以作为cp3-bench的一部分自动安装。cp3-bench的设计理念是尽可能用户友好,以即用格式提供,并允许轻松添加新算法和数据集。我们希望符号回归算法的用户能够使用cp3-bench轻松安装和比较符号回归算法,从而更好地决定针对手头具体任务使用哪些算法。为了介绍和推动cp3-bench的使用,我们展示了一个基准测试,该测试将12种符号回归算法应用于代表六种不同天体物理设置的28个数据集。总体而言,我们发现大多数被基准测试的算法在基准测试中表现不佳,并提出了可能的方法来开发能够更好地识别宇宙学数据集真实表达式的算法。我们的演示基准测试研究了特征空间维度和数据集精度的重要性。我们发现这两者对于符号回归任务的成功都至关重要。另一方面,我们没有发现数据集特征间相互依赖重要的迹象,即如果数据集包含例如$z$和$H(z)$作为特征,通常不会对符号回归算法构成障碍。最后,我们没有发现算法在标准化数据集上的性能是特定天体物理数据集性能的良好指标。这表明,根据标准化数据上的表现来选择符号回归算法不一定明智。更稳健的方法是考虑多种算法,根据手头的特定任务来选择。

英文摘要:

We introduce cp3-bench, a tool for comparing symbolic regression algorithms which we make publicly available at https://github.com/CP3-Origins/cp3-bench. Currently, cp3-bench includes 12 symbolic regression algorithms which can be automatically installed as part of cp3-bench. The philosophy behind cp3-bench is that it should be as user-friendly as possible, available in a ready-to-use format, and allow for easy additions of new algorithms and datasets. Our hope is that users of symbolic regression algorithms can use cp3-bench to easily install and compare symbolic regression algorithms to better decide which algorithms to use for their specific tasks at hand. To introduce and motivate the use of cp3-bench we present a benchmark of 12 symbolic regression algorithms applied to 28 datasets representing six different astrophysical setups. Overall, we find that most of the benched algorithms do poorly in the benchmark and suggest possible ways to proceed with developing algorithms that will be better at identifying ground truth expressions for cosmological datasets. Our demonstration benchmark studies the significance of dimensionality of the feature space and precision of datasets. We find both to be highly important for symbolic regression tasks to be successful. On the other hand, we find no indication that inter-dependence of features in datasets is important, i.e. it is not in general a hindrance for symbolic regression algorithms if datasets e.g. contain both $z$ and $H(z)$ as features. Lastly, we find no indication that performance of algorithms on standardized datasets are good indicators of performance on particular astrophysical datasets. This suggests that it is not necessarily prudent to choose symbolic regression algorithms based on their performance on standardized data. A more robust approach is to consider a variety of algorithms, chosen based on the particular task at hand.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑