arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1106.2832astro-ph.IMstat.AP
收藏

克服样本选择偏差的主动学习方法在光度变星分类中的应用

Active Learning to Overcome Sample Selection Bias: Application to Photometric Variable Star Classification

Joseph W. Richards, Dan L. Starr, Henrik Brink, Adam A. Miller, Joshua S. Bloom, Nathaniel R. Butler, J. Berian James, James P. Long, John Rice

摘要:

尽管机器学习算法在分类和预测大规模调查中观察到的大量天体物理源和瞬变的天体物理参数方面前景广阔,但训练数据的特殊性通常表现为对感兴趣数据的强烈偏见预测。通常情况下,训练集是从更明亮,更近的物体的历史调查中获得的,而不是从更广泛,更深入的调查(测试数据)中获得的。这种样本选择偏差可能会导致对测试数据的预测出现灾难性错误,因为a)机器学习模型选择程序的标准假设被打破,b)测试空间的密集区域可能完全没有训练数据。我们探索了样本选择偏差的可能补救措施,包括重要性加权(IW),协同训练(CT)和主动学习(AL)。我们认为,AL-其中的数据,其包含在训练集将最提高对测试集的预测查询手动跟进-是一种有效的方法,是适合于许多天文应用。对于一个变星分类问题的一组充分研究的恒星从依巴谷和OGLE,AL是最佳的方法在测试数据的错误率,击败了3.4%的现成的分类器和其他提出的方法至少3.0%。为了帮助手动标记的变星,我们开发了一个Web界面,它允许轻松的光变曲线可视化和查询外部数据库。最后,我们应用主动学习对ASAS调查中的变星进行分类,发现我们与ACVS目录的一致性从65.5%提高到79.5%,并且经过几次AL迭代后,分类器对测试集的平均置信度从14.6%提高到42.9%。

英文摘要:

Despite the great promise of machine-learning algorithms to classify and predict astrophysical parameters for the vast numbers of astrophysical sources and transients observed in large-scale surveys, the peculiarities of the training data often manifest as strongly biased predictions on the data of interest. Typically, training sets are derived from historical surveys of brighter, more nearby objects than those from more extensive, deeper surveys (testing data). This sample selection bias can cause catastrophic errors in predictions on the testing data because a) standard assumptions for machine-learned model selection procedures break down and b) dense regions of testing space might be completely devoid of training data. We explore possible remedies to sample selection bias, including importance weighting (IW), co-training (CT), and active learning (AL). We argue that AL---where the data whose inclusion in the training set would most improve predictions on the testing set are queried for manual follow-up---is an effective approach and is appropriate for many astronomical applications. For a variable star classification problem on a well-studied set of stars from Hipparcos and OGLE, AL is the optimal method in terms of error rate on the testing data, beating the off-the-shelf classifier by 3.4% and the other proposed methods by at least 3.0%. To aid with manual labeling of variable stars, we developed a web interface which allows for easy light curve visualization and querying of external databases. Finally, we apply active learning to classify variable stars in the ASAS survey, finding dramatic improvement in our agreement with the ACVS catalog, from 65.5% to 79.5%, and a significant increase in the classifier's average confidence for the testing set, from 14.6% to 42.9%, after a few AL iterations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑