Submodlib:一个子模块优化库
Submodlib: A Submodular Optimization Library
摘要:
次模函数是一类特殊的集合函数,它自然地模拟了代表性,多样性,覆盖等概念,并且已经被证明在计算上非常有效。过去的许多工作都应用子模块优化来寻找各种情况下的最优子集。一些示例包括用于高效人工消耗的数据汇总,找到有效的较小的训练数据子集以减少模型开发时间(训练,超参数调整),找到未标记数据的有效子集以降低标记成本,最近的一项工作也利用子模函数提出了子模信息测度,这些测度在解决引导子集问题中非常有用选择和引导总结。在这项工作中,我们提出了Submodlib,这是一个开源的,易于使用的,高效的和可扩展的Python库,用于子模块优化与C++优化引擎。Submodlib在总结、数据子集选择、超参数调整、高效训练等方面都有应用。通过丰富的API,它在使用方式上提供了很大的灵活性。Submodlib的源代码可以在https://github.com/decile-team/submodlib上找到。
英文摘要:
Submodular functions are a special class of set functions which naturally model the notion of representativeness, diversity, coverage etc. and have been shown to be computationally very efficient. A lot of past work has applied submodular optimization to find optimal subsets in various contexts. Some examples include data summarization for efficient human consumption, finding effective smaller subsets of training data to reduce the model development time (training, hyper parameter tuning), finding effective subsets of unlabeled data to reduce the labeling costs, etc. A recent work has also leveraged submodular functions to propose submodular information measures which have been found to be very useful in solving the problems of guided subset selection and guided summarization. In this work, we present Submodlib which is an open-source, easy-to-use, efficient and scalable Python library for submodular optimization with a C++ optimization engine. Submodlib finds its application in summarization, data subset selection, hyper parameter tuning, efficient training and more. Through a rich API, it offers a great deal of flexibility in the way it can be used. Source of Submodlib is available at https://github.com/decile-team/submodlib.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。