挖掘文档以提取超参数模式
Mining Documentation to Extract Hyperparameter Schemas
摘要:
人工智能自动化工具需要机器可读的超参数模式来定义其搜索空间。与此同时,AI库通常带有良好的人类可读文档。虽然这样的文档包含了大部分必要的信息,但不幸的是,它还没有准备好被工具使用。本文描述了如何自动挖掘AI库中的Python文档字符串,以提取JSON模式的超参数。我们评估我们的方法对119 Transformers和估计器从三个不同的图书馆,发现它是有效的提取机器可读的模式。我们的愿景是减轻人工智能自动化工具手动创建和维护此类模式的负担,并将自动化的范围扩大到更大的库和更丰富的模式。
英文摘要:
AI automation tools need machine-readable hyperparameter schemas to define their search spaces. At the same time, AI libraries often come with good human-readable documentation. While such documentation contains most of the necessary information, it is unfortunately not ready to consume by tools. This paper describes how to automatically mine Python docstrings in AI libraries to extract JSON Schemas for their hyperparameters. We evaluate our approach on 119 transformers and estimators from three different libraries and find that it is effective at extracting machine-readable schemas. Our vision is to reduce the burden to manually create and maintain such schemas for AI automation tools and broaden the reach of automation to larger libraries and richer schemas.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。