HugNLP：一个统一的综合性自然语言处理库
HugNLP: A Unified and Comprehensive Library for Natural Language Processing
摘要：
在本文中，我们介绍了HugNLP，一个统一而全面的自然语言处理（NLP）库，其后端是HuggingFace Transformers，旨在让NLP研究人员轻松利用现成的算法，并在现实世界的场景中使用用户定义的模型和任务开发新方法。HugNLP由一个分层结构组成，包括模型，处理器和应用程序，统一了不同NLP任务上预训练语言模型（PLM）的学习过程。此外，我们还展示了一些特色的NLP应用，以展示HugNLP的有效性，例如知识增强的PLM，通用信息抽取，低资源挖掘，代码理解和生成等。源代码将在GitHub上发布（https：//github.com/wjn1996/HugNLP）。
英文摘要：
In this paper, we introduce HugNLP, a unified and comprehensive library for natural language processing (NLP) with the prevalent backend of HuggingFace Transformers, which is designed for NLP researchers to easily utilize off-the-shelf algorithms and develop novel methods with user-defined models and tasks in real-world scenarios. HugNLP consists of a hierarchical structure including models, processors and applications that unifies the learning process of pre-trained language models (PLMs) on different NLP tasks. Additionally, we present some featured NLP applications to show the effectiveness of HugNLP, such as knowledge-enhanced PLMs, universal information extraction, low-resource mining, and code understanding and generation, etc. The source code will be released on GitHub (https://github.com/wjn1996/HugNLP).
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
