PARAGEN:一个并行生成工具包
PARAGEN : A Parallel Generation Toolkit
摘要:
PARAGEN是一个基于PyTorch的NLP工具包,用于进一步开发并行生成。PARAGEN提供了13种类型的可定制插件,帮助用户快速实验跨模型架构,优化和学习策略的新想法。我们实现了各种功能,例如无限数据加载和自动模型选择,以提高其工业用途。ParaGen现已部署用于支持字节跳动的各种研究和行业应用。PARAGEN可在https://github.com/bytedance/ParaGen上查阅。
英文摘要:
PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation. PARAGEN provides thirteen types of customizable plugins, helping users to experiment quickly with novel ideas across model architectures, optimization, and learning strategies. We implement various features, such as unlimited data loading and automatic model selection, to enhance its industrial usage. ParaGen is now deployed to support various research and industry applications at ByteDance. PARAGEN is available at https://github.com/bytedance/ParaGen.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。