arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.03582cs.CLcs.AI
收藏

一种面向神经机器翻译的开源架构设计

Design of an Open-Source Architecture for Neural Machine Translation

ADAPT Centre(ADAPT中心);MTU(芒特理工大学);DCU(都柏林城市大学)

Séamus Lankford, Haithem Afli, Andy Way

AI总结:

本研究提出开源神经机器翻译应用adaptNMT,基于OpenNMT生态简化模型开发部署流程,支持一键开发、多指标评估与能耗碳排放追踪,降低领域入门门槛。

摘要:

adaptNMT是一款开源应用,为循环神经网络与Transformer模型的开发和部署提供了简化流程。该应用基于被广泛采用的OpenNMT生态系统构建,对该领域的新入门者尤其实用,因为它简化了开发环境的搭建,以及训练集、验证集和测试集的划分工作。该应用具备可视化绘图功能,可展示模型训练的进展,并采用SentencePiece构建子词分词模型。此外,该应用提供了直观的用户界面,方便用户自定义超参数。值得注意的是,它实现了一键式模型开发模式,且通过adaptNMT开发的模型可使用多种指标进行评估。为鼓励环保型研究,adaptNMT内置了一份绿色报告,可标记模型开发过程中产生的耗电量和千克二氧化碳(kgCO₂)排放量。该应用可免费获取。

英文摘要:

adaptNMT is an open-source application that offers a streamlined approach to the development and deployment of Recurrent Neural Networks and Transformer models. This application is built upon the widely-adopted OpenNMT ecosystem, and is particularly useful for new entrants to the field, as it simplifies the setup of the development environment and creation of train, validation, and test splits. The application offers a graphing feature that illustrates the progress of model training, and employs SentencePiece for creating subword segmentation models. Furthermore, the application provides an intuitive user interface that facilitates hyperparameter customization. Notably, a single-click model development approach has been implemented, and models developed by adaptNMT can be evaluated using a range of metrics. To encourage eco-friendly research, adaptNMT incorporates a green report that flags the power consumption and kgCO${_2}$ emissions generated during model development. The application is freely available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑