arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.01964cs.CLcs.AI
收藏

使用基于转换器的语言模型构建元数据推理

Building Metadata Inference Using a Transducer Based Language Model

Macquarie University(麦考瑞大学);Commonwealth Scientific and Industrial Research Organisation(联邦科学与工业研究组织)

David Waterworth, Subbu Sethuvenkatraman, Quan Z. Sheng

摘要:

解决楼宇自动化系统文本元数据的自动机器翻译挑战是高效部署智能楼宇应用程序的关键第一步。与一般的自然语言相比,用于描述建筑物元数据的词汇表显得很小,但是每个术语都有多个常用的缩写。传统的机器学习技术效率低下,因为它们需要学习同一个单词的许多不同形式,并且必须使用大量数据来训练这些模型。也很难应用标准技术,如标记化,因为这通常会导致多个输出标签与单个输入标记相关联,这是传统序列标记模型所不允许的。有限状态转换器可以对输入和输出序列长度不同的序列到序列任务进行建模,并且它们可以与语言模型组合以确保生成有效的输出序列。我们进行了初步的分析,使用基于转换器的语言模型来解析和规范化构建点元数据。

英文摘要:

Solving the challenges of automatic machine translation of Building Automation System text metadata is a crucial first step in efficiently deploying smart building applications. The vocabulary used to describe building metadata appears small compared to general natural languages, but each term has multiple commonly used abbreviations. Conventional machine learning techniques are inefficient since they need to learn many different forms for the same word, and large amounts of data must be used to train these models. It is also difficult to apply standard techniques such as tokenisation since this commonly results in multiple output tags being associated with a single input token, something traditional sequence labelling models do not allow. Finite State Transducers can model sequence-to-sequence tasks where the input and output sequences are different lengths, and they can be combined with language models to ensure a valid output sequence is generated. We perform a preliminary analysis into the use of transducer-based language models to parse and normalise building point metadata.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑