偏序序列的分类模型
Classification Models for Partially Ordered Sequences
摘要:
许多模型,如长短期记忆(LSTM),门控递归单元(GRU)和Transformers已被开发来分类的时间序列数据的假设,事件在一个序列中的顺序。另一方面,较少的模型已经开发了基于集合的输入,其中顺序并不重要。由于时间戳的粒度或不确定性,有几种用例将数据作为部分排序的序列给出。我们介绍了一种新的Transformer为基础的模型,这样的预测任务,并对现有的顺序不变模型的扩展基准。我们还讨论了如何在一个序列中的事件之间的转移概率可以用来提高模型的性能。我们表明,基于变换的等时模型优于现有的集模型在三个数据集上的扩展。
英文摘要:
Many models such as Long Short Term Memory (LSTMs), Gated Recurrent Units (GRUs) and transformers have been developed to classify time series data with the assumption that events in a sequence are ordered. On the other hand, fewer models have been developed for set based inputs, where order does not matter. There are several use cases where data is given as partially-ordered sequences because of the granularity or uncertainty of time stamps. We introduce a novel transformer based model for such prediction tasks, and benchmark against extensions of existing order invariant models. We also discuss how transition probabilities between events in a sequence can be used to improve model performance. We show that the transformer-based equal-time model outperforms extensions of existing set models on three data sets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。