In this paper we explore the task of modeling semi-structured object sequences; in particular, we focus our attention on the problem of developing a structure-aware input representation for such sequences. Examples of such data include user activity on websites, machine logs, and many others. This type of data is often represented as a sequence of sets of key-value pairs over time and can present modeling challenges due to an ever-increasing sequence length. We propose a two-part approach, which first considers each key independently and encodes a representation of its values over time; we then self-attend over these value-aware key representations to accomplish a downstream task. This allows us to operate on longer object sequences than existing methods. We introduce a novel shared-attention-head architecture between the two modules and present an innovative training schedule that interleaves the training of both modules with shared weights for some attention heads. Our experiments on multiple prediction tasks using real-world data demonstrate that our approach outperforms a unified network with hierarchical encoding, as well as other methods including a record-centric representation and a flattened representation of the sequence.
MoSSDA: A Semi-Supervised Domain Adaptation Framework for Multivariate Time-Series Classification using Momentum Encoder
Department of Artificial Intelligence and Software, Ewha Womans University(人工智能与软件系,世瓦女子大学);Department of Data Science, Ewha Womans University(数据科学系,世瓦女子大学)
PFSD: A Multi-Modal Pedestrian-Focus Scene Dataset for Rich Tasks in Semi-Structured Environments
School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学技术学院);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), CASIA(中国科学院自动化研究所多模态人工智能系统国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Semi-overcomplete convolutional auto-encoder embedding as shape priors for deep vessel segmentation
LaTIM UMR 1101, Inserm(法国国家健康与医学研究院LaTIM UMR 1101研究所);University of Western Brittany(西布列塔尼大学);University Hospital of Brest(布雷斯特大学医院);University Hospital of Poitiers(普瓦捷大学医院);ICube UMR 7357, CNRS(法国国家科学研究中心ICube UMR 7357研究所);IMT Atlantique(大西洋电信学院)