Prediction tasks about students have practical significance for both student and college. Making multiple predictions about students is an important part of a smart campus. For instance, predicting whether a student will fail to graduate can alert the student affairs office to take predictive measures to help the student improve his/her academic performance. With the development of information technology in colleges, we can collect digital footprints which encode heterogeneous behaviors continuously. In this paper, we focus on modeling heterogeneous behaviors and making multiple predictions together, since some prediction tasks are related and learning the model for a specific task may have the data sparsity problem. To this end, we propose a variant of LSTM and a soft-attention mechanism. The proposed LSTM is able to learn the student profile-aware representation from heterogeneous behavior sequences. The proposed soft-attention mechanism can dynamically learn different importance degrees of different days for every student. In this way, heterogeneous behaviors can be well modeled. In order to model interactions among multiple prediction tasks, we propose a co-attention mechanism based unit. With the help of the stacked units, we can explicitly control the knowledge transfer among multiple tasks. We design three motivating behavior prediction tasks based on a real-world dataset collected from a college. Qualitative and quantitative experiments on the three prediction tasks have demonstrated the effectiveness of our model.
MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
School of Mathematical Sciences, Shanghai Jiao Tong University(上海交通大学数学科学学院);Bio-X Institutes, Key Laboratory for the Genetics of Developmental and Neuropsychiatric Disorders, Shanghai Jiao Tong University(上海交通大学Bio-X研究院、发育与神经精神疾病遗传学重点实验室);Shanghai Key Laboratory of Psychotic Disorders, Brain Science and Technology Research Center, Shanghai Jiao Tong University(上海精神疾病重点实验室、脑科学与技术研究中心,上海交通大学)
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
Zhejiang University(浙江大学);Stevens Institute of Technology(史蒂文斯理工学院);Alibaba-Zhejiang University Joint Institute of Frontier Technologies(阿里巴巴-浙江大学前沿技术联合研究院)
Jointly Optimizing Dataset Size and Local Updates in Heterogeneous Mobile Edge Learning
School of Computing and Information Sciences, Florida International University(佛罗里达国际大学计算与信息科学学院);School of Computing, Queen’s University(女王大学计算学院);Department Computer Science and Electrical Engineering, West Virginia University(西弗吉尼亚大学计算机科学与电气工程系)
Jointly Learning Representations for Map Entities via Heterogeneous Graph Contrastive Learning
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Economics and Management, Beihang University(北京航空航天大学经济管理学院)
Beijing University of Posts and Telecommunications(北京邮电大学);ByteDance(字节跳动);USTC(中国科学技术大学);Beijing Key Laboratory of Network System and Network Culture(北京网络系统与网络文化重点实验室);Key Laboratory of Interactive Technology and Experience System, Ministry of Culture and Tourism(文化和旅游部互动技术与体验系统重点实验室);Zhongguancun Academy(中关村科学城)
Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification
Department of Electrical Engineering Indian Institute of Technology Bombay 21D070002(电子工程系 印度理工学院班加罗尔 21D070002);Department of Electrical Engineering Indian Institute of Technology Bombay 210010010(电子工程系 印度理工学院班加罗尔 210010010);Department of Electrical Engineering Indian Institute of Technology Bombay 210020023(电子工程系 印度理工学院班加罗尔 210020023)
DyHGCN: A Dynamic Heterogeneous Graph Convolutional Network to Learn Users' Dynamic Preferences for Information Diffusion Prediction
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Alibaba Cloud Computing Co. Ltd.(阿里云计算有限公司)