Using Time-Series Privileged Information for Provably Efficient Learning of Prediction Models
Delft University of Technology(代尔夫特理工大学);Research Institute of Sweden(瑞典研究院);Massachusetts Institute of Technology(麻省理工学院);University of Toronto(多伦多大学);Chalmers University of Technology(查尔姆斯理工大学)
Rickard K. A. Karlsson, Martin Willbo, Zeshan Hussain, Rahul G. Krishnan, David Sontag, Fredrik D. Johansson
发表信息:
Proceedings of The 25th International Conference on Artificial Intelligence and Statistics, PMLR 151:5459-5484, 2022
We study prediction of future outcomes with supervised models that use privileged information during learning. The privileged information comprises samples of time series observed between the baseline time of prediction and the future outcome; this information is only available at training time which differs from the traditional supervised learning. Our question is when using this privileged data leads to more sample-efficient learning of models that use only baseline data for predictions at test time. We give an algorithm for this setting and prove that when the time series are drawn from a non-stationary Gaussian-linear dynamical system of fixed horizon, learning with privileged information is more efficient than learning without it. On synthetic data, we test the limits of our algorithm and theory, both when our assumptions hold and when they are violated. On three diverse real-world datasets, we show that our approach is generally preferable to classical learning, particularly when data is scarce. Finally, we relate our estimator to a distillation approach both theoretically and empirically.
City University of Hong Kong(香港城市大学);Tsinghua University(清华大学);Shenzhen University of Advanced Technology(深圳理工大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Efficient Conformal Prediction under Data Heterogeneity
Ecole Polytechnique(巴黎综合理工学院);Lagrange Mathematics and Computing Research Center(拉格朗日数学与计算研究中心);Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究所);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);HSE University(高等经济大学);Technology Innovation Institute(技术创新研究院)
Symphony in the Latent Space: Provably Integrating High-dimensional Techniques with Non-linear Machine Learning Models
William & Mary(威廉与玛丽学院);Tsinghua University(清华大学);Worcester Polytechnic Institute(伍斯特理工学院);University of Oxford(牛津大学);The Alan Turing Institute(艾伦·图灵研究所);AT&T Labs(美国电话电报公司实验室)
Department of Machine Learning, University of Kaiserslautern-Landau(机器学习系,凯撒斯劳滕-兰道大学);Laboratory of Engineering Thermodynamics, University of Kaiserslautern-Landau(工程热力学实验室,凯撒斯劳滕-兰道大学);Department of Chemical Process Engineering, Technical University of Munich(化学过程工程系,慕尼黑技术大学);BASF SE(巴斯夫股份有限公司);Data Science Institute, University of Wisconsin-Madison(数据科学研究院,威斯康星大学麦迪逊分校);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))
Xiaohongshu Inc.(小红书公司);College of Control Science and Technology, Zhejiang University(浙江大学控制科学与工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Computing and Artificial Intelligence, Shanghai University of Finance and Economics(上海财经大学计算与人工智能学院);State Key Lab of General AI, School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院通用人工智能国家重点实验室);Squirrel AI(松鼠AI);Center for Data Science, Peking University(北京大学数据科学中心);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecasting
Griffith University(格里菲斯大学);Monash University(莫纳什大学);University of Stuttgart(斯图加特大学);Alibaba Group(阿里巴巴集团);University of New South Wales(新南威尔士大学);Emory University(埃默里大学);Squirrel Ai Learning
FreqLens: Interpretable Frequency Attribution for Time Series Forecasting
Independent Researcher(独立研究者);Indiana University at Bloomington(印第安纳大学布卢明顿分校);National Yang Ming Chiao Tung University;National Taiwan University(国立台湾大学);Boise State University(博伊州立大学)
Attention-Based Feature Online Conformal Prediction for Time Series
King’s Communications, Learning & Information Processing (KCLIP) lab, Department of Engineering, King’s College London(国王通讯、学习与信息处理实验室(KCLIP),工程系,伦敦国王学院);Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(北京网络系统架构与融合重点实验室,信息与通信工程学院,北京邮电大学)