We show that fundamental learning tasks, such as finding an approximate linear separator or linear regression, require memory at least \emph{quadratic} in the dimension, in a natural streaming setting. This implies that such problems cannot be solved (at least in this setting) by scalable memory-efficient streaming algorithms. Our results build on a memory lower bound for a simple linear-algebraic problem -- finding orthogonal vectors -- and utilize the estimates on the packing of the Grassmannian, the manifold of all linear subspaces of fixed dimension.
Supervised Learning based QoE Prediction of Video Streaming in Future Networks: A Tutorial with Comparative Study
Cardiff Metropolitan University(卡迪夫城市大学);University of Western Australia(西澳大利亚大学);Dublin City University(都柏林城市大学);University College Dublin(都柏林大学学院);University of Cagliari(卡利亚里大学)
The Best Arm Evades: Near-optimal Multi-pass Streaming Lower Bounds for Pure Exploration in Multi-armed Bandits
Cheriton School of Computer Science, University of Waterloo(滑铁卢大学切尔顿计算机科学学院);Rutgers University(罗格斯大学);Rice University(莱斯大学);Texas A&M University(德克萨斯农工大学);Google Research(谷歌研究院)
A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Data
Aalborg University(奥尔堡大学);East China Normal University(华东师范大学);University of Electronic Science and Technology of China(电子科技大学);Huawei Cloud Database Innovation Lab(华为云数据库创新实验室)
Structured Adaptive Tensor Prediction for Streaming Data
Michigan Institute for Computational Discovery and Engineering, Department of Statistics, Department of Electrical Engineering and Computer Science, University of Michigan(密歇根大学计算发现与工程研究所、统计系、电气工程与计算机科学系);Department of Statistics, University of Michigan(密歇根大学统计系)
Columbia University(哥伦比亚大学);Nanyang Technological University(南洋理工大学);Toyota Technological Institute at Chicago(芝加哥丰田工业大学);Carnegie Mellon University(卡内基梅隆大学)
Quick Streaming Algorithms for Maximization of Monotone Submodular Functions in Linear Time
Florida State University(佛罗里达州立大学)
考虑基数约束$k$下基集大小为$n$的单调次模极大化问题.对于这个问题,我们介绍了第一个确定性算法的线性时间复杂度,这些算法是流算法。对于任何$c \ge 1$,我们的单遍算法在$\lceil n / c \rceil + c$ Oracle查询中获得恒定的比率。此外,我们提出了一个确定性的,多遍流算法,通过一个恒定的数量,达到接近线性查询和时间复杂度的最佳比例。我们证明了一个下界,这意味着没有常数因子近似存在使用$o(n)$查询,即使查询不可行集是允许的。实证分析表明,我们的算法需要更少的查询(通常大大低于$n$),但仍然实现更好的客观价值比目前的国家的最先进的算法,包括单通,多通,和非流算法。
Fairness-Aware Streaming Feature Selection with Causal Graphs
Center for Advance Computer Studies, University of Louisiana(路易斯安那大学高级计算机研究中心);Old Dominion University(奥多明尼昂大学);College of Computer and Information Science, Southwest University(西南大学计算机与信息科学学院);School of Data Science, William & Mary(威廉玛丽学院数据科学学院)