Continual learning is a machine learning sub-field specialized in settings with non-iid data. Hence, the training data distribution is not static and drifts through time. Those drifts might cause interferences in the trained model and knowledge learned on previous states of the data distribution might be forgotten. Continual learning's challenge is to create algorithms able to learn an ever-growing amount of knowledge while dealing with data distribution drifts.
One implementation difficulty in these field is to create data loaders that simulate non-iid scenarios. Indeed, data loaders are a key component for continual algorithms. They should be carefully designed and reproducible. Small errors in data loaders have a critical impact on algorithm results, e.g. with bad preprocessing, wrong order of data or bad test set. Continuum is a simple and efficient framework with numerous data loaders that avoid researcher to spend time on designing data loader and eliminate time-consuming errors. Using our proposed framework, it is possible to directly focus on the model design by using the multiple scenarios and evaluation metrics implemented. Furthermore the framework is easily extendable to add novel settings for specific needs.
Task-Core Memory Management and Consolidation for Long-term Continual Learning
School of Computer Science and Technology, East China Normal University(东华师范大学计算机科学与技术学院);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院);Computation and Artificial Intelligence Innovative College, Fudan University(复旦大学计算与人工智能创新学院)
More Sensors Only One Field: Rethinking Continual Spatio-Temporal Forecasting
City University of Hong Kong (Dongguan)(香港城市大学(东莞));City University of Hong Kong(香港城市大学);Zhuhai College of Science and Technology(珠海科技学院);Northwestern Polytechnical University(西北工业大学)
Towards stable training of parallel continual learning
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Automation, Southeast University(东南大学自动化学院)
Continual-Learning-as-a-Service (CLaaS): On-Demand Efficient Adaptation of Predictive Models
Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学);University of Pisa(比萨大学)
FastODT: A tree-based framework for efficient continual learning
Masaryk University(马萨里克大学);Czech Republic(捷克共和国);Warsaw University of Technology(华沙技术大学);Poland(波兰);Mycroft Mind;New York University(纽约大学);New York, NY, USA(纽约市,纽约州,美国);Analog AI;Abu Dhabi, UAE(阿布扎赫,阿联酋)
Confidence-Based Task Prediction in Continual Disease Classification Using Probability Distribution
Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(高性能计算研究所(A*STAR));Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)
TinyCL: An Efficient Hardware Architecture for Continual Learning on Autonomous Systems
Department of Electronics and Telecommunications, Politecnico di Torino(电子工程与电信系,都灵理工学院);eBrain Lab, Division of Engineering, New York University Abu Dhabi(eBrain实验室,工程系,纽约大学阿布扎克分校)
Towards Lifelong Aerial Autonomy: Geometric Memory Management for Continual Visual Place Recognition in Dynamic Environments
Department of Precision Instrument, Tsinghua University(清华大学精密仪器系);College of Instrument Science and Opto-electronics Engineering, Beijing Information Science and Technology University(北京信息科技大学仪器科学与光电工程学院);Key Laboratory of Complex System Intelligent Control and Decision Making, Beijing Institute of Technology(北京理工大学复杂系统智能控制与决策重点实验室);School of Aerospace Engineering, Beijing Institute of Technology(北京理工大学宇航学院)
Federated Data Analytics for Cancer Immunotherapy: A Privacy-Preserving Collaborative Platform for Patient Management
Faculty of Computers & Artificial Intelligence, Cairo University(开罗大学计算机与人工智能学院);Scientific Academy for Service Technology e.V. (ServTech)(服务技术科学学会);University of New South Wales(新南威尔士大学);University of Macquarie(麦考瑞大学);Egypt University of Informatics(埃及信息学大学)