ICLR

Hidden Convexity of Wasserstein GANs: Interpretable Generative Models with Closed-Form Solutions

Arda Sahiner, Tolga Ergen, Batu Ozturkler, Burak Bartan, John Pauly, Morteza Mardani, Mert Pilanci

Comments Published as paper in ICLR 2022. First two authors contributed equally to this work; 34 pages, 11 figures

Towards Understanding Generalization via Decomposing Excess Risk Dynamics

Jiaye Teng, Jianhao Ma, Yang Yuan

Comments Accepted by ICLR 2022

Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization

Tolga Ergen, Arda Sahiner, Batu Ozturkler, John Pauly, Morteza Mardani, Mert Pilanci

Comments Accepted to ICLR 2022. First two authors contributed equally to this work; 36 pages, 13 figures

Approximation and Learning with Deep Convolutional Models: a Kernel Perspective

Alberto Bietti

Comments ICLR 2022

IntSGD: Adaptive Floatless Compression of Stochastic Gradients

Konstantin Mishchenko, Bokun Wang, Dmitry Kovalev, Peter Richtárik

Comments Spotlight at ICLR 2022. 27 pages, 6 figures, 3 algorithms

Journal ref International Conference on Learning Representations (2022)

SURF: Semi-supervised Reward Learning with Data Augmentation for Feedback-efficient Preference-based Reinforcement Learning

Jongjin Park, Younggyo Seo, Jinwoo Shin, Honglak Lee, Pieter Abbeel, Kimin Lee

Comments Accepted to ICLR 2022

Monotonic Differentiable Sorting Networks

Felix Petersen, Christian Borgelt, Hilde Kuehne, Oliver Deussen

Comments Published at ICLR 2022, Code @ https://github.com/Felix-Petersen/diffsort, Video @ https://www.youtube.com/watch?v=Rl-sFaE1z4M

Learning Distributionally Robust Models at Scale via Composite Optimization

Farzin Haddadpour, Mohammad Mahdi Kamani, Mehrdad Mahdavi, Amin Karbasi

Comments Accepted to ICLR2022 as a conference paper. International Conference on Learning Representations (2022)

Triangle and Four Cycle Counting with Predictions in Graph Streams

Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David P. Woodruff, Michael Zhang

Comments To be presented at ICLR 2022

MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling

Yusong Wu, Ethan Manilow, Yi Deng, Rigel Swavely, Kyle Kastner, Tim Cooijmans, Aaron Courville, Cheng-Zhi Anna Huang, Jesse Engel

Comments Accepted by International Conference on Learning Representations (ICLR) 2022

Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting

Ryo Karakida, Shotaro Akaho

Comments 27 pages, 6 figures

Journal ref Published in ICLR 2022

CycleMLP: A MLP-like Architecture for Dense Prediction

Shoufa Chen, Enze Xie, Chongjian Ge, Runjian Chen, Ding Liang, Ping Luo

Comments ICLR 2022 (Oral). Camera-ready Code: https://github.com/ShoufaChen/CycleMLP

Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutions

Leslie O'Bray, Max Horn, Bastian Rieck, Karsten Borgwardt

Comments Accepted as a Spotlight presentation at ICLR 2022

Online Coreset Selection for Rehearsal-based Continual Learning

Jaehong Yoon, Divyam Madaan, Eunho Yang, Sung Ju Hwang

Comments ICLR 2022

Responsible Disclosure of Generative Models Using Scalable Fingerprinting

Ning Yu, Vladislav Skripniuk, Dingfan Chen, Larry Davis, Mario Fritz

Comments Accepted to ICLR'22 as Spotlight

Latent Image Animator: Learning to Animate Images via Latent Space Navigation

Yaohui Wang, Di Yang, Francois Bremond, Antitza Dantcheva

Comments ICLR 2022, project link https://wyhsirius.github.io/LIA-project

On the Convergence of Certified Robust Training with Interval Bound Propagation

Yihan Wang, Zhouxing Shi, Quanquan Gu, Cho-Jui Hsieh

Comments ICLR 2022

Memorizing Transformers

Yuhuai Wu, Markus N. Rabe, DeLesley Hutchins, Christian Szegedy

Comments Published as a conference paper at ICLR 2022 (spotlight)

Adversarial Support Alignment

Shangyuan Tong, Timur Garipov, Yang Zhang, Shiyu Chang, Tommi S. Jaakkola

Comments Accepted to ICLR 2022

On Redundancy and Diversity in Cell-based Neural Architecture Search

Xingchen Wan, Binxin Ru, Pedro M. Esperança, Zhenguo Li

Comments ICLR 2022. 10 pages, 10 figures, 2 tables (25 pages, 34 figures, 3 tables including references and appendices)

Orchestrated Value Mapping for Reinforcement Learning

Mehdi Fatemi, Arash Tavakoli

Comments Published at ICLR 2022

Learning Long-Term Reward Redistribution via Randomized Return Decomposition

Zhizhou Ren, Ruihan Guo, Yuan Zhou, Jian Peng

Comments Tenth International Conference on Learning Representations (ICLR 2022 Spotlight)

Multitask Prompted Training Enables Zero-Shot Task Generalization

Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Tali Bers, Stella Biderman, Leo Gao, Thomas Wolf, Alexander M. Rush

Comments ICLR 2022 Spotlight (with extended discussion)

FILM: Following Instructions in Language with Modular Methods

So Yeon Min, Devendra Singh Chaplot, Pradeep Ravikumar, Yonatan Bisk, Ruslan Salakhutdinov

Comments Published as a conference paper at International Conference on Learning Representations (ICLR) 2022

TAda! Temporally-Adaptive Convolutions for Video Understanding

Ziyuan Huang, Shiwei Zhang, Liang Pan, Zhiwu Qing, Mingqian Tang, Ziwei Liu, Marcelo H. Ang

Comments Accepted to ICLR 2022. Project page: https://tadaconv-iclr2022.github.io

Equivariant Subgraph Aggregation Networks

Beatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan, Chen Cai, Gopinath Balamurugan, Michael M. Bronstein, Haggai Maron

Comments Published at ICLR 2022, Spotlight. 46 pages

Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restoration

Cian Eastwood, Ian Mason, Christopher K. I. Williams, Bernhard Schölkopf

Comments ICLR 2022 (Spotlight)

Understanding Intrinsic Robustness Using Label Uncertainty

Xiao Zhang, David Evans

Comments ICLR 2022; 23 pages, 8 figures, 1 table

Bag of Instances Aggregation Boosts Self-supervised Distillation

Haohang Xu, Jiemin Fang, Xiaopeng Zhang, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian

Comments Published at ICLR 2022

How Low Can We Go: Trading Memory for Error in Low-Precision Training

Chengrun Yang, Ziyang Wu, Jerry Chee, Christopher De Sa, Madeleine Udell

Comments ICLR 2022