The ICLR conference is unique among the top machine learning conferences in that all submitted papers are openly available. Here we present the ICLR dataset consisting of abstracts of all 24 thousand ICLR submissions from 2017-2024 with meta-data, decision scores, and custom keyword-based labels. We find that on this dataset, bag-of-words representation outperforms most dedicated sentence transformer models in terms of $k$NN classification accuracy, and the top performing language models barely outperform TF-IDF. We see this as a challenge for the NLP community. Furthermore, we use the ICLR dataset to study how the field of machine learning has changed over the last seven years, finding some improvement in gender balance. Using a 2D embedding of the abstracts' texts, we describe a shift in research topics from 2017 to 2024 and identify hedgehogs and foxes among the authors with the highest number of ICLR submissions.
Gen-Review: A Large-scale Dataset of AI-Generated (and Human-written) Peer Reviews
University of Genoa(热那亚大学);University of Liechtenstein(列支敦士登大学);IBM Research(IBM研究院);Imperial College London(伦敦帝国理工学院);DistriNet, KU Leuven(鲁汶大学DistriNet);Paris School of Economics(巴黎经济学院)
CBS-NTT Program in Physics of Intelligence, Harvard University(哈佛大学物理智能联合项目);Department of Physics, Harvard University(哈佛大学物理系);Physics & Informatics Lab, NTT Research Inc.(NTT研究公司物理与信息学实验室);SEAS, Harvard University(哈佛大学科学与工程学院);CSE, University of Michigan, Ann Arbor(密歇根大学安娜堡分校计算机科学系)
UOL@IDEM at BEA 2026 Shared Task 1: Neural Fusion and Feature-Rich Modeling for L1-Aware Vocabulary Difficulty Prediction
Centre for Translation, Localisation and Interpreting Studies, School of Languages, Cultures and Societies, University of Leeds(利兹大学语言、文化与社会学院翻译、本地化与口译研究中心);Alexandria University(亚历山大大学)
ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations
INESC-ID;Instituto Superior Técnico, University of Lisbon(里斯本大学高级技术学院);Faculdade de Letras, University of Lisbon(里斯本大学文学院)
I4U Submission to NIST SRE 2018: Leveraging from a Decade of Shared Experiences
NEC Corporation(NEC公司);Tokyo Institute of Technology(东京工业大学);University of Eastern Finland(东芬兰大学);INRIA(法国国家信息与自动化研究所);JD AI Research and Platform(京东人工智能研究与平台);Institute for Infocomm Research(资讯通信研究院);LIUM(勒芒大学计算机实验室);National University of Singapore(新加坡国立大学);LIA(阿维尼翁大学计算机实验室);Nanyang Technological University(南洋理工大学);Northwest Polytechnic University(西北工业大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);EURECOM(欧洲通信学院)