Exploring the Design Space of Permutation Diffusion LLMs
Meta
Zhe Xu, Mingfu Liang, Kavosh Asadi, Jean-Pascal Billaud, Tianyi Chen, Yanhui Guo, Christina Huang, Baekjin Kim, Jimmy Kim, Yufei Li, Daqi Sun, Jiachen Sun, Dian… 展开作者
Zhe Xu, Mingfu Liang, Kavosh Asadi, Jean-Pascal Billaud, Tianyi Chen, Yanhui Guo, Christina Huang, Baekjin Kim, Jimmy Kim, Yufei Li, Daqi Sun, Jiachen Sun, Dian Yu, Zaiwei Zhang, Kaushik Rangadurai, Frank Shyu, Sandeep Pandey, Xi Liu, Luke Simon
Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output positions. We study this problem through three diffusion-LLM parameterizations: hard-assignment prediction over shuffled candidate-index sequences, soft-assignment prediction over doubly stochastic matrices, and direct ordering-score prediction followed by sorting. The three families place permutation constraints at different stages of prediction and decoding and therefore support different training objectives and sampling procedures. We evaluate these designs on recommendation reranking across three Amazon domains with candidate sets of size 10 and 20. At one function evaluation, the hard- and soft-assignment variants achieve Recall@1 comparable to a constrained masked-diffusion baseline, whereas direct ordering-score prediction guarantees valid permutations without Hungarian assignment or Sinkhorn normalization. Additional function evaluations do not consistently improve ranking quality, and their effect depends strongly on the state representation and training objective. These results show that corruption, prediction parameterization, objective, and decoder should be designed jointly for permutation diffusion with language-model denoisers.
A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs
Department of Computer Science University of California Los Angeles(计算机科学系,加州大学洛杉矶分校);Bioinformatics IDP University of California Los Angeles(生物信息学IDP,加州大学洛杉矶分校);Department of Computational Medicine University of California Los Angeles(计算医学系,加州大学洛杉矶分校)
Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs
The University of Tokyo(东京大学);NEC Laboratories America(NEC美国实验室);Dokkyo Medical University(多摩医学大学);Graduate School of Frontier Sciences, The University of Tokyo(东京大学前沿科学研究生院)
Exploring the Adversarial Capabilities of Large Language Models
German Research Center for AI (DFKI)(德国人工智能研究中心);Technical University of Darmstadt(达姆施塔特工业大学);DataSpark GmbH(DataSpark有限公司);Centre for Cognitive Science of Darmstadt(达姆施塔特认知科学中心);Hessian Center for AI (hessian.AI)(黑森州人工智能中心)
Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
Technische Universität Berlin(柏林工业大学);Deutsches Forschungszentrum für Künstliche Intelligenz(德国人工智能研究中心);National Institute of Informatics(信息学研究所);Harz University of Applied Sciences(哈尔茨应用技术大学)
How Deep is Love in LLMs' Hearts? Exploring Semantic Size in Human-like Cognition
Shanghai Jiao Tong University(上海交通大学);Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3(上海Web3可信数据流通与治理重点实验室);Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering(上海市教委智能交互与认知工程重点实验室)
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning
School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院);Alibaba Group(阿里巴巴集团);School of Statistics, East China Normal University(华东师范大学统计学院)
Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis
Department of Electrical and Computer Engineering, Seoul National University(电子与计算机工程系,首尔国立大学);Interdisciplinary Program in Artificial Intelligence, Seoul National University(人工智能跨学科计划,首尔国立大学);AIIS, ASRI, INMC, and ISRC, Seoul National University(人工智能研究所、人工智能研究机构、智能网络中心和智能系统研究组,首尔国立大学)
Can Frontier LLMs Replace Annotators in Biomedical Text Mining? Analyzing Challenges and Exploring Solutions
The University of Tokyo(东京大学);Graduate School of Frontier Sciences(前沿科学研究生院);Department of Computational Biology and Medical Sciences(计算生物学与医学科学系);Database Center for Life Science(生命科学数据库中心);Joint Support-Center for Data Science Research(数据科学研究联合支持中心)