Masked Diffusion Language Models (MDLMs) generate text by iteratively filling masked tokens, requiring two coupled decisions at each step: which positions to unmask (where-to-unmask) and which tokens to place (what-to-unmask). While standard MDLM training directly optimizes token prediction (what-to-unmask), inference-time unmasking orders (where-to-unmask) are typically determined by heuristic confidence measures or trained through reinforcement learning with costly on-policy rollouts. To address this, we introduce Gt-Margin, a position-wise score derived from ground-truth tokens, defined as the probability margin between the correct token and its strongest alternative. Gt-Margin yields an oracle unmasking order that prioritizes easier positions first under each partially masked state. We demonstrate that leveraging this oracle unmasking order significantly enhances final generation quality, particularly on logical reasoning benchmarks. Building on this insight, we train a supervised unmasking planner via learning-to-rank to imitate the oracle ordering from masked contexts. The resulting planner integrates into standard MDLM sampling to select where-to-unmask, improving reasoning accuracy without modifying the token prediction model.
Dependency-Guided Parallel Decoding in Discrete Diffusion Language Models
Department of Computer Science, Technion – Israel Institute of Technology(以色列理工学院计算机科学系);Blavatnik School of Computer Science and AI, Tel Aviv, Israel(特拉维夫布拉瓦特尼克计算机科学与人工智能学院);Department of Electrical and Computer Engineering, Technion – Israel Institute of Technology(以色列理工学院电气与计算机工程系)
SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasions
National Technical University of Athens(希腊国家技术大学);Instituto de Telecomunicações(电信研究所);Instituto Superior Técnico, Universidade de Lisboa(里斯本大学电信理工学院);ELLIS Unit Lisbon(里斯本ELLIS单位)
Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models
University of Surrey(塞拉利昂大学);Qualcomm AI Research. Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.(高通人工智能研究);ELLIS Institute Tübingen(图宾根ELLIS研究所);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Tübingen AI Center(图宾根人工智能中心)
Stability-Weighted Decoding for Diffusion Language Models
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,Location,Country);School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,Location,Country);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong, China(数据科学与人工智能系,香港理工大学,香港,中国)