Diff Mining: Logit Differences Reveal Finetuning Objectives
Diff Mining:对数差揭示微调目标
机构 * EPFL(洛桑联邦理工学院) ; ENS Paris-Saclay(巴黎萨克雷高等师范学校) ; Université Paris-Saclay(巴黎萨克雷大学) ; MATS
AI总结 提出Diff Mining框架,通过对比微调模型与基础模型的对数来识别微调目标,在微调领域检测、偏见识别等任务上优于现有方法,可用于开发微调审计工具。
Comments 37 pages, 7 figures. ICLR 2026 Workshop: Principled Design for Trustworthy AI. Code available at this https URL (https://github.com/science-of-finetuning/diffing-toolkit)