arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.02595cs.SEcs.PL

函数调用中结构化输出增益的归因:接口对齐与过程转移

Attributing Structured-Output Gains in Function Calling: Interface Alignment versus Procedural Transfer

Wanyi Chen, Daoyuan Chen, Fang Kong

首次发表
浏览论文内容

中文总结 AI 辅助

研究结构化输出基准中提示诱导函数调用增益的归因,介绍四层增益归因协议,应用于相关数据集得出部分增益源于接口对齐而非过程转移的结论,并发布相关资源。

中文摘要 AI 辅助

结构化输出基准奖励任务决策和接口合规性,提示诱导的函数调用增益需归因才能解释为可转移技能。我们为提示前置技能注入引入四层增益归因协议,应用于相关数据集表明部分增益应归因于接口对齐而非过程转移,还发布了相关资源。

英文摘要

Structured-output benchmarks reward both task decisions and interface compliance, so prompt-induced function-calling gains require attribution before they can be interpreted as transferable skill. We introduce a four-layer gain-attribution protocol for prompt-prepended skill injection, combining canonicalized rescoring, format-only controls, repaired/balanced induction, and portability checks. Applied to the Berkeley Function Calling Leaderboard (BFCL) and scoped with API-Bank, MATH-500, and MultiHop-RAG, the protocol shows that several apparent gains are better attributed to interface alignment than to procedural transfer: format-only prompts match or exceed full skills in key BFCL cells, repaired/balanced induction removes the largest sub-frontier gains, and API-Bank target-native gains are matched within 0.5 percentage points (pp) by length-matched generic procedural prompts. These findings treat format compliance as a useful engineering capability while clarifying what a structured-output score certifies. We release BFCL-CANONICAL and recommend canonicalized metrics, balanced induction, and format-only baselines for function-calling skill-gain attribution. Code and data are available at https://github.com/couragec/skill-injection-attribution.

补充信息

↑