arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.06115cs.CLcs.LG
收藏

任务驱动的分层叠加激活干预

Task-driven Layerwise Additive Activation Intervention

The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学)

Hieu Trung Nguyen, Bao Nguyen, Binh Nguyen, Viet Anh Nguyen

AI总结:

针对现代语言模型在实时应用中难以适应新语境的问题,提出分层叠加激活干预框架以优化干预过程、提升样本效率,在多数据集基准测试中证明其能提高预训练LMs准确性并优于现有干预基线。

摘要:

现代语言模型(LMs)显著推动了自然语言处理(NLP)中的生成建模发展。尽管取得成功,LMs在实时应用中常难以适应新语境。激活干预是任务适应的一种有前景方法,通过识别和操纵激活来引导LMs的生成过程。但现有干预高度依赖启发式规则,或需大量提示输入以确定有效干预。本文提出分层叠加激活干预框架,优化干预过程,提升样本效率。我们在多种数据集上对框架进行基准测试,证明其在预训练LMs的准确性上优于竞争干预基线。

英文摘要:

Modern language models (LMs) have significantly advanced generative modeling in natural language processing (NLP). Despite their success, LMs often struggle with adaptation to new contexts in real-time applications. A promising approach to task adaptation is activation intervention, which steers the LMs' generation process by identifying and manipulating the activations. However, existing interventions are highly dependent on heuristic rules or require many prompt inputs to determine effective interventions. This paper proposes a layer-wise additive activation intervention framework that optimizes the intervention process, thus enhancing the sample efficiency. We benchmark our framework on various datasets, demonstrating improvements in the accuracy of pre-trained LMs and competing intervention baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑