arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.00344cs.AI

Echo-N1:情感强化学习前沿

Echo-N1: Affective RL Frontier

Echo-N1: Affective RL Frontier Team(情感强化学习前沿团队)

Naifan Zhang, Ruihan Sun, Ruixi Su, Shiqi Ma, Shiya Zhang, Xianna Weng, Xiaofan Zhang, Yuhan Zhan, Yuyang Xu, Zhaohan Chen, Zhengyuan Pan, Ziyi Song

AI总结:

Echo-N1通过实时推断用户个性并优化个性化对话偏好,开创了情感强化学习的新领域,显著提升了人类般的交互质量。

摘要:

在LLM领域,人们已经花费一年时间完善强化学习(RL)以处理机器已经擅长的任务,如数学、编码和确定性推理,而完全忽略了定义人类智能的领域:主观的、情感基础的、个性敏感的对话。这一领域往往被视为本质上主观且难以形式化,使其看起来不适合传统的RL流程。我们证明,这不仅有可能,而且是一个可解决且具有变革性的RL问题。我们提出了第一个框架,该框架能够实时推断用户个性,并优化模型行为以适应个性化的对话偏好。与普遍认为RL在不可验证的环境中崩溃的观点相反,我们的方法在人类般的交互质量上产生了持续、稳健且显著的提升。我们还引入了第一个动态情感智能评估套件,以量化这些收益。我们的模型,即Echo-N1,其行为远超基础版本,并超越了专有版本的Doubao 1.5字符。这项工作为RL开辟了新的前沿:优化模型以适应深度主观且深刻的人类对话维度。

英文摘要:

The LLM field has spent a year perfecting RL for tasks machines already excel at, math, code, and deterministic reasoning, while completely sidestepping the domain that actually defines human intelligence: subjective, emotionally grounded, personality sensitive conversation. This space has often been regarded as inherently subjective and challenging to formalize, making it appear unsuitable for conventional RL pipelines. We show that it is not only possible and it is a solvable and transformative RL problem. We propose the first framework that infers user personality on the fly and optimizes model behavior toward personalized conversational preferences. Contrary to the widespread belief that RL collapses in non-verifiable settings, our method produces consistent, robust, and dramatic improvements in humanlike interaction quality. We also introduce the first dynamic emotional intelligence evaluation suite to quantify these gains. Our model, which is introduced as Echo-N1, behaves far above its base version and outperforming the proprietary Doubao 1.5 Character. This work establishes a new frontier for RL: optimizing models for the deeply subjective, deeply human dimensions of conversation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑