arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.22306cs.AI
收藏

Memory Bear AI记忆科学引擎:多模态情感智能的技术报告

Memory Bear AI Memory Science Engine for Multimodal Affective Intelligence: A Technical Report

Deliang Wen, Ke Sun, Yu Wang

AI总结:

本文提出Memory Bear AI框架,通过结构化记忆处理提升多模态情感智能,实现持续、鲁棒的情感识别与应用。

摘要:

真实交互中的情感判断往往不是纯粹的局部预测问题。情感意义常依赖于先前轨迹、累积上下文和多模态证据,这些证据可能当前时刻较弱、噪声或不完整。尽管多模态情感识别(MER)提升了文本、语音和视觉信号的整合,但许多现有系统仍优化于短程推理,对持久情感记忆、长周期依赖建模和不完美输入下的稳健解释支持有限。本技术报告介绍了Memory Bear AI Memory Science Engine,一个以记忆为中心的多模态情感智能框架。该框架将情感信息建模为记忆系统中的结构化和动态变量,通过结构化记忆形成、工作记忆聚合、长期巩固、记忆驱动检索、动态融合校准和持续记忆更新进行处理。核心在于将多模态信号转换为结构化的Emotion Memory Units(EMUs),使情感信息能够在交互范围内被保存、激活和修订。实验结果表明,在基准和业务场景中,该框架在准确性和鲁棒性方面均优于对比系统,特别是在噪声或缺失模态条件下表现更优。该框架为从局部情感识别向更连续、稳健和部署相关的情感智能迈进提供了实际步骤。

英文摘要:

Affective judgment in real interaction is rarely a purely local prediction problem. Emotional meaning often depends on prior trajectory, accumulated context, and multimodal evidence that may be weak, noisy, or incomplete at the current moment. Although multimodal emotion recognition (MER) has improved the integration of text, speech, and visual signals, many existing systems remain optimized for short-range inference and provide limited support for persistent affective memory, long-horizon dependency modeling, and robust interpretation under imperfect input. This technical report presents the Memory Bear AI Memory Science Engine, a memory-centered framework for multimodal affective intelligence. Instead of treating emotion as a transient output label, the framework models affective information as a structured and evolving variable within a memory system. It organizes processing through structured memory formation, working-memory aggregation, long-term consolidation, memory-driven retrieval, dynamic fusion calibration, and continuous memory updating. At its core, multimodal signals are transformed into structured Emotion Memory Units (EMUs), enabling affective information to be preserved, reactivated, and revised across interaction horizons. Experimental results show consistent gains over comparison systems across benchmark and business-grounded settings, with stronger accuracy and robustness, especially under noisy or missing-modality conditions. The framework offers a practical step from local emotion recognition toward more continuous, robust, and deployment-relevant affective intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑