In large language model (LLM)-driven multi-agent systems, disobey role specification (failure to adhere to the defined responsibilities and constraints of an assigned role, potentially leading to an agent behaving like another) is a major failure mode \cite{DBLP:journals/corr/abs-2503-13657}. To address this issue, in the present paper, we propose a quantitative role clarity to improve role consistency. Firstly, we construct a role assignment matrix $S(ϕ)=[s_{ij}(ϕ)]$, where $s_{ij}(ϕ)$ is the semantic similarity between the $i$-th agent's behavior trajectory and the $j$-th agent's role description. Then we define role clarity matrix $M(ϕ)$ as $\text{softmax}(S(ϕ))-I$, where $\text{softmax}(S(ϕ))$ is a row-wise softmax of $S(ϕ)$ and $I$ is the identity matrix. The Frobenius norm of $M(ϕ)$ quantifies the alignment between agents' role descriptions and their behaviors trajectory. Moreover, we employ the role clarity matrix as a regularizer during lightweight fine-tuning to improve role consistency, thereby improving end-to-end task performance. Experiments on the ChatDev multi-agent system show that our method substantially improves role consistency and task performance: with Qwen and Llama, the role overstepping rate decreases from $46.4\%$ to $8.4\%$ and from $43.4\%$ to $0.2\%$, respectively, and the role clarity score increases from $0.5328$ to $0.9097$ and from $0.5007$ to $0.8530$, respectively, the task success rate increases from $0.6769$ to $0.6909$ and from $0.6174$ to $0.6763$, respectively.
AMA: Adaptive Memory via Multi-Agent Collaboration
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Shandong University(山东大学);Nanyang Technological University(南洋理工大学);Southern University of Science and Technology(南方科技大学)
StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);United Arab Emirates University(阿拉伯联合酋长国大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)
AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算与智能研究院);The University of Sydney(悉尼大学);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
MedCollab: IBIS-Guided Multi-Agent Collaboration with Hierarchical Disease Relation Chains for Clinical Diagnosis
Princeton University(普林斯顿大学);Springer Heidelberg(斯普林格海德堡);ABC Institute(ABC研究所);Rupert-Karls-University Heidelberg(海德堡鲁珀特-卡尔大学);Hangzhou Dianzi University(杭州电子科技大学);Zhejiang University(浙江大学);Children’s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Children and Adolescents’ Health and Diseases(浙江大学医学院儿童医院,国家儿童青少年健康与疾病临床研究中心)
Operationalising Multi-Dimensional Evaluation for Conversational Agents: A Scalable, Governed Pipeline with Selective Re-evaluation and Model Benchmarking