arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

NetEase(网易)

至 收录 20
2606.24714 2026-06-24 cs.CL cs.SD eess.AS 新提交

CN-NewsTTS Bench: a target-level automatic benchmark for raw-input Chinese news TTS pronunciation

CN-NewsTTS Bench:面向原始输入中文新闻TTS发音的目标级自动基准

Shijun Luo

机构 * NetEase Cloud Music(网易云音乐)

AI总结 针对中文新闻TTS对密集书面形式(如分数、连字符型号等)发音不准的问题,提出CN-NewsTTS Bench v0.1基准,包含自动评估集和评分器,测试七个商业系统,最佳准确率0.879。

Comments 5 pages, 1 figure, 8 tables. ICASSP-style preprint

详情
AI中文摘要

中文新闻文本包含密集的书面形式,如分数、连字符型号、范围、单位符号、百分比、英文缩写以及中英数混合名称。这些形式在实际听力工作流中频繁出现,而文本转语音(TTS)系统可能保留书面字符串但改变口语含义。我们推出了CN-NewsTTS Bench v0.1,一个开放的目标级基准,用于评估中文新闻TTS产品是否能在没有用户侧规则、LLM重写、SSML提示或手动编辑的情况下,从原始文本正确发音此类目标。该发布包含200条记录的开发集、800条记录的公开测试集、992个公开可自动评估的目标、来自三ASR集成的固定转录文本、一个自动目标评分器,以及七个产品TTS系统的初步结果。我们还报告了ASR路由诊断、ASR子集消融、类别级结果、置信区间和提供商配置元数据。最佳系统达到0.879的严格准确率,而多个系统仍低于0.60。

英文摘要

Chinese news text contains dense written forms such as scores, hyphenated model names, ranges, unit symbols, percentages, English abbreviations, and mixed Chinese-Latin-digit names. These forms are frequent in real listening workflows, and a text-to-speech (TTS) system can preserve the written string while changing the spoken meaning. We introduce CN-NewsTTS Bench v0.1, an open target-level benchmark for evaluating whether Chinese news TTS products pronounce such targets correctly from raw text, without user-side rules, LLM rewriting, SSML hints, or manual edits. The release contains a 200-record development set, an 800-record public test set, 992 public auto-evaluable targets, fixed transcripts from a three-ASR ensemble, an automatic target scorer, and initial results for seven product TTS systems. We additionally report ASR-route diagnostics, ASR-subset ablations, category-level results, confidence intervals, and provider configuration metadata. The best system reaches 0.879 strict accuracy, while several systems remain below 0.60.

URL PDF HTML 收藏
2605.29256 2026-05-29 cs.CL cs.AI

DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents

DynSess:面向角色扮演智能体的动态会话级评估与优化框架

Rongsheng Zhang, Jiji Tang, Junnan Ren, Zuyi Bao, Weijie Chen, Ruofan Hu, Zhou Zhao, Tangjie Lv, Yan Zhang

机构 * Zhejiang University(浙江大学) Fuxi AI Lab, NetEase Inc.(福克斯人工智能实验室,网易公司) Xiamen University(厦门大学)

AI总结 提出DynSess统一会话级框架,通过会话级评估(DynSess-Eval)和基于多步前瞻搜索的训练轨迹优化(DSPO/GSRPO),提升角色扮演智能体的长程一致性和交互质量。

详情
AI中文摘要

基于大型语言模型的角色扮演本质上是一个会话级任务,要求智能体在扩展的多轮对话中维持角色身份和交互质量。然而,现有的评估和优化方法大多停留在轮次级别,无法捕捉长程质量。我们提出DynSess,一个统一的会话级角色扮演智能体框架。DynSess-Eval通过针对长程行为的评分标准对完整对话会话进行评分。利用其会话级奖励,我们通过多步前瞻搜索构建高质量训练轨迹,并训练DynSess-Character的两个互补变体:DSPO(离策略)和GSRPO(在策略)。实验表明,DynSess-Eval与人类判断的一致性显著优于先前的评估器,盲人机评估进一步显示,尽管参数少得多,DynSess-Character仍能与最强角色模型匹配,同时保持强大的角色一致性和交互能力。我们的数据集和代码将发布以促进未来研究。

英文摘要

Role-playing with large language models is fundamentally a session-level task, requiring agents to sustain character identity and interaction quality across extended multi-turn conversations. Yet existing evaluation and optimization methods remain largely turn-level, failing to capture long-horizon quality. We propose DynSess, a unified session-level framework for role-playing agents. DynSess-Eval scores complete dialogue sessions via rubrics targeting long-horizon behaviors. Leveraging its session-level rewards, we construct high-quality training trajectories through multi-turn lookahead search and train DynSess-Character with two complementary variants: DSPO (off-policy) and GSRPO (on-policy). Experiments show that DynSess-Eval aligns with human judgments substantially better than prior evaluators, and blind human evaluation further shows that DynSess-Character matches the strongest character model despite using substantially fewer parameters, while maintaining strong role consistency and interactive ability. Our dataset and code will be released to facilitate future research.

URL PDF HTML 收藏
2506.04602 2026-05-29 cs.GT cs.LG

MVP-Shapley: Feature-based Modeling for Evaluating the Most Valuable Player in Basketball

MVP-Shapley:基于特征建模的篮球最有价值球员评估方法

Haifeng Sun, Yu Xiong, Runze Wu, Kai Wang, Lan Zhang, Changjie Fan, Shaojie Tang, Xiang-Yang Li

机构 * University of Science and Technology of China(科学技术大学) Netease, Fuxi AI Lab(网易凤凰人工智能实验室) University at Buffalo(布法罗大学)

AI总结 提出一种基于Shapley值的MVP评估框架,通过特征处理、胜负模型训练和贡献分配,结合因果优化实现球员排名,并在NBA数据集上验证有效性。

详情
AI中文摘要

电子竞技和多人在线游戏社区的蓬勃发展凸显了评估最有价值球员(MVP)的关键重要性。建立可解释且实用的MVP评估方法非常具有挑战性。在我们的研究中,我们特别关注逐回合数据,该数据记录了比赛中的相关事件,如助攻和得分。我们旨在通过引入一种新的MVP评估框架(记为\oursys)来应对这些挑战,该框架利用Shapley值。该方法包括特征处理、胜负模型训练、Shapley值分配以及基于球员贡献的MVP排名确定。此外,我们从因果关系的角度优化算法,使其与专家投票结果一致。最后,我们通过使用NBA数据集和Dunk City Dynasty数据集进行验证,证实了我们方法的有效性,并在行业中实现了在线部署。

英文摘要

The burgeoning growth of the esports and multiplayer online gaming community has highlighted the critical importance of evaluating the Most Valuable Player (MVP). The establishment of an explainable and practical MVP evaluation method is very challenging. In our study, we specifically focus on play-by-play data, which records related events during the game, such as assists and points. We aim to address the challenges by introducing a new MVP evaluation framework, denoted as \oursys, which leverages Shapley values. This approach encompasses feature processing, win-loss model training, Shapley value allocation, and MVP ranking determination based on players' contributions. Additionally, we optimize our algorithm to align with expert voting results from the perspective of causality. Finally, we substantiated the efficacy of our method through validation using the NBA dataset and the Dunk City Dynasty dataset and implemented online deployment in the industry.

URL PDF HTML 收藏
2605.26717 2026-05-27 cs.IR cs.AI

L2Rec: Towards Dual-View Understanding of LLMs for Personalized Recommendation

L2Rec:面向个性化推荐的LLM双视图理解

Pingjun Pan, Tingting Zhou, Peiyao Lu, Tingting Fei, Hongxiang Chen, Chuanjiang Luo

机构 * Netease Cloud Music(网易云音乐)

AI总结 提出L2Rec方法,通过双视图个性化混合专家机制在参数层面统一行为与语义理解,实现端到端个性化推荐,实验证明优于现有方法。

Comments Accepted at SIGIR 2026

详情
AI中文摘要

将大型语言模型(LLM)适配于个性化推荐需要将其通用能力与用户特定偏好对齐,同时有效利用行为信号和语义信号。现有方法通常在输入层(例如,将行为嵌入注入令牌空间)或输出层(例如,独立编码器的对比对齐)整合这些信号,存在分布差距或缺乏端到端任务监督。在这项工作中,我们引入了L2Rec,它在LLM的参数层面统一了行为和语义理解。我们的关键洞察是,同一组Transformer参数可以作为两个视图的共享媒介:通过双视图个性化混合专家(DPMoE)机制应用视图特定的个性化低秩扰动,L2Rec使得单个LLM主干能够为每个用户产生互补的行为和语义适应,且表示层面的不对齐最小化。一个自适应跨视图融合模块进一步将双视图输出整合为统一的用户偏好。在四个数据集上的实验表明,L2Rec持续优于最先进的基线方法,并且在大型工业平台上的在线A/B测试验证了关键参与指标的显著改进。

英文摘要

Adapting large language models (LLMs) for personalized recommendation requires aligning their general-purpose capabilities with user-specific preferences while effectively leveraging both behavioral and semantic signals. Existing approaches typically integrate these signals at either the input level (e.g., injecting behavioral embeddings into the token space) or the output level (e.g., contrastive alignment of separate encoders), suffering from distribution gaps or lack of end-to-end task supervision. In this work, we introduce L2Rec, which unifies behavioral and semantic understanding at the parameter level of LLMs. Our key insight is that the same set of Transformer parameters can serve as a shared medium for both views: by applying view-specific, personalized low-rank perturbations via a Dual-view Personalized Mixture-of-Experts (DPMoE) mechanism, L2Rec enables a single LLM backbone to produce complementary behavioral and semantic adaptations for each user with minimal representation-level misalignment. An adaptive cross-view fusion module further integrates the dual-view outputs into a unified user preference. Experiments on four datasets show that L2Rec consistently outperforms state-of-the-art baselines, and online A/B testing on a large-scale industrial platform validates significant improvements in key engagement metrics.

URL PDF HTML 收藏
2602.11799 2026-05-27 cs.AI cs.IR

Hi-SAM: A Hierarchical Structure-Aware Multi-modal Framework for Large-Scale Recommendation

Hi-SAM: 一种面向大规模推荐的分层结构感知多模态框架

Pingjun Pan, Tingting Zhou, Peiyao Lu, Tingting Fei, Hongxiang Chen, Chuanjiang Luo

机构 * Netease Cloud Music(网易云音乐)

AI总结 针对多模态推荐中语义ID离散化存在的次优分词和架构-数据不匹配问题,提出Hi-SAM框架,通过解耦语义分词器和分层记忆-锚点Transformer,在冷启动场景下显著提升推荐性能。

Comments Accepted at ACM KDD 2026 ADS

详情
AI中文摘要

多模态推荐因物品具有文本和图像等丰富属性而受到关注。基于语义ID的方法有效地将这些信息离散化为紧凑的令牌。然而,存在两个挑战:(1)次优分词:现有方法(如RQ-VAE)缺乏共享跨模态语义和模态特定细节之间的解耦,导致冗余或崩溃;(2)架构-数据不匹配:普通Transformer将语义ID视为扁平流,忽略了用户交互、物品和令牌的层次结构。将物品扩展为多个令牌会放大长度和噪声,使注意力偏向局部细节而非整体语义。我们提出Hi-SAM,一种分层结构感知多模态框架,包含两个设计:(1)解耦语义分词器(DST):通过几何感知对齐统一模态,并通过从粗到细的策略进行量化。共享码本提取共识,而模态特定码本通过互信息最小化从残差中恢复细微差别;(2)分层记忆-锚点Transformer(HMAT):通过分层RoPE将位置编码分解为物品间和物品内子空间以恢复层次结构。它插入锚点令牌将物品压缩为紧凑记忆,保留当前物品的细节,同时仅通过压缩摘要访问历史。在真实世界数据集上的实验表明,相比最先进基线方法,Hi-SAM持续改进,尤其在冷启动场景中。在服务数百万用户的大规模社交平台上部署后,Hi-SAM在核心在线指标上实现了6.55%的提升。

英文摘要

Multi-modal recommendation has gained traction as items possess rich attributes like text and images. Semantic ID-based approaches effectively discretize this information into compact tokens. However, two challenges persist: (1) Suboptimal Tokenization: existing methods (e.g., RQ-VAE) lack disentanglement between shared cross-modal semantics and modality-specific details, causing redundancy or collapse; (2) Architecture-Data Mismatch: vanilla Transformers treat semantic IDs as flat streams, ignoring the hierarchy of user interactions, items, and tokens. Expanding items into multiple tokens amplifies length and noise, biasing attention toward local details over holistic semantics. We propose Hi-SAM, a Hierarchical Structure-Aware Multi-modal framework with two designs: (1) Disentangled Semantic Tokenizer (DST): unifies modalities via geometry-aware alignment and quantizes them via a coarse-to-fine strategy. Shared codebooks distill consensus while modality-specific ones recover nuances from residuals, enforced by mutual information minimization; (2) Hierarchical Memory-Anchor Transformer (HMAT): splits positional encoding into inter- and intra-item subspaces via Hierarchical RoPE to restore hierarchy. It inserts Anchor Tokens to condense items into compact memory, retaining details for the current item while accessing history only through compressed summaries. Experiments on real-world datasets show consistent improvements over SOTA baselines, especially in cold-start scenarios. Deployed on a large-scale social platform serving millions of users, Hi-SAM achieved a 6.55% gain in the core online metric.

URL PDF HTML 收藏
2605.25693 2026-05-26 cs.CL cs.DB cs.MA

From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents

从事实到洞察:面向角色扮演智能体的角色驱动双记忆框架与数据集

Rongsheng Zhang, Ruofan Hu, Weijie Chen, Jiji Tang, Junnan Ren, Wanying Wu, Xunuoyan Chen, Tangjie Lv, Tao Jin, Zhou Zhao

机构 * Zhejiang University(浙江大学) Fuxi AI Lab, Netease Inc.(复活AI实验室,网易公司)

AI总结 针对长期对话中角色扮演智能体因上下文窗口限制而丧失角色一致性的问题,提出角色记忆数据集RoleMemo和双记忆框架DualMem,通过将记忆解耦为事实认知和角色条件洞察,结合监督微调与强化学习,在4B参数模型上超越基于DeepSeek-V3.2的零样本角色无关框架。

Comments Preprint

详情
AI中文摘要

尽管角色扮演智能体在短期交互中表现出色,但长期对话会压垮上下文窗口,从而促使外部记忆框架的发展。当前系统通常依赖角色无关的摘要,记录事实而不进行角色特定的解释,导致生成通用回复,损害角色保真度。为弥补这一差距,我们引入了RoleMemo数据集,其中包含四个推理任务,这些任务要求通过角色解释事实片段以得出正确答案。在RoleMemo上的评估揭示了角色无关框架的关键局限性。因此,我们提出了DualMem,它将记忆解耦为两个流:事实认知和角色条件洞察。通过监督微调(SFT)和强化学习(RL)训练,我们的框架使用4B参数模型在持续角色保真度上优于由DeepSeek-V3.2驱动的零样本角色无关框架。我们的资源可在https://github.com/role2026/rolememo获取。

英文摘要

While role-playing agents excel in short-term interactions, long-term conversations overwhelm context windows, motivating external memory frameworks. Current systems typically rely on persona-agnostic summarization, which records facts without persona-specific interpretation, yielding generic responses that compromise persona fidelity. To bridge this gap, we introduce RoleMemo, a dataset featuring four reasoning tasks where the factual fragments must be interpreted through the persona to reach the correct answer. Evaluation on RoleMemo exposes critical limitations of persona-agnostic frameworks. We thus propose DualMem, which decouples memory into two streams: factual cognition and persona-conditioned insight. Trained through Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), our framework with a 4B-parameter model outperforms zero-shot persona-agnostic frameworks powered by DeepSeek-V3.2 for sustained persona fidelity. Our resources are available at https://github.com/role2026/rolememo.

URL PDF HTML 收藏
2605.20879 2026-05-21 cs.LG

NeighborDiv: Training-free Zero-shot Generalist Graph Anomaly Detection via Neighbor Diversity

NeighborDiv: 一种基于邻居多样性、无需训练的跨域通用图异常检测方法

Kaifeng Wei, Teng Liu, Liang Dong, Xiubo Liang, Yuke Li

机构 * Netease Yidun AI Lab(网易易盾AI实验室) School of Software Technology(软件学院) Zhejiang University(浙江大学)

AI总结 本文提出NeighborDiv,一种无需训练的通用图异常检测方法,通过邻居多样性原理来检测异常,克服了传统方法在训练复杂度、数据依赖性和跨域泛化稳定性方面的不足,实验表明其在多个评估框架下均取得最佳性能。

详情
AI中文摘要

图异常检测(GAD)正逐渐转向通用图异常检测(GGAD)以实现跨域的'一揽子'检测,但现有GGAD方法主要依赖邻居一致性原则,陷入'节点到邻居一致性范式'的异常量化中。这些方法存在训练流程复杂、依赖大量训练数据、计算成本高以及跨域泛化不稳定等问题。为了解决这些限制,我们提出了NeighborDiv,一种基于邻居多样性的无需训练的通用图异常检测框架。偏离主流的'节点到邻居一致性范式',我们转向'邻居到邻居多样性范式',发现节点邻居集合的内部结构分散性是一种强大且独立的异常信号。我们通过邻居间特征相似性的方差来量化邻居多样性,捕捉节点如何组织其局部图环境,并独立于传统节点到邻居一致性框架。在两个标准的GGAD评估范式下进行的大量实验表明,NeighborDiv在单域独立训练(SDIT)下平均AUC提升了10.25%,平均AP提升了17.78%;在统一多域训练(UMDT)下,AUC和AP分别提升了6.89%和9.58%。值得注意的是,NeighborDiv在所有数据集上均无性能波动,消除了训练集依赖性,建立了一个轻量且高度实用的GGAD框架。

英文摘要

Graph Anomaly Detection (GAD) is increasingly shifting to Generalist GAD (GGAD) for cross-domain "one-for-all" detection, but existing GGAD methods predominantly rely on the neighbor consistency principle, falling into the \textbf{Node-to-Neighbor Consistency Paradigm} for anomaly quantification. These methods suffer from complex training pipelines, heavy training data dependency, high computational costs, and unstable cross-domain generalization. To address these limitations, we propose NeighborDiv, a training-free generalist graph anomaly detection framework based on neighbor diversity. Departing from the dominant Node-to-Neighbor Consistency Paradigm, we shift the focus to the \textbf{Neighbor-to-Neighbor Diversity Paradigm}, and uncover that the internal structural dispersion of a node's neighbor set is a powerful, independently discriminative anomaly signal. We quantify neighbor diversity via the variance of inter-neighbor feature similarities, which captures how a node organizes its local graph environment, and operates independently of conventional node-to-neighbor consistency frameworks. Extensive experiments under two standard GGAD evaluation paradigms show NeighborDiv achieves state-of-the-art performance, with relative gains of 10.25% in average AUC and 17.78% in average AP over the second-best baseline under Single-Domain Independent Training (SDIT), and 6.89%/9.58% in AUC/AP under Unified Multi-Domain Training (UMDT), respectively. Notably, NeighborDiv yields zero performance volatility across all datasets, eliminating training-set dependency and establishing a lightweight and highly practical GGAD framework.

URL PDF HTML 收藏
2605.19776 2026-05-21 cs.CV

Preferences Order, Ratings Anchor: From Fused Expert Aesthetic Ground Truth to Self-Distillation

偏好顺序、评分锚定:从融合专家审美真实数据到自我蒸馏

Yuanpei Zhao, Jie Lin, Chao Zhang, Yilin Wang, Mao Li, Chenhui Li, Jie Hou, Tangjie Lv

机构 * Sichuan University(四川大学) NetEase Fuxi AI Lab(网易福溪人工智能实验室) East China Normal University(华东师范大学)

AI总结 本文提出PPaint基准,通过融合专家偏好和评分数据,改进图像审美评估模型,通过自我蒸馏方法在单次推理中实现更准确的审美评分,优于现有开源和闭源基线模型。

Comments 27 pages, 7 pages

详情
AI中文摘要

成对偏好和点状评分是图像审美评估(IAA)的两种主要标注协议,但现有基准仅采用其中一种,未能在受控条件下测量其互补性。我们引入PPaint,一种匹配双协议基准,在五个审美维度上,15名领域专家(每类5名)对150幅中国画进行双协议标注,通过本地密集偏好设计收集45,900个成对专家判断,同时匹配评分。匹配设计揭示了互补优势:偏好产生更一致的顺序排名,而评分锚定了绝对分数尺度。通过两种独立的偏好到评分方法融合两种信号,得到融合的专家真实数据,使两种构造收敛到几乎相同的分数。同样的偏好到评分原则也适用于无标签VLM训练。PSDistill通过Elo参考池将VLM的成对判断转换为校准的伪分数,并通过置信度加权排名优化训练相同的VLM,生成单次推理的审美评分器。在单个绘画类别上训练,蒸馏后的Qwen3-VL-8B在所有三个类别上将均值SRCC从0.504提升到0.709,优于所有开源基线,包括专用审美模型ArtiMuse,并在单次推理成本下与闭源Gemini-3.1-Pro相差0.04 SRCC,跨领域转移在APDDv2上进一步验证。我们将发布完整的PPaint数据集和训练代码。

英文摘要

Pairwise preferences and pointwise ratings are the two dominant annotation protocols in image aesthetic assessment (IAA), yet existing benchmarks adopt only one, leaving their complementarity unmeasured under controlled conditions. We introduce PPaint, a matched dual-protocol benchmark in which 15 domain experts, 5 per category, annotate 150 Chinese paintings under both protocols across five aesthetic dimensions, collecting 45,900 pairwise expert judgments through a locally dense preference design alongside the matched ratings. The matched design reveals complementary strengths: preferences yield more consistent ordinal rankings, while ratings anchor the absolute score scale. Fusing both signals via two independent preference-to-score methods yields a fused expert ground truth on which the two constructions converge to nearly identical scores. The same preference-to-score principle extends to label-free VLM training. PSDistill converts VLM pairwise judgments into calibrated pseudo-scores via an Elo reference pool, and trains the same VLM with confidence-weighted ranking optimization to produce a single-pass aesthetic scorer. Trained on a single painting category, the distilled Qwen3-VL-8B improves mean SRCC from 0.504 to 0.709 across all three categories, outperforming all open-source baselines including the dedicated aesthetic model ArtiMuse and matching closed-source Gemini-3.1-Pro within 0.04 SRCC at single-pass inference cost, with cross-domain transfer further validated on APDDv2. We will release the full PPaint dataset and training code.

URL PDF HTML 收藏
2509.17387 2026-04-29 cs.RO

High-Precision and High-Efficiency Trajectory Tracking for Excavators Based on Closed-Loop Dynamics

基于闭环动力学的高精度高效率挖掘机轨迹跟踪

Ziqing Zou, Cong Wang, Yue Hu, Xiao Liu, Bowen Xu, Rong Xiong, Changjie Fan, Yingfeng Chen, Yue Wang

机构 * Zhejiang University(浙江大学) Fuxi Robotics Lab, NetEase Inc.(网易弗西机器人实验室)

AI总结 本文提出EfficientTrack方法,结合模型学习和闭环动力学,解决液压挖掘机非线性动力学难题,提升轨迹跟踪精度与效率,实验证明其在仿真和实际应用中均优于传统方法。

Journal ref 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hangzhou, China, 2025, pp. 5617-5624

详情
AI中文摘要

液压挖掘机的复杂非线性动力学,如时间延迟和控制耦合,对实现高精度轨迹跟踪构成重大挑战。传统控制方法在处理此类非线性问题时效果有限,而基于学习的方法需与环境交互频繁,导致效率低下。为解决这些问题,我们引入EfficientTrack轨迹跟踪方法,整合模型学习以管理非线性动力学,并利用闭环动力学提高学习效率,最终最小化跟踪误差。我们通过仿真和真实世界挖掘机的全面实验验证了该方法。仿真对比实验表明,我们的方法在跟踪精度和流畅度上优于现有基于学习的方法,且交互次数最少。实际世界实验进一步显示,该方法在负载条件下仍有效,并具备持续学习能力,凸显其实际应用价值。实施细节和源代码请参考https://github.com/ZiqingZou/EfficientTrack。

英文摘要

The complex nonlinear dynamics of hydraulic excavators, such as time delays and control coupling, pose significant challenges to achieving high-precision trajectory tracking. Traditional control methods often fall short in such applications due to their inability to effectively handle these nonlinearities, while commonly used learning-based methods require extensive interactions with the environment, leading to inefficiency. To address these issues, we introduce EfficientTrack, a trajectory tracking method that integrates model-based learning to manage nonlinear dynamics and leverages closed-loop dynamics to improve learning efficiency, ultimately minimizing tracking errors. We validate our method through comprehensive experiments both in simulation and on a real-world excavator. Comparative experiments in simulation demonstrate that our method outperforms existing learning-based approaches, achieving the highest tracking precision and smoothness with the fewest interactions. Real-world experiments further show that our method remains effective under load conditions and possesses the ability for continual learning, highlighting its practical applicability. For implementation details and source code, please refer to https://github.com/ZiqingZou/EfficientTrack.

URL PDF HTML 收藏
2603.17729 2026-04-29 cs.CV cs.AI

SARE: Sample-wise Adaptive Reasoning for Training-free Fine-grained Visual Recognition

SARE:基于样本的自适应推理用于无训练细粒度视觉识别

Jingxiao Yang, DaLin He, Miao Pan, Kaixiang Yao, Ge Su, Wenqi Zhang, Yifeng Hu, Tangwei Li, Yuke Li, Xuhong Zhang

机构 * Zhejiang University(浙江大学) Netease Yidun AI Lab(网易云智AI实验室)

AI总结 SARE提出一种样本自适应推理框架,通过结合快速候选检索与细粒度推理,利用历史失败经验提升无训练细粒度视觉识别的准确性和效率。

Comments preprint, under review

详情
AI中文摘要

近年来,大规模视觉-语言模型(LVLMs)的进步使得无训练细粒度视觉识别(FGVR)成为可能。然而,由于从属级类别的固有视觉模糊性,有效利用LVLMs进行FGVR仍具挑战性。现有方法主要采用检索导向或推理导向范式,但两者均受限于两个根本性限制:(1)对所有样本应用相同的推理流程,未考虑识别难度的不均衡,导致准确性和效率低下;(2)缺乏机制整合和重用错误特定经验,导致在相似挑战性案例上重复失败。为解决这些限制,我们提出SARE,一种用于无训练FGVR的样本自适应推理框架。具体而言,SARE采用级联设计,结合快速候选检索与细粒度推理,在必要时才调用后者。在推理过程中,SARE整合了自我反思经验机制,利用过往失败经验在推理中提供可转移的判别指导,无需任何参数更新。在14个数据集上的广泛实验表明,SARE在达到最先进性能的同时,显著减少了计算开销。

英文摘要

Recent advances in Large Vision-Language Models (LVLMs) have enabled training-free Fine-Grained Visual Recognition (FGVR). However, effectively exploiting LVLMs for FGVR remains challenging due to the inherent visual ambiguity of subordinate-level categories. Existing methods predominantly adopt either retrieval-oriented or reasoning-oriented paradigms to tackle this challenge, but both are constrained by two fundamental limitations:(1) They apply the same inference pipeline to all samples without accounting for uneven recognition difficulty, thereby leading to suboptimal accuracy and efficiency; (2) The lack of mechanisms to consolidate and reuse error-specific experience causes repeated failures on similar challenging cases. To address these limitations, we propose SARE, a Sample-wise Adaptive textbfREasoning framework for training-free FGVR. Specifically, SARE adopts a cascaded design that combines fast candidate retrieval with fine-grained reasoning, invoking the latter only when necessary. In the reasoning process, SARE incorporates a self-reflective experience mechanism that leverages past failures to provide transferable discriminative guidance during inference, without any parameter updates. Extensive experiments across 14 datasets substantiate that SARE achieves state-of-the-art performance while substantially reducing computational overhead.

URL PDF HTML 收藏
2604.15998 2026-04-20 cs.CL

SCHK-HTC: Sibling Contrastive Learning with Hierarchical Knowledge-Aware Prompt Tuning for Hierarchical Text Classification

SCHK-HTC:基于层次知识感知提示微调的兄弟对比学习用于层次文本分类

Ke Xiong, Qian Wu, Wangjie Gan, Yuke Li, Xuhong Zhang

机构 * School of Software Technology, Zhejiang University, China(浙江大学软件学院) NetEase Yidun AI Lab, Hangzhou, China(网易易盾人工智能实验室)

AI总结 本文提出SCHK-HTC方法,通过层次知识提取模块和兄弟对比学习机制提升少样本层次文本分类性能,优于现有最先进方法。

Comments 5pages,3 figures,ICASSP 2026

详情
AI中文摘要

Few-shot Hierarchical Text Classification (few-shot HTC) 是一个具有挑战性的任务,涉及在数据稀缺条件下将文本映射到预定义的树状标签层次结构。尽管当前方法利用标签层次结构的结构约束来保持父-子预测一致性,但面临关键瓶颈,即由于领域知识不足,难以区分语义相似的兄弟类别。我们介绍了一种创新方法,名为Sibling Contrastive Learning with Hierarchical Knowledge-aware Prompt Tuning for few-shot HTC tasks (SCHK-HTC)。我们的工作增强了模型对更深层次兄弟类别之间细微差异的感知能力,而不是仅仅强制执行层次规则。具体而言,我们提出了一种包含两个核心组件的新型框架:层次知识提取模块和兄弟对比学习机制。该设计引导模型在每个层次级别编码判别性特征,从而提高可混淆类别的分离度。我们的方法在三个基准数据集上实现了优越的性能,大多数情况下优于现有最先进方法。我们的代码可在https://github.com/happywinder/SCHK-HTC获取。

英文摘要

Few-shot Hierarchical Text Classification (few-shot HTC) is a challenging task that involves mapping texts to a predefined tree-structured label hierarchy under data-scarce conditions. While current approaches utilize structural constraints from the label hierarchy to maintain parent-child prediction consistency, they face a critical bottleneck, the difficulty in distinguishing semantically similar sibling classes due to insufficient domain knowledge. We introduce an innovative method named Sibling Contrastive Learning with Hierarchical Knowledge-aware Prompt Tuning for few-shot HTC tasks (SCHK-HTC). Our work enhances the model's perception of subtle differences between sibling classes at deeper levels, rather than just enforcing hierarchical rules. Specifically, we propose a novel framework featuring two core components: a hierarchical knowledge extraction module and a sibling contrastive learning mechanism. This design guides model to encode discriminative features at each hierarchy level, thus improving the separability of confusable classes. Our approach achieves superior performance across three benchmark datasets, surpassing existing state-of-the-art methods in most cases. Our code is available at https://github.com/happywinder/SCHK-HTC.

URL PDF HTML 收藏
2603.16285 2026-03-18 cs.CV

Persistent Story World Simulation with Continuous Character Customization

持久故事世界模拟与连续角色定制

Jinlu Zhang, Qiyun Wang, Baoxiang Du, Jiayi Ji, Jing He, Rongsheng Zhang, Tangjie Lv, Xiaoshuai Sun, Rongrong Ji

机构 * Xiamen University(厦门大学) The Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州)) Fuxi AI Lab, Netease Inc.(福克斯AI实验室,网易公司)

AI总结 本文提出EverTale,通过统一LoRA模块实现连续角色自定义,引入质量门和区域聚焦采样策略,提升多角色视觉叙事的准确性和一致性。

详情
AI中文摘要

故事可视化在计算机视觉中日益受到关注。然而,现有方法难以在精确的角色定制、语义对齐和连续整合新身份之间实现协同。为此,本文提出EverTale,一个用于连续故事角色定制的故事世界模拟器。我们首先提出All-in-One-World Character Integrator,通过统一LoRA模块实现连续角色适应,消除先前方法中每个角色优化模块的需要。然后,我们引入Character Quality Gate通过MLLM-as-Judge确保每个角色适应过程的保真度,通过链式推理确定模型是否可以继续下一步或需要对当前角色进行额外训练。我们还引入Character-Aware Region-Focus Sampling策略,解决现有多角色视觉叙事中的身份退化和布局冲突问题,通过更高效地和谐本地角色特定细节与全局场景上下文,确保自然的多角色生成。实验结果表明,EverTale在单角色和多角色故事可视化上优于更广泛的方法。代码将被提供。

英文摘要

Story visualization has gained increasing attention in computer vision. However, current methods often fail to achieve a synergy between accurate character customization, semantic alignment, and continuous integration of new identities. To tackle this challenge, in this paper we present EverTale, a story world simulator for continuous story character customization. We first propose an All-in-One-World Character Integrator to achieve continuous character adaptation within unified LoRA module, eliminating the need for per-character optimization modules of previous methods. Then, we incorporate a Character Quality Gate via MLLM-as-Judge to ensure the fidelity of each character adaptation process through chain-of-thought reasoning, determining whether the model can proceed to the next character or require additional training on the current one. We also introduce a Character-Aware Region-Focus Sampling strategy to address the identity degradation and layout conflicts in existing multi-character visual storytelling, ensuring natural multi-character generation by harmonizing local character-specific details with global scene context with higher efficiency. Experimental results show that our EverTale achieves superior performance against a wider range of compared methods on both single- and multi-character story visualization. Codes will be available.

URL PDF HTML 收藏
2602.00676 2026-02-03 cs.AI cs.MA

OpenGuanDan: A Large-Scale Imperfect Information Game Benchmark

OpenGuanDan: 一个大规模非完全信息游戏基准

Chao Li, Shangdong Yang, Chiheng Zhan, Zhenxing Ge, Yujing Hu, Bingkun Bao, Xingguo Chen, Yang Gao

机构 * School of Computer Science, Nanjing University of Posts(南京邮电大学计算机科学学院) NetEase Fuxi AI Lab, Netease Inc(网易凤凰AI实验室,网易公司) School of Intelligent Science(智能科学学院) Technology, Nanjing University(技术,南京大学)

AI总结 OpenGuanDan是一个用于评估多智能体决策算法的新型大规模非完全信息游戏基准,通过模拟中国四人纸牌游戏并支持人机对抗,揭示了当前AI在复杂决策任务中的不足。

详情
AI中文摘要

数据驱动的人工智能(AI)特别是机器学习的进步严重依赖于大规模基准。尽管近年来在模式识别到智能决策等领域取得了显著进展,例如围棋、纸牌游戏和电子竞技等领域的突破,但仍需要更具挑战性的基准来推动进一步研究。为此,本文提出OpenGuanDan,一个新型基准,既能高效模拟GuanDan(一种流行的四人多轮中国纸牌游戏),又能全面评估基于学习和基于规则的GuanDan AI代理。OpenGuanDan提出了非平凡的挑战,包括非完全信息、大规模信息集和动作空间、混合学习目标涉及合作与竞争、长时间决策、可变动作空间和动态团队组成。这些特性使其成为现有智能决策方法的严峻测试平台。此外,每个玩家独立的API允许人机交互,并支持与大语言模型的集成。实证上,我们进行了两种类型的评估:(1)所有GuanDan AI代理之间的成对比赛,以及(2)人机对决。实验结果表明,尽管当前基于学习的代理显著优于基于规则的代理,但它们仍然无法达到超人类水平,凸显了在多智能体智能决策领域继续研究的必要性。该项目在https://github.com/GameAI-NJUPT/OpenGuanDan上公开可用。

英文摘要

The advancement of data-driven artificial intelligence (AI), particularly machine learning, heavily depends on large-scale benchmarks. Despite remarkable progress across domains ranging from pattern recognition to intelligent decision-making in recent decades, exemplified by breakthroughs in board games, card games, and electronic sports games, there remains a pressing need for more challenging benchmarks to drive further research. To this end, this paper proposes OpenGuanDan, a novel benchmark that enables both efficient simulation of GuanDan (a popular four-player, multi-round Chinese card game) and comprehensive evaluation of both learning-based and rule-based GuanDan AI agents. OpenGuanDan poses a suite of nontrivial challenges, including imperfect information, large-scale information set and action spaces, a mixed learning objective involving cooperation and competition, long-horizon decision-making, variable action spaces, and dynamic team composition. These characteristics make it a demanding testbed for existing intelligent decision-making methods. Moreover, the independent API for each player allows human-AI interactions and supports integration with large language models. Empirically, we conduct two types of evaluations: (1) pairwise competitions among all GuanDan AI agents, and (2) human-AI matchups. Experimental results demonstrate that while current learning-based agents substantially outperform rule-based counterparts, they still fall short of achieving superhuman performance, underscoring the need for continued research in multi-agent intelligent decision-making domain. The project is publicly available at https://github.com/GameAI-NJUPT/OpenGuanDan.

URL PDF HTML 收藏
2601.03306 2026-01-08 cs.AI cs.LG

Mastering the Game of Go with Self-play Experience Replay

Jingbin Liu, Xuechun Wang

机构 * NetEase AI Lab(网易人工智能实验室)

Comments 13 pages, 5 figures

详情
英文摘要

The game of Go has long served as a benchmark for artificial intelligence, demanding sophisticated strategic reasoning and long-term planning. Previous approaches such as AlphaGo and its successors, have predominantly relied on model-based Monte-Carlo Tree Search (MCTS). In this work, we present QZero, a novel model-free reinforcement learning algorithm that forgoes search during training and learns a Nash equilibrium policy through self-play and off-policy experience replay. Built upon entropy-regularized Q-learning, QZero utilizes a single Q-value network to unify policy evaluation and improvement. Starting tabula rasa without human data and trained for 5 months with modest compute resources (7 GPUs), QZero achieved a performance level comparable to that of AlphaGo. This demonstrates, for the first time, the efficiency of using model-free reinforcement learning to master the game of Go, as well as the feasibility of off-policy reinforcement learning in solving large-scale and complex environments.

URL PDF HTML 收藏
2512.14050 2025-12-17 cs.CV

SELECT: Detecting Label Errors in Real-world Scene Text Data

Wenjun Liu, Qian Wu, Yifeng Hu, Yuke Li

机构 * Yidun AI Lab, NetEase(网易异度人工智能实验室)

详情
英文摘要

We introduce SELECT (Scene tExt Label Errors deteCTion), a novel approach that leverages multi-modal training to detect label errors in real-world scene text datasets. Utilizing an image-text encoder and a character-level tokenizer, SELECT addresses the issues of variable-length sequence labels, label sequence misalignment, and character-level errors, outperforming existing methods in accuracy and practical utility. In addition, we introduce Similarity-based Sequence Label Corruption (SSLC), a process that intentionally introduces errors into the training labels to mimic real-world error scenarios during training. SSLC not only can cause a change in the sequence length but also takes into account the visual similarity between characters during corruption. Our method is the first to detect label errors in real-world scene text datasets successfully accounting for variable-length labels. Experimental results demonstrate the effectiveness of SELECT in detecting label errors and improving STR accuracy on real-world text datasets, showcasing its practical utility.

URL PDF HTML 收藏
2506.05281 2025-11-21 cs.LG cs.AI

Fast-DataShapley: Neural Modeling for Training Data Valuation

Haifeng Sun, Yu Xiong, Runze Wu, Xinyu Cai, Changjie Fan, Lan Zhang, Xiang-Yang Li

机构 * University of Science and Technology of China(中国科学技术大学) Netease, Fuxi AI Lab(网易智谱实验室) Nanyang Technological University(南洋理工大学)

Journal ref ACM WSDM 2026

详情
英文摘要

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool for evaluating contributions, outperforms other methods in theory, but its computational overhead escalates exponentially with the number of data providers. Recent works based on Shapley values attempt to mitigate computation complexity by approximation algorithms. However, they need to retrain for each test sample, leading to intolerable costs. We propose Fast-DataShapley, a one-pass training method that leverages the weighted least squares characterization of the Shapley value to train a reusable explainer model with real-time reasoning speed. Given new test samples, no retraining is required to calculate the Shapley values of the training data. Additionally, we propose three methods with theoretical guarantees to reduce training overhead from two aspects: the approximate calculation of the utility function and the group calculation of the training data. We analyze time complexity to show the efficiency of our methods. The experimental evaluations on various image datasets demonstrate superior performance and efficiency compared to baselines. Specifically, the performance is improved to more than 2 times, and the explainer's training speed can be increased by two orders of magnitude.

URL PDF HTML 收藏
2504.15927 2025-10-07 cs.SI cs.AI

New Recipe for Semi-supervised Community Detection: Clique Annealing under Crystallization Kinetics

Ling Cheng, Jiashu Pu, Ruicheng Liang, Qian Shao, Hezhe Qiao, Feida Zhu

机构 * Singapore Management University(新加坡国立管理大学) Fuxi AI Lab, NetEase, Inc(Foxi人工智能实验室,网易公司)

Comments arXiv admin note: text overlap with arXiv:2203.05898 by other authors

详情
英文摘要

Semi-supervised community detection methods are widely used for identifying specific communities due to the label scarcity. Existing semi-supervised community detection methods typically involve two learning stages learning in both initial identification and subsequent adjustment, which often starts from an unreasonable community core candidate. Moreover, these methods encounter scalability issues because they depend on reinforcement learning and generative adversarial networks, leading to higher computational costs and restricting the selection of candidates. To address these limitations, we draw a parallel between crystallization kinetics and community detection to integrate the spontaneity of the annealing process into community detection. Specifically, we liken community detection to identifying a crystal subgrain (core) that expands into a complete grain (community) through a process similar to annealing. Based on this finding, we propose CLique ANNealing (CLANN), which applies kinetics concepts to community detection by integrating these principles into the optimization process to strengthen the consistency of the community core. Subsequently, a learning-free Transitive Annealer was employed to refine the first-stage candidates by merging neighboring cliques and repositioning the community core, enabling a spontaneous growth process that enhances scalability. Extensive experiments on \textbf{43} different network settings demonstrate that CLANN outperforms state-of-the-art methods across multiple real-world datasets, showcasing its exceptional efficacy and efficiency in community detection.

URL PDF HTML 收藏
2509.24229 2025-09-30 cs.CL

Model Fusion with Multi-LoRA Inference for Tool-Enhanced Game Dialogue Agents

Kangxu Wang, Ze Chen, Chengcheng Wei, Jiewen Zheng, Jiarong He, Max Gao

机构 * Interactive Entertainment Group of Netease Inc.(网易互动娱乐集团)

Comments 8 pages

详情
英文摘要

This paper presents the opdainlp team's solution for the GPU track of the CPDC 2025 challenge. The challenge consists of three tasks, aiming to build an in-game conversational AI that adheres to character personas, aligns with the game's worldview, and supports function calling. Considering both effectiveness and resource/time constraints during inference, we synthesized data for some of the tasks based on the datasets provided by the competition organizers. We employed Qwen3-14B with LoRA fine-tuning and model fusion, and utilized a base model integrated with multiple LoRA adapters during inference. Specifically, in the competition, we used three distinct LoRA adapters to handle tool calling, response generation with tool call results, and response generation without tool call results, respectively. MultiLoRA inference was implemented using vLLM. Our solution achieved the first place in Task 1 and Task 3, and the second place in Task 2 of the GPU track.

URL PDF HTML 收藏
2509.14030 2025-09-18 cs.AI

CrowdAgent: Multi-Agent Managed Multi-Source Annotation System

Maosheng Qin, Renyu Zhu, Mingxuan Xia, Chenkai Chen, Zhen Zhu, Minmin Lin, Junbo Zhao, Lu Xu, Changjie Fan, Runze Wu, Haobo Wang

机构 * Zhejiang University(浙江大学) NetEase Fuxi AI Lab(网易凤凰AI实验室) Zhejiang Sci-tech University(浙江科技学院)

详情
英文摘要

High-quality annotated data is a cornerstone of modern Natural Language Processing (NLP). While recent methods begin to leverage diverse annotation sources-including Large Language Models (LLMs), Small Language Models (SLMs), and human experts-they often focus narrowly on the labeling step itself. A critical gap remains in the holistic process control required to manage these sources dynamically, addressing complex scheduling and quality-cost trade-offs in a unified manner. Inspired by real-world crowdsourcing companies, we introduce CrowdAgent, a multi-agent system that provides end-to-end process control by integrating task assignment, data annotation, and quality/cost management. It implements a novel methodology that rationally assigns tasks, enabling LLMs, SLMs, and human experts to advance synergistically in a collaborative annotation workflow. We demonstrate the effectiveness of CrowdAgent through extensive experiments on six diverse multimodal classification tasks. The source code and video demo are available at https://github.com/QMMMS/CrowdAgent.

URL PDF HTML 收藏
2509.05263 2025-09-09 cs.AI cs.CV cs.LG

LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation

Yinglin Duan, Zhengxia Zou, Tongwei Gu, Wei Jia, Zhan Zhao, Luyi Xu, Xinzhu Liu, Yenan Lin, Hao Jiang, Kang Chen, Shuang Qiu

机构 * NetEase, Inc.(网易公司) Beihang University(北京航空航天大学) Tsinghua University(清华大学) City University of Hong Kong(香港城市大学) Independent Researcher & Technical Artists(独立研究者及技术艺术家)

详情
英文摘要

Recent research has been increasingly focusing on developing 3D world models that simulate complex real-world scenarios. World models have found broad applications across various domains, including embodied AI, autonomous driving, entertainment, etc. A more realistic simulation with accurate physics will effectively narrow the sim-to-real gap and allow us to gather rich information about the real world conveniently. While traditional manual modeling has enabled the creation of virtual 3D scenes, modern approaches have leveraged advanced machine learning algorithms for 3D world generation, with most recent advances focusing on generative methods that can create virtual worlds based on user instructions. This work explores such a research direction by proposing LatticeWorld, a simple yet effective 3D world generation framework that streamlines the industrial production pipeline of 3D environments. LatticeWorld leverages lightweight LLMs (LLaMA-2-7B) alongside the industry-grade rendering engine (e.g., Unreal Engine 5) to generate a dynamic environment. Our proposed framework accepts textual descriptions and visual instructions as multimodal inputs and creates large-scale 3D interactive worlds with dynamic agents, featuring competitive multi-agent interaction, high-fidelity physics simulation, and real-time rendering. We conduct comprehensive experiments to evaluate LatticeWorld, showing that it achieves superior accuracy in scene layout generation and visual fidelity. Moreover, LatticeWorld achieves over a $90\times$ increase in industrial production efficiency while maintaining high creative quality compared with traditional manual production methods. Our demo video is available at https://youtu.be/8VWZXpERR18

URL PDF HTML 收藏