arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

FlowNeg:用于知识图谱嵌入的GFlowNet引导的多样化难负采样方法

FlowNeg: GFlowNet-Guided Diverse Hard Negative Sampling for Knowledge Graph Embedding

Ibne Farabi Shihab, Naoshin Anzum Hridi, Joyanta Jyoti Mondal

arXiv 2608.23849首次发表:更新:

发表机构

Iowa State University; BRAC University; University of Delaware(爱荷华州立大学; BRAC大学; 特拉华大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

FlowNeg是一种GFlowNet引导的知识图谱嵌入难负采样方法,在多个基准实验中,其MRR显著优于EMU和IF-NS,具有高梯度信息性与低冲突的优势。

AI 中文摘要

负采样决定知识图谱嵌入(KGE)模型是从有信息的反例中学习,还是在不可信的损坏样本上浪费更新。均匀负样本多样但简单,而难负采样器集中于少数实体,与保留的正样本冲突更多。我们提出FlowNeg,一种上下文条件分层生成流网络,它对与奖励成比例的采样进行摊销,无需在实体集上归一化复合奖励:给定一个正三元组和损坏侧,它先选择类型,再选择实体。其终端奖励结合了基于有界模型的难样本度,以及仅用于训练的、针对保留正样本冲突的结构分数,且基于特定关系的类型兼容支持。我们推导了奖励,对标准轨迹平衡进行了专门化,并以乘法方式界定了残差不平衡对终端和模式概率的扰动。在包含5种架构和5种基准的5种子的描述性网格实验中,FlowNeg在25个单元中有24个的平均MRR高于EMU和IF-NS(平均分别提升0.0172和0.0160)。另一项针对FB15k-237/RotatE的15种子对照实验,固定负样本数量、诊断预算和计算资源,结果显示FlowNeg的MRR为0.359±0.001,而EMU为0.346±0.002,FlowNeg具有接近均匀的固定划分多样性、高梯度信息性和低冲突。该证据支持覆盖模式的负样本生成,无需将结构相似性视为开放世界的真理 oracle。

英文摘要

Negative sampling determines whether a knowledge graph embedding (KGE) model learns from informative counterexamples or wastes updates on implausible corruptions. Uniform negatives are diverse but easy, whereas hard-negative miners concentrate on few entities and collide more with held-out positives. We introduce FlowNeg, a context-conditioned hierarchical generative flow network that amortizes reward-proportional sampling without normalizing a composite reward over the entity set: given a positive triple and corruption side, it selects a type, then an entity. Its terminal reward combines bounded model-based hardness with a training-only structural score for held-out-positive collision, over a relation-specific type-compatible support. We derive the reward, specialize standard trajectory balance, and bound multiplicatively how residual imbalance perturbs terminal and mode probability. Across a descriptive five-seed grid of five architectures and five benchmarks, FlowNeg has higher mean MRR than EMU and than IF-NS in 24 of 25 cells ($+0.0172$ and $+0.0160$ on average). A separate 15-seed FB15k-237/RotatE control fixing negative count, diagnostic budget, and compute gives FlowNeg $0.359\pm0.001$ MRR against $0.346\pm0.002$ for EMU, with near-uniform fixed-partition diversity, high gradient informativeness, and low collision. The evidence supports mode-covering negative generation without treating structural similarity as an open-world truth oracle.

Comments20 pages, 1 figure

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑