According to the distributional inclusion hypothesis, entailment between words can be measured via the feature inclusions of their distributional vectors. In recent work, we showed how this hypothesis can be extended from words to phrases and sentences in the setting of compositional distributional semantics. This paper focuses on inclusion properties of tensors; its main contribution is a theoretical and experimental analysis of how feature inclusion works in different concrete models of verb tensors. We present results for relational, Frobenius, projective, and holistic methods and compare them to the simple vector addition, multiplication, min, and max models. The degrees of entailment thus obtained are evaluated via a variety of existing word-based measures, such as Weed's and Clarke's, KL-divergence, APinc, balAPinc, and two of our previously proposed metrics at the phrase/sentence level. We perform experiments on three entailment datasets, investigating which version of tensor-based composition achieves the highest performance when combined with the sentence-level measures.
Tokens, the oft-overlooked appetizer: Large language models, the distributional hypothesis, and meaning
Computational Story Lab（计算故事实验室）；Vermont Complex Systems Institute（佛蒙特复杂系统研究所）；University of Vermont（佛蒙特大学）；Department of Computer Science（计算机科学系）；St. Michael’s College（圣米歇尔学院）；Communication Media and Marginalization Lab（传播媒体与边缘化实验室）；Northeastern University（东北大学）；Department of Mathematics & Statistics（数学与统计学系）
Rethinking the Idiomaticity Decomposability Hypothesis: Evidence from Distributional Learning
University of Sheffield（谢菲尔德大学）；Berliner Hochschule für Technik (BHT)（柏林技术大学（BHT））；University of Exeter（埃克塞特大学）；Federal University of Rio Grande do Norte, Brazil（巴西北里奥格兰德联邦大学）
Where New Words Are Born: Distributional Semantic Analysis of Neologisms and Their Semantic Neighborhoods
Language Technologies Institute, Carnegie Mellon University（卡内基梅隆大学语言技术研究所）；Department of Computer Science, University of Toronto（多伦多大学计算机科学系）；Computer Science and Engineering, University of California, San Diego（加利福尼亚大学圣地亚哥分校计算机科学与工程系）
Can Eye Movement Data Be Used As Ground Truth For Word Embeddings Evaluation?
The National Research University Higher School of Economics（国立研究型大学高等经济学院）；Federal Research Center `Computer Science and Control' of Russian Academy of Sciences（俄罗斯科学院计算机科学与控制联邦研究中心）
