归一化Web距离与词相似度

基于归一化响应相似性的回顾性蒸馏归因

Retrospective Distillation Attribution via Normalized Response Similarity

提出仅基于输出的SCOUT方法，通过聚合句法模式并校准距离，实现对经历后续训练的蒸馏模型进行有效溯源归因，并发现教师句法特征在训练中持续存在。

网络检索文本中情感名称的分类

Categories of Emotion names in Web retrieved texts

情感名称的分类，即，将具有相似情感内涵的情感词组合在一起，是社会心理学用来探索人们情感知识的重要工具。无一例外，遵循这一研究路线的研究都是基于对实验参与者情绪名称之间感知相似性的测量。在这里，我们提出并研究了一种新的方法来研究情感名称的类别-目标情感名称之间的相似性是通过比较它们出现在从万维网检索到的文本中的上下文来获得的。这种比较不考虑任何明确的语义信息;它只是计算上下文中使用的常用词或词汇项的数量。这个过程允许我们将相似性矩阵的条目写为上下文的线性向量空间中的点积。该矩阵的属性，然后探索使用多维尺度分析和层次聚类。我们的主要发现，即情绪空间的基本维度和情绪名称的类别，与人们的情绪名称的相似性判断的基础上一致。

Automated Query Generation for Evidence Collection from Web Search Engines

It is widely accepted that so-called facts can be checked by searching for information on the Internet. This process requires a fact-checker to formulate a search query based on the fact and to present it to a search engine. Then, relevant and believable passages need to be identified in the search results before a decision is made. This process is carried out by sub-editors at many news and media organisations on a daily basis. Here, we ask the question as to whether it is possible to automate the first step, that of query generation. Can we automatically formulate search queries based on fac…

Word Embeddings from Large-Scale Greek Web Content

Word embeddings are undoubtedly very useful components in many NLP tasks. In this paper, we present word embeddings and other linguistic resources trained on the largest to date digital Greek language corpus. We also present a live web tool for testing the Greek word embeddings, by offering "analogy", "similarity score" and "most similar words" functions. Through our explorer, one could interact with the Greek word vectors.

Google distance between words

Cilibrasi and Vitanyi have demonstrated that it is possible to extract the meaning of words from the world-wide web. To achieve this, they rely on the number of webpages that are found through a Google search containing a given word and they associate the page count to the probability that the word appears on a webpage. Thus, conditional probabilities allow them to correlate one word with another word's meaning. Furthermore, they have developed a similarity distance function that gauges how closely related a pair of words is. We present a specific counterexample to the triangle inequality for …

Semantic Word Clusters Using Signed Normalized Graph Cuts

Vector space representations of words capture many aspects of word similarity, but such methods tend to make vector spaces in which antonyms (as well as synonyms) are close to each other. We present a new signed spectral normalized graph cut algorithm, signed clustering, that overlays existing thesauri upon distributionally derived vector representations of words, so that antonym relationships between word pairs are represented by negative weights. Our signed clustering algorithm produces clusters of words which simultaneously capture distributional and synonym relations. We evaluate these clu…

ClusterEA: Scalable Entity Alignment with Stochastic Training and Normalized Mini-batch Similarities

Entity alignment (EA) aims at finding equivalent entities in different knowledge graphs (KGs). Embedding-based approaches have dominated the EA task in recent years. Those methods face problems that come from the geometric properties of embedding vectors, including hubness and isolation. To solve these geometric problems, many normalization approaches have been adopted for EA. However, the increasing scale of KGs renders it hard for EA models to adopt the normalization processes, thus limiting their usage in real-world applications. To tackle this challenge, we present ClusterEA, a general fra…

Google相似距离

The Google Similarity Distance

单词和短语从它们在社会中的使用方式中获得意义，从它们与其他单词和短语的相关语义中获得意义。对于计算机来说，“社会”的等价物是“数据库”，而“使用”的等价物是“搜索数据库的方式”。“我们提出了一种基于信息距离和Kolmogorov复杂度的词和短语之间相似性的新理论。我们使用万维网作为数据库，谷歌作为搜索引擎来修复思想。该方法也适用于其他搜索引擎和数据库。然后，该理论被应用于构建一种方法来自动提取相似性，谷歌相似性距离，从万维网使用谷歌页面计数的单词和短语。万维网是地球上最大的数据库，数百万独立用户输入的上下文信息平均起来提供有用质量的自动语义。我们给出了层次聚类，分类和语言翻译中的应用。我们给出的例子来区分颜色和数字，集群名称的绘画由17世纪的荷兰大师和书籍的名称由英国小说家，理解紧急情况的能力，和素数，我们展示了做一个简单的自动英语-西班牙语翻译的能力。最后，我们使用WordNet数据库作为一个客观的基准，以判断我们的方法的性能。我们使用支持向量机在二进制分类中进行了大规模的随机试验，以根据Google距离学习类别，结果与专家制作的WordNet类别的平均一致率为87%。