首页/论文/2003.03444

arXiv 2003.034442020-03cs.CL

NYTWIT: A Dataset of Novel Words in the New York Times

Georgia Institute of Technology（佐治亚理工学院）；University of Wisconsin（威斯康星大学）；School for Poetic Computation（诗意计算学院）

Yuval Pinter, Cassandra L. Jacobs, Max Bittker

备注：: COLING 2020

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

We present the New York Times Word Innovation Types dataset, or NYTWIT, a collection of over 2,500 novel English words published in the New York Times between November 2017 and March 2019, manually annotated for their class of novelty (such as lexical derivation, dialectal variation, blending, or compounding). We present baseline results for both uncontextual and contextual prediction of novelty class, showing that there is room for improvement even for state-of-the-art NLP systems. We hope this resource will prove useful for linguists and NLP practitioners by providing a real-world environment of novel word appearance.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

PAWS: Paraphrase Adversaries from Word Scrambling

Google AI Language（谷歌人工智能语言）

Existing paraphrase identification datasets lack sentence pairs that have high lexical overlap without being paraphrases. Models trained on such data fail to distinguish pairs like flights from New York to Florida and flights from Florida to New York. This paper introduces PAWS (Paraphrase Adversaries from Word Scrambling), a new dataset with 108,463 well-formed paraphrase and non-paraphrase pairs with high lexical overlap. Challenging pairs are generated by controlled word swapping and back translation, followed by fluency and paraphrase judgments by human raters. State-of-the-art models trai…

2019-04-01cs.CL

Discovering topics in text datasets by visualizing relevant words

Technische Universität Berlin（柏林工业大学）；Fraunhofer Heinrich Hertz Institute（弗劳恩霍夫海因里希·赫兹研究所）；Korea University（高丽大学）

When dealing with large collections of documents, it is imperative to quickly get an overview of the texts' contents. In this paper we show how this can be achieved by using a clustering algorithm to identify topics in the dataset and then selecting and visualizing relevant words, which distinguish a group of documents from the rest of the texts, to summarize the contents of the documents belonging to each topic. We demonstrate our approach by discovering trending topics in a collection of New York Times article snippets.

2017-07-18cs.CL

Exploring text datasets by visualizing relevant words

Technische Universität Berlin（柏林工业大学）；Fraunhofer Heinrich Hertz Institute（弗劳恩霍夫海因里希赫兹研究所）；Korea University（高丽大学）

When working with a new dataset, it is important to first explore and familiarize oneself with it, before applying any advanced machine learning algorithms. However, to the best of our knowledge, no tools exist that quickly and reliably give insight into the contents of a selection of documents with respect to what distinguishes them from other documents belonging to different categories. In this paper we propose to extract `relevant words' from a collection of texts, which summarize the contents of documents belonging to a certain class (or discovered cluster in the case of unlabeled datasets…

2017-07-17cs.CL

Domain-Specific Word Embeddings with Structure Prediction

TU Berlin（柏林工业大学）；University of Copenhagen（哥本哈根大学）；BIFOLD（柏林学习与数据基础研究所）；Le Mans Université（勒芒大学）；RIKEN Center for AIP（理化学研究所先进智能项目中心）

Complementary to finding good general word embeddings, an important question for representation learning is to find dynamic word embeddings, e.g., across time or domain. Current methods do not offer a way to use or predict information on structure between sub-corpora, time or domain and dynamic embeddings can only be compared after post-alignment. We propose novel word embedding methods that provide general word representations for the whole corpus, domain-specific representations for each sub-corpus, sub-corpus structure, and embedding alignment simultaneously. We present an empirical evaluat…

2022-10-06cs.CL

连点成线：使用纽约时报Connections文字游戏评估LLMs的抽象推理能力

Connecting the Dots: Evaluating Abstract Reasoning Capabilities of LLMs Using the New York Times Connections Word Game

Barnard College, Columbia University（哥伦比亚大学巴纳德学院）；Stony Brook University（石溪大学）

本文使用438个《纽约时报》Connections游戏评估LLMs的抽象推理能力，发现表现最好的Claude 3.5 Sonnet仅解决18%的游戏且不及人类玩家，并构建知识类型分类法揭示了LLMs在百科知识等非语义推理上的不足。

2024-10-14cs.AIcs.CL

Concise comparative summaries (CCS) of large text corpora with a human experiment

Peking University（北京大学）；Harvard University（哈佛大学）；University of California, Berkeley（加州大学伯克利分校）；San Francisco State University（旧金山州立大学）

In this paper we propose a general framework for topic-specific summarization of large text corpora and illustrate how it can be used for the analysis of news databases. Our framework, concise comparative summarization (CCS), is built on sparse classification methods. CCS is a lightweight and flexible tool that offers a compromise between simple word frequency based methods currently in wide use and more heavyweight, model-intensive methods such as latent Dirichlet allocation (LDA). We argue that sparse methods have much to offer for text analysis and hope CCS opens the door for a new branch o…

2014-04-29cs.CLstat.AP

更多相关论文收起更多论文

建立新联系：大型语言模型作为《纽约时报》连线单词游戏的谜题生成器

Making New Connections: LLMs as Puzzle Generators for The New York Times' Connections Word Game

New York University（纽约大学）；Jester Labs（杰斯特实验室）

本文研究GPT系列大语言模型生成《纽约时报》连线单词谜题的能力，提出基于思维树提示的生成方法，并通过用户研究证明AI能生成多样且富有挑战性和创造性的谜题。

2024-07-15cs.AIcs.CL

Learning language variations in news corpora through differential embeddings

Instituto Tecnológico de Buenos Aires（布宜诺斯艾利斯理工学院）；Universidad de Buenos Aires（布宜诺斯艾利斯大学）；CONICET（国家科学技术研究委员会）

There is an increasing interest in the NLP community in capturing variations in the usage of language, either through time (i.e., semantic drift), across regions (as dialects or variants) or in different social contexts (i.e., professional or media technolects). Several successful dynamical embeddings have been proposed that can track semantic change through time. Here we show that a model with a central word representation and a slice-dependent contribution can learn word embeddings from different corpora simultaneously. This model is based on a star-like representation of the slices. We appl…

2020-11-13cs.CLcs.LG

Down and Across: Introducing Crossword-Solving as a New NLP Benchmark

University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校）

Solving crossword puzzles requires diverse reasoning capabilities, access to a vast amount of knowledge about language and the world, and the ability to satisfy the constraints imposed by the structure of the puzzle. In this work, we introduce solving crossword puzzles as a new natural language understanding task. We release the specification of a corpus of crossword puzzles collected from the New York Times daily crossword spanning 25 years and comprised of a total of around nine thousand puzzles. These puzzles include a diverse set of clues: historic, factual, word meaning, synonyms/antonyms…

2022-05-20cs.AIcs.CL

Learning dynamic word embeddings with drift regularisation

LIMSI（机械与工程科学计算机实验室）；CNRS（法国国家科学研究中心）；Univ. Paris-Sud（巴黎第十一大学）；Univ. Paris-Saclay（巴黎萨克雷大学）；Société Générale（法国兴业银行）

Word usage, meaning and connotation change throughout time. Diachronic word embeddings are used to grasp these changes in an unsupervised way. In this paper, we use variants of the Dynamic Bernoulli Embeddings model to learn dynamic word embeddings, in order to identify notable properties of the model. The comparison is made on the New York Times Annotated Corpus in English and a set of articles from the French newspaper Le Monde covering the same period. This allows us to define a pipeline to analyse the evolution of words use across two languages.

2019-07-22cs.CLcs.LG

基于词中心语义图的可解释历时意义跟踪

Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking

University of Zurich（苏黎世大学）；TU Dortmund University（多特蒙德技术大学）

本文提出基于词中心语义图的方法，用于可解释地追踪词义随时间的变化，通过整合分布相似性和词汇替代性，揭示多义性动态和意义演变轨迹。

2026-01-29cs.CL

通过维基化增强的嵌入式主题模型

Embedded Topic Models Enhanced by Wikification

University of Tsukuba（筑波大学）

本文提出将维基百科知识融入神经主题模型以感知命名实体，实验表明该方法能提升模型泛化能力并更好地捕捉主题的时间演变。

2024-10-03cs.CL

Sentiment in New York City: A High Resolution Spatial and Temporal View

New England Complex Systems Institute（新英格兰复杂系统研究所）

Measuring public sentiment is a key task for researchers and policymakers alike. The explosion of available social media data allows for a more time-sensitive and geographically specific analysis than ever before. In this paper we analyze data from the micro-blogging site Twitter and generate a sentiment map of New York City. We develop a classifier specifically tuned for 140-character Twitter messages, or tweets, using key words, phrases and emoticons to determine the mood of each tweet. This method, combined with geotagging provided by users, enables us to gauge public sentiment on extremely…

2013-08-22cs.CLcs.CYphysics.soc-ph

Using Wordle for Learning to Design and Compare Strategies

National Chengchi University（国立政治大学）

Wordle is a very popular word game that is owned by the New York Times. We can design parameterized strategies for solving Wordle, based on probabilistic, statistical, and information-theoretical information about the games. The strategies can handle a reasonably large family of Wordle-like games both systematically and dynamically, meaning that we do not rely on precomputations that may work for non-fixed games. More specifically, the answer set can be arbitrary, not confining to the current 2315 words. The answer words may include any specific number of letters (does not have to be five), an…

2022-04-30cs.AIcs.CL