Crisis responders are increasingly using social media, data and other digital sources of information to build a situational understanding of a crisis situation in order to design an effective response. However with the increased availability of such data, the challenge of identifying relevant information from it also increases. This paper presents a successful automatic approach to handling this problem. Messages are filtered for informativeness based on a definition of the concept drawn from prior research and crisis response experts. Informative messages are tagged for actionable data -- for example, people in need, threats to rescue efforts, changes in environment, and so on. In all, eight categories of actionability are identified. The two components -- informativeness and actionability classification -- are packaged together as an openly-available tool called Emina (Emergent Informativeness and Actionability).
Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for Summarization
New York University(纽约大学);ADAPT Centre, DCU(都柏林城市大学ADAPT中心);IBM Research(IBM研究院);Google(谷歌);Google Research(谷歌研究院);Yale University(耶鲁大学);trivago N.V.(途易集团);University of Edinburgh(爱丁堡大学);Allen Institute for AI(艾伦人工智能研究所)
Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find
Center for Alzheimer’s Disease and Related Dementias, NIA, NIH(阿尔茨海默病及相关痴呆症研究中心,国家老龄化研究所,国家卫生研究院);DataTecnica LLC(DataTecnica公司);Johns Hopkins University(约翰霍普金斯大学);Laboratory of Neurogenetics, NIA, NIH(神经遗传学实验室,国家老龄化研究所,国家卫生研究院)
U-NIAH: Unified RAG and LLM Evaluation for Long Context Needle-In-A-Haystack
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(同济大学上海智能自主系统研究院);School of Computer Science, Fudan University(复旦大学计算机科学技术学院);College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(南京航空航天大学人工智能学院);College of Design and Innovation, Tongji University(同济大学设计与创新学院)
Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation
Instituto de Telecomunicações(电信研究所);Instituto Superior Técnico(高等技术学院);LUMLIS (Lisbon ELLIS Unit)(LUMLIS(里斯本ELLIS单元));University of Edinburgh(爱丁堡大学);Unbabel(Unbabel公司)
NeMo: Needle in a Montage for Video-Language Understanding
The Chinese University of Hong Kong(香港中文大学);Phoenix TV(凤凰电视台);Stanford University(斯坦福大学);University of Liverpool(利物浦大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校)