We propose the new task of K principal concept identification for dataset summarizarion. The objective is to find a set of K concepts that best explain the variation within the dataset. Concepts are high-level human interpretable terms such as "tiger", "kayaking" or "happy". The K concepts are selected from a (potentially long) input list of candidates, which we denote the concept-bank. The concept-bank may be taken from a generic dictionary or constructed by task-specific prior knowledge. An image-language embedding method (e.g. CLIP) is used to map the images and the concept-bank into a shared feature space. To select the K concepts that best explain the data, we formulate our problem as a K-uncapacitated facility location problem. An efficient optimization technique is used to scale the local search algorithm to very large concept-banks. The output of our method is a set of K principal concepts that summarize the dataset. Our approach provides a more explicit summary in comparison to selecting K representative images, which are often ambiguous. As a further application of our method, the K principal concepts can be used to classify the dataset into K groups. Extensive experiments demonstrate the efficacy of our approach.
Rethinking Scientific Summarization Evaluation: Grounding Explainable Metrics on Facet-aware Benchmark
King Abdullah University of Science and Technology(国王阿卜杜勒·阿齐兹科技大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);National Institutes of Health(美国国家卫生研究院);University of Notre Dame(诺特难大学);Shandong University(山东大学)
A Unified Framework for Generic, Query-Focused, Privacy Preserving and Update Summarization using Submodular Information Measures
Department of Computer Science, Indian Institute of Technology Bombay(印度理工学院孟买分校计算机科学系);Department of Computer Science, University of Texas at Dallas(得克萨斯大学达拉斯分校计算机科学系);Department of Electrical and Computer Engineering, University of Washington, Seattle(华盛顿大学西雅图分校电气与计算机工程系);School of Technology and Computer Science, Tata Institute of Fundamental Research, Mumbai(塔塔基础研究所孟买技术与计算机科学学院)