Entity6K:面向真实世界实体识别的大规模开放域评估数据集
Entity6K: A Large Open-Domain Evaluation Dataset for Real-World Entity Recognition
AI总结:
针对开放域实体识别缺乏评估数据的问题,提出包含5,700个实体、26个类别及人工验证图像标注的Entity6K数据集,并通过多任务基准测试验证其有效性。
摘要:
开放域真实世界实体识别至关重要但充满挑战,涉及在多样环境中识别各种实体。由于实体数量庞大且数据整理需要大量人力,缺乏合适的评估数据集一直是该领域的主要障碍。我们推出了Entity6K,一个全面的真实世界实体识别数据集,包含26个类别的5,700个实体,每个实体由5张人工验证的图像及其标注支持。Entity6K提供了多样化的实体名称和分类,填补了现有数据集的空白。我们使用现有模型在图像描述、目标检测、零样本分类和密集描述等任务上进行了基准测试,以展示Entity6K在评估模型实体识别能力方面的有效性。我们相信Entity6K将成为推动开放域场景中准确实体识别发展的宝贵资源。
英文摘要:
Open-domain real-world entity recognition is essential yet challenging, involving identifying various entities in diverse environments. The lack of a suitable evaluation dataset has been a major obstacle in this field due to the vast number of entities and the extensive human effort required for data curation. We introduce Entity6K, a comprehensive dataset for real-world entity recognition, featuring 5,700 entities across 26 categories, each supported by 5 human-verified images with annotations. Entity6K offers a diverse range of entity names and categorizations, addressing a gap in existing datasets. We conducted benchmarks with existing models on tasks like image captioning, object detection, zero-shot classification, and dense captioning to demonstrate Entity6K's effectiveness in evaluating models' entity recognition capabilities. We believe Entity6K will be a valuable resource for advancing accurate entity recognition in open-domain settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。