What is not where: the challenge of integrating spatial representations into deep learning architectures
ADAPT Centre for Digital Content Technology(ADAPT数字内容技术中心);Dublin Institute of Technology(都柏林理工学院);CLASP and FLOV(CLASP与FLOV);University of Gotenburg(哥德堡大学)
John D. Kelleher, Simon Dobnik
备注:
15 pages, 10 figures, Appears in CLASP Papers in Computational Linguistics Vol 1: Proceedings of the Conference on Logic and Machine Learning in Natural Language (LaML 2017), pp. 41-52
This paper examines to what degree current deep learning architectures for image caption generation capture spatial language. On the basis of the evaluation of examples of generated captions from the literature we argue that systems capture what objects are in the image data but not where these objects are located: the captions generated by these systems are the output of a language model conditioned on the output of an object detector that cannot capture fine-grained location information. Although language models provide useful knowledge for image captions, we argue that deep learning image captioning architectures should also model geometric relations between objects.
ITINERA: Integrating Spatial Optimization with Large Language Models for Open-domain Urban Itinerary Planning
Tutu AI(图图人工智能);University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);Massachusetts Institute of Technology(麻省理工学院);University of Michigan(密歇根大学);The Hong Kong Polytechnic University(香港理工大学)
A Generic Approach to Integrating Time into Spatial-Temporal Forecasting via Conditional Neural Fields
Paris Research Center, Huawei Technologies France(华为技术法国巴黎研究中心);IMT Atlantique(大西洋国立高等工业技术与矿业学校);Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);INRIA(法国国家信息与自动化研究所);LS2N(南特数字科学实验室);Orange Labs, France(法国Orange实验室)
Imaging-anchored multiomics in cardiovascular disease: integrating cardiac imaging, bulk, single-cell, and spatial transcriptomics
International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan;AIBioMed Research Group, Taipei Medical University, Taipei, Taiwan;Medical Sciences Division, University of Oxford, Oxford, United Kingdom;Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA;Department of Computer Science, Emory University, Atlanta, GA, USA;Department of Chemistry, Emory University, Atlanta, GA, USA;International Master Program for Translational Science, College of Medical Science;Technology, Taipei Medical University, Taipei 110, Taiwan;In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan;Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
Integrating Secondary Structures Information into Triangular Spatial Relationships (TSR) for Advanced Protein Classification
The School of Computing and Informatic, University of Louisiana at Lafayette(计算与信息学院,路易斯安那州立大学拉法叶分校);Department of Chemistry, University of Louisiana at Lafayette(化学系,路易斯安那州立大学拉法叶分校)
Integrating Dynamical Systems Modeling with Spatiotemporal scRNA-seq Data Analysis
School of Mathematical Sciences, Peking University(北京大学数学科学学院);Center for Machine Learning Research, Peking University(北京大学机器学习研究中心);Laboratory of Mathematics and Its Applications (LMAM), Peking University(北京大学数学及其应用实验室);Center for Quantitative Biology, Peking University(北京大学定量生物学中心);National Engineering Laboratory for Big Data Analysis and Applications, Peking University(北京大学大数据分析与应用国家工程实验室);AI for Science Institute, Beijing(北京科学智能研究院)