Computational modeling of artwork meaning is complex and difficult. This is because art interpretation is multidimensional and highly subjective. This paper experimentally investigated the degree to which a state-of-the-art Deep Convolutional Neural Network (DCNN), a popular Machine Learning approach, can correctly distinguish modern conceptual art work into the galleries devised by art curators. Two hypotheses were proposed to state that the DCNN model uses Exhibited Properties for classification, like shape and color, but not Non-Exhibited Properties, such as historical context and artist intention. The two hypotheses were experimentally validated using a methodology designed for this purpose. VGG-11 DCNN pre-trained on ImageNet dataset and discriminatively fine-tuned was trained on handcrafted datasets designed from real-world conceptual photography galleries. Experimental results supported the two hypotheses showing that the DCNN model ignores Non-Exhibited Properties and uses only Exhibited Properties for artwork classification. This work points to current DCNN limitations, which should be addressed by future DNN models.
FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding
Lappeenranta-Lahti University of Technology LUT(拉佩兰塔-拉赫蒂技术大学);Tianjin University(天津大学);AMD Silo AI;Great Bay University(大湾大学);Rensselaer Polytechnic Institute(雷士大学);Brno University of Technology(布拉格技术大学)
The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Massachusetts Institute of Technology(麻省理工学院);South China University of Technology(华南理工大学);Tsinghua University(清华大学);Shanghai Qi Zhi Institute(上海期智研究院)
MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education
AI Singapore, National University of Singapore(新加坡国立大学新加坡人工智能);School of Computing, National University of Singapore(新加坡国立大学计算学院);Institute of Advanced Intelligence and Computing, A*STAR(新加坡科技研究局先进智能与计算研究所)
Werner Reichardt Centre for Integrative Neuroscience(维尔纳·赖卡特整合神经科学中心);Institute of Theoretical Physics, University of Tübingen(图宾根大学理论物理研究所);Bernstein Center for Computational Neuroscience(伯恩斯坦计算神经科学中心);Max Planck Institute for Biological Cybernetics(马克斯·普朗克生物控制论研究所);Baylor College of Medicine(贝勒医学院);Graduate School for Neural Information Processing(神经信息处理研究生院)
PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings
Case Western Reserve University(凯斯西储大学);Department of Physics(物理系);Department of Art History and Art(艺术史与艺术系);The Frick Pittsburgh Museums and Gardens(弗里克匹兹堡博物馆和花园);Department of Computer and Data Sciences(计算机与数据科学系);MORE Center(MORE中心);Cleveland Institute of Art(克利夫兰艺术学院);Factum Foundation(Factum基金会)
RGBX-R1: Visual Modality Chain-of-Thought Guided Reinforcement Learning for Multimodal Grounding
School of Artificial Intelligence, Tianjin University(天津大学人工智能学院);Low-Altitude Intelligence Lab, Xiong’an National Innovation Center(雄安国家创新中心低空智能实验室);Xiong’an Guochuang Lantian Technology Co., Ltd.(雄安国创莲田科技有限公司);College of Electronic Science and Technology, National University of Defense Technology(国防科技大学电子科学学院)
Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action Understanding
Zhejiang Gongshang University(浙江工商大学);Peking University(北京大学);Zhejiang Key Lab of E-Commerce(浙江省电子商务重点实验室);Huazhong University of Science and Technology(华中科技大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Science and Technology of China(中国科学技术大学);Hefei University of Technology(合肥工业大学)
From Consistency to Complementarity: Aligned and Disentangled Multi-modal Learning for Time Series Understanding and Reasoning
The Hong Kong University of Science(香港科学与技术大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)
Directed-Tokens: A Robust Multi-Modality Alignment Approach to Large Language-Vision Models
CVIU Lab, University of Arkansas, USA(美国亚拉巴马大学CVIU实验室);Vietnam National University, Ho Chi Minh City University of Science, Vietnam(越南国家大学胡志明市科技大学);Carnegie Mellon University, USA(美国卡内基梅隆大学)
NEARL: Interacted Query Adaptation with Orthogonal Regularization for Medical Vision-Language Understanding
MoE Key Lab of Artificial Intelligence(人工智能MOE实验室);AI Institute(人工智能研究院);School of Computer Science(计算机科学学院);Shanghai Jiao Tong University(上海交通大学);Department of Radiology(放射科);The First Affiliated Hospital(第一附属医院);School of Medicine(医学院);Zhejiang University(浙江大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);State Key Laboratory of Infrared Physics(红外物理国家重点实验室);Shanghai Institute of Technical Physics(上海技术物理研究所);Chinese Academy of Science(中国科学院)
3DCity-LLM: Empowering Multi-modality Large Language Models for 3D City-scale Perception and Understanding
School of Geospatial Engineering and Science(测绘工程与科学学院);Sun Yat-sen University(中山大学);College of Electronic Science(电子科学学院);National University of Defense Technology(国防科技大学);Department of Civil and Environmental Engineering(土木与环境工程系);Norwegian University of Science and Technology(挪威科技大学);National Geomatics Center of China(中国国家测绘地理信息中心)