Cattle-CLIP: A Multimodal Framework for Dairy Cattle Behaviour Recognition from Video
Bristol Veterinary School, University of Bristol(布里斯托尔大学布里斯托尔兽医学院);School of Computer Science, University of Bristol(布里斯托尔大学计算机科学学院);Joint Institute of Qingdao Huanghai University and WeITec, Qingdao Huanghai University(青岛黄海学院与WeITec联合学院,青岛黄海学院)
Huimin Liu, Jing Gao, Daria Baran, Axel X Montout, Neill W Campbell, Andrew W Dowsey
Monitoring cattle behaviour provides valuable insights into animal health, productivity and welfare. However, robust behaviour recognition in real-world farm environments remains challenging because well-annotated livestock video datasets are scarce and agricultural surveillance footage differs substantially from large-scale pretraining data. To address these challenges, we propose Cattle-CLIP, a domain-adaptive vision-language framework based on Contrastive Language-Image Pretraining (CLIP), which reformulates cattle behaviour recognition as a cross-modal semantic alignment task. Cattle-CLIP incorporates a temporal integration module that extends image-level contrastive pretraining to video-based behaviour understanding and promotes consistent semantic alignment across time. To reduce domain discrepancy, customised data augmentation and behaviour-oriented prompts are employed. We also construct CattleBehaviours6, a curated dataset containing 1,905 annotated clips from six indoor behaviours: feeding, drinking, standing-self-grooming, standing-ruminating, lying-self-grooming and lying-ruminating. The dataset provides standardised ethogram definitions for model training, evaluation and future livestock behaviour research. Cattle-CLIP was evaluated under supervised and few-shot learning settings, with particular emphasis on data-constrained behaviour recognition. In supervised experiments, the model achieved 96.1% accuracy across six behaviours and showed high precision and recall for feeding, drinking and standing-ruminating. It also maintained promising few-shot performance with limited labelled data, demonstrating the potential of multimodal learning for cattle behaviour recognition in data-constrained farm environments.
U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025
Faculty of Information Technology, University of Science, VNU-HCM(越南国家大学胡志明市分校信息科技学院);Vietnam National University, Ho Chi Minh City, Vietnam(越南国家大学胡志明市分校)
MagicAnime: A Hierarchically Annotated, Multimodal and Multitasking Dataset with Benchmarks for Cartoon Animation Generation
National Centre for Computer Animation, Bournemouth University(伯恩茅斯大学计算机动画国家中心);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Hong Kong University of Science and Technology(香港科技大学);Department of Computer Science and Information Engineering, National Cheng Kung University(国立成功大学计算机科学与信息工程系)
ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP
Khalifa University(卡利法大学);University of Western Australia(西澳大学);The Chinese University of Hong Kong(香港中文大学);University of Melbourne(墨尔本大学);University of Central Florida(佛罗里达中央大学)
Direct Video-Based Spatiotemporal Deep Learning for Cattle Lameness Detection
Department of Software Engineering(软件工程系);Daffodil International University(达福尔国际大学);Department of Computer Science, Faculty of Computer Science and Information Technology(计算机科学系);King Faisal University(国王法赫德大学)
CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院);National University of Singapore(新加坡国立大学);Meituan(美团);Georgia Institute of Technology(佐治亚理工学院);Picsart AI Research (PAIR)(Picsart AI研究(PAIR))
CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction
Chalmers University of Technology(查尔姆斯理工大学);Umeå University(于默奥大学);Sahlgrenska University Hospital(萨尔格伦斯卡大学医院);Sahlgrenska Academy at Gothenburg University(哥德堡大学萨尔格伦斯卡学院)
Extracting Multimodal Learngene in CLIP: Unveiling the Multimodal Generalizable Knowledge
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其跨学科应用关键实验室)
UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editing
Center for Data Science, Peking University(北京大学数据科学中心);Alibaba Group(阿里巴巴集团);CASIA;Center for Machine Learning Research, Peking University(北京大学机器学习研究中心);State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室)
GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding
China Agricultural University(中国农业大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);AniEye Technology(安尼眼科技);State Key Laboratory of Animal Nutrition and Feeding(动物营养与饲料国家重点实验室)
MA-FSAR: Multimodal Adaptation of CLIP for Few-Shot Action Recognition
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);Alibaba Group(阿里巴巴集团);College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);SGIT AI Lab, State Grid Corporation of China(中国国家电网有限公司SGIT人工智能实验室);Baidu(百度);Institute of AI (TeleAI)(中国电信人工智能研究院(TeleAI));School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能与光学电子学院(iOPEN))
UniCrossAdapter: Multimodal Adaptation of CLIP for Radiology Report Generation
Wuhan University of Technology(武汉理工大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);MedAI Technology (Wuxi) Co. Ltd.(MedAI科技(无锡)有限公司);Technical University of Munich(慕尼黑工业大学)
CLIP-IT: CLIP-based Pairing for Histology Images Classification
LIVIA, ILLS, Dept. of Systems Engineering, ETS Montreal, Canada(LIVIA、ILLs、系统工程系、蒙特利尔大学ETSMontreal加拿大);Dept. of Computer Engineering, University of Cagliari, Italy(计算机工程系、卡利亚里大学意大利);Goodman Cancer Research, Centre, Dept. of Oncology, McGill University, Canada(Goodman癌症研究中心、肿瘤学系、麦吉尔大学加拿大)
Image-to-Brain Signal Generation for Visual Prosthesis with CLIP Guided Multimodal Diffusion Models
Jinan University, Guangzhou, China;Department of Rehabilitation Medicine, The First Affiliated Hospital of Jinan University, Guangzhou, China;Western University, Ontario, Canada;Guangdong University of Technology, Guangzhou, China;Tsinghua University, Beijing, China
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所)
CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection
Institute for Analytics and Data Science, University of Essex(埃塞克斯大学分析与数据科学研究所);University of Exeter(埃克塞特大学);Queen Mary University of London(伦敦大学玛丽皇后学院)
CLIP-Optimized Multimodal Image Enhancement via ISP-CNN Fusion for Coal Mine IoVT under Uneven Illumination
School of Artificial Intelligence, China University of Mining and Technology (Beijing)(中国矿业大学(北京)人工智能学院);Ministry of Emergency Management Big Data Center(应急管理部大数据中心)
Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC
Xi'an Jiaotong University(西安交通大学);Queen Mary University of London(伦敦女王玛丽大学);Center for Multimodal AI(多模态人工智能中心);Digital Environment Research Institute(数字环境研究院)
Defending Multimodal Backdoored Models by Repulsive Visual Prompt Tuning
Southeast University(东南大学);University of Queensland(昆士兰大学);Nanyang Technological University(南洋理工大学);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学)