A Multimodal Physics-Informed Neural Network Approach for Mean Radiant Temperature Modeling
School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院);College of Architecture, Kuwait University(科威特大学建筑学院);School of Arts, Media and Engineering, Arizona State University(亚利桑那州立大学艺术、媒体与工程学院)
Outdoor thermal comfort is a critical determinant of urban livability, particularly in hot desert climates where extreme heat poses challenges to public health, energy consumption, and urban planning. Mean Radiant Temperature ($T_{mrt}$) is a key parameter for evaluating outdoor thermal comfort, especially in urban environments where radiation dynamics significantly impact human thermal exposure. Traditional methods of estimating $T_{mrt}$ rely on field measurements and computational simulations, both of which are resource intensive. This study introduces a Physics-Informed Neural Network (PINN) approach that integrates shortwave and longwave radiation modeling with deep learning techniques. By leveraging a multimodal dataset that includes meteorological data, built environment characteristics, and fisheye image-derived shading information, our model enhances predictive accuracy while maintaining physical consistency. Our experimental results demonstrate that the proposed PINN framework outperforms conventional deep learning models, with the best-performing configurations achieving an RMSE of 3.50 and an $R^2$ of 0.88. This approach highlights the potential of physics-informed machine learning in bridging the gap between computational modeling and real-world applications, offering a scalable and interpretable solution for urban thermal comfort assessments.
Learning to Weigh Waste: A Physics-Informed Multimodal Fusion Framework and Large-Scale Dataset for Commercial and Industrial Applications
Department of Computer Science and Engineering, United International University(计算机科学与工程系,国际大学);Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory(应用人工智能与智能系统实验室);Department of Data Science and Artificial Intelligence, Monash University(数据科学与人工智能系,墨尔本大学);Faculty of Science and Technology, Charles Darwin University(科学与技术学院,查尔斯达尔文大学);Faculty of Arts and Society, Charles Darwin University(艺术与社会学院,查尔斯达尔文大学)
Stress-Testing Multimodal Foundation Models for Crystallographic Reasoning
Dept. of Electrical and Computer Engineering, Texas A&M University(电气与计算机工程系,德克萨斯A&M大学);College of Science and Engineering, Hamad Bin Khalifa University(科学与工程学院,哈马德·本·卡西姆大学);Dept. of Electrical and Computer Engineering, Texas A&M University at Qatar(电气与计算机工程系,德克萨斯A&M大学(卡塔尔));Dept. of Prosthetics and Orthotics, Ankara University(假肢与矫形系,安卡拉大学)
OE-BevSeg: An Object Informed and Environment Aware Multimodal Framework for Bird's-eye-view Vehicle Semantic Segmentation
School of Vehicle and Mobility, Tsinghua University(清华大学车辆与 Mobility学院);State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University(清华大学智能绿色车辆与交通全国重点实验室);Department of Computer and Information Science, University of Macau(澳门大学计算机与信息科学系)
A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy
Department of Radiation Oncology, Mayo Clinic, Phoenix, Arizona, USA(梅奥诊所放射肿瘤科);School of Biomedical Engineering, ShanghaiTech University, Shanghai, China(上海科技大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd., Shanghai 200230, China(上海联合影像智能科技有限公司);Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China(上海人工智能实验室);Shanghai Clinical Research and Trial Center, Shanghai 201210, China(上海临床研究与试验中心)
A physics-informed, behavior-aware digital twin for robust multimodal forecasting of core body temperature in precision livestock farming
Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory(应用人工智能与智能系统实验室);Department of Computer Science and Engineering(计算机科学与工程系);Department of Data Science and Artificial Intelligence(数据科学与人工智能系);Department of Software Systems & Cybersecurity(软件系统与网络安全系);Energy and Resources Institute, Faculty of Science and Technology(能源与资源研究所,科学与技术学院);Faculty of Science and Technology(科学与技术学院);School of Engineering and Energy(工程与能源学院)
Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models
University of British Columbia(不列颠哥伦比亚大学);Zuse School(Zuse学校);Qatar Computing Research Institute (QCRI)(卡塔尔计算研究所);Hamad Bin Khalifa University(哈马德·本·哈利法大学)
BigTokDetect: A Clinically-Informed Vision-Language Modeling Framework for Detecting Pro-Bigorexia Videos on TikTok
USC Information Sciences Institute(USC信息科学研究所);Keck School of Medicine, USC(USC凯克医学院);Department of Clinical Psychology, Drexel University(德雷塞尔大学临床心理学系);Department of Psychiatry and Biobehavioral Sciences, UCLA(UCLA精神病学与生物行为科学系)
GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement
Institute of Material Systems Modeling(材料系统建模研究所);Helmholtz Zentrum Hereon(海德堡研究中心Hereon);Institute of Material and Process Design(材料与加工设计研究所);German Research Center for Artificial Intelligence(德国人工智能研究中心)
QuPAINT: Physics-Aware Instruction Tuning Approach to Quantum Material Discovery
CVIU Lab, University of Arkansas, USA(Arkansas大学计算机视觉实验室);University of Utah, USA(犹他大学);Department of Physics, University of Arkansas, USA(Arkansas大学物理系)