Time series reasoning demands both the perception of complex dynamics and logical depth. However, existing LLM-based approaches exhibit two limitations: they often treat time series merely as text or images, failing to capture the patterns like trends and seasonalities needed to answer specific questions; and when trained on a mix of simple and complex tasks, simpler objectives often dominate the learning process, hindering the development of deep reasoning capabilities. To address these limitations, we propose the Pattern-Aware Alignment and Balanced Reasoning model (PATRA), introducing a pattern-aware mechanism that extracts trend and seasonality patterns from time series to achieve deep alignment. Furthermore, we design a task-aware balanced reward to harmonize learning across tasks of varying difficulty, incentivizing the generation of coherent Chains of Thought. Extensive experiments show that PATRA outperforms strong baselines across diverse Time Series Question Answering (TSQA) tasks, demonstrating superior cross-modal understanding and reasoning capability.
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question Answering
Khoury College of Computer Sciences, Northeastern University(东北大学克劳尔计算机科学学院);New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室)
Exploring Diverse Methods in Visual Question Answering
University of Michigan(密歇根大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Chongqing University(重庆大学);Columbia University(哥伦比亚大学);University of Chicago(芝加哥大学)
Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);Zhongguancun Academy(中关村学院);Shenzhen Loop Area Institute(深圳河套学院)
Vision-language models for chest radiography do not always need the image
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃尔朗根-纽伦堡大学模式识别实验室);Department of Diagnostic and Interventional Radiology, TUM University Clinic, School of Medicine and Health, Klinikum rechts der Isar, Technical University of Munich(慕尼黑工业大学医学院与健康学院伊萨尔河右岸医院诊断与介入放射学系);Lab for AI in Medicine, RWTH Aachen University(亚琛工业大学医学人工智能实验室);Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen(亚琛工业大学医院诊断与介入放射学系)
PVChat: Personalized Video Chat with One-Shot Learning
MedVisAI Lab(MedVisAI实验室);National University of Singapore(新加坡国立大学);Nankai University(南开大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室(深圳));Lee Kong Chian School of Medicine, Nanyang Technological University(南洋理工大学李科谦医学院)