This manuscript (arXiv:2503.03215) is being withdrawn at the supervisor's request. The content is preliminary and needs further internal revision and approval before public release. We will resubmit a revised version after completion. Apologies for the inconvenience
Open Source Intelligence (OSINT) requires the integration and reasoning of diverse multimodal data, presenting significant challenges in deriving actionable insights. Traditional approaches, including multimodal large language models (MLLMs), often struggle to infer complex contextual relationships or deliver comprehensive intelligence from unstructured data sources. In this paper, we introduce COSINT-Agent, a knowledge-driven multimodal agent tailored to address the challenges of OSINT in the Chinese domain. COSINT-Agent seamlessly integrates the perceptual capabilities of fine-tuned MLLMs with the structured reasoning power of the Entity-Event-Scene Knowledge Graph (EES-KG). Central to COSINT-Agent is the innovative EES-Match framework, which bridges COSINT-MLLM and EES-KG, enabling systematic extraction, reasoning, and contextualization of multimodal insights. This integration facilitates precise entity recognition, event interpretation, and context retrieval, effectively transforming raw multimodal data into actionable intelligence. Extensive experiments validate the superior performance of COSINT-Agent across core OSINT tasks, including entity recognition, EES generation, and context matching. These results underscore its potential as a robust and scalable solution for advancing automated multimodal reasoning and enhancing the effectiveness of OSINT methodologies.
Exploring the Privacy Protection Capabilities of Chinese Large Language Models
School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机与信息技术学院);Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University(北京交通大学交通数据分析与挖掘北京市重点实验室);Key Laboratory of Big Data Artificial Intelligence in Transportation(Beijing Jiaotong University), Ministry of Education(交通大数据人工智能教育部重点实验室(北京交通大学))
LingLan: An Advancing Traditional Chinese Medicine Diagnosis LLM with Multimodal Data
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Guangdong Provincial Laboratory of Traditional Chinese Medicine Hengqin(广东省中医药横琴实验室)
Evidence-Based Intelligent Diagnostic and Therapeutic Visualization System with Large Language Models: Multi-Turn Interaction and Multimodal Treatment Plan Generation
Harbin Institute of Technology, Weihai(哈尔滨工业大学(威海));Harbin Institute of Technology (Weihai) Qingdao Research Institute(哈尔滨工业大学(威海)青岛研究院);Shandong Key Laboratory of Digital Service Computing Technology and Systems(山东省数字服务计算技术与系统重点实验室);Weihai Municipal Hospital(威海市人民医院);Shanghai Taizhu Technology Co., Ltd(上海泰山技术有限公司);Tianjin Zhifu Qihuang Medical Technology Co., Ltd(天津中孚启黄医疗技术有限公司)
An Empirical Study of Instruction-tuning Large Language Models in Chinese
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);APUS AiLMe Lab(APUS AiLMe实验室)
Shanghai East Hospital(上海东方医院);Tongji University School of Medicine(同济大学医学院);Institute of Ethnology and Anthropology(民族学与人类学研究所);Chinese Academy of Social Sciences(中国社会科学院)
NICE: A Theory-Grounded Diagnostic Benchmark for Social Intelligence of LLMs
Department of Psychology and Behavioral Sciences, Zhejiang University(浙江大学心理学与行为科学系);College of Artificial Intelligence, Zhejiang University(浙江大学人工智能学院);Human Machine Interaction Lab, Huawei Technologies Co., Ltd.(华为技术有限公司人机交互实验室);Zhejiang Key Laboratory of Neurocognitive Development and Mental Health(浙江省神经认知发展与心理健康重点实验室)
Can MLLMs Understand the Deep Implication Behind Chinese Images?
Huazhong University of Science and Technology(华中科技大学);Shenzhen Institute of Advanced Technology, CAS(中国科学院深圳先进技术研究院);University of Science and Technology of China(中国科学技术大学);CDUT(成都理工大学);University of Memphis(孟菲斯大学);University of California, Santa Barbara(加利福尼亚大学圣巴巴拉分校);SICAU(四川农业大学);University of Manchester(曼彻斯特大学);SWU(西南大学);UCAS(中国科学院大学);UMich(密歇根大学)
CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark
Multimodal Art Projection Research Community(多模态艺术投影研究共同体);Hong Kong University of Science and Technology(香港科技大学);University of Waterloo(滑铁卢大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Peking University(北京大学);The Hong Kong Polytechnic University(香港理工大学);Waseda University(早稻田大学);University of Manchester(曼彻斯特大学)
An Ontology-Based Artificial Intelligence Model for Medicine Side-Effect Prediction: Taking Traditional Chinese Medicine as An Example
School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);School of Electrical Engineering and Telecommunications, University of New South Wales(新南威尔士大学电气工程与电信学院);Faculty of Medicine, Ludwig Maximilian University of Munich(慕尼黑大学医学院);The First Clinical Medical College, Zhejiang Chinese Medicine University(浙江中医药大学第一临床医学院)
Leveraging Group Relative Policy Optimization to Advance Large Language Models in Traditional Chinese Medicine
University of Missouri(密苏里大学);Christopher S. Bond Life Sciences Center, University of Missouri(密苏里大学克里斯托弗·S·邦德生命科学中心);Community Health Service Center Shanghai Pudong New Area(上海市浦东新区社区卫生服务中心);Shanghai University of Traditional Chinese Medicine(上海中医药大学)
Lingdan-V2: Large language models for clinically grounded reasoning in traditional Chinese medicine
School of Computer Science & Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Tianjin Tasly Digital Chinese Medicine Technology Co., Ltd.(天津天士力数字中医药科技有限公司);Tasly Biopharmaceuticals Co., Ltd.(天士力生物制药有限公司);Affiliated Hospital of Hubei University of Chinese Medicine(湖北中医药大学附属医院);Da’an Health Technology (Beijing) Co., Ltd.(大安健康科技(北京)有限公司);Institute of Chinese Medicine Epidemic Disease, Beijing University of Chinese Medicine(北京中医药大学中医疫病研究所);Guang’anmen Hospital, China Academy of Chinese Medical Sciences(中国中医科学院广安门医院);Xiyuan Hospital, China Academy of Chinese Medical Sciences(中国中医科学院西苑医院)
M3GIA: A Cognition Inspired Multilingual and Multimodal General Intelligence Ability Benchmark
AutoLab, Westlake University(西湖大学AutoLab);Alibaba Group(阿里巴巴集团);Zhejiang University(浙江大学);Key Laboratory of Behavioral Science, Institute of Psychology, CAS(中国科学院心理研究所行为科学重点实验室);Key Laboratory of AI Safety, Institute of Computing Technology, CAS(中国科学院计算技术研究所人工智能安全重点实验室)
The impact of generative artificial intelligence on academic development of Chinese students in humanities and social sciences
Design School, Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学设计学院);School of Computer Science and Informatics, University of Liverpool(利物浦大学计算机科学与信息学院)
From Mind to Machine: The Rise of Manus AI as a Fully Autonomous Digital Agent
Department of Electrical and Computer Engineering, Virginia Tech(弗吉尼亚理工学院电气与计算机工程系);Department of Computer Science, Brown University(布朗大学计算机科学系);Department of Computer Science, University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系);Khoury College of Computer Sciences, Northeastern University(东北大学科里尔计算机科学学院)
FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examination
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Institute of Intelligent Computing Technology, Chinese Academy of Sciences(中国科学院智能计算技术研究所);Zhongke Shenjian (Suzhou) Technology Co., Ltd(中科神箭(苏州)科技有限公司)
From Binary to Bilingual: How the National Weather Service is Using Artificial Intelligence to Develop a Comprehensive Translation Program
Department of Climate, Meteorology & Atmospheric Sciences, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校气候、气象与大气科学系);Department of Communication, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校通信系);NOAA/National Weather Service Office of Central Processing(国家海洋和大气管理局/国家气象服务中央处理办公室);Department of Geography & Geographic Information Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校地理与地理信息科学系);Department of Atmospheric Sciences, University of North Dakota(北达科塔大学大气科学系);Pace University(帕克大学);NOAA/National Weather Service Office of Observations(国家海洋和大气管理局/国家气象服务观测办公室);LILT, Emeryville, CA(LILT,埃默里维尔,CA);NOAA/National Weather Service(国家海洋和大气管理局/国家气象服务);NOAA/NWS Southeast River Forecast Center(国家海洋和大气管理局/国家气象服务东南河预报中心);Cooperative Institute for Research in the Atmosphere, Colorado State University(大气研究合作研究所,科罗拉多州立大学);Center for Spatial Analysis, University of Oklahoma(空间分析中心,俄克拉荷马大学)
Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environments
Fudan University(复旦大学);Shanghai Innovation Institute(上海创新研究院);Huazhong University of Science and Technology(华中科技大学);University of Southern California(南加利福尼亚大学);Midu Technology(米度科技);Northwest University of Political and Law(西北政法大学)
AI Nushu: An Exploration of Language Emergence in Sisterhood -Through the Lens of Computational Linguistics
Royal College of Art(皇家艺术学院);Tsinghua University(清华大学);Politecnico di Milano(米兰理工大学);Hong Kong University of Science and Technology(香港科技大学);Ubisoft(育碧);New Drama Studio(新戏剧工作室);University of London(伦敦大学);King’s College London(伦敦国王学院)
From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs
School of Information Science, Beijing Language and Culture University(北京语言大学信息科学学院);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院)
EmoMeta: A Multimodal Dataset for Fine-grained Emotion Classification in Chinese Metaphors
School of Software(软件学院);Dalian University of Technology(大连理工大学);School of Foreign Languages and School of Software(外语学院和软件学院);Faculty of Business Administration(商学院);University of Macau(澳门大学);School of Computing Technologies(计算技术学院);RMIT University(皇家墨尔本理工大学)
Mastering Olympiad-Level Physics with Artificial Intelligence
School of Physics, Peking University(物理系,北京大学);School of Electronics Engineering and Computer Science, Peking University(电子工程与计算机科学系,北京大学);Center for High Energy Physics, Peking University(高能物理中心,北京大学)