AEC drawings encode geometry and semantics through symbols, layout conventions, and dense annotation, yet it remains unclear whether modern multimodal and vision-language models can reliably interpret this graphical language. We present AECV-Bench, a benchmark for evaluating multimodal and vision-language models on realistic AEC artefacts via two complementary use cases: (i) object counting on 120 high-quality floor plans (doors, windows, bedrooms, toilets), and (ii) drawing-grounded document QA spanning 192 question-answer pairs that test text extraction (OCR), instance counting, spatial reasoning, and comparative reasoning over common drawing regions. Object-counting performance is reported using per-field exact-match accuracy and MAPE results, while document-QA performance is reported using overall accuracy and per-category breakdowns with an LLM-as-a-judge scoring pipeline and targeted human adjudication for edge cases. Evaluating a broad set of state-of-the-art models under a unified protocol, we observe a stable capability gradient; OCR and text-centric document QA are strongest (up to 0.95 accuracy), spatial reasoning is moderate, and symbol-centric drawing understanding - especially reliable counting of doors and windows - remains unsolved (often 0.40-0.55 accuracy) with substantial proportional errors. These results suggest that current systems function well as document assistants but lack robust drawing literacy, motivating domain-specific representations and tool-augmented, human-in-the-loop workflows for an efficient AEC automation.
Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness
School of Computer Science, Engineering Research Center of Machine Learning and Industry Intelligence, Sichuan University(计算机科学学院,机器学习与产业智能工程研究中心,四川大学);School of Computer and Information Engineering, Xiamen University of Technology(计算机与信息工程学院,厦门理工大学);Department of Electrical and Computer Engineering, University of Hong Kong(电气与计算机工程系,香港大学);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testing
School of Cyber Science and Engineering, Sichuan University(四川大学网络空间安全学院);Institute for Network Sciences and Cyberspace, Tsinghua University(清华大学网络科学与网络空间研究院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);National University of Singapore(新加坡国立大学);College of Electronic Engineering, National University of Defense Technology(国防科技大学电子工程学院);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)
Beyond Correctness: Enhancing Architectural Reasoning in Code LLMs via Scalable Labeling with Agentic Judgment
Centre for Software Excellence, Huawei Canada(华为加拿大软件卓越中心);Department of Computer Science, University of Manitoba, Canada(曼尼托巴大学计算机科学系);School of Computing, Queen’s University, Canada(皇后大学计算科学学院)
Comprehensive Analysis of VQC for Financial Fraud Detection: A Comparative Study of Quantum Encoding Techniques and Architectural Optimizations
School of Science;Engineering, Al Akhawayn University, Ifrane, Morocco.;Engineering Sciences Laboratory,Polydisciplinary Faculty of Taza, Sidi Mohamed Ben Abdellah University, Fez, Morocco.;Signal Systems \& Components Laboratory, Faculty of Sciences;Technology, Sidi Mohamed Ben Abdellah University, Fez, Morocco.;University of Medina Saudi Arabia, Kingdom of Saudi Arabia
Video Understanding by Design: How Datasets Shape Video Models
School of Engineering and Built Environment, Electrical and Electronic Engineering, Griffith University(工程与建筑环境学院,电气与电子工程学院,格里菲斯大学);School of Computer Science and Engineering, University of New South Wales(计算机科学与工程学院,新南威尔士大学)