CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers
CMT-Benchmark:由专家研究人员构建的凝聚态理论基准
机构 * Rutgers University(罗格斯大学) ; Harvard University(哈佛大学) ; Weizmann Institute of Science(魏茨曼科学研究所) ; ETH Zürich(苏黎世联邦理工学院) ; Cornell University(康奈尔大学) ; Stanford University(斯坦福大学) ; University of Zürich(苏黎世大学) ; Stanford Institute for Materials and Energy Sciences(斯坦福材料与能源科学研究所) ; SLAC National Accelerator Laboratory(斯坦福直线加速器实验室) ; University of California, Los Angeles(加州大学洛杉矶分校) ; National Taiwan University(台湾大学) ; San José State University(圣何塞州立大学)
AI总结 CMT-Benchmark通过专家设计的50个凝聚态理论问题评估LLM在物理推理能力上的不足,揭示当前模型在复杂科学问题上的局限性。
Comments CMT-Benchmark dataset is available at https://huggingface.co/datasets/JVRoggeveen/cmt_benchmark. CMT-Benchmark was referenced in the Gemini 3 Deep Think (February 2026) release at https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-deep-think/
Journal ref International Conference on Learning Representations (ICLR) main conference 2026