Lost in Tokenization: Context as the Key to Unlocking Biomolecular Understanding in Scientific LLMs
Kai Zhuang, Jiawei Zhang, Yumou Liu, Hanqun Cao, Chunbin Gu, Mengdi Liu, Zhangyang Gao, Zitong Jerry Wang, Xuanhe Zhou, Pheng-Ann Heng, Lijun Wu, Conghui He, Cheng Tan
机构
*
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Westlake University(西交大学)
;
Shanghai Innovation Institute(上海创新研究院)
;
Shanghai Jiaotong University(上海交通大学)
;
The Chinese University of Hong Kong(香港中文大学)
;
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
On the creation of narrow AI: hierarchy and nonlocality of neural network skills
Eric J. Michaud, Asher Parker-Sartori, Max Tegmark
机构
*
Department of Physics, Massachusetts Institute of Technology(物理学系,麻省理工学院)
;
Department of EECS, Massachusetts Institute of Technology(电子工程与计算机科学系,麻省理工学院)
;
The NSF AI Institute for Artificial Intelligence and Fundamental Interactions(国家科学基金会人工智能与基本相互作用研究所)