Recently, there has been a growing interest among researchers in understanding molecules and their textual descriptions through molecule language models (MoLM). However, despite some early promising developments, the advancement of MoLM still trails significantly behind that of vision language models (VLM). This is because unique challenges exist apart from VLM in the field of MoLM due to 1) a limited amount of molecule-text paired data and 2) missing expertise that occurred due to the specialized areas of focus among the experts. To this end, we propose AMOLE, which 1) augments molecule-text pairs with structural similarity preserving loss, and 2) transfers the expertise between the molecules. Specifically, AMOLE enriches molecule-text pairs by sharing descriptions among structurally similar molecules with a novel structural similarity preserving loss. Moreover, we propose an expertise reconstruction loss to transfer knowledge from molecules that have extensive expertise to those with less expertise. Extensive experiments on various downstream tasks demonstrate the superiority of AMOLE in comprehending molecules and their descriptions, highlighting its potential for application in real-world drug discovery. The source code for AMOLE is available at https://github.com/Namkyeong/AMOLE.
Self-Aware Safety Augmentation: Leveraging Internal Semantic Understanding to Enhance Safety in Vision-Language Models
Shanghai Key Laboratory of Computer Software Testing and Evaluating(上海软件测试与评估 key laboratory);Shanghai Normal University(上海Normal University);TrustAI Pte. Ltd.;East China Normal University(东华师范大学)
Stitch and Tell: A Structured Multimodal Data Augmentation Method for Spatial Understanding
School of Computer Science, Beijing Institute of Technology(北京理工大学计算机科学学院);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);Xiaohongshu Inc(小红书公司)
Stitch and Tell通过结构化空间监督提升视觉-语言模型的空间理解能力,有效缓解空间幻觉并提高相关任务性能。
TTA-OOD: Test-time Augmentation for Improving Out-of-Distribution Detection in Gastrointestinal Vision
Nepal Applied Mathematics and Informatics Institute for research(NAAMII)(尼泊尔应用数学与信息学研究所(NAAMII));Fogsphere(Redev AI Ltd.)(Fogsphere(Redev AI有限公司));School of Natural and Computing Sciences, University of Aberdeen(阿伯丁大学自然与计算科学学院);West Virginia University(西弗吉尼亚大学)
Detection of pulmonary pathologies using convolutional neural networks, Data Augmentation, ResNet50 and Vision Transformers
Universidad Abierta Interamericana(泛美开放大学);Faculty of Information Technology(信息技术学院);Center for Advanced Studies in Information Technology(信息技术高级研究中心);Interamerican Open University(泛美开放大学)
Scaffold-Aware Generative Augmentation and Reranking for Enhanced Virtual Screening
Yale University(耶鲁大学);University of Oregon(俄勒冈大学);Broad Institute of MIT and Harvard(MIT和哈佛大学Broad研究所);Leipzig University(莱比锡大学);Vanderbilt University(范德比大学)
AugVLA-3D: Depth-Driven Feature Augmentation for Vision-Language-Action Models
Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Department of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学计算机科学与工程系);School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);School of Information Technology, Carleton University(卡尔顿大学信息技术学院)
Comprehensive pKa Data Augmentation from Limited Real Data through an Engineered Models-Quantum Framework
Department of Chemistry, Tsinghua University(清华大学化学系);Department of Chemical Engineering, Tsinghua University(清华大学化学工程系);School of Science, China Pharmaceutical University(中国药科大学理学院)
Ctrl-A: Control-Driven Machine Learning using Adaptive Online Data Augmentation
Danish Fundamental Metrology (DFM)(丹麦基础计量院);National Physical Laboratory (NPL)(国家物理实验室);TÜV SÜD;Royal Surrey NHS Foundation Trust(皇家萨里国家健康服务基金会信托);Istituto Nazionale di Ricerca Metrologica (INRiM)(意大利国家计量研究院)
SA-Attack: Improving Adversarial Transferability of Vision-Language Pre-training Models via Self-Augmentation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学);Sun Yat-sen University(中山大学)
Institute of Biomedical Sciences(生物医学科学研究所);Universidad de Chile(智利大学);Universidad de Santiago(圣地亚哥大学);Institute of Informatics(信息学研究所);Universidad Austral de Chile(智利奥斯特拉尔大学)