Text2Weight: Bridging Natural Language and Neural Network Weight Spaces
Deep Interdisciplinary Intelligence Lab(深度跨学科智能实验室);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The University of Cambridge(剑桥大学);Zhejiang University(浙江大学);Institute of Deep Perception Technology(深度感知技术研究所);Jiangsu Industrial Technology Research Institute(江苏省工业技术研究所)
How far are we really from automatically generating neural networks? While neural network weight generation shows promise, current approaches struggle with generalization to unseen tasks and practical application exploration. To address this, we propose T2W, a diffusion transformer framework that generates task-specific weights conditioned on natural language descriptions. T2W hierarchically processes network parameters into uniform blocks, integrates text embeddings from CLIP via a prior attention mechanism, and employs adversarial training with weight-space augmentation to enhance generalization. Experiments on Cifar100, Caltech256, and TinyImageNet demonstrate T2W's ability to produce high-quality weights for unseen tasks, outperforming optimization-based initialization and enabling novel applications such as weight enhancement and text-guided model fusion. Our work bridges textual semantics with weight-space dynamics, supported by an open-source dataset of text-weight pairs, advancing the practicality of generative models in neural network parameter synthesis. Our code is available on Github.
EmotionRankCLAP: Bridging Natural Language Speaking Styles and Ordinal Speech Emotion via Rank-N-Contrast
Center for Language and Speech Processing (CLSP), Johns Hopkins UniversityUSA(语言与语音处理中心(CLSP),约翰霍普金斯大学);The University of Texas at Dallas, USA(德克萨斯大学达拉斯分校);Amazon, USA(亚马逊);NUSSingapore(南洋理工大学);Language Technologies Institute (LTI), Carnegie Mellon UniversityUSA(语言技术研究所(LTI),卡内基梅隆大学)
Bridging the Gap between Probabilistic and Deterministic Models: A Simulation Study on a Variational Bayes Predictive Coding Recurrent Neural Network Model
KAIST(韩国科学技术院);Okinawa Institute of Science and Technology(冲绳科学技术大学院大学)
Bridging Formal Language with Chain-of-Thought Reasoning to Geometry Problem Solving
Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen International Center for Industrial and Applied Mathematics(深圳国际工业与应用数学中心)
Graphical einops: bridging tensor networks and computation graphs
Laboratory for Human-Centered AI, Department of Philosophy, University of Oxford(人类中心人工智能实验室,哲学系,牛津大学);Machine Learning Research Group, Department of Engineering Science, University of Oxford(机器学习研究组,工程科学系,牛津大学)