Auto-X3D: Ultra-Efficient Video Understanding via Finer-Grained Neural Architecture Search
University of Texas at Austin(德克萨斯大学奥斯汀分校);Texas A&M University(德克萨斯农工大学);University of Oregon(俄勒冈大学);Picsart AI Research (PAIR)(Picsart人工智能研究院);Facebook AI(Facebook人工智能研究院)
Efficient video architecture is the key to deploying video recognition systems on devices with limited computing resources. Unfortunately, existing video architectures are often computationally intensive and not suitable for such applications. The recent X3D work presents a new family of efficient video models by expanding a hand-crafted image architecture along multiple axes, such as space, time, width, and depth. Although operating in a conceptually large space, X3D searches one axis at a time, and merely explored a small set of 30 architectures in total, which does not sufficiently explore the space. This paper bypasses existing 2D architectures, and directly searched for 3D architectures in a fine-grained space, where block type, filter number, expansion ratio and attention block are jointly searched. A probabilistic neural architecture search method is adopted to efficiently search in such a large space. Evaluations on Kinetics and Something-Something-V2 benchmarks confirm our AutoX3D models outperform existing ones in accuracy up to 1.3% under similar FLOPs, and reduce the computational cost up to x1.74 when reaching similar performance.
FINER: MLLMs Hallucinate under Fine-grained Negative Queries
Technical University of Munich(慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Helmholtz Munich(海德堡-慕尼黑亥姆霍尔茨中心);Google(谷歌);LTCI, Télécom Paris, Institut Polytechnique de Paris(LTCI,巴黎电信学院,巴黎理工学院)
Fine-Grained Representation Learning and Recognition by Exploiting Hierarchical Semantic Embedding
Sun Yat-sen University(中山大学);South China Agricultural University(华南农业大学);University of Electronic Science and Technology of China(电子科技大学);Guilin University of Electronic Technology(桂林电子科技大学)
School of Computer Science, Peking University(北京大学计算机学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机学院);School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Peking University(北京大学深圳研究生院电子与计算机工程学院)
FineRS: Fine-grained Reasoning and Segmentation of Small Objects with Reinforcement Learning
Dalian University of Technology(大连理工大学);University of Electronic Science and Technology of China(电子科技大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际graduate school)
Unveiling Parts Beyond Objects:Towards Finer-Granularity Referring Expression Segmentation
Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS)(中国科学院大学人工智能学院);Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院);University of Science and Technology Beijing (USTB)(北京科技大学)
Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding
Fudan University(复旦大学);NVIDIA(英伟达);Shanghai Key Lab of Intell. Info. Processing(上海智能信息处理重点实验室);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心)
Investigating Fine- and Coarse-grained Structural Correspondences Between Deep Neural Networks and Human Object Image Similarity Judgments Using Unsupervised Alignment
Graduate School of Arts and Science, University of Tokyo(东京大学艺术与科学研究生院)