面向机器的图像编码(Image Coding for Machines,ICM)是一种用于图像识别的图像压缩技术。由于对图像识别人工智能的需求日益增长,这项技术变得至关重要。在本文中,我们提出了一种ICM方法,该方法专注于仅对图像中物体部分的边缘信息进行编码和解码,我们称之为SA-ICM。这是一个使用由Segment Anything生成的边缘信息训练的学习型图像压缩(Learned Image Compression,LIC)模型。我们的方法可用于具有各种任务的图像识别模型。SA-ICM对输入数据的变化也具有鲁棒性,使其在多种使用场景中有效。此外,我们的方法从隐私角度提供了益处,因为它在编码器端移除了人脸信息,从而保护了个人隐私。此外,这种LIC模型训练方法可用于训练神经视频表示(Neural Representations for Videos,NeRV),这是一种视频压缩模型。通过使用由Segment Anything生成的边缘信息训练NeRV,可以创建对图像识别有效的NeRV(SA-NeRV)。实验结果证实了SA-ICM的优势,在面向图像识别的图像压缩中呈现出最佳性能。我们还表明,SA-NeRV在面向机器的视频压缩中优于普通NeRV。代码可在https://github.com/final-0/SA-ICM获取。
英文摘要:
Image Coding for Machines (ICM) is an image compression technique for image recognition.
This technique is essential due to the growing demand for image recognition AI.
In this paper, we propose a method for ICM that focuses on encoding and decoding only the edge information of object parts in an image, which we call SA-ICM.
This is an Learned Image Compression (LIC) model trained using edge information created by Segment Anything.
Our method can be used for image recognition models with various tasks.
SA-ICM is also robust to changes in input data, making it effective for a variety of use cases.
Additionally, our method provides benefits from a privacy point of view, as it removes human facial information on the encoder's side, thus protecting one's privacy.
Furthermore, this LIC model training method can be used to train Neural Representations for Videos (NeRV), which is a video compression model.
By training NeRV using edge information created by Segment Anything, it is possible to create a NeRV that is effective for image recognition (SA-NeRV).
Experimental results confirm the advantages of SA-ICM, presenting the best performance in image compression for image recognition.
We also show that SA-NeRV is superior to ordinary NeRV in video compression for machines.
Code is available at https://github.com/final-0/SA-ICM.
Polyp-DAM: Polyp segmentation via depth anything model
Nanjing University of Science and Technology(南京理工大学);University of Science and Technology of China(中国科学技术大学);Sun Yat-sen University(中山大学);National University of Singapore(新加坡国立大学)
Nanyang Technological University(南洋理工大学);SenseTime Research(商汤科技研究院);Carnegie Mellon University(卡内基梅隆大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
TASAM: Terrain-and-Aware Segment Anything Model for Temporal-Scale Remote Sensing Segmentation
University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);Wuhan University(武汉大学);Dalian University of Technology(大连理工大学);University of Chinese Academy of Sciences(中国科学院大学)
Biomedical SAM 2: Segment Anything in Biomedical Images and Videos
University of Georgia(佐治亚大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Lehigh University(理海大学);Northeastern University(东北大学);University of Notre Dame(圣母大学)
Segment Anything Model Can Not Segment Anything: Assessing AI Foundation Model's Generalizability in Permafrost Mapping
Arizona State University(亚利桑那州立大学);Woodwell Climate Research Center(伍德韦尔气候研究中心);University of Connecticut(康涅狄格大学);U.S. Geological Survey(美国地质调查局);University of California, Santa Barbara(加利福尼亚大学圣巴巴拉分校);University of Illinois at Urbana-Champaign(伊利诺伊大学香槟分校)
本文评估了以 Meta SAM 为代表的视觉基础模型在永久冻土地貌分割中的表现,通过多种提示策略和微调测试其零样本能力与领域适应性,并指出其在挑战性地理空间任务中仍需改进。
SAMamba3D: adapting Segment Anything for generalizable 3D segmentation of multiphase pore-scale images
Department of Earth Science and Engineering, Imperial College London(帝国理工学院伦敦地球科学与工程系);College of Artificial Intelligence, China University of Petroleum (Beijing)(中国石油大学(北京)人工智能学院);College of Petroleum Engineering, China University of Petroleum (Beijing)(中国石油大学(北京)石油工程学院)
Cross Prompting Consistency with Segment Anything Model for Semi-supervised Medical Image Segmentation
The Chinese University of Hong Kong(香港中文大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Institute of Medical Intelligence and XR, The Chinese University of Hong Kong(香港中文大学医学智能与XR研究所)
提出 CPC-SAM,在双分支框架中通过 SAM 交叉提示和提示一致性正则化利用标注与未标注数据,显著提升半监督医学图像分割性能。