首页/论文/1702.02744

arXiv 1702.027442017-02-09cs.CV

L1-regularized Reconstruction Error as Alpha Matte

Nanyang Technological University（南洋理工大学）

Jubin Johnson, Hisham Cholakkal, Deepu Rajan

备注：: 5 pages, 5 figure, Accepted in IEEE Signal Processing Letters
DOI：: 10.1109/LSP.2017.2666180

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Sampling-based alpha matting methods have traditionally followed the compositing equation to estimate the alpha value at a pixel from a pair of foreground (F) and background (B) samples. The (F,B) pair that produces the least reconstruction error is selected, followed by alpha estimation. The significance of that residual error has been left unexamined. In this letter, we propose a video matting algorithm that uses L1-regularized reconstruction error of F and B samples as a measure of the alpha matte. A multi-frame non-local means framework using coherency sensitive hashing is utilized to ensure temporal coherency in the video mattes. Qualitative and quantitative evaluations on a dataset exclusively for video matting demonstrate the effectiveness of the proposed matting algorithm.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search

Brown University（布朗大学）；Facebook AI Research（Facebook人工智能研究院）

Neural Architecture Search (NAS) has shown great success in automating the design of neural networks, but the prohibitive amount of computations behind current NAS methods requires further investigations in improving the sample efficiency and the network evaluation cost to get better results in a shorter time. In this paper, we present a novel scalable Monte Carlo Tree Search (MCTS) based NAS agent, named AlphaX, to tackle these two aspects. AlphaX improves the search efficiency by adaptively balancing the exploration and exploitation at the state level, and by a Meta-Deep Neural Network (DNN)…

2019-10-02cs.CV

Hierarchical and Progressive Image Matting

Dalian University of Technology（大连理工大学）；Beijing Technology And Business University（北京工商大学）；Wonxing Technology（万兴科技）

Most matting researches resort to advanced semantics to achieve high-quality alpha mattes, and direct low-level features combination is usually explored to complement alpha details. However, we argue that appearance-agnostic integration can only provide biased foreground details and alpha mattes require different-level feature aggregation for better pixel-wise opacity perception. In this paper, we propose an end-to-end Hierarchical and Progressive Attention Matting Network (HAttMatting++), which can better predict the opacity of the foreground from single RGB images without additional input. S…

2022-10-13cs.CV

Sparse Coding for Alpha Matting

Nanyang Technological University（南洋理工大学）；University of California San Diego（加利福尼亚大学圣迭戈分校）

Existing color sampling based alpha matting methods use the compositing equation to estimate alpha at a pixel from pairs of foreground (F) and background (B) samples. The quality of the matte depends on the selected (F,B) pairs. In this paper, the matting problem is reinterpreted as a sparse coding of pixel features, wherein the sum of the codes gives the estimate of the alpha matte from a set of unpaired F and B samples. A non-parametric probabilistic segmentation provides a certainty measure on the pixel belonging to foreground or background, based on which a dictionary is formed for use in …

2016-04-11cs.CV

Neural Architecture Search using Deep Neural Networks and Monte Carlo Tree Search

Brown University（布朗大学）；Worcester Polytechnic Institute（伍斯特理工学院）；Facebook AI Research（脸书人工智能研究院）

2019-11-21cs.AIcs.CVcs.DC

Alpha Matte Generation from Single Input for Portrait Matting

Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Istanbul Technical University（伊斯坦布尔理工大学）；Carnegie Mellon University（卡内基梅隆大学）

In the portrait matting, the goal is to predict an alpha matte that identifies the effect of each pixel on the foreground subject. Traditional approaches and most of the existing works utilized an additional input, e.g., trimap, background image, to predict alpha matte. However, (1) providing additional input is not always practical, and (2) models are too sensitive to these additional inputs. To address these points, in this paper, we introduce an additional input-free approach to perform portrait matting. We divide the task into two subtasks, segmentation and alpha matte prediction. We first…

2022-04-25cs.CV

Fast Multi-Level Foreground Estimation

Heinrich-Heine-Universität Düsseldorf（海因里希·海涅杜塞尔多夫大学）

Alpha matting aims to estimate the translucency of an object in a given image. The resulting alpha matte describes pixel-wise to what amount foreground and background colors contribute to the color of the composite image. While most methods in literature focus on estimating the alpha matte, the process of estimating the foreground colors given the input image and its alpha matte is often neglected, although foreground estimation is an essential part of many image editing workflows. In this work, we propose a novel method for foreground estimation given the alpha matte. We demonstrate that our …

2020-06-26cs.CV

更多相关论文收起更多论文

DiffusionMat：将Alpha抠图视为序列细化学习

DiffusionMat: Alpha Matting as Sequential Refinement Learning

The University of Hong Kong（香港大学）；Singapore Management University（新加坡管理大学）；Shanghai AI Laboratory（上海人工智能实验室）

本文提出DiffusionMat框架，将图像抠图视为序列细化学习过程，通过扩散模型对trimap迭代去噪生成精细alpha matte，并引入校正模块和Alpha Reliability Propagation技术保证结构一致性与简化校正任务，在多个基准上优于现有方法。

2023-11-22cs.CV

$F$, $B$, Alpha Matting

Trinity College Dublin（都柏林大学三一学院）

Cutting out an object and estimating its opacity mask, known as image matting, is a key task in many image editing applications. Deep learning approaches have made significant progress by adapting the encoder-decoder architecture of segmentation networks. However, most of the existing networks only predict the alpha matte and post-processing methods must then be used to recover the original foreground and background colours in the transparent regions. Recently, two methods have shown improved results by also estimating the foreground colours, but at a significant computational and memory cost.…

2020-03-17cs.CV

Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation

Portland State University（波特兰州立大学）

Natural image matting is an important problem in computer vision and graphics. It is an ill-posed problem when only an input image is available without any external information. While the recent deep learning approaches have shown promising results, they only estimate the alpha matte. This paper presents a context-aware natural image matting method for simultaneous foreground and alpha matte estimation. Our method employs two encoder networks to extract essential information for matting. Particularly, we use a matting encoder to learn local features and a context encoder to obtain more global …

2019-10-02cs.CV

Smart Scribbles for Image Mating

Dalian University of Technology（大连理工大学）；Beijing Technology and Business University（北京工商大学）；South China University of Technology（华南理工大学）；Peng Cheng Laboratory（鹏城实验室）；City University of Hong Kong（香港城市大学）

Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles. Drawing a fne trimap requires a large amount of user effort, while using scribbles can hardly obtain satisfactory alpha mattes for non-professional users. Some recent deep learning-based matting networks rely on large-scale composite datasets for training to improve performance, resulting in the occasional appearance of obvious artifacts when processing natural images. In this article, we explore the intrinsic relationship between user input and alpha mattes and strike a balance bet…

2021-03-31cs.CV

Alpha作为效率信号：可见性路由的RGBA图像到视频生成

Alpha as an Efficiency Signal: Visibility-Routed RGBA Image-to-Video Generation

ByteDance（字节跳动）

针对游戏RGBA视频生成的数据集与效率问题，提出可见性路由的RGBA视频生成模型，实现了更低FVD与1.2倍推理加速，质量下降可忽略。

2026-08-11cs.CV

Adaptive Background Matting Using Background Matching

Due to the difficulty of solving the matting problem, lots of methods use some kinds of assistance to acquire high quality alpha matte. Green screen matting methods rely on physical equipment. Trimap-based methods take manual interactions as external input. Background-based methods require a pre-captured, static background. The methods are not flexible and convenient enough to use widely. Trimap-free methods are flexible but not stable in complicated video applications. To be stable and flexible in real applications, we propose an adaptive background matting method. The user first captures the…

2022-03-14cs.CV

Multipath CNN with alpha matte inference for knee tissue segmentation from MRI

Chinese University of Hong Kong（香港中文大学）

Precise segmentation of knee tissues from magnetic resonance imaging (MRI) is critical in quantitative imaging and diagnosis. Convolutional neural networks (CNNs), which are state of the art, have limitations owing to the lack of image-specific adaptation, such as low tissue contrasts and structural inhomogeneities, thereby leading to incomplete segmentation results. This paper presents a deep learning based automatic segmentation framework for knee tissue segmentation. A novel multipath CNN-based method is proposed, which consists of an encoder decoder-based segmentation network in combinatio…

2021-09-29cs.CVeess.IV

Self-supervised Matting-specific Portrait Enhancement and Generation

South China University of Technology（华南理工大学）

We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance this input so that the alpha matte can be easily estimated by any existing matting models. This is accomplished by exploring the latent space of GAN models. It is demonstrated that interpretable directions can be found in the latent space and they correspond to semantic image transformations. We further explore this property in alpha matting. Particularly, we invert an input portr…

2022-08-13cs.AIcs.CV