arXiv 1710.034882017-10cs.CV

Automatic Streaming Segmentation of Stereo Video Using Bilateral Space

Beihang University（北京航空航天大学）

Wenjing Ke, Yuanjie Zhu, Lei Yu

英文摘要：

In this paper, we take advantage of binocular camera and propose an unsupervised algorithm based on semi-supervised segmentation algorithm and extracting foreground part efficiently. We creatively embed depth information into bilateral grid in the graph cut model and achieve considerable segmenting accuracy in the case of no user input. The experi- ment approves the high precision, time efficiency of our algorithm and its adaptation to complex natural scenario which is significant for practical application.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Real-Time Subpixel Fast Bilateral Stereo

The Hong Kong University of Science and Technology（香港科技大学）；University of Bristol（布里斯托大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）

Stereo vision technique has been widely used in robotic systems to acquire 3-D information. In recent years, many researchers have applied bilateral filtering in stereo vision to adaptively aggregate the matching costs. This has greatly improved the accuracy of the estimated disparity maps. However, the process of filtering the whole cost volume is very time consuming and therefore the researchers have to resort to some powerful hardware for the real-time purpose. This paper presents the implementation of fast bilateral stereo on a state-of-the-art GPU. By highly exploiting the parallel comput…

2018-08-15cs.CV

Bilateral Grid Learning for Stereo Matching Networks

Orbbec Research（奥比中格研究院）；Hefei University of Technology（合肥工业大学）；Sun Yat-sen University（中山大学）

Real-time performance of stereo matching networks is important for many applications, such as automatic driving, robot navigation and augmented reality (AR). Although significant progress has been made in stereo matching networks in recent years, it is still challenging to balance real-time performance and accuracy. In this paper, we present a novel edge-preserving cost volume upsampling module based on the slicing operation in the learned bilateral grid. The slicing layer is parameter-free, which allows us to obtain a high quality cost volume of high resolution from a low-resolution cost volu…

2021-03-29cs.CV

BANet：面向移动端立体匹配的双边聚合网络

BANet: Bilateral Aggregation Network for Mobile Stereo Matching

Huazhong University of Science and Technology（华中科技大学）；Autel Robotics（Autel机器人公司）；Optics Valley Laboratory（光学谷实验室）

本文提出面向移动端立体匹配的双边聚合网络BANet，仅用2D卷积将代价体分离为细节体和光滑体分别聚合再融合，在KITTI 2015上比MobileStereoNet-2D精度提高35.3%且运行更快。

2025-07-03cs.CV

Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Prediction

University of California, Los Angeles（加州大学洛杉矶分校）；Chung-Ang University（中央大学）

Supervised learning methods to infer (hypothesize) depth of a scene from a single image require costly per-pixel ground-truth. We follow a geometric approach that exploits abundant stereo imagery to learn a model to hypothesize scene structure without direct supervision. Although we train a network with stereo pairs, we only require a single image at test time to hypothesize disparity or depth. We propose a novel objective function that exploits the bilateral cyclic relationship between the left and right disparities and we introduce an adaptive regularization scheme that allows the network to…

2019-06-19cs.CV

MORPHOLO C++ Library for glasses-free multi-view stereo vision and streaming of live 3D video

The MORPHOLO C++ extended Library allows to convert a specific stereoscopic snapshot into a Native multi-view image through morphing algorithms taking into account display calibration data for specific slanted lenticular 3D monitors. MORPHOLO can also be implemented for glasses-free live applicatons of 3D video streaming, and for diverse innovative scientific, engineering and 3D video game applications -see http://www.morpholo.it

2019-12-04cs.CV

The Fast Bilateral Solver

Google（谷歌）

We present the bilateral solver, a novel algorithm for edge-aware smoothing that combines the flexibility and speed of simple filtering approaches with the accuracy of domain-specific optimization algorithms. Our technique is capable of matching or improving upon state-of-the-art results on several different computer vision tasks (stereo, depth superresolution, colorization, and semantic segmentation) while being 10-1000 times faster than competing approaches. The bilateral solver is fast, robust, straightforward to generalize to new domains, and simple to integrate into deep learning pipeline…

2016-07-22cs.CV

更多相关论文收起更多论文

面向流式感知的实时双目立体3D目标检测

Real-time Stereo-based 3D Object Detection for Streaming Perception

Sun Yat-sen University（中山大学）；Pengcheng Laboratory（鹏城实验室）；Hofstra University（霍夫斯特拉大学）；National University of Defense Technology（国防科技大学）

本文提出了StreamDSGN，首个面向流式感知的实时双目立体3D目标检测端到端框架，通过利用历史信息预测下一时刻物体3D属性，并结合特征流融合、运动一致性回归损失和大卷积核主干三种策略，在KITTI Tracking数据集上将流式平均精度提升最高4.33%。

2024-10-16cs.CV

低延迟神经立体视频流媒体

Low-Latency Neural Stereo Streaming

Qualcomm AI Research（高通人工智能研究）

针对现有立体视频压缩方法顺序处理导致并行化差、延迟高的问题，提出低延迟并行编解码器LLSS，通过双向特征移位模块和联合跨视角先验模型直接利用视角间互信息进行熵编码，实现左右视角并行处理，显著提升了率失真性能并最小化延迟。

2024-03-26cs.CVeess.IV

Do End-to-end Stereo Algorithms Under-utilize Information?

cs.stevens.edu（斯蒂文斯理工学院计算机系(注：此处按机构含义直译，原文本中cs.stevens.edu更倾向于斯蒂文斯理工学院计算机科学相关部门，但根据提取规则，大学/学院级别即可，故保留en为cs.stevens.edu，zh为斯蒂文斯理工学院计算机系的常见中文译法或直译，但更准确的是，原作者邮箱中的stevens.edu表明其所属机构为斯蒂文斯理工学院，cs.stevens.edu是该学院内的计算机系，但根据提取规则，机构粒度到大学/学院级别即可，因此这里两个机构均属于斯蒂文斯理工学院，故统一处理为斯蒂文斯理工学院，或根据实际情况，两个邮箱都指向斯蒂文斯理工学院，因此en应为stevens.edu，zh为斯蒂文斯理工学院。但原文本中作者邮箱分别为ccai1@stevens.edu和mordohai@cs.stevens.edu，其中cs.stevens.edu是斯蒂文斯理工学院计算机科学系，属于学院级别，因此两个机构均属于斯蒂文斯理工学院，因此正确的en应为stevens.edu和cs.stevens.edu，zh均为斯蒂文斯理工学院和斯蒂文斯理工学院计算机科学系？但根据提取规则，“提取到大学/学院/公司/研究院级别即可，不要细拆到系、专业、课题组、实验室（除非实验室本身就是独立机构）”，因此cs.stevens.edu属于学院内的系，不应提取，因此只有stevens.edu对应的机构是斯蒂文斯理工学院，因此正确的输出应为{）

Deep networks for stereo matching typically leverage 2D or 3D convolutional encoder-decoder architectures to aggregate cost and regularize the cost volume for accurate disparity estimation. Due to content-insensitive convolutions and down-sampling and up-sampling operations, these cost aggregation mechanisms do not take full advantage of the information available in the images. Disparity maps suffer from over-smoothing near occlusion boundaries, and erroneous predictions in thin structures. In this paper, we show how deep adaptive filtering and differentiable semi-global aggregation can be int…

2020-10-14cs.CV

Self-Supervised Real-time Video Stabilization

KAIST（韩国科学技术院）；POSTECH（浦项工科大学）

Videos are a popular media form, where online video streaming has recently gathered much popularity. In this work, we propose a novel method of real-time video stabilization - transforming a shaky video to a stabilized video as if it were stabilized via gimbals in real-time. Our framework is trainable in a self-supervised manner, which does not require data captured with special hardware setups (i.e., two cameras on a stereo rig or additional motion sensors). Our framework consists of a transformation estimator between given frames for global stability adjustments, followed by scene parallax r…

2021-11-10cs.CV

FVV Live: A real-time free-viewpoint video system with consumer electronics hardware

Universidad Politécnica de Madrid（马德里理工大学）；Universidad Autónoma de Madrid（马德里自治大学）；Huawei Technologies Co., Ltd.（华为技术有限公司）

FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation, based on off-the-shelf components. The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware, which enables low deployment costs and easy installation for immersive event-broadcasting or videoconferencing. The paper describes the architecture of the system, including acquisition and encoding of multiview plus depth data in several capture servers and virtual view synthesis on an edge server. All the blocks of the system have been des…

2020-07-01cs.CVcs.MM