传感器处的硬连线分布式处理单元:真正并行的视觉预处理以释放主机CPU
Hardwired Distributed Processing Units at the Sensor: Truly Parallel Vision Pre-Processing that Frees the Host CPU
AI总结:
本文提出在传感器处部署硬连线分布式处理单元(HDPU)并行执行视觉预处理,在FPGA上实现后可大幅降低主机CPU负载,提升响应速度,使巡线车辆最高速度翻倍。
摘要:
传统视觉流水线将每个像素传输至主机处理器,主机必须等待完整帧后才能执行操作,并将每帧周期的一部分用于常规预处理。本文研究一种替代架构,该架构将预处理工作分配给硬连线分布式处理单元(HDPU):直接连接至传感器的小型固定数据通路,每个单元专注于单一持续运行的任务,在同一像素流上真正并行运行,并向主机输出紧凑结果。从共享两拍延迟的3×3算子库中,我们构建了三个HDPU(Canny边缘检测器、Harris角点检测器和输出转向决策的线跟踪器),并在低成本Artix-7 FPGA上对单个相机流并行运行这些单元,消耗2568个LUT,估计功耗0.318 W。每个单元的每一级均与其软件模型完全位精确。在使用 datasheet 相机模型的全系统仿真中,每个决策生成时,其HDPU距离产生该决策的像素不超过11.03行,比主机上基于帧的程序最早响应时间快22至67倍;HDPU延迟变化不超过17 ns,而主机自身运行时间达到其中值的12.5倍。在640×480分辨率下,卸载这三个任务每帧周期可为主机释放18%至30%的核心资源;在1080p分辨率下,当所有线程处于使用状态时,可释放63%的帧周期。单元的成本仅通过行缓冲随帧宽增长,在巡线车辆的闭环模型中,HDPU将保持线路的最高速度从4.75 m/s提升至10.00 m/s。
英文摘要:
Conventional vision pipelines route every pixel to a host processor, which must then wait for a complete frame before it can act and devote part of each frame period to routine pre-processing. We examine an alternative organisation in which this work is distributed across hardwired distributed processing units (HDPUs): small, fixed datapaths attached directly to the sensor, each committed to a single always-on task, operating truly in parallel on the same pixel stream and delivering compact results to the host. From one library of 3x3 operators sharing a common two-clock latency, we construct three HDPUs (Canny edges, Harris corners, and a line tracker that issues a steering decision) and run them side by side on a single camera stream in a low-cost Artix-7 FPGA, at a cost of 2,568 LUTs and an estimated 0.318 W. Every stage of every unit is bit-exact with its software model. In a full-system simulation with a datasheet camera model, each decision leaves its HDPU within 11.03 camera lines of the pixel that produced it, 22-67x sooner than the earliest moment at which a frame-based program on the host could respond; the HDPU latency varies by no more than 17 ns, whereas the host's own run times reached 12.5x their median. Offloading the three tasks returns 18-30% of a core to the host in every frame period at 640x480, and 63% of the frame period, with all threads in use, at 1080p. The cost of the units grows with frame width only through their line buffers, and in a closed-loop model of a line-following vehicle the HDPU raises the highest speed at which the line is held from 4.75 to 10.00 m/s.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。