超越模型的边缘AI部署:面向工业嵌入式平台的BSP感知系统框架
Edge AI Deployment Beyond Models: A BSP-Aware Systems Framework for Industrial Embedded Platforms
AI总结:
提出一个五层BSP感知系统框架,将边缘AI部署视为系统工程问题,解决工业嵌入式平台中模型与硬件、BSP、运行时等环节的集成挑战,提升可复现性、可诊断性、持续吞吐量和现场可靠性。
摘要:
工业边缘AI项目通常从模型开始,之后才面对平台。这种顺序具有吸引力,因为它允许早期演示,但当部署目标是具有长产品生命周期、供应商特定内核、异构加速器、安全约束和非平凡I/O路径的嵌入式系统时,这种方法就会失效。在这种环境中,模型只是从传感器开始、经过板级支持包(BSP)、最终进入生产服务循环的更大执行链中的一个组成部分。本文认为,稳健的边缘AI部署必须被视为一个系统问题,而不是一个后期应用打包练习。本文提出了一个面向工业嵌入式平台的BSP感知框架,围绕五个层次组织:硬件、BSP/操作系统适配、运行时与加速、应用/推理、以及运维/验证。讨论基于Android、NXP i.MX、NVIDIA Jetson、ONNX Runtime和TensorRT的供应商架构文档,以及关于嵌入式AI基准测试、设备不稳定性和异构边缘机群的系统文献。结果是一个实用框架,将底层平台工作与可衡量的部署成果(如可复现性、可诊断性、持续吞吐量和现场可靠性)联系起来。
英文摘要:
Industrial Edge AI programs often begin with the model and only later confront the platform. That sequencing is attractive because it allows early demonstrations, but it breaks down when the deployment target is an embedded system with long product lifecycles, vendor-specific kernels, heterogeneous accelerators, safety constraints, and nontrivial I/O paths. In that environment, a model is only one component of a larger execution chain that begins at the sensor, traverses the board support package (BSP), and ends in a production service loop. This paper argues that robust Edge AI deployment must be treated as a systems problem rather than a late-stage application packaging exercise. The paper presents a BSP-aware framework for industrial embedded platforms organized around five layers: hardware, BSP/operating-system adaptation, runtime and acceleration, application/inference, and operations/validation. The discussion is grounded in vendor architecture documentation for Android, NXP i.MX, NVIDIA Jetson, ONNX Runtime, and TensorRT, and in systems literature on embedded AI benchmarking, device instability, and heterogeneous edge fleets. The result is a practical framework that connects low-level platform work to measurable deployment outcomes such as reproducibility, diagnosability, sustained throughput, and field reliability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。