arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.19178cs.CVeess.SP
收藏

Power-LLaVA:面向输电线路巡检的大语言视觉助手

Power-LLaVA: Large Language and Vision Assistant for Power Transmission Line Inspection

State Key Laboratory of Electrical Insulation and Power Equipment(电力设备电气绝缘国家重点实验室);Xi’an Jiaotong University(西安交通大学)

Jiahao Wang, Mingxuan Li, Haichen Luo, Jinguo Zhu, Aijun Yang, Mingzhe Rong, Xiaohua Wang

AI总结:

针对现有输电线路巡检方法泛化性与智能性不足的问题,本文提出首个面向该场景的大语言视觉助手Power-LLaVA,构建专用大规模高质量数据集,以两阶段训练实现低训练成本下的优异巡检性能。

摘要:

过去几年,输电线路巡检工作取得了显著成果,这主要得益于深度学习技术的融入。然而,当前的巡检方法在泛化性和智能性方面仍存在困难,限制了其进一步应用。本文提出了Power-LLaVA,这是首个专为输电线路巡检设计的大语言视觉助手,可通过与人类对话提供专业可靠的巡检服务。此外,我们还构建了一个专门面向巡检任务的大规模高质量数据集。在构建的数据集上采用两阶段训练策略,Power-LLaVA以相对较低的训练成本展现出了优异性能。大量实验进一步证明了Power-LLaVA在输电线路巡检领域的强大能力。代码将开源发布。

英文摘要:

The inspection of power transmission line has achieved notable achievements in the past few years, primarily due to the integration of deep learning technology. However, current inspection approaches continue to encounter difficulties in generalization and intelligence, which restricts their further applicability. In this paper, we introduce Power-LLaVA, the first large language and vision assistant designed to offer professional and reliable inspection services for power transmission line by engaging in dialogues with humans. Moreover, we also construct a large-scale and high-quality dataset specialized for the inspection task. By employing a two-stage training strategy on the constructed dataset, Power-LLaVA demonstrates exceptional performance at a comparatively low training cost. Extensive experiments further prove the great capabilities of Power-LLaVA within the realm of power transmission line inspection. Code shall be released.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑