arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.17428cs.CVcs.AI
收藏

面向遥操作中AIGC任务分配的视觉语言模型赋能合同理论

Vision Language Model-Empowered Contract Theory for AIGC Task Allocation in Teleoperation

Zijun Zhan, Yaxian Dong, Yuqing Hu, Shuai Li, Shaohua Cao, Zhu Han

AI总结:

本文提出了一种VLM赋能合同理论的AIGC任务分配框架,通过VLM自动评估任务难度并结合合同理论在信息不对称下制定定价策略,显著提升了遥操作员与边缘服务器的效用。

摘要:

集成低光照图像增强技术(其中基于扩散的AI生成内容(AIGC)模型极具前景)对于增强夜间遥操作是必要的。值得注意的是,AIGC模型是计算密集型的,因此需要将AIGC任务分配给具有充足计算资源的边缘服务器。鉴于使用不同规模数据集训练的AIGC模型具有不同的成本,且AIGC任务具有不同的需求,因此必须制定差异化定价策略,以同时优化遥操作员和边缘服务器的效用。然而,定价策略的制定处于信息不对称之下,即AIGC任务的需求(例如AIGC任务的难度等级及其分布)对边缘服务器而言是隐藏信息。此外,手动评估AIGC任务的难度等级对遥操作员来说是繁琐且不必要的。为此,我们设计了一个由视觉语言模型(VLM)赋能的合同理论辅助的AIGC任务分配框架,该框架包括两个部分:VLM赋能的难度评估和合同理论辅助的AIGC任务分配。第一部分实现了自动且准确的AIGC任务难度评估。第二部分能够在信息不对称下为边缘服务器制定定价策略,从而优化边缘服务器和遥操作员的效用。仿真结果表明,我们提出的框架能将遥操作员和边缘服务器的平均效用分别提高10.88~12.43%和1.4~2.17%。代码和数据可在 https://github.com/ZiJun0819/VLM-Contract-Theory 获取。

英文摘要:

Integrating low-light image enhancement techniques, in which diffusion-based AI-generated content (AIGC) models are promising, is necessary to enhance nighttime teleoperation. Remarkably, the AIGC model is computation-intensive, thus necessitating the allocation of AIGC tasks to edge servers with ample computational resources. Given the distinct cost of the AIGC model trained with varying-sized datasets and AIGC tasks possessing disparate demand, it is imperative to formulate a differential pricing strategy to optimize the utility of teleoperators and edge servers concurrently. Nonetheless, the pricing strategy formulation is under information asymmetry, i.e., the demand (e.g., the difficulty level of AIGC tasks and their distribution) of AIGC tasks is hidden information to edge servers. Additionally, manually assessing the difficulty level of AIGC tasks is tedious and unnecessary for teleoperators. To this end, we devise a framework of AIGC task allocation assisted by the Vision Language Model (VLM)-empowered contract theory, which includes two components: VLM-empowered difficulty assessment and contract theory-assisted AIGC task allocation. The first component enables automatic and accurate AIGC task difficulty assessment. The second component is capable of formulating the pricing strategy for edge servers under information asymmetry, thereby optimizing the utility of both edge servers and teleoperators. The simulation results demonstrated that our proposed framework can improve the average utility of teleoperators and edge servers by 10.88~12.43% and 1.4~2.17%, respectively. Code and data are available at https://github.com/ZiJun0819/VLM-Contract-Theory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑