DML-RAM:使用预训练模型的机械臂操作深度多模态学习框架
DML-RAM: Deep Multimodal Learning Framework for Robotic Arm Manipulation using Pre-trained Models
AI总结:
本文提出DML-RAM框架,通过后期融合预训练模型与机器学习处理多模态输入预测机械臂连续动作,在BridgeData V2和Kuka上表现优异且支持模块化与实时决策。
摘要:
本文提出了一种用于机械臂操作的新型深度学习框架,该框架使用后期融合策略集成多模态输入。与传统端到端或强化学习方法不同,该方法利用预训练模型处理图像序列,并利用机器学习算法处理机器人状态数据,融合它们的输出以预测用于控制的连续动作值。在 BridgeData V2 和 Kuka 数据集上进行评估,最佳配置(VGG16 + Random Forest)分别实现了 0.0021 和 0.0028 的 MSE,展现出强大的预测性能和鲁棒性。该框架支持模块化、可解释性和实时决策,符合自适应、人在回路的信息物理系统的目标。
英文摘要:
This paper presents a novel deep learning framework for robotic arm manipulation that integrates multimodal inputs using a late-fusion strategy. Unlike traditional end-to-end or reinforcement learning approaches, our method processes image sequences with pre-trained models and robot state data with machine learning algorithms, fusing their outputs to predict continuous action values for control. Evaluated on BridgeData V2 and Kuka datasets, the best configuration (VGG16 + Random Forest) achieved MSEs of 0.0021 and 0.0028, respectively, demonstrating strong predictive performance and robustness. The framework supports modularity, interpretability, and real-time decision-making, aligning with the goals of adaptive, human-in-the-loop cyber-physical systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。