SketcherX：基于 Diffusion model 和 Vectorization 技术的 AI 驱动交互式机器人绘画
SketcherX: AI-Driven Interactive Robotic drawing with Diffusion model and Vectorization Techniques
AI总结：
本文提出 SketcherX 机器人系统，结合 LLM、Stable Diffusion model 及 Vector LoRA 等技术，通过双 6 轴机械臂实现实时交互与风格化绘画，能在两分钟内生成高质量个性化肖像，推进了人机艺术协作。
摘要：
我们介绍了 SketcherX，这是一个通过人机交互进行个性化肖像绘画的新型机器人系统。与依赖模拟印刷技术的传统机器人艺术系统不同，SketcherX 捕获并处理面部图像，以独特、类人的艺术风格生成矢量化绘画。该系统包含两个 6 轴机械臂：一个面部机器人，配备头戴式摄像头和 Large Language Model (LLM) 用于实时交互；另一个是绘画机器人，利用微调的 Stable Diffusion model、ControlNet 和 Vision-Language models 进行动态、风格化绘画。我们的贡献包括开发定制的 Vector Low Rank Adaptation model (LoRA)，实现对各种艺术风格的无缝适应，并集成成对微调方法以提升笔画质量和风格准确性。实验结果证明，该系统能在两分钟内生成高质量、个性化的肖像，突显了其作为机器人创造力新范式的潜力。这项工作通过将机器人定位为创作过程中的积极参与者，推进了机器人艺术领域的发展，为未来交互式人机艺术协作的探索铺平了道路。
英文摘要：
We introduce SketcherX, a novel robotic system for personalized portrait drawing through interactive human-robot engagement. Unlike traditional robotic art systems that rely on analog printing techniques, SketcherX captures and processes facial images to produce vectorized drawings in a distinctive, human-like artistic style. The system comprises two 6-axis robotic arms : a face robot, which is equipped with a head-mounted camera and Large Language Model (LLM) for real-time interaction, and a drawing robot, utilizing a fine-tuned Stable Diffusion model, ControlNet, and Vision-Language models for dynamic, stylized drawing. Our contributions include the development of a custom Vector Low Rank Adaptation model (LoRA), enabling seamless adaptation to various artistic styles, and integrating a pair-wise fine-tuning approach to enhance stroke quality and stylistic accuracy. Experimental results demonstrate the system's ability to produce high-quality, personalized portraits within two minutes, highlighting its potential as a new paradigm in robotic creativity. This work advances the field of robotic art by positioning robots as active participants in the creative process, paving the way for future explorations in interactive, human-robot artistic collaboration.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
