AnyTask: an Automated Task and Data Generation Framework for Advancing Sim-to-Real Policy Learning
Robotics and AI Institute(机器人与人工智能研究所)
Ran Gong, Xiaohan Zhang, Jinghuan Shang, Maria Vittoria Minniti, Jigarkumar Patel, Valerio Pepe, Riedana Yan, Ahmet Gundogdu, Ivan Kapelyukh, Ali Abbas, Xiaoqia… 展开作者
Ran Gong, Xiaohan Zhang, Jinghuan Shang, Maria Vittoria Minniti, Jigarkumar Patel, Valerio Pepe, Riedana Yan, Ahmet Gundogdu, Ivan Kapelyukh, Ali Abbas, Xiaoqiang Yan, Harsh Patel, Laura Herlant, Karl Schmeckpeper
备注:
28 pages, 25 figures. The first four authors contributed equally
Generalist robot learning remains constrained by data: large-scale, diverse, and high-quality interaction data are expensive to collect in the real world. While simulation has become a promising way for scaling up data collection, the related tasks, including simulation task design, task-aware scene generation, expert demonstration synthesis, and sim-to-real transfer, still demand substantial human effort. We present AnyTask, an automated framework that pairs massively parallel GPU simulation with foundation models to design diverse manipulation tasks and synthesize robot data. We introduce three AnyTask agents for generating expert demonstrations aiming to solve as many tasks as possible: 1) ViPR, a novel task and motion planning agent with VLM-in-the-loop Parallel Refinement; 2) ViPR-Eureka, a reinforcement learning agent with generated dense rewards and LLM-guided contact sampling; 3) ViPR-RL, a hybrid planning and learning approach that jointly produces high-quality demonstrations with only sparse rewards. We train behavior cloning policies on generated data, validate them in simulation, and deploy them directly on real robot hardware. The policies generalize to novel object poses, achieving 44% average success across a suite of real-world pick-and-place, drawer opening, contact-rich pushing, and long-horizon manipulation tasks. Our project website is at https://anytask.rai-inst.com .
Automated Adversarial Collaboration for Advancing Theory Building in the Cognitive Sciences
Department of Psychology, Princeton University(普林斯顿大学心理学系);Department of Psychology, Stanford University(斯坦福大学心理学系);Princeton AI Lab, Princeton University(普林斯顿大学人工智能实验室)
Advancing LLM-Based Security Automation with Customized Group Relative Policy Optimization for Zero-Touch Networks
National Engineering Research Center for Mobile Network Technologies, Beijing University of Posts and Telecommunications(移动网络技术国家工程研究中心,北京邮电大学);Beijing University of Posts and Telecommunications(北京邮电大学);Singapore University of Technology and Design(新加坡科技设计大学);Department of Electronic Engineering, Kyung Hee University(韩国庆熙大学电子工程系)
Automated Construction of Medical Indicator Knowledge Graphs Using Retrieval Augmented Large Language Models
The second hospital of Jilin University Northeast Asia Active Aging Laboratory Jilin, China Email;QMUL DERI \ Institute Of Health Informatics, Lonodn, UK Email;QMUL School of Electronic Engineering \ Computer Science London, UK Email;The second hospital of Jilin University College of Artificial Intelligence, \ University, Jilin, China Email
PETAR: Localized Findings Generation with Mask-Aware Vision-Language Modeling for PET Automated Reporting
University of Wisconsin–Madison Department of Computer Sciences(威斯康星大学麦迪逊分校计算机科学系);University of Wisconsin–Madison Department Radiology(威斯康星大学麦迪逊分校放射学系);Microsoft(微软公司)
Automated Procedural Analysis via Video-Language Models for AI-assisted Nursing Skills Assessment
Weldon School of Biomedical Engineering, Purdue University(普渡大学生物医学工程学院);Department of Industrial and Operations Engineering, University of Michigan(密歇根大学工业与运作工程系);Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University(北卡罗来纳州立大学工业与系统工程系);School of Nursing, Purdue University(普渡大学护理学院)
AutoGEEval: A Multimodal and Automated Framework for Geospatial Code Generation on GEE with Large Language Models
Wuhan University(武汉大学);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(武汉大学测绘遥感信息工程国家重点实验室);Collaborative Innovation Center of Geospatial Technology, Wuhan University(武汉大学地理空间技术协同创新中心);School of Resource and Environmental Sciences, Wuhan University(武汉大学资源与环境科学学院);School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感信息工程学院)
OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Wuhan AI Research(武汉人工智能研究);GWM AI Lab(GWM人工智能实验室)
Synergizing chemical and AI communities for advancing laboratories of the future
Department of Chemistry, Unknown University, Unknown Town(化学系,未知大学,未知镇);BioPACIFIC Materials Innovation Platform, University of California, Santa Barbara, Santa Barbara, CA, 93106 USA(BioPACIFIC材料创新平台,加州大学圣巴巴拉分校,圣巴巴拉,CA,93106 USA);Department of Statistics and Applied Probability, University of California, Santa Barbara, Santa Barbara, CA, 93106 USA(统计与应用概率系,加州大学圣巴巴拉分校,圣巴巴拉,CA,93106 USA);Department of Materials Science and Engineering, University of California, Irvine, CA, 92697 USA(材料科学与工程系,加州大学伊维特分校,CA,92697 USA);Department of Chemistry and Biochemistry, University of California, Los Angeles, Los Angeles, CA, 90095 USA(化学与生物化学系,加州大学洛杉矶分校,洛杉矶,CA,90095 USA);Department of Chemistry and Biochemistry, University of California, Santa Barbara, Santa Barbara, CA, 93106 USA(化学与生物化学系,加州大学圣巴巴拉分校,圣巴巴拉,CA,93106 USA)
CoopScenes: Multi-Scene Infrastructure and Vehicle Data for Advancing Collective Perception in Autonomous Driving
Institute for Intelligent Systems(智能系统研究所);Faculty of Computer Science and Engineering(计算机科学与工程学院);University of Applied Sciences Esslingen(应用科学大学埃森堡);Institut Pascal ISPR(帕斯卡尔研究所);Universite Clermont Auvergne INP / CNRS(克勒蒙费朗大学 INP / CNRS);Center for Artificial Intelligence(人工智能中心)
Institute for Mechatronic Systems, TU Darmstadt(达姆施塔特工业大学机电系统研究所);Hessian Center for Artificial Intelligence (hessian.AI)(黑森人工智能中心);Department of Computer Science, TU Darmstadt(达姆施塔特工业大学计算机科学系);Department of Electrical Engineering, TU Darmstadt(达姆施塔特工业大学电气工程系);ABB AG(ABB集团)