We present SymForce, a library for fast symbolic computation, code generation, and nonlinear optimization for robotics applications like computer vision, motion planning, and controls. SymForce combines the development speed and flexibility of symbolic math with the performance of autogenerated, highly optimized code in C++ or any target runtime language. SymForce provides geometry and camera types, Lie group operations, and branchless singularity handling for creating and analyzing complex symbolic expressions in Python, built on top of SymPy. Generated functions can be integrated as factors into our tangent-space nonlinear optimizer, which is highly optimized for real-time production use. We introduce novel methods to automatically compute tangent-space Jacobians, eliminating the need for bug-prone handwritten derivatives. This workflow enables faster runtime code, faster development time, and fewer lines of handwritten code versus the state-of-the-art. Our experiments demonstrate that our approach can yield order of magnitude speedups on computational tasks core to robotics. Code is available at https://github.com/symforce-org/symforce.
Lang2Manip: A Tool for LLM-Based Symbolic-to-Geometric Planning for Manipulation
Khalifa University Center for Autonomous Robotic Systems (KUCARS)(卡利法大学自主机器人系统中心);Khalifa University(卡利法大学);Institute of Industrial and Control Engineering (IOC)(工业与控制工程研究所);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学)
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy
University at Buffalo(布法罗大学);Pennsylvania State University(宾夕法尼亚州立大学);Carnegie Mellon University(卡内基梅隆大学);ETH Zürich(苏黎世联邦理工学院);Purdue University(普渡大学)
Chameleon: Fast-slow Neuro-symbolic Lane Topology Extraction
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Bosch Corporate Research, China(博世中国企业研究中心);Institute for Interdisciplinary Information Sciences(IIIS), Tsinghua University(清华大学交叉信息研究院)
Optimal task and motion planning and execution for human-robot multi-agent systems in dynamic environments
Institute of Intelligent Industrial Technologies and Systems, National Research Council of Italy(意大利国家研究委员会智能工业技术与系统研究所);Institute of Cognitive Sciences and Technologies, National Research Council of Italy(意大利国家研究委员会认知科学与技术研究所);University of Brescia(布雷西亚大学)
Interpretable Robotic Friction Learning via Symbolic Regression
Ludwig-Maximilians-Universität München(慕尼黑路易斯-马克西米利安大学);German Aerospace Center(德国航空航天中心);University of Tromsø(特罗姆瑟大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Learning Structured Robot Policies from Vision-Language Models via Synthetic Neuro-Symbolic Supervision
University of Padova, Dept. of Information Engineering(帕多瓦大学信息工程系);Fraunhofer Italia Research(弗劳恩霍夫意大利研究所);Polytechnic of Bari Dept. of Electrical and Information Engineering(巴里理工学院电气与信息工程系)
Language-Augmented Symbolic Planner for Open-World Task Planning
The University of Hong Kong(香港大学);Chongqing Institute of Microelectronics Industry Technology, University of Electronic Science and Technology of China(电子科技大学 Chongqing Institute of Microelectronics Industry Technology);Centre for Transformative Garment Production (TransGP)(变革性服装生产中心(TransGP));Southern University of Science and Technology(南方科技大学);Texas A&M University(德克萨斯农工大学)
Bayesian Inverse Physics for Neuro-Symbolic Robot Learning
Robotics Research Group University of Bremen(不莱梅大学机器人研究组);Robotics Innovation Center DFKI GmbH(DFKI机器人创新中心);Technical University of Chemnitz(化学工业大学);Technical University of Darmstadt(图尔恩技术大学);Systems AI for Robot Learning DFKI GmbH(DFKI机器人学习系统AI);Robotics Research Group, University of Bremen(不莱梅大学机器人研究组);Robotics Innovation Center, DFKI GmbH(DFKI机器人创新中心)
APTree: Extended Behavior Trees for Adaptive and Scalable Automated Robotic Task Planning in Construction
University of Stuttgart(斯图加特大学);Institute for Computational Design and Construction(计算设计与建造研究所);Institute for Control Engineering of Machine Tools and Manufacturing Units(机床与制造单元控制工程研究所)
Unifying Deep Predicate Invention with Pre-trained Foundation Models
Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);Computer Science and Engineering Division, University of Michigan(密歇根大学计算机科学与工程系);Department of Computer Science, University of Pittsburgh(匹兹堡大学计算机科学系);Centaur AI Institute(Centaur人工智能研究所);Department of Electrical and Computer Engineering, Princeton University(普林斯顿大学电气与计算机工程系)