Learning models of user behaviour is an important problem that is broadly applicable across many application domains requiring human-robot interaction. In this work we show that it is possible to learn a generative model for distinct user behavioral types, extracted from human demonstrations, by enforcing clustering of preferred task solutions within the latent space. We use this model to differentiate between user types and to find cases with overlapping solutions. Moreover, we can alter an initially guessed solution to satisfy the preferences that constitute a particular user type by backpropagating through the learned differentiable model. An advantage of structuring generative models in this way is that it allows us to extract causal relationships between symbols that might form part of the user's specification of the task, as manifested in the demonstrations. We show that the proposed method is capable of correctly distinguishing between three user types, who differ in degrees of cautiousness in their motion, while performing the task of moving objects with a kinesthetically driven robot in a tabletop environment. Our method successfully identifies the correct type, within the specified time, in 99% [97.8 - 99.8] of the cases, which outperforms an IRL baseline. We also show that our proposed method correctly changes a default trajectory to one satisfying a particular user specification even with unseen objects. The resulting trajectory is shown to be directly implementable on a PR2 humanoid robot completing the same task.
Learning Linear Temporal Specifications from Demonstrations with Uncertainty
The Pennsylvania State University(宾夕法尼亚州立大学);School of Electrical Engineering and Computer Science at The Pennsylvania State University(宾夕法尼亚州立大学电气工程与计算机科学学院)
Demonstration of the common dual-channel feature decoupling characteristic of front-door mediation causal inference methods in whole-slice image classification
Causality on Longitudinal Data: Stable Specification Search in Constrained Structural Equation Modeling
Universitas Islam Indonesia(印度尼西亚伊斯兰大学);Radboud University Nijmegen(拉德堡德大学奈梅亨分校);Radboud University Medical Center(拉德堡德大学医学中心);Academic Medical Center, University of Amsterdam(阿姆斯特丹大学学术医学中心);Netherlands Institute for Health Services Research(荷兰卫生服务研究所)
Toward User Comprehension Supports for LLM Agent Skill Specifications
University of Washington, Tacoma School of Engineering \& Technology Tacoma, Washington, USA;University of Washington, Tacoma School of Engineering \& Technology