Intuitive Task-Level Programming by Demonstration through Semantic Skill Recognition
Intuitive robot programming for non-experts will be essential to increasing automation in small and medium-sized enterprises (SMEs). Programming by Demonstration (PbD) is a fast and intuitive approach, whereas programs created with Task-Level Programming (TLP) are easy to understand and flexible in their execution. In this paper, we propose an approach which combines these complementary advantages of PbD and TLP. Users define complete task-level programs including all parameters through PbD alone. Therefore, we call this approach Task-Level Programming by Demonstration (TLPbD). TLPbD extends skill-based approaches by enabling experts to semantically annotate robot skills with their conditions and effects, which facilitates online skill recognition from pure demonstrations by a non-expert. In a user study with 21 participants, the approach is compared with an existing intuitive TLP approach. The results show that the new approach drastically reduces the programming time while at the same time being more intuitive, reducing mental load, and achieving the same or even better skill sequences.
The video first demonstrates the three different tasks used in the user study (Section IV). Both approaches, Task-Level Programming by Demonstration (TLPbD) and Task-Level Programming (TLP), are shown in comparison. While all three tasks are programmed with TLPbD, the first task cannot be finished using TLP in the same time.
In the second half of the video, the first task is programmed again using TLPbD. Afterwards, a user skill is added mahually. Then, the created program is executed and its flexibility is shown.
Paper: https://elib.dlr.de/128339/