Kinetic AR: Robotic Motion Planning and Programming using Augmented Reality Interfaces

Using Augmented Reality (AR) interfaces, motion paths and tasks for co-bots in the factory can become visible and interactive. We present Kinetic AR, a system to control and manipulate motion of an MIR100 Automated Guided Vehicle (AGV) in Augmented Reality using the Reality Editor platform. The MIR100 robot performs a mapping of the environment using laser scanners. We synchronize the coordinate systems recognized by the smartphone and the AGV by performing spatial mapping. This allows for a seamless interaction where the user can control the motion of the AGV in an intuitive and spatial manner without any further technical requirements than a mobile phone. The user can perform path planning and visualize the motion of the AGV in real-time in AR. The synchronization of both environments allows for a usable manipulation where the AGV is aware of the position of the phone at all times and can perform actions such as following the user or moving towards the position where the phone is pointing on the floor. Moreover, motion checkpoints can be actionable and visually connected to other equipment in order to program the coordinated behavior of multiple systems. The platform is spatially aware and allows for a co-located seamless interaction between machines. We envision this technology as a usable interface for the creation and visualization of manifold AGV operations while maintaining a low entry barrier to complex spatial hardware programming.