Tracking Non-Planar and Non-Rigid Objects for Augmented Reality

Derek Bradley

Abstract.

Augmented Reality (AR) is the concept of adding virtual objects to the real world using either a head-mounted display or a real-time video sequence. Most of the previous research in the field of AR has focused on the tracking of rigid planar surfaces. This is typically accomplished using 2D monochrome patterns that are identified in the scene and then virtual objects are registered with the real world through a homography. This seminar will describe my research into the new idea of tracking non-planar objects (such as a sphere) and non-rigid objects (such as cloth) for AR. Two successful solutions will be described and demonstrated, one showing real-time tracking of a sphere with six degrees of freedom, and the other will show real-time tracking of cloth that includes the real-world illumination. In both cases, augmentations are performed to show the tracking accuracy, and interactive applications will be discussed.