User-Guided Computer Vision

Tracker:

Above is a snapshot of an interactive tool for the extraction of 3D graphics models from video. The window at the top of the screen depicts two views of the current video frame. The left view is the input video and the right is an edge-enhanced version (specifically, it is a color representation of the spatial gradient). The graphic overlay (in red) depicts the current 2D polygons and feature points that are being tracked. The tracking control window on the left side of the screen allows for parameter setting and direct user control of the 3D extraction process. The Inventor window in the center of the screen depicts the current 3D model corresponding to the tracked polygons. Textures (surface patterns) for the extracted 3D polygons are obtained directly from the input image sequence and mapped onto the polygon surfaces by "undoing" the perspective warp that is introduced by the camera. The warp control window in the lower-left part of the screen provides for user-adjustment of the extracted textures.