From: Michael Sinclair Subject: Re: APPS: Live-interactive Performer Tracking Date: 6 Aug 1995 16:53:42 GMT Organization: Georgia Tech Interactive Media Technology Center Paul Kelman wrote: >INQUIRY RE: LIVE REAL-TIME INTERACTIVE PERFORMER TRACKING FOR THE STAGE > >AVR is about to undertake a project that involves tracking a live >performer on stage along with real-time interaction with virtual >images. We are interested in hearing from anyone who has had >experience with live interactive tracking from the technical/creative >perspective. (text deleted) Paul, We are in the process of developing a motion tracking system for stage performance, specifically ballet dancers. We are starting on a production on a piece in conjunction with the Georgia Tech Theater for the Arts and the Atlanta Ballet to be performed during the 96 Olympics featuring this technology. Earlier this year we put on a world premier of "Springing Grass" which featured dancers with multiple appendages being tracked in real-time using hidden IR optical targets. This piece and "Non Sequitur" performed last year featuring a synthetic dancer were choreographed by Lisa de Ribere. In "Springing Grass", the processed target centroid data is communicated to an Indigo Extreme graphics computer (loaned to us by the great folks at SGI!) that produced various animations that were projected back on-stage to nearby scrims that acted as translucent screens. The effect was the appearance that the dancers were eminating "pixie dust" (complex particle systems) or "silly string" (variable persistance splines) from their fingertips. We also showed work in progress that consisted of tracking 12 joints of a dancer in real-time and projecting animated "markers" in sync and coincident with the respective joints of the dancer. The desire is for the ultimate in virtual costumes -- the stage performers wear white reflective costumes and let the tracker/computer/projector do the rest. Static textured costumes that move with the dancers, animated or morphing textures that reflect the mood of the piece..... We are also hoping to use this technology in a low cost motion tracking system for the applications in athletic coaching aids, biomechanics, 3D animations, dance, etc. Hope you get as much enjoyment with creative applications of this technology as we do!! Michael Sinclair Interactive Media Technology Laboratory Georgia Tech www.oip.gatech.edu/mmtltop.html ms38@prism.gatech.edu