A digital puppet and a live user interact with some props:

The 3D was created and animated in 3ds Max. The development was made in Unity3D and uses the Vuforia AR engine.

I wanted to use casual items as markers: Since credit cards where highly glossy, I used 3 playing cards. A wobbly outline vertex shader was applied to the assets to drown down the effects of small registration errors that are inherent in all current AR engines.

The interactions are based on distance and some few other data, nothing complex in comparison with a dance routine of 2 characters for example, which was my initial test idea.