The experience toured at different motor shows around the world, allowing Jaguar's customers to interact with the stand and have a memorable experience. The Jaguar had five bespoke interactions that reacted to movements of the audience in realtime, using AI gesture recognition to attract the Jaguar, allow it to freeplay, recognise clapping and react to obstacles, as well as giving each visitor an AR photograph takeaway.

The brief was to design a reactive character to personify abstract ideas of the car’s key performance. The Jaguar needed to seem as real as possible while in reacting in real-time and staying on-brand, so it couldn’t appear tame, docile or playful. The team made a completely independent and responsive character, incorporating machine learning pose recognition into a traditional VFX pipeline.

 

Creating a new pipeline to bring VFX assets into Unreal Engine allowed the team to use the world class animators to bring the Jaguar to life.

 

Mill+ partnered with Machine learning pioneers Wrnch to incorporate their pose recognition system into the Unreal Engine project. This allowed them to capture full human body animation and poses using an off-the-shelf web-cam.