Cinematic storytelling in AR using WRLD 3D maps and UnityBy WRLD Team on 7th December 2017 | Augmented Reality, Cinematic Storytelling, Pre-visualization, Unity When you think of Augmented Reality (AR), you may not think of the movies, yet, but AR is becoming an emerging format for building and sharing new or reimagined worlds. With cinematic storytelling in AR, individual separation from screen to user dissolves so that both the story creation and viewing experience are more immersive. AR brings elements of a story into reality, giving us a new way to experience what we see, hear, and of course feel.
The WRLD 3D maps provide a fully textured 3D environment of our cities, land and buildings. This replica of the real world can easily (and cheaply) be used as a ready-built set for creating content and cinematic storytelling in AR; there is no need to digitally create a new film setting. If you missed it, see how you can build your own Blade Runner scene by transforming WRLD 3D maps into a dystopian sci-fi world using the WRLD Unity SDK.
HOW TO REIMAGINE STORIES FOR ARInspired by Unity art and design tools, we wanted to build a classic film scene using the WRLD 3D maps in Unity. We started out recreating a scene from the 1933 American monster adventure film King Kong. Using the WRLD Unity SDK, and Unity Post-Processing Stack tools, we found it quite easy to transform our 3D map of New York City into a virtual movie set for film pre-visualization. See below for a quick tutorial on how to create the same scene in Unity and interact with it using AR. Finally, your director dreams come true!
- First, we obtained a model and created very basic rigging and animations. After the animation was done, we imported it into Unity.
- Then, we created a GameObject for King Kong and added animator so it plays animations.
- You will want to add GeographicTransform on the GameObject.g. Give Kong GameObject a lat, long for the iconic Empire State Building in New York City.For converting between Unity’s world space and real world coordinates, you will want to use GeographicTransform — see the WRLD SDK documentation and an example. Other coordinate conversions are covered in the docs for your reference.
- We then made some minor position and rotation adjustments. It’s up to you how you want to do this – have some fun!
- We integrated animation with the 3D map and created some cameras to place them as we like. Since the whole scene is being performed for you, you become the cinematographer and director for full creative input on the cameras. Enjoy!
- To create high-quality visuals, we used Unity’s post-processing stack to make the scene black and white, and then added a little grain to give it some vintage film feel. We were really impressed by this easy to use interface and the filters offered.
- Cinematic storytelling in AR – last but not least, set up the scene to view and interact with King Kong in AR! To do this last step, check out part 1 of this tutorial on how to set up WRLD in ARKit using Unity.