Disney Research AR app turns colored drawings into 3D characters
A new Disney Research project can make colouring books more exciting for those of us with limited art skills. The team has built an interactive Android and iOS colouring book app using Unity game engine that can take a coloured drawing and turn it into an augmented reality object on screen — and, yes, as you can see above, it retains the original artwork’s texture. In fact, the app can generate parts of the object in the same texture even if you only colour a 2D picture. For example, if you fill the front-facing line drawing of the elephant above, the app will show you a backside that resembles your masterpiece. It’s definitely not perfect, but it works.
The app does that by copying pixels from your piece and adapting them for use on the objects regions. It also transforms your drawing into a 3D object in real time, so you can actually watch it getting coloured on screen. We hope the researchers expand the app’s capabilities in time — it could, for instance, use the characters in interactive games. Unfortunately, you can’t download the app or buy the accompanying colouring book for now.