Since the 3D objects created by the photogrammetry software range between 10 to 40 million polygons, the GPUs also provide the performance necessary for the 3D applications to handle them smoothly.

It is not always easy to capture a subject as intended. There are often plants in the way or you may not able to reach it or failed to get a good photograph. In those cases, the photogrammetry process can sometimes have issues and texture can get projected weirdly, or you can get gaps in the model. One way to deal with this is to use Allegorithmic Substance Painter — its projection tool is great to touch up textures in these problematic areas, making it possible to fix multiple channels at once with the content from other parts of the object or photographs.

The plants are done through a different workflow. After selecting live the plants that he intends to digitize, he separates the leaves from the stem and takes a top down image capture using a custom built light box. This allows him to adjust the light directions, making it possible to capture a diffuse, subsurface, opacity and different lighting directions. The normal information and height are then created using Allegorithmic Substance Designer and inputting the various light directions into the multi angle node.

Eventually, when everything has been reconstructed, it comes together in Unreal Engine 4. For this he uses a free special build found on GitHub, that includes NVIDIA VXGI — an implementation of a global illumination algorithm known as Voxel Cone Tracing. Global illumination computes all the lighting in the scene, including secondary bounced light reflecting off diffuse and specular surfaces. Adding GI to the scene greatly improves the realism of the rendered images.

Since he is developing for 4K monitors, de Boer uses massive 8K textures to ensure image quality in the real-time experience. Working at this resolution is not only more work for the artist but also taxing for the hardware and software. Creating large environments with high quality textures requires ample GPU memory pushing the limits of gaming hardware and into NVIDIA Quadro territory with 24GB of GPU memory.

While images are great, seeing these environments in motion running in real-time is truly spectacular.

To stay up to date on Rense de Boer’s work you can check out his website and Facebook page.

The video below is captured directly from Unreal Engine