Varjo introduces ‘virtual teleportation’ platform

Varjo Reality Cloud will allow collaborators to ‘teleport’ to a construction site in real-time

The Varjo Reality Cloud is a new ‘virtual teleportation’ platform from industrial VR/XR specialist Varjo. It enables anybody to 3D scan their surroundings in real time using a Varjo XR-3 mixed reality headset and then instantly transport others to that same physical reality.

The Varjo Reality Cloud platform has a major focus on construction. Anyone can instantly ‘teleport’ to a construction site to join others live inside a collaborative immersive expeirience using a ‘highly accurate’ 3D reconstruction of the site. In the future, Varjo said the technology could extend to merging as-designed BIM data with as-built reality models for construction verification.

“With the Varjo teleport, you can have a construction worker, maybe one of the managers over there, put the headset on, and then the customers can join in, instantly,” says Urho Konttori, founder and Chief Technology Officer, Varjo speaking with AEC Magazine. “Or maybe the architect can oversee the site, the creation of the building, give final comments and collaborate without having to actually fly to a different country.”

To capture the reality, the Varjo XR-3 headset uses a combination of its built in LiDAR scanner and stereo video pass through cameras. The ‘fully immersive photorealistic real time 3D’ data is then pushed to the cloud in real-time where it is processed on powerful GPUs and the pixels streamed to a variety of client devices.

According to Varjo, thanks to its foveated transport algorithm, powered by Varjo eye tracking on the headset, you can stream your reality with a lower bitrate than you would stream a movie from Netflix, while keeping the human eye resolution quality.

You currently need a Varjo VR-3 or XR-3 headset to experience the Varjo Reality Cloud, but this will extend to other devices in the future, including laptops, phones, tablets, or wireless headsets.

Capturing reality for Varjo Reality Cloud

The LiDAR scanner on the Varjo XR-3 headset can capture the world at distances of up to five metres at 30 frames per second. According to Varjo, accuracy is sub-cm at close distance, but 5cm at 5m due to calibration tolerances. Larger areas can be captured by walking around a site and because positional tracking is sub-mm, the accuracy would not decrease, says Varjo.

LiDAR data is then combined with various in house developed algorithms that ‘fuse it with depth from stereo disparity maps’ taken from the video see through cameras. “What this means is that we have a very robust depth estimate for every single pixel of the camera feed and this is one of the game changers in the quality,” says Konttori.

Building construction workflows

To help drive development of AEC workflows in the Varjo Reality Cloud, Varjo has acquired Dimension10, a Norwegian software company that specialises in BIM collaboration using VR/AR headsets.

The company’s virtual meeting suite is designed specifically for AEC teams and will be a ‘critical component’ in future developments for virtual collaboration.

Dimension10 will allow Varjo to bring in as-designed BIM models and merge them with as-built reality models captured by the Varjo XR-3.

Varjo told AEC Magazine that it is already exploring construction verification workflows with Dimension10 having previously used on-site LiDAR data from traditional laser LiDAR scanners. Dimension10 has direct integrations with Autodesk Revit, Autodesk Navisworks and supports IFC, BCF, FBX and other neutral formats.

Varjo is also inviting select developers to create solutions on the platform, using an API, so expect more industry-specific integrations. But, not for a while. In the words of Timo Toikkanen, Varjo CEO, “It’s going to be a long journey, it’s not going to be happening overnight.”

Alpha Access to the software will start later this year.

The post Varjo introduces ‘virtual teleportation’ platform appeared first on AEC Magazine.