Ariseum has developed a universal platform for mass browsing of VR content under control of a host device.

We have created a universal platform allowing arranging a VR cinema for viewing 360° panoramas, 360° video, 3D models, photos, and listening to audio recordings 

A user-friendly administrative section allows creating watch lists on different topics. The platform can be used for educational purposes, for excursions, as well as during entertainment events.

Customer's background

The ArVizio project, in which the Ariseum team participates, aims to creating VR content for AR excursions, virtual excursions, teaching pupils, students, and industry experts.

Task

To conduct interactive excursions with up to 40 participants traveling around the city with a guide both on foot and by bus, it was necessary to develop a universal platform. With its help, the guide will be able to show VR restorations of buildings and squares, support the story with 3D illustrations and sound effects in different formats.

The platform shall be highly scalable, easy in administering, and provide fast data exchange between the monitoring device and the client.

Solution

Having analyzed the existing solutions on the market, we came to the conclusion that none of them meets the requirements and cannot be used even partially.

We developed the VarMix platform from scratch, consistently thinking through the maximum possible use of cases and providing it with a scalable feature set. 

We have tested many devices, routers, headsets, smartphones, server capacities in order to predict all possible difficulties in advance. We have analyzed and viewed gigabytes of multi-format content and came up with ways to optimize and display content for a better broadcast.

A lot of work has been performed so that the platform could support 40 devices and 1 monitoring device simultaneously without interruptions in communication, and the content to be broadcasted synchronously.

Today the platform has a wide range of functions, but it continues to change and evolve, becoming more versatile and flexible.

What we have done

• Interface for client and a monitoring device
• Server-side portion, logic for processing requests and data management
• Entity database (content, users, and device IDs)
• Server and client API library
• Administrative part for managing content, devices, viewing device statuses (charge level and temperature) and updating them
• Content file preview generator
• Content updates receiving interface
• Module for receiving commands from the console
• Automatic synchronization of files and metadata between devices
• Editing playlists
• Support for mp4 codec h264, h265 formats; JPEG.
  360⁰, 180⁰. 360⁰, 180⁰. Including support for stereo content.
• Optimization of the content viewing quality on mobile devices
• Support of files over 2GB
• Automatic restoration of connection with the router in case of signal loss
• Support for viewing content on the move (on the bus)
• Samsung GearVR, Oculus Quest, Cardboard support

How it works

The Varmix platform displays various digital content in VR glasses. This platform is remotely controlled by the Presenter using a tablet or smartphone. The Presenter can be a teacher, a guide, or any other speaker.

Before the presentation, the Presenter uploads the content to the Server via the admin panel. The admin panel is a special app on the computer.

On a tablet / smartphone (hereinafter referred to as the "Console”) The Console client management app must be installed there. Using it the Presenter downloads content from the Server via a local Wi-Fi network and manages its display on the devices of audience (hereinafter referred to as ”Viewers"). The Presenter can add some content to the Server and then upload it to the Console for further display at any time.

Another Viewer client app must be installed on the Viewers' devices. To connect the Console to the Viewers, you need to launch the app on all devices and connect them to a Wi-Fi network. After that, the Viewers and the Console are connected to each other, and the Console content can be passed to the Viewers. Content is downloaded and updated automatically via a local Wi-Fi network.

The Console allows to track which Viewers are connected, to display their name, number, connection status, and battery level.

Connection statuses:

- Viewers who are ready to display content are indicated by a green ”Ready " indicator.
- Viewers with a lost connection are indicated by a gray “Not connected” indicator. If the Viewer loses the connection as a result of a short-term network disruption, it is restored automatically and doesn't affect the course of the presentation.
- Viewers who are out of synch with the Console and don't have the desired content are indicated by a red “Out of synch" indicator.

When Viewers are synchronized, they can display content. The Presenter selects nessesary content on his Console. It can switch photos and videos, make a pause, continue and stop viewing. Playback occurs synchronously on all connected devices of the Audience.

The guide independently creates a playlist before the excursion, or can download an already saved list on the server. 

During viewing, the guide sees the status of each device, battery charge, temperature, which is done in order to replace a discharged device or prevent overheating.

Equipment

Samsung GearVR + SamsungS7 (S8, S9), Oculus Quest, Cardboard. WiFi router, Samsung tablet (or equivalent) for the monitoring device.

Result

Today, the platform is successfully used to conduct interactive tours of the most iconic items of interest around the world. Thousands of viewers leave the most rave reviews in all languages. “These are unforgettable emotions everyone should experience when visiting the museum”, “Great idea and implementation, we look forward to new excursions!”.

The platform is also popular with educational institutions and retraining centers. ArVizio is constantly expanding its libraries with new quality content and expanding the scope of the app.