Development of an AR remote assistant platform

Project description:

A turnkey solution – a platform including a user/expert personal account, with the ability to add new procedures and with a help desk system module where user requests will be closed, as well as the AR headset software.

The software package allows for remote maintenance and employee consultations using advanced augmented reality technology to solve problems faster and more efficiently with the ability to display the desired information on the user’s screen, as well as to mark the desired area in three dimensions or to create step-by-step operations.

Features:

Executing a sequence of actions according to instructions
Ability to connect a remote expert with video/audio communication
Real-time visualization of prompts

Supported devices:

AR glasses
Smartphones
Tablets

Object detection capabilities in three-dimensional space:

Tracking by graphical mark
AR headset or mobile device detects a mark to which the coordinates of the desired objects are subsequently attached
Neural network training for object detection
Suitable for complex objects with size starting from 5 sq. cm.

Support for AR devices and their capabilities:

Features	Microsoft Hololens 2	Epson Moverio	Smartphone or tablet
Audio/video transmission	+	+	+
User position detection	+	–	+
Ability to place a mark or todraw in 3D space by the administrator on the user’s screen	+	–	+
Initialization of an object on the user device	+	–	+
Display and confirmation of the action sequence	+	+	+

Development of an AR remote assistant platform