Use of Mixed Reality in product presentations at MBIT

Augmented and mixed reality (AR/MR) technologies are based on the initial recognition of a device's environment using digital sensors. Based on the information gathered about the spatial surroundings, AR/MR devices can anchor content to fixed points within that environment. Depending on the sensors used, lighting conditions and the boundaries of the spatial area play a role. Therefore, AR/MR technologies are currently best suited for indoor use. Enclosed spaces or clearly defined and identifiable sections of larger buildings (e.g., production halls in industrial plants) are optimal environments. Applications designed for outdoor use present some particular challenges. MBIT, an expanding SME in the IT sector, planned the construction of a new company building. Even before construction began, the building was to be visible to anyone interested at the planned location using AR-enabled consumer devices (smartphones, tablets).

During the implementation phase, various AR marker types were evaluated for their suitability for loading VR content over long distances and under different lighting conditions using the AR framework "Vuforia." Such markers often serve as "initial triggers" for smartphone cameras to load specific spatial information. There are different approaches: Simple "image targets" are markers where an image (with many unique features) is printed. "Object targets" require the prior capture of real-world 3D objects using specialized software. The object is captured from various angles, for example, with a smartphone camera. An algorithm then identifies unique features that an AR application can later use to load content related to this object. "Model targets" are existing digital 3D data that correspond to a real-world object. Similar to “Object Targets,” they can be used to employ physical objects (corresponding to the respective digital 3D data) as markers. The results led to the development of a prototype app that utilizes the “VuMarks” marker type, and a bachelor's thesis describing the evaluation and its findings. “VuMarks” are Vuforia's own marker type. Following a specific guide, custom images are laid out, characterized by a particular arrangement/coding of fixed areas in two different colors. These areas must exhibit high contrast. These markers also function, in appropriate sizes, over long distances and under challenging lighting conditions.

Here you can find a video about the project implementation.

The overall project "Mixed Reality Based Collaboration 4 Industry" was created through the collaboration of 22 companies and five scientific institutions from Lower Austria, Vienna and Upper Austria ((FH St. Pölten, FH Oberösterreich Standort Steyr, FOTEC, IMC FH Krems und TU Wien).