Picture showing Microsoft HoloLens, used with permission from Microsoft
Augmented Reality or Mixed Reality?
Definition
Augmented Reality is a live direct or indirect view of a physical, real-world environment whose elements are “augmented” by computer-generated or extracted real-world sensory input such as sound, video, graphics or GPS data (Wikipedia). Therefore it’s a section of Mixed Reality (Image 1 “Reality-Virtuality-Continuum”).
A common example for an application of Augmented Reality would be the insertion of further information during the live broadcast of a soccer game. Offside lines or goal distances during a free kick are digitally shown on TV. The augmentation of every reality impression, together with all extra information, occurs live (in real time) and is able to respond to every human sense modality. However, the term “augmented reality” is often used in connection with a visually extended depiction and therefore functionally often reduced to extensions of only the visual perception of its users.
In everyday life, one’s auditory sense can also benefit of AR-functions. Voice announcements in public transports are most often automatized and computer-controlled. The software tracks down the recent location of the tramcar and based on this information, determines the next stop. As a result the passenger can hear a combination of different pieces of text and hence knows about the next stop and direction of the exit.
Requirements
In the following, typical requirements for a mobile AR solution based on image markers are listed.
Hardware requirements:
- Sensors to capture real life surroundings and orient themselves in space (e.g. RGB Camera, GPS, Gyroscope)
- Interfaces to register user inputs (e.g. Touchscreen, Microphone)
- Computing power/ Processors to process and calculate data
- Interfaces for the output of data and information (e.g. Display, Earphones, Vibration)
Software requirements:
Technology for the purpose of …
- Analysing camera pictures (Image analysis)
- Analysing different sensor data (GPS, Acceleration Sensor, Gyrosope)
- Linking existing data sources and resources (e.g. Database Interfaces etc.)
- Managing user inputs and sequence control systems (z.B. Game-Engine)
- Superimposing the camera input with virtual augmentations (Image Processing)
History
AR can be traced back to the 1960´s. Mobile Augmented Reality however, is relatively new, yet developing very quickly. The first AR-Browser-Apps named junaio, Layar and Wikitude have been developed between 2008 and 2010. With the appearance of the iPhone 3Gs, which had the necessary sensors and more computing power, mobile AR became interesting for mass market in 2009. Over the course of time, companies such as metaio, Total Immersion and Qualcomm established themselves as Software-Providers for Augmented Reality SDKs, which have been provided on a license model basis to other developers. Due to the growth of these companies and software solutions respectively, other technology groups took them over. Therefore in October 2015, PTC bought QUALCOMM’s vuforia SDK for 65 mil USD. Shortly before that (05-2015), Apple acquired the company metaio and their technology portfolio. Almost contemporaneously, Microsoft announced new data headset, the HoloLenses. Forerunners to those are, among others, the data goggles by the company Vuzix and the Google Glass. Since mid-2015 two basic progresses in the technology sector for AR solutions have been developed. For one thing the development of already existing approaches of solutions for mobile “handheld” devices, such as Smartphone, Tablet and Phablet (mostly changes in software e.g. Apples ARKit or Googles ARCore, both becoming native AR-technologies of iOS and Android respectively) and for another the investigation and production of new AR-Output Devices (mostly smartglasses, data goggles or camera and sensor technology). Not only Microsoft HoloLens is trying to achieve those developments but also other companies, that run the projects “Meta” and “Magic Leap”.
Reality-Virtuality-Continuum
The R-V-Continuum (or Immersive Computing Spectrum) pictures the continuous transition of real environment (on the left) up to virtual environment (on the right) and gives every different section appropriate terms. Mixed Reality is the part of the R-V-Continuum that shows the range of the integral real and the whole virtual environment. Mixed Reality therefore comprises every section in which reality is mixed with virtuality (or vice versa). Augmented Reality is consequently part of Mixed Reality.
Where do Augmented Reality and Mixed Reality Solutions appear in every day life? How can Mixed Reality Headsets like the Microsoft HoloLens revolutionize the Human-Computer Interaction (HCI) in private but also professional environments in the future? In the following, some examples of AR/MR usecases and their advantages for various industries and business units will be pointed out.
Real Estate / Architecture / Interior Design
Project for KWAG – AR App Leopold Carré – 2015
- High Information rate due to interactive, animated depiction of planned or existing Real Estate as AR-Miniature Model
- Intuitive access to the context of the building (neighbourhood development, existing objects, lighting and shadows, prominent properties of the object) due to the processing of information in the AR-Scene
- Convincing presentation of construction project via pre-visualization of the buildings and their construction phases in life size in the foundation ditch
- AR-Applications as tools for interactive planning of the interior design help the client’s imagination
- and others…
Fairs / Exhibitions
Project for OWA – AR App for exhibition booth – 2017
- Maximum benefit from the exhibition area via virtual presentation of products while being shown in real size at the same time
- Depiction of additional information on exhibits (Text, Images, Moving Images, 3D Animation) with linear or non-linear user guides via the AR-App
- Cost savings due to reduced transport costs for exhibitors (products can be transported as virtual exhibits)
- Uncomplicated clients approach via Augmented Reality trade-fair concepts (crowd-puller, Icebreaker, innovation feature) with smart devices or as kiosk system (digital signage)
- and others…
Marketing / Augmented Reality Print
Project for Lamborghini. On behalf of TERRITORY – AR in Magazin – 2016
- Increased information content of print via Augmented Reality Companion-Apps as an interactive addition to the printed format, also known as AR-Print or Interactive-Print (e.g. product catalogues, product packaging, flyers, mailshot, business cards, etc.)
- Especially high-quality virtual processing of complex information (e.g. image brochures, annual reports, anniversary magazines, etc.)
- Possibility to use Authoring-Systems to simplify production and administration of new contents
- and others…
Finishing and Expansion of the product
Project for Columbus-Verlag – 4D Globus App – 2014
- Smooth connection of timeless and high-quality product properties with innovative digital functions (e.g. Columbus-Verlag Globus-Weltkugel, 4D Globus App)
- Successful enhancement of traditional board games via the clever combination of analogue and digital game mechanics (e.g. Ravensburger AR-Puzzle, Scotland Yard Master, etc.)
- User-friendly combination of analogue and digital data stocks (e.g. the print of a magazine with digital media on the Internet, Web-to-Print Photobooks with video clips)
- and others…
Training / Instructions / Education
Picture showing Microsoft HoloLens, used with permission from Microsoft
- Simplified explanation of products, whose use and repair with the help of the corresponding AR-App (e.g. maintenance and service of electric devices, instructions for the construction of party games, etc.)
- Optimized and individualized training of business people via AR Training Solution – independent from location, flexible concerning time and space, scalable
- success in learning via interactive and positively emotional learning with AR Learning Applications as an innovative approach to communicate knowledge
- and others…
Augmented Reality Medicine
Picture showing Microsoft HoloLens, used with permission from Microsoft
- Dentistry – Real time depiction of teeth reconstruction, while having freedom of acting due to free hands (AR-Goggles)
- Surgery – Visual help via AR-Depiction leads to reduced error rates at surgeries
- Training – detailed studies of the human body on a 3D, virtual basis (without threatening the life of a living patient)
- and others…
Logistics / Warehouse
Conzept of AR Vision-Picking – XPuls / www.tag-der-logistik.de
- Optimized courses for warehouse and logistics workers, Vision-Picking makes paper or handheld-devices unnecessary
- Important information on the product (weight, destination, characteristics, etc.) can be visualized for the supplier via Augmented Reality App in the context of the parcel
- Clear depiction of the delivery address, Identification of receipt or individual delivery requests to the supplier
- and others…
Productivity
Picture showing Microsoft HoloLens, used with permission from Microsoft
- Time and cost efficiency via Rapid-Prototyping with a virtual part overlapping on the real product (true to scale, easy to configure, short production phases, rapid iteration)
- Decentralized cooperation , virtual collaboration as well as networking of locations and staff via Multi-User MR Applications (collaborative approach of AR and VR applications)
- Translation-Apps with AR-Functions for a rapid and context related translation via picture recognition and smartphone
- and others…
Automotive
Picture of BMW Head-UP Display, used with permission from BMW-Group
- Improved security in traffic via AR control and navigation systems and simplified use of complex data for the driver
- Quicker Iterations while the planning of new vehicles due to reduced conception times, faster prototyping via AR-Tools in the construction area
- Increasing efficiency and reduced error rates in the processing of vehicles via networked and digitalized processes and AR-Systems
- Enormously facilitated maintenance works on the own vehicle via clients or service staff and mechanics via AR-App maintenance work help
- and others…
Industry / Manufacture
Picture showing Microsoft HoloLens, used with permission from Microsoft
- Digitalization and innovation with AR as a solution to show information in the context of running processes
- Optimized visualisation of each work stage – hands-free, interactive, connected/networked
- Smooth and time efficient Testing via AR quality control replace prone to errors processes with paper
- Digitalization and optimization due to Multi-User – Multi-Device solutions for Industry and Manufacture
- Reduction of production times and error rates via networked and interactive AR-Systems
- and others…
Augmented Reality Tourism
Concept of GPS based AR Navigation
- Integral understanding of backgrounds and occurrences via high-quality depiction of historic developments and attractions and buildings
- Higher travelling quality due to interactive travel guides
- More fun whilst exploring new destinations via AR-Gamefication for travel groups
- Emotional experiencing of metropolises via stunning sightseeing tours with the AR-App
- Simplified orientation and navigation via GEO-Positioning and AR-App
- Simplified searching and booking of hotels, rental cars, tickets, etc.
- and others…
Games / Gamification / Serious Games
Image of Pokémon Go, nianticlabs.com – 2017
- AR-Games turn our well-known environment and every day life into a fantastic world of games (e.g. ski run with virtual route points as Gamification)
- Games with AR-Technologies work in the context of reality and get their players to get up from the couch and back to nature (e.g. GEO-Cashing Games)
- Edutainment with AR-Functions can bring realistic, historic, fantastic but also serious contents together (e.g. historical guiding tours as paper chases)
- AR-Functions can be used as a mechanism for serious games and build the bridge between virtual and real contents
- and others…
Sales and Commerce
Concept of AR Shopping App
- Virtual fitting of watches, glasses and clothes as a cost efficient alternative to real product samples (Saving of returns
- Easy to carry and show virtual product samples for sales staff in field service, at the same time exiting form of presentation
- Every AR-Marketing scenario can be shown together with direct sales options for the portrayed products (mobile Commerce)
- e.g. Portraying the print with virtual price tags and digital purchase option
- e.g. Order-function to show virtually placed furniture
- Individual solutions, not only possible as Apps for smartphones and tablets but also Kiosk-Systems at the Point-of-Sale
- and others…
Your Mixed Reality (AR/MR) Solution?
Innovations and Ideas become solutions – Augmented Minds – since 2010
- AR Technology has a lot of unused potential to offer – as a part of digitalization, visual overlapping of Internet Of Things (IoT), interactive Tool to optimize production and controlling processes or the marketing and selling of products
- … even in your branch. Please contact us!
