Considerations When Starting With Augmented Reality
Once you have some ideas about how Augmented Reality (AR) can help your business, you’ll quickly realize that you have numerous permutations of hardware and software decisions when getting started. Following are some points to consider as you choose which AR hardware and software to purchase.
Monocular vs Binocular
It’s cheaper to get glasses that only project to one eye (monocular), but you’ll find that creates an unnatural viewing experience that can lead to fatigue or headaches. It’s also impossible to provide a 3D experience without projecting to both eyes (binocular).
Of course, you can begin testing some AR application concepts using tablets or even smartphones. Atheer’s AiR Enterprise software can be used on a variety of tablets – with on-going development work underway to expand appropriate tablet devices as they are released.
To get the very most from an AR solution deployment, however, you will want to make use of smart glasses to support a number of key scenarios. They include:
- Augmenting what you see
- Interpreting what you see
- Hands free operation
- Limitless viewing area (“screen size”)
- See-what-I-see collaboration
- Gesturing interface (breaking the bounds of keyboards, mice, and touchscreens)
So, for the purposes of helping you design the optimal AR solution, we’ll focus on smart glasses (excuse the pun).
To start with, be aware that this isn’t like buying your first pair of reading glasses when you hit middle age. Buying the cheapest pair of smart glasses just to get an AR trial underway isn’t actually a smart solution. You will need smart glasses with enough power and capability to fully explore the business scenarios that your industrial enterprise is hoping to support with an AR solution.
Another reason not to skimp is for the user interaction. Inexpensive glasses usually will have something resembling a touchpad (e.g., a very tiny version on the side of
One very big reason not to skimp on the smart glasses you buy has to be with the quality of user interaction.
Inexpensive glasses usually will have something resembling a touchpad (e.g., a very tiny trackpad or wheel on the side of the glasses) or “wearable mouse” (such a ring on your finger that provides wireless controls for the glasses). These interfaces are usually cumbersome at best, and unusable for many uses (like drawing an on-screen circle around a broken valve).
A microphone is helpful for voice commands or remote collaboration as long as your use is in a quiet environment.
Some inexpensive glasses can recognize very crude hand gestures via their standard camera. Premium smart glasses, however, will typically have a “depth sensor” that can enable hand gestures (remember the movie “Minority Report”?).
Using gestures not only enables field workers with gloves or doctors with sterile hands, but using gestures similar to touchscreen gestures (swipe, point, etc.), is familiar for users, which should improve their acceptance of the device and perhaps even reduce their learning curve.
Similarly, you want glasses that can detect head motion, which can, for example, enable the user to view multiple “screens” floating in the air off to the side, by simply turning his/her head.
The simple reality is that no two work places are the same. Working conditions vary in terms of noise, light, physical access and safety concerns. Tasks vary from company to company and from person to person. We believe that smart glasses should smart enough to understand this and be better at supporting the work your people do.
Here’s how we look at the key methods of interacting with smart glasses:
- Gestures – Gestures are a great way to precisely interact and are perfect for dirty or loud environments. Atheer AiR Experience’s precise and efficient hand tracking algorithm can enable your existing smart glasses to take advantage of their existing RGB camera or depth sensors to recognize and respond to gestures – providing a hands-free working experience to your team.
- Voice – There are some situations when gestures are not ideal, for example when your hands are occupied with tools, voice commands provider an important and safe alternative for interacting with your smart glasses. With Atheer AiR Experience you can add voice commands to your smart glass system actions and developers can define voice commands to extend their apps.
- Head Motion – In situations where voice commands and gestures are not suitable, for example in noisy environments, head motion is a great alternative. Atheer AiR Experience’s multi-display and sphere view technologies allow your workers to access and scroll between content (including video feeds) and drill into images, maps, and 3D models with a simple motion of their heads.
- Touch – Support for industry standard touchscreen devices means workers using iOS (coming soon) and Android phones and tablets can experience AiR computing from the palm of their hand
Smart glasses are computers needing an operating system. By far, Android is currently the most choice for smart glass manufacturers, and there’s good reason for that. The compact size of wearables like smart glasses must rely on the component miniaturization driven by smartphones.
The open mobile standard with the most apps is Android. You’ll want to make sure you get a device that runs standard Android (not a proprietary forked version that may not run the apps you want). Keep in mind that you’ll want a device that can provide a usable touchscreen compatible interface or your users won’t be able to use the apps even if they run.
The right Android smart glasses should be able to run any of millions of Android apps. And the more existing apps and tools you leverage without “reinventing any wheels”, the faster you can recognize value from your AR devices.
In your industrial enterprise, you may want to consider things like battery life. For example, will the battery last long enough for a typical work shift?
Or peripheral vision — In some environments, it may be safer to have a wider peripheral vision while wearing the device. Some devices block side vision. What ports does the device have? You may want to connect headsets, video output, etc.
What you’ll quickly realize after purchasing glasses is that it doesn’t do much without software. “But I’ll purchase an Android device with a touchscreen-compatible interface and run millions of existing apps, even my custom apps.” Sure, and that’s great if you just want to leverage the benefit of hands-free use. But you are unlikely to augment much reality from Play store apps.
Often with new computing devices, the first applications must be custom developed. And AR is no exception, AR already has several SDKs like Metaio, Vuforia, and Wikitude. Of course, this still means you need to determine which SDKs will work on your device’s platform, meet the needs of your immediate and future use cases, and fit in with your organization’s application development standards.
Of course, this still means you need to determine which SDKs will work on your device’s platform, meet the needs of your immediate and future use cases, and fit in with your organization’s application development standards.
Fortunately, however, there are also a few “out-of-the-box” software platforms that can address some common enterprise AR use cases in:
- Field service and inspection
- Manufacturing and assembly
- Logistics and operations
- Medical and healthcare
For example, many of the use cases with demonstrable ROI include providing intelligent, contextual guidance to personnel out in the field dealing with complex machinery or situations. Others include capturing and documenting what the field person sees and does. Others still often involve escalation to an expert with “see-what-I-see” video collaboration. Thus, these software platforms can provide drag-and-drop creation of contextual task flows that can guide a field worker.
Still other scenarios include capturing and documenting what the field person sees and does – or escalating a given issue to an expert with “see-what-I-see” video collaboration.
Thus, these software platforms can provide drag-and-drop creation of contextual task flows that can guide a field worker.
Here are some considerations when comparing which out-of-the-box” software to choose:
- Functionality – Finding software that not only meets your current use case needs, but also likely future needs is an obvious consideration
- Extensibility – The good thing with software is that you can do just about anything. The bad part about software is that you can do just about anything…if you custom code it which is expensive (at least from TCO perspective).
Thus, the best of both worlds (if you can find it), is a product solution that can easily be extended.
Look for standard RESTful interfaces and the ability to develop add-in functionality. Not only does this allow you to customize as needed without being at the mercy of the software vendor, but you can potentially leverage other 3rd party add-ins if made available.
At some point, you may want to integrate with backend systems, whether pulling or pushing data (e.g., you may want to validate barcodes with valid material part numbers). Be sure to ask about capabilities for integrating data in either direction.
The easiest way to try a solution is if they offer a Software As A Service (SaaS) offering. In this cloud era, that should be easy to find.
However, if you want access to data or integration to systems behind the firewall, you may want to ensure the software vendor has an on-premises solution as well. Your business’ preference for OpEx or CapEx may also be a factor in your deployment choice.
Innovative technologies like AR move quickly. Therefore, look for software that supports multiple devices so you don’t get locked into one device. Also, for large organizations, it is possible you may have different devices used for different use cases throughout your company.
Your AR solution needs to “enterprise ready” for the industrial enterprises – and will need the appropriate security and authentication. It will also require that the AR software can register and track devices and users, ideally tying into your corporate directory?
Total Cost of Ownership:
As you look ahead, you should keep an eye on costs, in fact, the total cost of ownership.
Beyond licensing or subscription costs, this includes factors like professional services to get it installed, working, integrated, configured, maintained, and costs of internal skills also needed.
Unless you have unlimited time and money, you probably want to make choices that will deliver value or test your AR use cases quickly.
If you’re part of an innovation team discovering technology that might drive LOB innovation and have a healthy budget, you can probably purchase one of each category of device:
- one monocular and one binocular
- one with a crude user interface and one with high fidelity gestures
- one running standard Android and one running Windows (or a closed system)
But if you don’t have the budget to try “one of each” to fully appreciate the difference, trying just the cheapest device will probably not serve you well if you’re truly trying to discover the possibilities of AR. It might be money well spent to ensure you buy a device or two high-end smart glasses that can demonstrate the revolutionary benefits of AR.
To get value out of those glasses, look for a software (probably SaaS) off-the-shelf solution that requires minimal customization to address your target use case(s). Common examples include guided task flows and “see-what-I-see” collaboration with experts.
Often, enterprises entering AR will start with a proof of concept (POC) to test their use case hypotheses and measure initial ROI.
For the common AR use cases like field service, inspection, repair, manufacturing, logistics, assembly, and some medical healthcare, the ROI is virtually always clear (e.g., reduced downtime or travel costs, improved productivity or outcomes, etc.).
Thus, next steps lead to larger pilots before ultimate production deployments. Enough large enterprises have experienced sufficient returns to invest heavily in AR. Augmented Reality technology is evolving rapidly, so don’t get stuck in analysis paralysis. Above are some considerations. Above all, though, it’s best to get started.