Conference

DevSummit 2019 Talk: Augmented Reality Paired with Computer Vision

Argis Solutions’ CEO Brady Hustad presented on computer vision and augmented reality and how to use the Open Computer Vision Library with ArcGIS at Esri’s 2019 DevSummit. 

By Alyssa Grant 

At Esri’s 2019 DevSummit held in Palm Springs, CA on March 5-8, machine learning and ArcGIS REST JS created a big buzz. Another hot topic among DevSummit attendees was how developers are switching to 4X JavaScript libraries, which allows for more 3D capability and better functionality. This conference is the annual opportunity for Esri’s expert developers to share their technical knowledge with other software developers to help them write better code, build better systems, and create state-of-the-art apps that utilize ArcGIS mapping technology. While there are 8 rooms simultaneously hosting a full daily schedule of talks, there’s also a little time for dodgeball and beer! 

Argis Solutions’ CEO Brady Hustad had the honor of sharing how to integrate computer vision and Esri, explaining how to use the Open Computer Vision Library (Open CV) with ArcGIS. The presentation covered the technical setup of Open CV, some interesting tips on how to successfully connect it to ArcGIS, and coding tips that will help Open CV function properly for developers interested in using computer vision in their next project. Reflecting on his talk, Hustad remarked, “It was exciting to see how people are getting creative and how computer vision and machine learning are impacting the way they are doing business. People are seeing ways to go beyond doing maps and creating systems software.” 

Computer vision enables a computer to see something and make a decision that a human no longer has to make. For example, if hundreds of miles of roadways need to be analyzed for damage, computer vision could allow the computer to look through thousands of images and determine which images contain road damage. In robotics, computer vision has been one of the hardest problems for programmers to solve. Now with access to libraries such as OpenCV and some some finesse to connect it to ArcGIS, programmers are able to attempt to integrate this complex technology in ways that will shape the future of business. 

Big cities can be GPS black holes—their large volume of concrete and metal throws off GPS service and blocks signals. It can be difficult to get accurate geographic data. Using the rough satellite location of the mobile device, the computer can compare and compute location using two known points, giving improved accuracy in the city. Computer vision could enable the mobile device to detect an asset such as a manhole cover, storm drain, or hydrant. It just needs to be trained to see these known above-ground facilities, enabling the ability to generate accuracy where before none existed. 

Together, AR and computer vision could be used to document missing GIS assets. The computer could be programmed to be passively viewing in the background with the ability to notice an asset that is not documented in the ArcGIS data. The computer would then generate a basic record with spatial location. Its final step would be to ask the end user for further details, for instance: “This asset is not found in your data. Is this correct?” This would be an efficient way to quality check data. 

Computer vision could also be used to train a computer to look at an asset when a field worker is looking at it and then automatically pull up the right manual to work on that asset, streamlining field work. As AR visualizer improves with computer vision and image recognition this will all be possible. Computer vision is a game changer in improving accuracy and processes. 

How do we get there? Spatial referencing is required. Once you know where something is in space by way of dual cameras, you can extrapolate 3D space around it. Most mobile devices now come standard with dual cameras, paving the way for programming these functionalities. Argis Solutions has also made the code for Brady Hustad’s talk available on GITHub for developers interested in building projects using the OpenCV library and ArcGIS

What is needed to program computer vision? A knowledge of a modern programming language like Swift, C++, Java, Python, Kotlin, etc. A developer will also need to be savvy with mobile software like ARCOREARKitOpenCVEsri, etc. Lastly, a project using Open CV and ArcGIS will need decent software and high availability GIS data. If you would like tips and further information on programming, please visit GITHub, where our example is built in Android using Java and Esri’s ArcGIS Runtime SDK for Android.

Experience AR at the Esri UC 2018

Esri’s User Conference is something to be experienced in person. GIS professionals gather in the San Diego Convention Center for a week of geospatial thought leadership and thousands of hours of GIS learning. It is a great chance to discover how GIS is transforming our world. Augmented Reality is at the forefront of that transformation and Argis Solutions is the premier provider of Augmented Reality integrated with ArcGIS.

If you are going to the UC in July, it is a great opportunity to learn more how the Argis Lens is changing meter reading in the Esri StartUp Demo Theater, how North Carolina’s Project Zero in its final stages is making a difference in educating the community with the help of Argis Solutions’ consulting team, and most importantly, see real-world application for Augmented Reality and how it is changing the way we see our maps.

North Carolina’s Vision Zero Map:
Enabling Access to Traffic Crash Patterns

GIS for Safety Management

Date: Tuesday, July 10, 2018
Time: 8:30 AM - 9:30 AM
Venue: SDCC - Room 24 BNCSU Project Zero Visualization Project

Co-presenters: Burke Foley and Brady Hustad

Burke Foley

Burke Foley

 
Brady Hustad

Brady Hustad

 

The main thrust of the NC Vision Zero initiative is to create a unified traffic safety vision that helps reduce risky driving behaviors by changing the overall traffic safety culture. The Vision Zero Map application accomplishes this by engaging ALL safety partners, including the public, as a way to bring this shared safety vision to reality. Safety educators especially will find the Vision Zero Map application and website a rich tool for educational purposes. 

Improved Meter Reading with Augmented Reality

Startup Zone Spotlight Theater

Date: Wednesday, July 11
Time:  2:30 pm - 2:50 pm
Venue: SDCC - Esri Showcase: Startup Zone Spotlight Theater
Presenter: Brian Collison

Brian Collison

Brian Collison

 

The Argis Lens brings GIS data into the 3D world meter readers work in. Learn how integrating the ArcGIS implementation of the Lines, Hydrants, Meters Department in the City of Thornton, CO with Augmented Reality improves the productivity and improves asset documentation.

AR/VR Special Interest Group Meeting (SIG) 

Co-Sponsored by Argis Solutions

Date: Tuesday, July 10
Time: 11:30 am - 12:30 pm
Venue: SDCC - Room 28 E  - AR/VR SIG

Presenter: Brady Hustad

Brady Hustad

Brady Hustad

 

Rapid advancements in spatial awareness and display capabilities of mobile devices and headsets are powering innovative simulations and augmentations of reality with authoritative geospatial data. The ArcGIS Platform is critical for hosting geospatial data and operations, powering 3D capabilities, and enabling immersive mixed reality experiences. This meeting will include presentations from customers who build augmented, virtual, and mixed reality (AR/VR/MR) solutions on the ArcGIS platform.

Experience AR at the UC by visiting Argis at Booth Z2 in the Start Up Zone!

The Esri's User Conference takes place July 9 - 13, 2018 at the San Diego Convention Center, San Diego, California. We'd love to connect with you. Let us know you will be there.   

Practical Application of AR

Practical Application of AR

Argis Solutions is the most practical application of AR available in today's market with expert interpretation of geospatial symbology and application. It is one of those cutting edge technologies that can be shared with today's workforce now and make a major difference in how that team communicates and interprets how the data looks in the real world. 

Podcast: Digital Politics with Karen Jagoda

Paul Hoemke, Business Analyst at Argis Solutions, did fascinating podcast with Karen Jagoda at the Esri UC earlier this month. Listen to the whole podcast at Digital Politics with Karen Jagoda. We've reproduced a few of the highlights here.

Argis Road Trip: Risk Mitigation

The Argis Road Trip is continuing on to San Diego. See how the trip went and learn something about how #AR can effect risk mitigation.

On our way through Moab, Utah, we took a hike to show you how augmented reality helps mitigate risk. Sounds exciting, I know. But the truth is: what we’re about to show you revolutionizes the way you and your teams will harness GIS data. 
Dusty dirt paths to the naked eye become rich veins of information through the Argis Lens. 
But simply being able to view these assets wouldn’t be revolutionary, would it? So what we’ve done is allow you to interact with them.  
The Attribute Window makes crucial information regarding any asset readily available at the touch of a screen. In Moab, for instance, we could view the lengths of the trails or the last time they were maintained.  The Argis Lens brings all the rich information that surrounds us right to your fingertips. 

See the rest of the story here on our blog by subscribing or by following our youtube channel. 
 

#argisroadtrip #AR #esriuc

Argis Road Trip: First Stop

On our way out of town, we stopped by Colorado’s world-famous Red Rocks Ampitheatre, to show you how, together, the Argis® Framework and Lens bring GIS data into the real-world.
Using data gathered through Esri’s ArcGIS Online, we rendered Red Rock’s assets into the Argis Lens, transforming invisible information into visible resources.  Resources such as the electrical lines used to power the ampitheatre’s unforgettable performances. All this incredible information can be viewed from any perspective in the field, live or cached, with our without Wi-Fi. 

ArcGIS Online Map of Red Rocks

ArcGIS Online Map of Red Rocks

Side-by-side, it’s easy to see why a three-dimensional perspective of your data is simpler and far more intuitive for anyone to use than a two-dimensional map.
Augmented reality may seem like something of the future, but here’s now, and it works.  

Follow the rest of the journey on our youtube playlist or follow #argisroadtrip on twitter to hear the rest of the story. See you in San Diego!