This functionality relies on Google's Street View data, so of course it won't work on remote roads that have never been documented. I also found the app took a few extra seconds when heavy traffic, or large vehicles such as trucks or trams, blocked the view. But for the most part it worked like magic.
Once confirmed, a set of big blue arrows appears over the road in front of you, letting you know in which direction you should head off. This is the single most useful part of the new feature. When finding your way around an unfamiliar place, the biggest problem with Maps navigation (unless you possess a perfect internal compass) is working out whether you need to set off in one direction or the other. And GPS can be slow to update, meaning you can go in the wrong direction a decent way before realising you need to turn back. AR solves this instantly.
Once you're on your way, a blue bubble appears in the distance to mark your next turn, with street names and distances marked at the intersection. Arrows appear when you're closer. The directions are hard to miss, and even cast a simulated shadow, although it can be weird when cars drive through them. If they're behind you a pointer will appear so you know where to look.
You can lower your phone and it returns to the usual navigation mode, vibrating when you need to turn and displaying a map, but if you raise it back up the AR vision will reappear. I found that if I'd walked a bit in the meantime the phone often needed to scan again, meaning you need to stop for a few seconds.
To discourage people from walking while staring at their phone, the app will warn you if it detects you're moving while in AR mode, and if you keep going, after a few seconds it will go blank and insist you stop or lower your phone. It's an effective system, and works well if you only stop to check AR when you're not sure where to go.
To discourage people from walking while staring at their phone, the app will warn you if it detects you're moving while in AR mode.
The new feature makes use of several bits of technology from across Google's services, including Maps and Street View, but also Lens and Playgrounds. Lens is the function built into Pixel's camera, and available as a separate app, that can scan anything and offer information from the web. For example, scanning a business card might link you to send an email or call a person, while scanning a friend's shoe could bring up shopping information about where it's on sale.
Playgrounds is the AR component of the Pixel camera, which scans your surroundings to determine where the floor and other objects are before allowing you to drop in a range of characters, from Detective Pikachu to Stormtroopers to Childish Gambino, that walk around and interact.
Mobile AR has been an increased focus for both Apple and Google since the development of software that lets single cameras accurately determine depth, and AR functionality is available on phones as old as the original Pixel and the iPhone 6s.
At this week's Google I/O developer's conference, the company announced it would be integrating AR objects into search results on mobile. For example, someone searching for information on a great white shark might have the option to drop a true-to-life scale AR model of the shark into their surroundings and examine it.
Tim is the editor of The Age and Sydney Morning Herald technology sections.