Researchers have been testing the potential of augmented reality to allow drivers to enjoy the benefits of being driven by an autonomous vehicle while enabling them to quickly take the wheel if required.
As self-driving cars become more common on our roads, a key question for future road safety is how to balance passengers’ desire to relax during their trip with remaining aware of road hazards and being ready to retake control.
The University of Glasgow research suggests that placing attention-grabbing graphics over real-world views through car windscreens using augmented reality heads-up displays (HUDs) could help drivers to use entertainment apps while still maintaining awareness of the road.
However, their design needs to be carefully managed to avoid overwhelming users with information at critical moments.
The findings can inform the development of safety features in future generations of self-driving cars as they move towards the full autonomous control planned by manufacturers, researchers say.
Thomas Goodge, of the University of Glasgow’s School of Computing Science, is one of the paper’s coauthors. He said: “One of the main attractions of autonomous vehicles is that drivers will eventually be able take their focus off the road and place it on non-driving-related tasks like reading, playing games, or watching TV.
“Drivers can do that to some extent at the moment, but they still have to maintain an awareness of road conditions so they can take control in emergencies. It will likely be years before they’re capable of driving themselves entirely without human intervention.
“In the meantime, the people sitting behind the wheel are somewhere between drivers and passengers – not actively involved in steering but still required to supervise their vehicle to make sure they get safely to their destination.
“One big problem with that is that humans don’t deal very well with sustained supervisory tasks. They get bored, they get distracted, and when they do they lose their awareness of the road. That could be dangerous if they react too slowly to a sudden change of the road conditions around them.
“What we wanted to do with this study was explore whether attention-grabbing augmented reality systems could allow people to perform non-driving tasks but quickly switch focus at critical moments.”
The team’s lab experiment put study participants in a driver’s seat in front of a steering wheel and computer monitors to simulate their view out of a car window.
The screens displayed a series of 40 video clips of real road situations and asked them to complete tasks on either a tablet screen, similar to the large dashboard displays of current-generation vehicles, or while using an augmented reality display overlaying tasks on top of the road scene.
One task was a simple game where users tracked and ‘collected’ gems moving across the screen by gazing at them. The second task presented the participants with a more complicated number pad app on which they had to correctly copy a phone number.
In both scenarios, the video stopped abruptly before a potentially hazardous situation like a pedestrian stepping into the road, to test situational awareness. The participants were asked to select from one of four predictions about what would happen next based on their understanding of the road conditions at the point the video cut off.
Their ability to correctly guess the outcome of the hazard was measured against an initial control experiment where they made predictions without performing a task. In both the heads-down portion of the task using the tablet and the heads-up section using the AR headset, participants were able to maintain some awareness of the conditions on the road.
However, their ability to reliably predict what would happen next was significantly reduced in both setups.
In another section of the experiment, the AR headset displayed special visual cues in participants’ eyelines to draw their attention to developing road situations several seconds before the video stopped. Here, the participants showed increased awareness of the road conditions, with performance improving more in the gem-collecting game than in the more demanding keypad app.
Study co-author Professor Frank Pollick, of the University’s School of Psychology & Neuroscience, said: “An important aspect of road safety is something called the ‘look but fail to see’ phenomenon, which happens when people fail to adequately process what’s right in front of their eyes.
“This study aimed to replicate that in a simulated driving situation, where participants had all the relevant information on the screen in front of them but were being distracted to one degree or another, blurring their ability to judge the road conditions correctly.
“Augmented reality tech really does put information right in front of people’s eyes, so it could be a good fit for tackling the look but fail to see problem.
“The study shows that adding visual cues to draw drivers’ attention to situations does seem to improve their ability to quickly focus and understand situations. However, the level of demand on their attention is important – they were more able to read the road correctly in the less cognitively-challenging task.”
“ As self-driving cars become more common on our roads”.
Except they’re not and never will be. Pointless and wasteful research.
Philip Jones, Birmingham
--9