Drivers need to to understand limitations of automation
A new study by the University of Nottingham and the RAC Foundation suggests that behavioural training for drivers is paramount for the transition into the next stage of automated vehicles, known as level 3 automation1.
Researchers from the University’s Human Factors Research Group studied two groups of experienced drivers in a high-fidelity driving simulator to observe their behaviour while ‘driving’ a car with level 3 automation.
The study found that drivers who received behavioural training were more measured in their behaviour and better understood the car’s capabilities and limitations.
The behavioural training included the provision of a checklist known as ‘CHAT’, pioneered by Emily Shaw in the University’s Faculty of Engineering. The other group trained by reading an operating manual.
Key findings found in the behavioural training group:
- Significantly more likely to notice a potential hazard during the transition from automated to manual driving (in this case, a tailgating car), with 90% of drivers noticing the car in this group, compared to 24% of the operating manual group
- Made more measured decisions in lane change manoeuvre shortly after taking back manual control
- Spent more time preparing (e.g. acquiring knowledge of the road environment through mirror checks) before physically making the lane change
- Made more mirror checks in the run up to and during the lane change manoeuvre
- Checked their mirrors more frequently, even while the car was driving autonomously
During a period of automated driving, participants in both groups could decide whether to engage in a non-driving task, such as looking at their phone, tablet, laptop or reading materials, or nothing at all. When notified by the vehicle to take back control and transition from automated driving, the group who were trained with only an operating manual took almost 10 times longer to pay full attention to driving, continuing glances at their non-driving task for an average of 11.2 seconds, compared with 1.8 seconds in the behavioural group.
The behavioural group was also markedly faster at making their first glance at the road when notified to take over – on average 7.3 seconds, in comparison to 21 seconds in the other group.
Transforming the role of the driver:
Emily Shaw, lead author and member of the University of Nottingham’s Human Factors Research Group, said:
“This research demonstrates that the complex and changing nature of the role of the driver in an increasingly automated car should not be underestimated.
“It’s clear that behavioural training has a positive effect on the driver’s behaviour and their understanding of the car’s capabilities. Our proven training procedure, ‘CHAT’, can be used to help drivers understand their shared role and responsibilities with automated vehicle technology, so that they develop the right state of mind for interacting with these vehicles.
“The ‘CHAT’ procedure’s unique messaging is designed to support and motivate drivers to rapidly recall the checks and assessments they need to undertake before making a controlled transition from automated to manual control.”
Dr David R Large, Senior Research Fellow with the Human Factors Research Group at the University of Nottingham, said:
“While future vehicles will deliver more automation than ever before, these vehicles are likely to remain visually the same as the current cars we are used to, and therefore may not present an obvious step-change in development. Drivers, as well as those responsible for delivering driver training– and indeed, those who manufacture and sell these vehicles– may therefore be forgiven for assuming that no new skills are required to use them.
“However, this research clearly shows there is a lot of work to be done around preparing drivers for this next stage of automation. Without this, drivers are more likely to form inaccurate or inappropriate mental models of automation capability and competence, which can lead to misuse or incorrect use of driving automation.”
Steve Gooding, Director of the RAC Foundation, said:
“Many of us have been uncomfortable with the very concept of a partially automated car suddenly seeking to thrust control on a human driver whose mind, understandably, will have been on other things. The good news in this report is that there are ways drivers can be trained to handle the take-over safely. The challenge is going to be in making that training happen. The risk is that we leave it up to drivers to read their new car user manuals and when was the last time you met someone who’d done that?
“Given that the driving test was revamped to include candidates being guided by a satnav, further change seems inevitable to help new drivers understand what cars can and cannot do in a world of semi-automation where one moment the car is in control and the next it’s back to them. But based on the pace at which this tech is being developed it’s clear we’re going to need those changes sooner rather than later.
“The bigger challenge is how best to inform the 40 million or so licence holders who aren’t expecting to have to take another test. One option would be for auto companies to build on the advanced infotainment systems they are already installing in our cars so that they coach us on what we need to know in order to drive them safely.
“We’ve got used to our satnavs talking to us, maybe we need to brace ourselves for our cars giving us advice too.”
The research was funded by the RAC Foundation and led by researcher Emily Shaw, working with Dr David R. Large and Professor Gary Burnett, in the Human Factors Research Group, Faculty of Engineering.
Emily Shaw said:
“To date, driver training for automated vehicles is no different to that provided for manual vehicles. The assumption being that prior manual vehicle training and experience, alongside instruction from the dealer and/or the vehicle’s operating manual, is more than sufficient. However, the introduction of intermediate levels of automation into vehicles means that the driving task is shared between the driver and system, fundamentally changing the role of the driver.”
Emily Shaw developed the driver behaviour training (‘CHAT’) as a proof of concept to test during the study, designed as a standardised operating procedure, to motivate and support drivers in remembering and applying explanatory knowledge acquired about level 3 automated vehicles.
The letters represent the actions required and help to guide the driver in making the appropriate checks and assessment of their internal and external environments prior to taking over operational control of the vehicle:
- CH = CHeck
- A = Assess
- T =Takeover
Emily Shaw said:
“The use of ‘CHAT’ provides a way of standardising this procedure, similar to ‘mirror, signal, manoeuvre’, which drivers are already accustomed to as a result of driving lessons.
“We chose the acronym carefully to ensure the procedure was easy to remember, as well as the semantic association with the word chat – giving a purposeful nod to the necessary communication that needs to take place whenever control is being passed between members of a team, as a further reminder of the shared control drivers have with the automated systems.”
Understanding the capabilities and limitations of automated vehicles:
Cars on the road at present are equipped with levels 1 and 2 of vehicle automation, meaning several simultaneous activities which assist steering or acceleration are partially automated – this includes, lane centring, adaptive cruise control, blind spot warning and automatic emergency braking.2
At level 3, automation capability extends to the monitoring task, allowing drivers to switch their attention towards non-driving related tasks (NDRTs). However, the human driver remains responsible for the vehicle’s actions and must be ready to intervene in the event of a system failure or where the boundary of the automated system’s operational design has been reached.
Planned takeovers – when a vehicle issues a takeover request to the driver because the boundaries of automated driving capability have been reached – will become a normal part of the driving task with level 3 vehicles.
Emily Shaw said:
“In a takeover scenario, drivers need to be aware that having their eyes on the road and their hands on the wheel is not enough, their minds need to be back on the driving task.
“If and when a driver is issued with a planned takeover request they need to be making observations in order to orient themselves, making those checks and assessments, so they can start engaging their mind on the driving task, making decisions on what actions they may need to take, over and above controlling the steering and speed of the car, before they take back manual control.”
Dr David R Large said:
“The upshift in automation capability at level 3 introduces a new task to driving where the driver will be required to transition in and out of the driving control loop. This brings additional challenges where driver attention is divided between the non-driving related tasks, such as using a mobile phone, and the driving task, which can lead to missed information and error when it comes to switching from automated driving mode back to the driver being in manual control. Drivers, therefore, need to learn how to interact with these vehicles safely and effectively to be able to smoothly transition in and out of the loop of the driving task.”
Philip Gomm – Head of External Communications – RAC Foundation
[email protected] | 07711 776448
Emily Shaw – report author
David R Large – report author
Katie Andrews – University of Nottingham press office
Notes to editors:
The report is available to download here: https://www.racfoundation.org/wp-content/uploads/Driver_training_for_future_automated_vehicles_Shaw_Large_Burnett_October_2020.pdf
The RAC Foundation is a transport policy and research organisation that explores the economic, mobility, safety and environmental issues relating to roads and their users.
The Foundation publishes independent and authoritative research with which it promotes informed debate and advocates policy in the interest of the responsible motorist. All the Foundation’s work is available at: www.racfoundation.org
The University of Nottingham is a research-intensive university with a proud heritage, consistently ranked among the world’s top 100. Studying at the University of Nottingham is a life-changing experience and we pride ourselves on unlocking the potential of our students. We have a pioneering spirit, expressed in the vision of our founder Sir Jesse Boot, which has seen us lead the way in establishing campuses in China and Malaysia – part of a globally connected network of education, research and industrial engagement. We are ranked eighth for research power in the UK according to REF 2014. We have six beacons of research excellence helping to transform lives and change the world; we are also a major employer and industry partner – locally and globally. Alongside Nottingham Trent University, we lead the Universities for Nottingham initiative, a pioneering collaboration which brings together the combined strength and civic missions of Nottingham’s two world-class universities and is working with local communities and partners to aid recovery and renewal following the COVID-19 pandemic.
- A vehicle at level 3 automation is expected to be capable of delivering intermediate levels of automation that will allow the driver to relinquish control under certain, predefined conditions, for example, while driving on a dual carriageway.
- Society of Automated Engineers
Overview of the study:
- Prior to completing the simulated drive, all participants took part in a 15 minute self-directed training session.
- One group, the ‘Operational group’, were provided with a document based on a user-manual for a commercially available vehicle fitted with level 2 automated systems (Advanced Driver Assistance System).
- The other, ‘Behavioural group’, completed training in the form of a PowerPoint presentation with audio commentary voiced by a professional actor.
- The drivers were also interviewed by the researchers both before and after the simulator task, to log their attitudes towards level 3 automation, such as understanding the vehicle’s capabilities and the level of control and attention required as the driver.
- The authors note that due to the nature of the study, drivers were likely motivated to behave in a particular way due to the training they received alongside the CHAT procedure, prior to the drive.
- The authors are clear that a check list on its own is not enough and does not replace knowledge, training and practice.
Previous study with the RAC Foundation can be found here.