Video of AR display for cars
General Motors R&D and several universities are working on a system that would use data gathered from an array of vehicle sensors and cameras and project images generated by compact ultra violet lasers directly onto the entire surface of the windshield. Head up displays are already used in cars for data suuch as speed, but this aims to use the whole windscreen for an augmenteed reality system.
“We’re looking to create enhanced vision systems,” says Thomas Seder, group lab manager-GM R&D. His team is working with Carnegie Mellon University and The University of Southern California, as well as other institutions, to create a full windshield head-up system leveraging night vision, navigation and camera-based sensor technologies to improve driver visibility and object detection ability.
“Let’s say you’re driving in fog, we could use the vehicle’s infrared cameras to identify where the edge of the road is and the lasers could ‘paint’ the edge of the road onto the windshield so the driver knows where the edge of the road is,” said Seder.
Enhanced vision systems are a 21st Century take on Head up display technology that GM was the first to market in 1988. Designed to help keep driver attention on the road ahead by displaying important information such as vehicle speed, lane change indicator status and vehicle warning messages directly into the driver’s field of vision, head-up display systems are currently available on the GMC Acadia, Chevrolet Corvette, Buick LaCrosse and Cadillac STS.
Scientists and lab technicians at GM’s global research and development in Warren, MI, are now developing next-generation head-up systems that could transform the everyday windshield into a device that can make driving even safer. While the full windshield head-up system has not yet been identified for a future GM vehicle program, Seder says some of the supporting technologies could end up in GM vehicles in the near-term future.
Coated with a series of transparent phosphors which emit visible light when excited by a light beam—in this case from a compact laser—the windshield becomes a large area transparent display, instead of current HUD systems that use only a small portion of the windshield.
The ability to use such an expansive surface enables the system to alert drivers of potential dangers that may exist outside of the normal field of vision—including children playing or motorcycles passing.
On that foggy day, maybe worsened by sleet or snow, the enhanced vision system could combine night vision with the head-up system to identify and highlight the precise location of animals roaming along the side of the road that could have avoided recognition with the naked eye.
“This design is superior to traditional head down display-based night vision systems, which require a user to read information from a traditional display, create a mental model and imagine the threat’s precise location in space,” Seder said
As an added safety feature, the head-up system can be combined with automated sign reading technology, similar to the Opel Eye system that debuted on the 2009 Opel Insignia, to alert the driver if they are driving over the posted speed limit or if there’s impending construction or other potential problems ahead. Additionally, the system can use navigation system data to alert the driver of their desired exit by reading overhead traffic signs.
“We have done testing on a number of drivers and their performance is better relative to head-down systems that are commonly used in vehicles today,” Seder said. “It’s a compelling design.”