• Skip to primary navigation
  • Skip to main content
  • Skip to footer
Logo for the Department of Civil and Environmental Engineering at the University of Michigan
  • Strategic Directions
  • News and Events
  • Contact

  • About
    • History
    • Strategic Directions
    • Diversity, Equity and Inclusion
      • CEE DEI Committee
      • DEI Resources
      • Have a concern?
    • Alumni
      • CEE Friends Association
        • CEEFA Board
      • Award Winners
    • Giving
      • Giving Legacy
    • Leadership and Governance
    • Faculty Search
      • Faculty Position in Environmental Engineering
      • Faculty Position in Intelligent Systems
    • Contact
      • Student Services Contacts
      • Master’s Advising Contacts
      • Undergraduate Advising Contacts
  • Undergraduate Studies
    • BSE Degree in Civil Engineering
    • BSE Degree in Environmental Engineering
    • Minor in Civil Engineering
    • Minor in Environmental Engineering
    • FocusCEE
      • Community Policy and Planning
      • Smart Cities
      • Sustainability
    • Undergraduate Opportunities
      • Undergraduate Externship
      • Student Research and Employment
        • CEE SURE/SROP Projects 2023
    • Schedule an Advising Appointment
    • Declare Your Major
    • Careers in CEE
      • What is a Civil or Environmental Engineer?
      • Career Pathways
      • Employers of CEE Graduates
      • How to Recruit CEE Graduates
    • Undergraduate Student Advisory Council
    • Student Life
  • Graduate Studies
    • Master’s Programs
    • PhD Programs
      • PhD Mentoring Framework
      • PhD Candidate Roster
    • Pelham Scholars Program
    • Online Learning
      • Construction Engineering and Management MasterTrack™
    • Admissions Information
      • International Applicants
      • Sequential Undergraduate/Graduate Studies (SUGS) Applicants
    • Graduate Handbook
    • Graduate Student Advisory Council
    • Student Life
  • People
    • Faculty
      • Affiliated Faculty
      • Core Faculty
      • Emeritus Faculty
    • Postdocs
    • Researchers
    • Staff
      • Administrative
      • Finance
      • Human Resources
      • IT & Web
      • Laboratory Technicians
      • Purchasing
      • Student Services
  • Research
    • New Grants
    • Civil Infrastructure Systems
      • Construction Engineering and Management
      • Geotechnical Engineering
      • Intelligent Systems
      • Next Generation Transportation Systems
      • Structural and Materials Engineering
    • Environment and Water Resources
      • Ecohydrology and Hydraulic Engineering
      • Energy and Clean Technology
      • Environmental Chemistry and Soil Physics
      • Environmental Microbiology and Biotechnology
    • Smart Infrastructure Finance
    • Urban Collaboratory
    • Facilities
      • Advanced Materials Research
      • Cementitious Composites
      • Center of Excellence in Bridges and Structures
      • Computational Community Resilience
      • Computational Structural Simulation
      • Construction Engineering Lab
      • Geotechnical Engineering Labs
      • Intelligent Structural Technology
      • Next Generation Infrastructure
      • Next Generation Transportation Systems Research Facilities
      • Pavement Research Center of Excellence
      • Structural Engineering Lab
  • Resources
    • Shipping
    • Purchasing
      • Purchasing Frequently Asked Questions
    • Reimbursement
    • IT Resources
    • Lab Safety
      • Lab Safety Basics
      • Minimum Training Requirements
    • Lab Requests and Procedures
    • Room Requests
    • Faculty Intranet
    • Strategic Directions
    • News and Events
    • Contact

World’s first realistic simulated driving environment based on ‘crash-prone’ Michigan intersection

Real-time data collected at the two-lane roundabout will be used to efficiently test the safety of autonomous vehicles.

Written by: michiganengineering

May 1, 2023

The first statistically realistic roadway simulation has been developed by researchers at the University of Michigan. While it currently represents a particularly perilous roundabout, future work will expand it to include other driving situations for testing autonomous vehicle software.

The simulation is a machine-learning model that trained on data collected at a roundabout on the south side of Ann Arbor, recognized as one of the most crash-prone intersections in the state of Michigan and conveniently just a few miles from the offices of the research team.

The State Street/Ellsworth Road roundabout. Researchers have mounted their sensor system on light poles around the intersection.

Known as the Neural Naturalistic Driving Environment or NeuralNDE, it turned that data into a simulation of what drivers experience everyday. Virtual roadways like this are needed to ensure the safety of autonomous vehicle software before other cars, cyclists and pedestrians ever cross its path. 

“The NeuralNDE reproduces the driving environment and, more importantly, realistically simulates these safety-critical situations so we can evaluate the safety performance of autonomous vehicles,” said Henry Liu, U-M professor of civil engineering and director of Mcity, a U-M-led public-private mobility research partnership. 

Liu is also director of Center for Connected and Automated Transportation and corresponding author of the study in Nature Communications. The publication has been featured as an Editor’s Highlight.

Safety critical events, which require a driver to make split-second decisions and take action, don’t happen that often. Drivers can go many hours between events that force them to slam on the brakes or swerve to avoid a collision, and each event has its own unique circumstances. 

Together, these represent two bottlenecks in the effort to simulate our roadways, known as the “curse of rarity” and the “curse of dimensionality” respectively. The curse of dimensionality is caused by the complexity of the driving environment, which includes factors like pavement quality, the current weather conditions, and the different types of road users including pedestrians and bicyclists. 

To model it all, the team tried to see it all. They installed sensor systems on light poles which continuously collect data at the State Street/Ellsworth Road roundabout.

A closer look at the sensor system attached to the State Street/Ellsworth Road roundabout.

“The reason that we chose that location is that roundabouts are a very challenging, urban driving scenario for autonomous vehicles. In a roundabout, drivers are required to spontaneously negotiate and cooperate with other drivers moving through the intersection. In addition, this particular roundabout experiences high traffic volume and is two lanes, which adds to its complexity,” said Xintao Yan, a Ph.D. student in civil and environmental engineering and first author of the study, who is advised by Liu. 

The NeuralNDE serves as a key component of the CCAT Safe AI Framework for Trustworthy Edge Scenario Tests, or SAFE TEST, a system developed by Liu’s team that uses artificial intelligence to reduce the testing miles required to ensure the safety of autonomous vehicles by 99.99%. It essentially breaks the “curse of rarity,” introducing safety-critical incidents a thousand times more frequently than they occur in real driving. The NeuralNDE is also critical to a project designed to enable the Mcity Test Facility to be used for remote testing of AV software.

But unlike a fully virtual environment, these tests take place in mixed reality on closed test tracks such as the Mcity Test Facility and the American Center for Mobility in Ypsilanti, Michigan. In addition to the real conditions of the track, the autonomous vehicles also experience virtual drivers, cyclists and pedestrians behaving in both safe and dangerous ways. By testing these scenarios in a controlled environment, AV developers can fine-tune their systems to better handle all driving situations.

An intersection inside the Mcity Test Facility.

The NeuralNDE is not only beneficial for AV developers but also for researchers studying human driver behavior. The simulation can interpret data on how drivers respond to different scenarios, which can help develop more functional road infrastructure. 

In 2021, the U-M Transportation Research Institute was awarded $9.95 million in funding by the U.S. Department of Transportation to expand the number of intersections equipped with these sensors to 21. This implementation will expand the capabilities of the NeuralNDE and provide real-time alerts to drivers with connected vehicles. 
The research was funded by Mcity, CCAT and the U-M Transportation Research Institute. Founded in 1965, UMTRI is a global leader in multidisciplinary research and a partner of choice for industry leaders, foundations and government agencies to advance safe, equitable and efficient transportation and mobility. CCAT is a regional university transportation research center that was recently awarded a $15 million, five-year renewal by the USDOT.

Written by Calvin Tuttle

Explore: Civil & Environmental Engineering Civil and Environmental Engineering Mcity Transportation Autonomy in Infrastructure Henry Liu

Footer

Logo for Michigan Engineering at the University of Michigan

  • Giving
  • News and Events
  • Contact
  • Sign up for our newsletter
  • U-M Engineering Home
  • Strategic Vision
  • Graduate and Professional
  • Undergraduate
  • U-M Engineering Research News
  • U-M Home

  • Giving
  • News and Events
  • Contact
  • Sign up for our newsletter

© 2023 The Regents of the University of Michigan Ann Arbor, MI 48109 USA Privacy Policy | Non-Discrimination Policy | Campus Safety

  • Facebook
  • Instagram
  • LinkedIn
  • Twitter
  • YouTube