Safe AI for Safe Streets

More than 40,000 people have died on U.S. roads in each of the last three years. In an effort to eliminate these preventable accidents, The Department of Transportation has awarded the City of Pittsburgh, in partnership with Ding Zhao, $1.3 million to analyze Pittsburgh’s current transportation infrastructure and inform safety-first upgrades by the end of 2026.

As part of the the Safe Streets and Roads for All Grant Program(opens in new window) (SS4A)  in the Biden-Harris administration’s Bipartisan Infrastructure Law, the project will support a road safety audit, the development of a Vision Zero(opens in new window)-focused streets design manual along with quick build projects and a Vision Zero ambassador program to eliminate traffic fatalities and increase equitable mobility.

Ding Zhao(opens in new window), director of the Safe AI Lab and an associate professor of mechanical engineering(opens in new window)(opens in new window) at Carnegie Mellon University, will use large language models (LLMs) to analyze Pittsburgh’s streets, identify which intersections are the highest risk for drivers and pedestrians, and work with city officials to test new street design improvements.

“Large language models offer a very scalable, very powerful way to collect data and run simulations,” explained Zhao. “By collecting more data, more efficiently, we can be inclusive of rare events and vulnerable users.” 

Simulations of Pittsburgh’s streets will be used by Ding Zhao to identify intersections that pose the highest risk for drivers and pedestrians. The team will work with city officials to test new street design improvements as part of the Safe Streets and Roads for All Program.

The team will also use LLMs to analyze the results of their simulations, an approach Zhao says is novel to transportation and infrastructure.

“We have a clear goal for this project and by working with the City of Pittsburgh we are guaranteeing real world impact,” said Zhao. “I’m excited to see how my research will positively affect our neighborhoods. If we can save even one person, I’ll be very proud.”

“We’re excited to partner with the research teams at Carnegie Mellon University as we work toward our goal of zero traffic fatalities,” said Pittsburgh Mayor Ed Gainey. “To make our streets safer, we need to break down silos and build strong partnerships between the City of Pittsburgh and our private institutions. Together, we can drive the kind of innovation that makes a real difference in roadway safety.”

Zhao, who has been working to advance AI in self-driving cars for nearly a decade, is also eager to explore how enhanced infrastructure can make the roads safer for semi and fully autonomous vehicles.

The team will leverage on its in-house tool SafeBench(opens in new window), an open-sourced platform designed to assess and improve the safety of AI models based on a high-fidelity autonomous driving simulator. SafeBench provides a suite of standardized benchmarks and testing environments for evaluating how AI models perform in dynamic, safety-critical situations, such as autonomous driving or infrastructure planning. This tool can be integrated into projects like Pittsburgh’s transportation audit by offering a rigorous framework for analyzing AI-driven systems’ resilience under various conditions, including multimodal perturbations and rare events. By ensuring the safety and robustness of AI systems, SafeBench will help cities like Pittsburgh deploy cutting-edge AI technologies with confidence, minimizing risks and enhancing the overall safety of public infrastructure.

A video display of SafeBench, an open-sourced platform designed to assess and improve the safety of AI models based on a high-fidelity autonomous driving simulator

“SafeBench allows us to identify potential safety issues in the AI-empowered systems early on, which helps improve their reliability as they are integrated into real-world applications,” said Haohong Lin, a Ph.D. student at CMU working with Zhao.

“I have been working on self-driving cars for 17 years,” Zhao said. “This project opens a new door for us to explore how streets can be modified to provide a safer environment for us all both today and in the future when humans will share the road with AVs.”