A better way to assess vulnerability discovery tools allowing cybersecurity professionals to better understand what techniques are most effective and ultimately leading to safer software is now in development.

To that end, Brendan Dolan-Gavitt, an assistant professor in the Department of Computer Science and Engineering and a faculty member of New York University’s (NYU) Center for Cybersecurity, received a 2022 National Science Foundation (NSF) Faculty Early Career Development Award, more widely known as a CAREER Award, which supports early-career faculty who have the potential to serve as academic role models in research and education.

A five-year, $500,000 grant will support a project that aims to create techniques for automatically generating benchmark sets of software vulnerabilities that can end up used to rigorously assess newly developed and existing tools used to root out dangerous programming bugs.

Software vulnerabilities pose a major threat to the safety and security of computer systems, and while there is a large body of research on how to find vulnerabilities in programs, the large, empirically tested a set of vulnerabilities required to rigorously test that research are difficult and expensive to assemble.

Although researchers have discovered ways to automatically generate vulnerabilities and inject them into software, the vulnerabilities created in that way are unrealistic (containing artifacts that made them easier to discover than real vulnerabilities inadvertently created by human programmers) and not varied enough.

Schneider Bold

Dolan-Gavitt intends to address those shortcomings by employing large language models trained on code to synthesize vulnerabilities realistic and diverse, placing vulnerabilities in hard-to-discover paths, allowing new vulnerability classes to be added quickly with a customized domain-specific language, and automatically generating exploits for each vulnerability.

The end result will be a limitless supply of highly realistic vulnerabilities that can be generated cheaply, at scale, and on-demand, giving researchers valuable benchmarks in measuring the efficacy of their cybersecurity tools.

In addition to his work’s benefit to cybersecurity researchers and industry professionals, it is also expected to be a boon to educators. Since joining NYU’s Tandon School of Engineering in 2015, Dolan-Gavitt has been involved in CSAW, the most comprehensive student-run cybersecurity event in the world, and among the most popular offerings at the annual event is a “capture the flag” competition that challenges students to find vulnerabilities in a software program.

Brendan Dolan-Gavitt, an assistant professor in the Department of Computer Science and Engineering and a faculty member of NYU’s Center for Cybersecurity, received a 2022 NSF Faculty Early Career Development Award.
Source: NYU


“These types of competitions are an extremely popular and effective means of teaching a variety of cybersecurity skills, but they require large amounts of time, money, and expertise to create and manage,” he said. “If the creation of the challenges can be partially or wholly automated, it could bring new educational opportunities within reach of a broader and more diverse population of students by dramatically lowering costs and reducing the time and effort needed.”

Pin It on Pinterest

Share This