Attention: You are using an outdated browser, device or you do not have the latest version of JavaScript downloaded and so this website may not work as expected. Please download the latest software or switch device to avoid further issues.

News > Attacks & Threats > AI-Generated Patches Fail Half the Time

AI-Generated Patches Fail Half the Time

A study of more than 6,000 patches found that even working patches can introduce new bugs, break something else, or are open to bypass.

As developers turn to AI models to generate an increasing amount of code, they are also relying on the systems to find vulnerabilities and generate patches. Unfortunately, the models just aren't very good at their jobs.

Recent research suggests that even the latest AI systems only produce effective patches about half the time, according to a report published on Aug. 6 by identity management firm 1Password. To test their efficacy, the company's Off-By-1 research team generated 540 patches for six vulnerabilities disclosed since March using two different large language models (LLMs): OpenAI's ChatGPT-5.5 with Trusted Access for Cyber, and Anthropic's Opus 4.8 with Cyber Verification Program. More here

Similar Stories

Organizations don't need better vulnerability scanners; they need to know who owns their assets and has the authority and capacity to actually fix them. More...

Threat actors are now hiding payloads by using DNS TXT records and browser cache pre-fetching, making it tougher to spot… More...

A purported ad-blocker exfiltrates reams of sensitive information and benefits from having Google's stamp of approval de… More...

The "third-party[.]com" domain, commonly used as a documentation placeholder, has been observed serving a ClickFix lure … More...

Microsoft seized 50 websites and disabled more than 150 domains as part of a coordinated disruption effort against a phi… More...

Have your say

 

News Categories

Organizations don't need better vulnerability scanners; they need to know who owns their assets and has the authority and capacity to actually fix them. More...

Threat actors are now hiding payloads by using DNS TXT records and browser cache pre-fetching, making it tougher to spot… More...

A purported ad-blocker exfiltrates reams of sensitive information and benefits from having Google's stamp of approval de… More...

The "third-party[.]com" domain, commonly used as a documentation placeholder, has been observed serving a ClickFix lure … More...

Microsoft seized 50 websites and disabled more than 150 domains as part of a coordinated disruption effort against a phi… More...

image

Contact Us

Security Interest Group Switzerland
c/o Bridge Head AG
Sulzbergstrasse 34
5430 Wettingen
Switzerland

Follow Us

This website is powered by
ToucanTech