This blog post has been reported on and distorted by a lot of tech news sites using it to wax delusional about AI’s future role in vulnerability detection.

But they all gloss over the critical bit: in fairly ideal circumstances where the AI was being directed to the vuln, it had only an 8% success rate, and a whopping 28% false positive rate!

  • Sailor Sega Saturn
    link
    fedilink
    English
    24
    edit-2
    25 days ago

    LLMs: now as effective as enumerating use-after-frees as grep "free" source.cc.