the holy grail is formal verification for all code
currently code has tests (a lossy proxy for the behavior of the code)
in reality, code should be more like math. in order for code to flourish, we need ways to formally verify any program
AnthropicX
View on XNew on our Frontier Red Team blog: using Claude to formally verify software at large scale.
Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time).
With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks.
Read our research in full here: https://www.anthropic.com/research/formal-verification