Chuyue Sun, a researcher from Stanford, along with her team of computer scientists, has created an AI tool capable of completing an engineering task in under half a day for less than $500. In stark contrast, three highly skilled experts took five months to accomplish the same project manually. This significant decrease in both time and expense highlights early findings related to a lesser-known area in coding and mathematics called formal verification, as detailed in Sun's recent research paper.
For years, software developers have aspired to leverage mathematical proofs to ensure their programs are free of bugs. However, this intricate process has historically been time-consuming, requiring engineers to articulate precise specifications for their software and translate their code into checkable mathematical formulas. Although companies conduct sophisticated tests to uncover a multitude of software flaws, formal verification—which can identify even more subtle issues—remains a rarely utilized practice due to its perceived complexity.
A surge of startups is now positioning generative AI as a game-changer in making formal software verification both feasible and indispensable. One such company is &Truth, which Sun joined in August and officially launched last Thursday. Her research showcased the capability of this technology by using AI to validate a segment of the code responsible for securing conversations in the messaging platform Signal.
Ilya Sergey, chief science officer at &Truth, stated, "Bridges and buildings remain structurally sound because mathematical principles were applied during their design. Why not adopt the same approach for code? The tools for mathematical reasoning were always available, but scaling them was a challenge."
&Truth has successfully secured $70 million in investments and aims to eventually expand its verification capabilities across all programming languages. In competition, Harmonic—co-founded by Robinhood CEO Vlad Tenev—has raised $295 million and recently revealed that its AI agent, Aristotle, can assist in verifying software written in C and hardware designs in Verilog. The startup is currently testing its technology with potential clients like chipmakers Tensordyne and Nvidia, whose venture arm has invested in the company.
Recently, Anthropic and Theorem collaborated to leverage AI for detecting bugs in open-source software that had eluded detection despite extensive testing. They also launched an add-on for Claude, aimed at aiding developers in the verification process, though cost details for this initiative have not been disclosed.
The overarching hope is for a future where software functions more reliably and incurs fewer security vulnerabilities. However, the challenge remains: can AI extend the reach of formal verification beyond critical systems at major organizations like NASA and Apple to widespread adoption?
