Version 3.7 Flash has demonstrated notable advancements over its predecessor, 3.6 Flash, particularly in coding-related tasks such as debugging and resolving issues. The new version boasts enhanced first-pass code accuracy and exhibits improved capabilities in producing production-ready code, with impressive performance metrics seen in FrontierCode 1.1, achieving 43.6% compared to 34.4%, and DeepSWE v1.1, scoring 65.3% versus 49.0%.
In the realm of web development, version 3.7 Flash excels at generating functional layouts and fully-featured applications with fewer prompts. When it comes to user interface creation, this model maintains a strong design fidelity and consistency based on reference inputs, which could consist of a screenshot, an image, or a comprehensive design system. It registers a higher performance than 3.6 Flash on Arena.ai’s WebDev Arena, where it achieved an Elo score of 1588, surpassing the previous version's score of 1538.
In knowledge-intensive domains such as finance, law, and biosciences, version 3.7 Flash shows improved reasoning skills and accuracy. It significantly outshines 3.6 Flash on the GDP.pdf benchmark, achieving a score of 34.0% in contrast to the earlier version's 22.0%. Furthermore, it exceeds the performance of 3.6 Flash in AutomationBench, proving its ability to efficiently finalize real-world business workflows with a score of 30.4% against 17.0%.



