Google has updated its Android Bench, a benchmark designed to assess the performance of large language models (LLMs) in Android application development. The platform now includes a wider array of new AI models and an updated framework intended to be more user-friendly. Developers are encouraged to participate by running their own tests and providing feedback.
Expanding the Benchmark Landscape
Code generation is a prominent application for LLMs, and Android Bench aims to differentiate which AI agents excel at various development tasks. Launched in March, the benchmark evaluates LLMs across 100 distinct Android development challenges. The recent update introduces eight new models, incorporating leading options such as Claude Fable 5, Claude Sonnet 5, Claude Opus 4.8, GLM 5.2, Kimi K2.7 Code, MiniMax M3, Qwen 3.7 Plus, and Qwen 3.7 Max. Google has also added metrics like cost and efficiency, along with support for open-weight models, to enhance the benchmark’s relevance and scope.
Gemini Falls Behind in New Rankings
Even upon its initial release, Android Bench did not place Google’s own AI models at the top, with OpenAI’s LLMs holding a slight advantage. The situation appears less favorable for Google’s Gemini models with the expanded lineup. In the latest leaderboard, Gemini 3.1 Pro is positioned in fifth place. It trails behind GPT 5.4, Claude Sonnet 5, and Claude Fable 5. Claude Fable 5, in particular, demonstrates strong performance, achieving 84.5 percent accuracy on the benchmark tests.
Norman Pearlstine is the Chief Editor of News Raise and focuses on Business news. His responsibility is to oversee the editorial content including business, commodities, personal investments and the stock market.
