TL;DR: Early developer testing reveals Gemma 4 12B struggles with structured tool calling and formatting arguments in agentic coding tasks.
Summary: Developers evaluating the new Gemma 4 12B model reported severe limitations in its tool-calling capabilities during complex coding challenges. The 8-bit quantized model repeatedly failed to structure simple arguments correctly, such as specifying patterns for search tools, causing execution errors. This indicates potential integration friction between the model and agentic scaffolding frameworks like opencode.
Why it matters: AI builders leveraging open-weights models for agentic coding workflows should be cautious about using Gemma 4 12B out of the box for tool-intensive applications. Developers may need to implement stricter structured outputs or robust error recovery mechanisms to mitigate formatting failures.
Source: r/localllama