TL;DR: Ideogram 4.0 transitions to structured JSON inputs, open-sourcing a system prompt that lets developers convert natural language to JSON via off-the-shelf LLMs.
Summary: Ideogram 4.0 is designed to take structured JSON as input rather than traditional unstructured text prompts. To ease the transition, the creators released a prompt-enhancement model in their API and open-sourced the corresponding system prompt. This allows developers to handle the natural-language-to-JSON conversion using their own off-the-shelf LLMs.
Why it matters: Programmatic JSON input allows for more precise, reproducible control over generated image elements, text, and layout. AI builders can use the open-source system prompt to integrate structured image generation workflows into their own applications.
Source: r/stablediffusion