Recently, the renowned AI company Runway officially launched the first major model of its new "Interface World Models" series - Solaris. This innovative system marks a breakthrough in software and web interfaces, no longer relying on pre-written code and fixed frameworks, but instead rendering the entire graphical user interface in real-time, frame by frame, as you use it.
In traditional software engineering, digital interfaces are typically built on two separate systems: "AI assistants that know things" (such as large models and search engines, which excel at providing static content like text and images) and "real-time responsive" traditional programs (such as game engines and front-end code, which are good at rendering dynamic effects but have no understanding of your tasks). For a long time, every interaction between operating systems and applications had to be explicitly defined through code or other intermediate representations, which inevitably sacrificed the richness of visual expression and severely "lossily compressed" the possible operational space.
The core breakthrough of Solaris lies in integrating rendering and interaction. It no longer requires an intermediate code layer for translation, but instead generates each frame directly as a single world model and provides immediate, coherent dynamic responses to every user input. When browsing a virtual clothing store, users can even directly drag clothes from a rack using their own photo as a reference, just like in real life; or with a simple voice command, let the position of tables and chairs and the color of objects evolve in real-time with the light. This open, immersive experience makes software feel more like a living scene rather than a pile of cold scripts.
This revolutionary technology is made possible by hard-core innovations in its underlying architecture. Solaris is built upon Runway's Gen-4.5 video generation model and has achieved breakthroughs in speed, coherence, and cost control. First, it compresses the originally seconds or even minutes-long video generation process into real-time operation that matches human interaction rhythm through self-regressive generation mechanisms and multi-step denoising distillation. Second, by coordinating large language models with world models, the large model interprets user intent and guides scene evolution, while the world model handles real-time visual rendering. Finally, through continuous training of fast models, the model maintains long session and multi-step interaction coherence while significantly reducing inference costs.
In objective academic and user evaluations, Solaris has demonstrated unique advantages. In benchmark tests comparing multi-modal large language models' ability to reconstruct interfaces based solely on screenshots, research found that traditional translation methods inevitably lose details as visual complexity increases, while Solaris perfectly preserves the visual and semantic state of the interface from the first frame. In a user study involving over 7,500 paired comparisons, participants showed preferences for Solaris in following instructions accurately and behaving naturally, reaching 61% and 71% respectively, far exceeding the performance of traditional coded interfaces updating UIs in isolation.
Naturally, as a cutting-edge innovation, Solaris still faces some challenges that need to be addressed. For example, high-precision real-time text generation remains a significant challenge in the field of video generation; maintaining visual and semantic consistency during long-term open interactions also needs further optimization; and it also needs to solve integration issues with existing screen readers and accessibility APIs.
Despite these challenges, the emergence of interface world models outlines the initial form of the next-generation computing platform. It has the potential to completely eliminate the boundaries of traditional "applications," allowing software to dynamically reshape itself according to users' immediate intentions, thereby fundamentally changing how we connect with the digital world. Currently, Runway has opened up early access applications for this model to key partners.
Official website: https://runway.com/news/research/introducing-solaris
