WebGen-R1 trains small LLMs to build full websites via RL

WebGen-R1 addresses a significant gap in LLM code generation: while models handle function-level tasks well, generating complete, multi-page websites with correct cross-page interactions and visual aesthetics remains highly challenging. Existing approaches are largely limited to single-page static sites, and agentic frameworks that use multi-turn execution with proprietary models incur high token costs, latency, and brittle integrations. The paper proposes training a small LLM end-to-end with reinforcement learning as a more efficient alternative.

The framework's two core innovations are a scaffold-driven structured generation paradigm — which constrains the large open-ended action space and preserves architectural integrity across pages — and a cascaded multimodal reward system. This reward couples structural guarantees with execution-grounded functional feedback and vision-based aesthetic supervision, addressing the inherent difficulty of evaluating subjective aesthetics and cross-page correctness that cannot be handled by simple unit tests.

Experiments show that WebGen-R1 substantially transforms a 7B base model from generating nearly nonfunctional websites into producing deployable, aesthetically aligned multi-page sites. Notably, it consistently outperforms heavily scaled open-source models up to 72B parameters, rivals the state-of-the-art DeepSeek-R1 (671B) in functional success, and substantially exceeds it in valid rendering and aesthetic alignment — positioning small open models as viable candidates for project-level web application generation.

Key facts

1. 01WebGen-R1 is an end-to-end reinforcement learning framework for project-level, multi-page website generation.
2. 02It uses a scaffold-driven structured generation paradigm to constrain the open-ended action space and preserve architectural integrity.
3. 03A cascaded multimodal reward combines structural, execution-grounded functional, and vision-based aesthetic signals.
4. 04The framework transforms a 7B base model from generating nearly nonfunctional websites into deployable, aesthetically aligned multi-page sites.
5. 05WebGen-R1 consistently outperforms open-source models up to 72B parameters.
6. 06It rivals DeepSeek-R1 (671B) in functional success and substantially exceeds it in valid rendering and aesthetic alignment.
7. 07Existing agentic approaches rely on multi-turn execution with proprietary models, causing high token costs, latency, and brittle integration.

Topics