Research-Multi-scale controllable scene generation

Intro

DiffuTown explores a multi-scale generative pipeline for transforming diffusion-based images into structured and controllable urban scenes. Starting from text prompts, the system generates global layout images and progressively refines them into localized regions through semantic segmentation, focus-based cropping, and controlled diffusion. Each stage introduces increasing levels of spatial detail, from city-scale planning to architectural and environmental elements. The pipeline integrates vision-language models, segmentation models, and diffusion control mechanisms to extract semantic patches, reconstruct spatial hierarchies, and enable consistent layout generation across multiple scales. By bridging image generation with spatial structure, DiffuTown reframes diffusion models as a tool for computational urban design — enabling iterative refinement, asset-level control, and potential extension toward 3D scene reconstruction.

Year

/

2022

Field

/

Department of Computing

We explore how generative models can move beyond images to construct structured, multi-scale spatial systems. By integrating diffusion, segmentation, and spatial reasoning, we aim to transform visual generation into a controllable process for designing complex environments.

Arcodius, Zhangfengyuan, Eva

Next work

Create a free website with Framer, the website builder loved by startups, designers and agencies.