Scaffold Diffusion is a novel generative model designed for sparse 3D voxel structures. To handle data with 99.9%+ sparsity, Scaffold Diffusion first leverages a scaffold—an outline of the structure—which discrete diffusion then uses for generation. Our method extends the utility of discrete diffusion beyond the traditional domain of naturally sequential data to 3D spatial generation.
Click inside to start. Press Esc to free and use mouse.
Interactive 3D Minecraft viewer demonstrating generated structures
Sampled from an uncurated set of 2,500 samples. Note: The current renderer cannot support complex blocks such as stairs and beds and converts them to placeholder question blocks. The filtered view displays structures with minimal non-renderable blocks, which typically biases towards simpler generations.