Layout-Your-3D: Controllable and Precise 3D Generation with 2D Blueprint

Junwei Zhou¹,Xueting Li²,Lu Qi³, Ming-Hsuan Yang^3,4

¹ Huazhong University of Science and Technology, ² NVIDIA, ³ UC Merced, ⁴ Yonsei University

Official implementation for paper 'Layout-Your-3D: Controllable and Precise 3D Generation with 2D Blueprint'.

Overview

Given a text prompt describing multiple objects and their 2D spatial relationships, our method generates a 3D scene depicting these objects naturally interacting with one another. Also, Layout-Your-3D supports instance-wise attributes editing and customization, which opens up new possibilities for compositional 3D generation.

Check out our website and paper for more results!

Method