Search results
The official repo for CM-GAN (Cascaded Modulation GAN) for Image Inpainting. We introduce a new cascaded modulation design that cascades global modulation with spatial adaptive modulation for better hole filling. We also introduce an object-aware training scheme to facilitate better object removal.
Mar 22, 2022 · CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training. Haitian Zheng, Zhe Lin, Jingwan Lu, Scott Cohen, Eli Shechtman, Connelly Barnes, Jianming Zhang, Ning Xu, Sohrab Amirghodsi, Jiebo Luo. Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing ...
- arXiv:2203.11947 [cs.CV]
- 32 pages, 19 figures
We focus on three directions: (1) We design generative models to help humans create visual data effortlessly. Our models can synthesize realistic outputs (e.g., images, videos, 3D data, multimodal data) given humans' simple instructions. (2) We build user interfaces and algorithms for humans to visualize, create, share, and discover generative ...
CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training. European Conference on Computer Vision (ECCV'22) Publication date: October 23, 2022. Haitian Zheng, Zhe Lin, Jingwan (Cynthia) Lu, Scott Cohen, Eli Shechtman, Connelly Barnes, Jianming Zhang, Ning Xu, Sohrab Amirghodsi, Jiebo Luo.
– Cascaded Modulation GAN, a new inpainting network architecture formed by a masked image encoder with Fourier convolution blocks and a cascaded global-spatial modulation-based decoder. – An object-aware mask generation scheme preventing the model from gener-ating new objects inside holes and mimicking realistic inpainting use cases. – A ...
Mar 14, 2022 · InsetGAN for Full-Body Image Generation. Anna Frühstück, Krishna Kumar Singh, Eli Shechtman, Niloy J. Mitra, Peter Wonka, Jingwan Lu. While GANs can produce photo-realistic images in ideal conditions for certain domains, the generation of full-body human images remains difficult due to the diversity of identities, hairstyles, clothing, and ...
Oct 21, 2022 · To seek a better way to inject global context into the missing region in inpainting, we investigate a new modulation scheme by cascading global and spatial modulations. We propose Cascaded Modulation GAN (CM-GAN), a new generative network that can synthesize better holistic structure and local details, cf. Figs 1 and 5.
