0

A Style-aware Discriminator for Controllable Image Translation

A style-aware discriminator enhances image-to-image translation by learning a controllable style space and guiding the generator, improving results and enabling diverse applications.

Year
2022
Venue
CVPR 2022 1
Authors
5
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2203.15375ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.

Authors

5