Removing blob artifact from StyleGAN generations without retraining. Inspired by StyleGAN2
 |
Got StyleGAN generator working without producing the blob artifact using the same architecture/weights. This might be useful for those, who have already trained a model using the initial version of StyleGAN, but still want to produce generations without the blob artifacts. https://reddit.com/link/ecji6v/video/h4m9fryurg541/player The idea is pretty simple. I observed, that the artifact appears right after 64×64 resolution. Network tries to fool the instance normalization layer and creates one or two entries in a tensor that have the same order of magnitude as the sum of the rest of the tensor. I simply zero out those entries. However, doing just that would ruing the generation. Instead, starting from resolution 64×64 I execute two branches: one with original tensor and the second one with pruned tensor. The original one is used to compute coefficients for the instance normalization, that are later applied to the pruned branch. https://twitter.com/StasPodgorskiy/status/1207369489676996614 submitted by /u/stpidhorskyi |