Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[P] New in DeOldify: Smooth Colorization of Video! Courtesy of one weird trick- NoGAN

[P] New in DeOldify: Smooth Colorization of Video! Courtesy of one weird trick- NoGAN

Hello again! I just realized after a few weeks of sitting on this that I didn’t tell you guys about something really cool I’ve been working on! Maybe I should do that.

A few months ago I posted about DeOldify- my pet project for colorizing and restoring old photos. Well now that includes videos as well! Here’s a demo I showed at Facebook’s F8 conference:

https://reddit.com/link/bq8gji/video/9tu80qji41z21/player

And here’s the talk at F8: https://www.facebook.com/FacebookforDevelopers/videos/340167420019712/

And here’s the article I wrote with Jeremy Howard of FastAI and Uri Manor of Salk Institute: https://www.fast.ai/2019/05/03/decrappify/

Anyway, the gist is that we (FastAI and I) developed this one weird trick called NoGAN to achieve this. That basically consists of this (slide from F8):

https://i.redd.it/midd5z9v41z21.jpg

The pretraining is using basic perceptual loss (or “feature loss”) for the generator. This gets you the benefits of GANs, without the problems, basically. Hence, smooth video!

The progression of training looks like this (sweet spot is at 1.4%, then it goes too far from there and gets weird with the orange skin):

https://reddit.com/link/bq8gji/video/34o1egby41z21/player

Anyway, that’s the gist. You can read more in the links above (readme for github project also has good details on NoGAN). Oh by the way, NoGAN also works on super resolution, and I suspect for most image to image tasks as well as perhaps even non-image tasks.

https://i.redd.it/z0tlr0zz41z21.png

submitted by /u/MyMomSaysImHot
[link] [comments]