Hi All,

Just wanted to share a PyTorch implementation of “Continuous Relaxation Training of Discrete Latent Variable Image Models”, Casper Kaae Sønderby, Ben Poole, Andriy Mnih. It includes the GS-Soft and VQVAE models from the paper and (to my knowledge) is the only implementation that that gets close to the reported bits per dimension on CIFAR10 for VQVAE.

Link to repo: https://github.com/bshall/VectorQuantizedVAE

Link to paper: http://bayesiandeeplearning.org/2017/papers/54.pdf