2002.10631

Total: 1

#1 Batch norm with entropic regularization turns deterministic autoencoders into generative models [PDF7] [Copy] [Kimi1] [REL]

Authors: Amur Ghose ; Abdullah Rashwan ; Pascal Poupart

The variational autoencoder is a well defined deep generative model that utilizes an encoder-decoder framework where an encoding neural network outputs a non-deterministic code for reconstructing an input. The encoder achieves this by sampling from a distribution for every input, instead of outputting a deterministic code per input. The great advantage of this process is that it allows the use of the network as a generative model for sampling from the data distribution beyond provided samples for training. We show in this work that utilizing batch normalization as a source for non-determinism suffices to turn deterministic autoencoders into generative models on par with variational ones, so long as we add a suitable entropic regularization to the training objective.

Subjects: Machine Learning ; Computer Vision and Pattern Recognition ; Machine Learning

Publish: 2020-02-25 02:42:18 UTC