Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[D] If convolution kernels encode a strong prior on spatial locality, what prior do transposed convolutions encode?

Convolution layers are understood to encode an infinitely strong prior on spatial locality. (Ian Goodfellow’s Deep Learning book, summary here https://medium.com/inveterate-learner/deep-learning-book-chapter-9-convolutional-networks-45e43bfc718d). From my understanding, this means that conv kernels are good at capturing regional patterns (e.g. a point here, a stroke there, etc).

Do strided transpose convolutions encode a prior of some kind as well? (an uneducated guess from my end – a preference for texture and pattern at a larger scale?)

submitted by /u/toadsofbattle
[link] [comments]