Join our meetup, learn, connect, share, and get to know your Toronto AI community.
Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.
Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.
Embedding layer is essentially a lookup into an array while fully connected layer is full matrix multiplication.
However, for one-hot encoding, there is one 1 value in the whole input layer, so when you matmul, you are getting different weights for every input neuron. Therefore, I believe it should be the same as an array lookup. Is this true?
submitted by /u/happyhammy
[link] [comments]