Learn About Our Meetup

4200+ Members

[D] Is embedding layer and fully connected layer the same thing for one hot?

Embedding layer is essentially a lookup into an array while fully connected layer is full matrix multiplication.

However, for one-hot encoding, there is one 1 value in the whole input layer, so when you matmul, you are getting different weights for every input neuron. Therefore, I believe it should be the same as an array lookup. Is this true?

submitted by /u/happyhammy
[link] [comments]

Next Meetup




Plug yourself into AI and don't miss a beat


Toronto AI is a social and collaborative hub to unite AI innovators of Toronto and surrounding areas. We explore AI technologies in digital art and music, healthcare, marketing, fintech, vr, robotics and more. Toronto AI was founded by Dave MacDonald and Patrick O'Mara.