Blog

Learn About Our Meetup

4500+ Members

[D] Is embedding layer and fully connected layer the same thing for one hot?

Embedding layer is essentially a lookup into an array while fully connected layer is full matrix multiplication.

However, for one-hot encoding, there is one 1 value in the whole input layer, so when you matmul, you are getting different weights for every input neuron. Therefore, I believe it should be the same as an array lookup. Is this true?

submitted by /u/happyhammy
[link] [comments]

Next Meetup

 

Days
:
Hours
:
Minutes
:
Seconds

 

Plug yourself into AI and don't miss a beat