Hey all,

I was going through the following blog w.r.t Word2Vec models. I realized that the hidden layer which later on serves as the Embedding Matrix has no activation or has the “Linear” Activation. I remember that introducing non-linearities usually help. Is there a specific reason for doing so ?