Join our meetup, learn, connect, share, and get to know your Toronto AI community.
Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.
Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.
FAIR paper that claims to “obviate RAdam”. It writes RAdam(W) is functionally equivalent to Adam(W) with “linear warmup over 2 / (1 – beta2) training iterations”.
Legit? This makes either MSR or FAIR look pretty bad.
submitted by /u/fabf673b3fa7401e62df
[link] [comments]