Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[D] Meta-learning for fast convergence for training from scratch?

Meta-learning is good for learning new class with <10 samples.And it requires sort of pre-training with similar classes.

Is there good recent works to improve convergence for randomly-initialized networks using meta-learning? Last time I looked into https://ai.google/research/pubs/pub46116/ and rejected work at openreview,
So far results are worse than SGD and Adam. Or maybe ~0.1% faster convergence but consumes ~30% more computations.

submitted by /u/tsauri
[link] [comments]