Skip to main content

Blog

Learn About Our Meetup

5000+ Members

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

[Discussion] Millions of different NN models at the same time?

Hi folks,

does anyone know of applications or use cases where one has to deal with hundreds, thousands or even millions of queries of different neural network models? Maybe cloud service providers with user-customised neural networks, or maybe some AR applications… And if there is, how do people handle this situation nowadays, wouldn’t the storage requirements blow up like crazy? And what about latency issues (off-chip loading)?

submitted by /u/swiedema
[link] [comments]