Skip to main content

Blog

Learn About Our Meetup

5000+ Members

GO >

MEETUPS

LEARN, CONNECT, SHARE

Join our meetup, learn, connect, share, and get to know your Toronto AI community. 

JOIN

JOB POSTINGS

INDEED POSTINGS

Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.

JOBS

CONTACT

CONNECT WITH US

Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.

CONTACT

[R] Benchmarking OpenAI’s GPT-2 on GPUs vs. CPUs (realtime inference)

Written by torontoai on . Posted in Reddit MachineLearning.

I ran an experiment comparing both the latency and cost of serving realtime inference with GPT-2 on AWS using GPUs and CPUs. I also added a bit of context for how latency correlates to real world product requirements:

https://towardsdatascience.com/how-much-difference-do-gpus-make-in-model-serving-c40b885ac096?

submitted by /u/calebkaiser
[link] [comments]