Blog

Learn About Our Meetup

4500+ Members

[R] Understanding the Neural Tangent Kernel

Hey everyone,

I’ve put up a new blog post, Understanding the Neural Tangent Kernel, that aims to distill the ideas behind the neural tangent kernel that is making waves in recent theoretical deep learning research. A large portion of the talks in the recent Workshop on Theory of Deep Learning at the Institute for Advanced Study were based on ideas related to the neural tangent kernel. This is a slightly long post, as it involves a fair bit of math (you can skip some of the proofs though). A bit of linear algebra background is necessary to fully grasp what is going on here, but I hope that my visualizations can help with that.

Code for the experiments and animations: https://github.com/rajatvd/NTK

Feedback and suggestions are welcome!

submitted by /u/MindSustenance
[link] [comments]

Next Meetup

 

Days
:
Hours
:
Minutes
:
Seconds

 

Plug yourself into AI and don't miss a beat

 


Toronto AI is a social and collaborative hub to unite AI innovators of Toronto and surrounding areas. We explore AI technologies in digital art and music, healthcare, marketing, fintech, vr, robotics and more. Toronto AI was founded by Dave MacDonald and Patrick O'Mara.