Join our meetup, learn, connect, share, and get to know your Toronto AI community.
Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.
Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.
Blog post: https://openai.com/blog/sparse-transformer/
Direct link to PDF: https://d4mucfpksywv.cloudfront.net/Sparse_Transformer/sparse_transformers.pdf
I wonder how this compares to learned “hard” attention models like the recurrent attention glimpsing method ( https://papers.nips.cc/paper/5542-recurrent-models-of-visual-attention.pdf )
submitted by /u/rtk25
[link] [comments]