Join our meetup, learn, connect, share, and get to know your Toronto AI community.
Browse through the latest deep learning, ai, machine learning postings from Indeed for the GTA.
Are you looking to sponsor space, be a speaker, or volunteer, feel free to give us a shout.
I’m implementing https://arxiv.org/pdf/1906.05909.pdf in this repo (https://github.com/MerHS/SASA-pytorch), but current implementation consumes too much GPU memory. (currently x0.5 less params than ResNet-50, x10 more mem consumption)
I think some sort of `matmul` or `view` are causing this problem, hence I’m working on changing matmul to einsum. (also I am not sure that I implemented it correctly)
Could anyone guess how the authors optimized this network?
submitted by /u/MerHS
[link] [comments]