I see a lot of brilliant techniques that produce incredible results, but are there any techniques that try to bring learning speeds an order of magnitude or two up even if it costs them half the accuracy, or techniques that try to learn from 400 images instead of 40k?

Or in other words, I would love if someone were to link me some research pursuing non-conventional goals.