[D] Deploying deep learning models into production without HTTP overhead
when it comes to deployment and integration of deep learning models, it seems like there are a lot of solutions out there, but the most are kind of complex or depend on third party solutions. While it often seems to be a good idea to containerize models and deploy them the modern microservices way, I think this approach is kind of heavy and needs a lot of infrastructure, therefore is not the best idea as small or medium sized company.
I want to share an alternative approach, which can be used easily by just utilizing what python and e.g. the Java ecosystem offers out-of-the-box. Link
What about you, how do you productionize deep neural networks?