[P] Keras BERT for Medical Question Answer Retrieval using Tensorflow 2.0 ! With GPT-2 for Answer Generator. Pip installable. Weights/Data readily available. Reduced version for Google Colab instantly available in premade notebook.
We fine-tuned a Keras version bioBert for Medical Question and Answering, and GPT-2 for answer generation. This was a project we submitted for the Tensorflow 2.0 Hackathon.
We made all the weights and lookup data available, and made our github pip installable.
We also have a float16 version of our data for running in Colab. Currently we weren’t able to fit all the lookup data in their original float32 forms (although that may change as we get better data managing skills). (If you have some skills in this area you would like to share, we are hungry for it!).
Our models and predictor function are pip installable, to make it as easy as possible for people to try them.
!wget https://anaconda.org/pytorch/faiss-cpu/1.2.1/download/linux-64/faiss-cpu-1.2.1-py36_cuda9.0.176_1.tar.bz2 !tar xvjf faiss-cpu-1.2.1-py36_cuda9.0.176_1.tar.bz2 !cp -r lib/python3.6/site-packages/* /usr/local/lib/python3.6/dist-packages/ !pip install mkl !pip install tensorflow-gpu==2.0.0-alpha0 import tensorflow as tf !pip install https://github.com/Santosh-Gupta/DocProduct/archive/master.zip Here is our Colab folder
https://drive.google.com/drive/u/0/folders/1hSwWL_WqmcVJytMbsWSbhYxxK4KT7UMI
Here is our Github
https://github.com/Santosh-Gupta/DocProduct/blob/master/README.md
Here is our Devpost
https://devpost.com/software/nlp-doctor
Feel free to reach out with any feedback, questions, or comments. I’ll answer all questions here.
https://i.imgur.com/wzWt039.png
https://i.imgur.com/Z8DOXuJ.png
submitted by /u/BatmantoshReturns
[link] [comments]