I’ve seen a few posts on this subreddit and /r/learnmachinelearning asking how to finetune GPT-2 and generate text from it. As the creator of gpt-2-simple, I’ve had a lot of experience working with GPT-2, so here’s a (lengthy!) blog post on how to finetune GPT-2 and generate text using gpt-2-simple, along with a history of GPT-2 finetuning and its future:

https://minimaxir.com/2019/09/howto-gpt2/

Let me know if you have any questions!