Hi guys,

​

Just tried to experiment with GPT-2 for hotel reviews generation -> https://github.com/tomasrasymas/gpt2-hotel-reviews

After analysing the results, I think GPT-2 is not suitable for such a task (short text, reviews generation), cause reviews in dataset are very similar and talking about same thinks, there are no context for model to learn. In my opinion using simpler model like few LSTM + Attention might produce same or even better results.

​

What do you think?