[D] GPT-2 for hotel reviews generation?
Just tried to experiment with GPT-2 for hotel reviews generation -> https://github.com/tomasrasymas/gpt2-hotel-reviews
After analysing the results, I think GPT-2 is not suitable for such a task (short text, reviews generation), cause reviews in dataset are very similar and talking about same thinks, there are no context for model to learn. In my opinion using simpler model like few LSTM + Attention might produce same or even better results.
What do you think?