[P]TOEIC Part 5(70% correct rate) Solving only using pre-trained BERT!
I’ll share an interesting undergraduate project we’ve done through only pre-trained BERT model.
It can solve TOEIC blank problem(Part 5) better than me!
There are two types of problems: finding more contextual or grammatical sentence(word)
- Selecting Correct Grammar Type.
Q) The teacher had me _________ scales several times a day. 1. play (Answer) 2. to play 3. played 4. playing
Selecting Correct Vocabulary Type.
Q) The wet weather _________ her from going shopping. 1. interrupted 2. obstructed 3. impeded 4. discouraged (Answer)
Total 7067 datasets
bert-base-uncased 5192( 73.46%)
bert-large-uncased 5321( 75.29%)
bert-large-cased 5148( 72.84%)
My github repository is here: