I’ll share an interesting undergraduate project we’ve done through only pre-trained BERT model.

It can solve TOEIC blank problem(Part 5) better than me!

​

There are two types of problems: finding more contextual or grammatical sentence(word)

​

1. Selecting Correct Grammar Type.

​

Q) The teacher had me _________ scales several times a day. 1. play (Answer) 2. to play 3. played 4. playing 

1. Selecting Correct Vocabulary Type.

   Q) The wet weather _________ her from going shopping. 1. interrupted 2. obstructed 3. impeded 4. discouraged (Answer)

​

####Result

Total 7067 datasets

bert-base-uncased 5192( 73.46%)

bert-base-cased 5398(76.38%)

bert-large-uncased 5321( 75.29%)

bert-large-cased 5148( 72.84%)

​

My github repository is here:

https://github.com/graykode/toeicbert