I’m trying to use NER to extract data from flight itineraries rather than making regexes for each and every provider, unless they’re obviously similar.

My first question is what’s the current SOTA for tasks like this in seemingly unstructured HTML (although I am stripping the HTML and making it plain text first)? Secondly, how well would a technique like this ideally work for entities that look like YY57FLN5 of variable length?

I’ve found this paper which uses hidden markov models alongside NER for data extraction but seems quite old and doesn’t have all the details necessary to reproduce.

Could anyone more familiar in NER and data extraction help steer me in the right direction?

So far I’m attempting to make a small dataset using the BRAT tool while I research the area in more detail.