2

We know that we can extract entities from a sentence using named entity recognition, but what if the sentence contains only an entity and no other context?

For example, we can use CRF for the following sentence:

Conditional random fields (CRFs) are a class of statistical modeling method often applied in pattern recognition and machine learning and used for structured prediction.

to extract Conditional random fields, statistical modeling, pattern recognition and etc from the sentence if we train our model with labeled data to do that.

But what if the sentences look like the following three?

Sentence 1: Conditional random fields
Sentence 2: statistical modeling
Sentence 3: Donald J. Trump

Can we use CRF again to recognize them respectively as "algorithm", "algorithm", "politician"? If not, how can we tackle that?

Lerner Zhang
  • 5,017
  • 1
  • 31
  • 52

1 Answers1

0

This study shows that

We find that context does influence predictions, but the main factor driving high performance is learning the name tokens themselves.

Then if we train a BiLSTM-CRF or BERT for such sake with not only pure named entities but also entities with context the performance would be good enough.

One more option would be to extract more context from the data source and use that as a separate condition, as stated in that paper:

context-only systems are sometimes correct even when humans fail to recognize the entity type from the context
Our results suggest that designing models that explicitly operate over representations of local inputs and context, respectively, may in some cases improve performance

Lerner Zhang
  • 5,017
  • 1
  • 31
  • 52