A maximum-entropy Markov model (MEMM) is a discriminative model that extends a standard maximum entropy classifier by assuming that the unknown values to be learnt are connected in a Markov chain rather than being conditionally independent of each other.
Questions tagged [memm]
5 questions
10
votes
2 answers
Named entity recognition and class imbalance
I have implemented Maximum-entropy Markov model (MEMM) for the Named entity recognition (NER) problem.
I have four classes: geographical, people, material (book titles etc) and other.
Class other is overrepresented in the training & test datasets.…
Howie
- 103
- 1
- 9
9
votes
1 answer
Creating a maximum entropy Markov model from an existing multi-input maximum entropy classifier
I am intrigued by the concept of a Maximum Entropy Markov Model (MEMM), and I am thinking
of using it for a Part of Speech (POS) tagger. At the moment, I am using a conventional
Maximum Entropy (ME) classifier to tag each individual word. This…
winwaed
- 1,103
- 1
- 9
- 11
4
votes
1 answer
HMM and CRF: the label bias problem and I-equivalence
I have a question about the label bias problem in HMM and CRF.
I understand that HMM and MEMM suffer from the label bias problem, which is a preference for states with fewer transitions. The problem is due to the fact that in HMM and MEMM use local…
Mou
- 638
- 2
- 5
- 14
2
votes
1 answer
Is there any advantage of using MEMM instead of CRF for named-entity recognition?
I wonder whether there is any advantage of using maximum-entropy Markov model (MEMM), a.k.a. conditional Markov model (CMM) instead of using conditional random fields (CRF) for named-entity recognition, aside from the training cost.
Franck Dernoncourt
- 42,093
- 30
- 155
- 271
0
votes
0 answers
Maximum Entropy Markov Model Calculations
I am new to ML and I'm having trouble figuring out how to implement a Maximum Entropy Markov Model for a sequence labeling task. Given this MEMM equation
$$
P_{s'}(s|,o)=\frac{1}{Z(o,s')}\exp\left(\sum_{a}\lambda_{a}f_{a}(o,s)\right)
$$
Where $s'$…
GrantD71
- 109
- 2