Difference between revisions of "Margin Infused Relaxed Algorithm"
From Cohen Courses
Jump to navigationJump to search| Line 11: | Line 11: | ||
[[File:Online-training.jpg|center|400px]] | [[File:Online-training.jpg|center|400px]] | ||
| − | <math>\forall t, (f^{t}, \mathbf{e}^t) \in <mathcal> T </mathcal></math> | + | <math>\forall t, (f^{t}, \mathbf{e}^t) \in <mathcal> T </mathcal> </math> |
Revision as of 17:48, 29 September 2011
This method is used by Watanabe et al., EMNLP 2007 to train an MT system a with a very large number of features of the order of millions. The training step was performed using a specific algorithm called the Margin Infused Relaxed Algorithm (MIRA) proposed by Crammer et al., 2006
Summary
MIRA is an online large-margin training algorithm which updates the weight vector according to certain margin constraints and loss function.
It is used to learn the weights of features after processing each training instance similar to structured perceptron algorithm with an additional loss function and margin constraint in its update rule.
Definition
A general definition of online training algorithms is depicted below:
