Difference between revisions of "Siddiqi et al 2009 Reduced-Rank Hidden Markov Models"
(Created page with '== Citation == == Online version == [http://arxiv.org/pdf/0910.0902v3] == Summary == This paper introduces Reduced-Rank Hidden Markov Models (RR-HMMs). RR-HMMs are similar to …') |
|||
Line 8: | Line 8: | ||
== Method == | == Method == | ||
+ | Sample singles, doubles, and triples from the from the observed output of the RR-HMM. Then let: | ||
+ | |||
[[File:Siddiqi et al 2009 Definition of P.png]] | [[File:Siddiqi et al 2009 Definition of P.png]] | ||
+ | |||
+ | The learning algorithm uses a singular value decomposition (SVD) of the correlation matrix between past and future observations. The algorithm is borrowed from Hsu et al 2009, with no change for the reduced-rank case. Learning is O( | ||
[[File:Siddiqi et al 2009 Algorithm.png]] | [[File:Siddiqi et al 2009 Algorithm.png]] | ||
+ | <math>\hat{b}_1</math> is the initial state distribution, <math>\hat{b}_\infty</math> is the final state distribution, and <math>\hat{B}_x</math> is the transition matrix when x is observed. Note that <math>X^+</math> denotes the Moore-Penrose pseudo-inverse of the matrix <math>X</math>. | ||
+ | |||
+ | |||
+ | Inference can be performed using the model parameters: | ||
+ | [[File:Siddiqi et al 2009 Inference.png]] | ||
== Experimental Result == | == Experimental Result == |
Revision as of 12:16, 10 October 2011
Citation
Online version
Summary
This paper introduces Reduced-Rank Hidden Markov Models (RR-HMMs). RR-HMMs are similar to standard HMMs, except the rank of the transition matrix is less than the number of hidden states. Thus the dynamics evolve in a subspace of the hidden state probability space.
Method
Sample singles, doubles, and triples from the from the observed output of the RR-HMM. Then let:
The learning algorithm uses a singular value decomposition (SVD) of the correlation matrix between past and future observations. The algorithm is borrowed from Hsu et al 2009, with no change for the reduced-rank case. Learning is O(
is the initial state distribution, is the final state distribution, and is the transition matrix when x is observed. Note that denotes the Moore-Penrose pseudo-inverse of the matrix .
Inference can be performed using the model parameters:
Experimental Result
Related Papers
In progress by User:Jmflanig