Church's suffix array algorithm

This method is used for language modeling based on sub-strings instead of usual n-grams.

Relevant Paper

Mikio Yamamoto and Kenneth Church. Using suffix arrays to compute term frequency and document frequency for all substrings in a corpus. In Proceedings of the 6th Workshop on Very Large Corpora.