Learn Before
Concept

Katz Backoff Equation

The probability for a Katz backoff n-gram is given by PBO(wnwnN+1:n1)={P(wnwnN+1:n1), if C(wnN+1:n)>0α(wnN+1:n1)PBO(wnwnN+2:n1), otherwiseP_{BO}(w_n|w_{n-N+1:n-1}) = \begin{cases} P^*(w_n|w_{n-N+1:n-1}), \text{ if } C(w_{n-N+1:n}) > 0 \\ \alpha(w_{n-N+1:n-1})P_{BO}(w_n|w_{n-N+2:n-1}), \text{ otherwise} \end{cases} where α\alpha is a function that distributes higher-order n-grams to lower-order n-grams, to ensure that the backoff model gives a correct probability distribution.

0

1

Updated 2026-06-07

Tags

Data Science

Related