Ngram

An ngram is a set of n adjacent tokens. For example, if each word is a token then "my name is" is a 3-gram. Ngram models, which estimate the probabilities of all nsets of models, were considered state-of-the-art within language modeling, and are a useful pairing with large language models (LLMs), specuulative decoding tools and other applications.