BPE (Byte Pair Encoding)
< GlossaryA tokenization algorithm that iteratively merges the most frequent character pairs. Used in GPT, Claude, and most modern LLMs.
A tokenization algorithm that iteratively merges the most frequent character pairs. Used in GPT, Claude, and most modern LLMs.