Dynamic Multi-Byte Prediction With Hierarchical Language Models
16 Aug 2026
Byte-level hierarchical language models (LMs) have recently emerged as a robust alternative to their popular counterparts that use subword tokenization. However, generating one byte at a time remains a bottleneck for inference speed.