Apr 2, 2026 / 5 min read Your 4K Context Window Might Only Be 300 Bengali Words My Bengali tokenizer benchmark found that a 4K window can mean 2,786 words or 299 words depending on the tokenizer. nlp llm bengali tokenization research unicode