🌐 DE
🌙 Dark
Generative AI
Token
ization
Pick a text — watch the model chop it into tokens, not words.
text
tokenize.py