Lesson 4 of 11 · Part 1 · Check yourself · 2 min Draft

Check yourself

Four quick questions on tokens, the token menu and the language tax.

Four quick questions on Part 1. Look back at the lessons whenever you like.

Check yourself

Get every answer right to open part 2.

1. About how many English words fit in 1,000 tokens?
2. Why do models use tokens instead of whole words?
3. What did Llama 3's bigger vocabulary do, compared with Llama 2?
4. In the 2023 study, whose text needed many times the English token count?