Public KG record
tokenizer
Recorded overview
KG-recorded mechanism related to tokenizer; detailed English notes are not yet available.
An evidence-backed entity from the project knowledge graph; detailed tool metadata is still being added.
Recorded details
- Performance: 同一长提示词的 token 计数约为 Haiku 4.5 的 1.25 倍
Evidence coverage
The KG currently records 7 known information dimensions and has 12 undocumented dimensions, linked to 2 public source articles. These counts describe record coverage, not model performance or verified fit.
Related public records
- Claude Token Counter — related to
- vocabulary — uses
- Claude Haiku 5.5 — uses
- Qwen3-4B — uses
- Claude Token Counter — related to