Answer: The latest version of Tokenizers is 0.23.3, released on 2026-10-09.
Status: Confirmed
Entry: version/tokenizers
Revision: 1
Digest: sha256:b8fde0ba45519254 (changes whenever the content changes)
Timeline:
Created: 2026-11-12T11:23:40Z
Last changed: 2026-11-12T11:23:40Z
Last verified: 2026-11-12T11:33:51Z
Next check: 2026-11-13T11:33:51Z
Check interval: Daily
Expected change: New releases are published at no fixed schedule.
Data:
Field | Value | Source | As of
Latest version | 0.23.3 | [1] | 2026-11-12
Released | Fri, 09 Oct 2026 10:00:51 GMT | [1] | 2026-11-12
Sources:
[1] PyPI (tokenizers). "Tokenizers: release information". https://pypi.org/rss/project/tokenizers/releases.xml
Role: primary. Accessed: 2026-11-12T11:33:51Z
Quote: "
0.23.3" (Supports: Latest version)
Quote: ".org/project/tokenizers/0.23.3/
None
patry.nicolas@protonmail.com, anthony@huggingface.co Fri, 09 Oct 2026 10:00:51 GMT" (Supports: Released)
Snapshot SHA-256: d13a3b9ca2c72d2616aa5fc689be5e8003a51b434bd83dcf142d53a6b3c5c218 (captured 2026-11-12T11:23:40Z)
Verification:
Method: Read by code directly from the structured data published at [1]; no language model was involved. Every value appears verbatim in a quoted passage of [1]. On this check the text of [1] was unchanged since 2026-11-12T11:23:40Z, so the values verified then were kept.
Cross-check: not-available at 2026-11-12T11:33:51Z. No independent second source is configured for this entry
Last successful check: 2026-11-12T11:33:51Z
Last attempt: 2026-11-12T11:33:51Z
Notes and limitations:
"Latest version" is the newest stable version in the registry; pre-releases are excluded.
Change log:
Time | Event | Change | Source
2026-11-12T11:23:40Z | added | Entry created | —
Changes for this entry as a feed: https://latestn.com/version/tokenizers/latest
Challenge this entry:
Open challenges: None
How: If a value here is wrong or out of date, send what is wrong and a link to evidence. Challenges are queued and checked against the evidence; they do not change the entry by themselves. If the entry changes as a result, the change log says so.
Form: https://latestn.com/dispute/version/tokenizers
POST: https://latestn.com/dispute/version/tokenizers with claim, evidence_url, and optionally field and contact (form-encoded or JSON)
GET: https://latestn.com/dispute/version/tokenizers?claim={what is wrong}&evidence_url={link}
How to cite:
latestN. (2026). What is the latest version of Tokenizers? Revision 1, last verified 2026-11-12T11:33:51Z. https://latestn.com/version/tokenizers (accessed 2026-11-12T12:50:52Z).
@misc{latestN_version_tokenizers_r1,
title = {What is the latest version of Tokenizers?},
author = {{latestN}},
year = {2026},
howpublished = {\url{https://latestn.com/version/tokenizers}},
note = {Revision 1; digest sha256:b8fde0ba45519254; last verified 2026-11-12T11:33:51Z; accessed 2026-11-12T12:50:52Z}
}
URL: https://latestn.com/version/tokenizers