Skip to content

Pull requests: openai/tiktoken

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

Loosened Encoding.encode*_batch's input types
#455 opened Oct 9, 2025 by jamesbraza Loading…
Swift Binding Generation via UniFFI
#431 opened Aug 14, 2025 by narner Loading…
Add support for building TikToken WoA
#412 opened Jul 4, 2025 by Greenie0701 Loading…
Update load.py
#399 opened Apr 23, 2025 by Shivam-Singh-Dev Loading…
In-code documentation update
#383 opened Feb 17, 2025 by louisbrulenaudet Loading…
make decoder and sorted_token_bytes re-use existing memory
#352 opened Oct 17, 2024 by tmm1 Loading…
use HashSet from rustc-hash too
#351 opened Oct 17, 2024 by tmm1 Loading…
Uses Regex instead of fancy-regex - 6x speedup
#331 opened Aug 5, 2024 by Majdoddin Loading…
Cache for Encoding - Runtime Boosted by 12%
#319 opened Jul 10, 2024 by Majdoddin Loading…
Remove dependency on requests
#271 opened Mar 26, 2024 by tristan-jl Loading…
feat: Add option TIKTOKEN_FORCE_CACHE
#170 opened Jul 28, 2023 by Kontrolix Loading…
Option to use env variable for BPE_FILE location
#128 opened May 15, 2023 by csnelsonchu Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.