Skip to content

Pull requests: openai/tiktoken

New pull request New
45 Open 108 Closed
45 Open 108 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Respect TIKTOKEN_OFFLINE env var to prevent network access in offline mode
#514 opened Mar 27, 2026 by Spectual Loading…
3 tasks
1
Add PyInstaller hooks for tiktoken
#509 opened Mar 17, 2026 by joaquinhuigomez Loading…
1
Add command-line interface for tiktoken
#508 opened Mar 14, 2026 by alpnix Loading…
1
bug fixes
#507 opened Mar 14, 2026 by eeea2222 Loading…
7
ci: add riscv64 wheel builds
#506 opened Mar 12, 2026 by gounthar Loading…
1
2
Add support for armv7l wheel building
#505 opened Mar 12, 2026 by ekarad1um Loading…
3
Upgrade GitHub Actions to latest versions
#504 opened Mar 11, 2026 by salmanmkc Contributor Loading…
Upgrade GitHub Actions for Node 24 compatibility
#503 opened Mar 11, 2026 by salmanmkc Contributor Loading…
Add support for building and testing tiktoken on Windows ARM64
#501 opened Mar 9, 2026 by MugundanMCW Loading…
1
Initialize _special_token_values in Encoding.__init__
#497 opened Feb 21, 2026 by jcpach Loading…
Update license information in pyproject.toml
#496 opened Feb 11, 2026 by aytekinar Loading…
1
docs: add windows (MSVC) build guide and link From README
#476 opened Jan 13, 2026 by rafaellimatecnologia-cloud Loading…
Add instructions for developer installation
#475 opened Jan 6, 2026 by edawson Loading…
1
feat: add support for custom HTTP client in encoding functions
#470 opened Dec 9, 2025 by GabrielVGS Loading…
1
1
Add GPT-5.1 support with o200k_base encoding
#468 opened Nov 21, 2025 by magkue Loading…
2
Replacing fancy-regex for faster encode
#460 opened Oct 31, 2025 by MadMax129 Loading…
1
fix: remove conflicting <|reserved_200018|>; add token-id uniqueness …
#458 opened Oct 13, 2025 by jinzhuer Loading…
1
1
Loosened Encoding.encode*_batch's input types
#455 opened Oct 9, 2025 by jamesbraza Loading…
Refactor encoding name resolution to improve model prefix matching logic
#452 opened Sep 30, 2025 by hrishabhn Loading…
Optimize _byte_pair_merge to o(m log n) using heap-based candidate selection
#442 opened Aug 27, 2025 by ArchishmanSengupta Loading…
1
Swift Binding Generation via UniFFI
#431 opened Aug 14, 2025 by narner Loading…
Update load.py
#399 opened Apr 23, 2025 by Shivam-Singh-Dev Loading…
Make decoder and sorted_token_bytes re-use existing memory - Unit Tests
#384 opened Feb 19, 2025 by CodeBeaverAI Loading…
In-code documentation update
#383 opened Feb 17, 2025 by louisbrulenaudet Loading…
1
Option to use TIKTOKEN_BPE_HOST environment variable for configurable BPE host URL
#357 opened Nov 4, 2024 by AitBaali-Hamza-bcg Loading…
2
ProTip! Exclude everything labeled bug with -label:bug.