Skip to content

Issues: dqbd/tiktoken

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
35 Open 76 Closed
35 Open 76 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add gpt-4o-mini model
#111 opened Jul 18, 2024 by huytool157
React native error SyntaxError: Invalid RegExp: Invalid escape] in react native expo.
#110 opened Jul 16, 2024 by djaffer
Add support for new text-embedding-3 models
#109 opened Jul 2, 2024 by lukasugar Loading…
1
Missing ranks files from js-tiktoken
#108 opened Jun 7, 2024 by jonasb
1
missing example code for js-tiktoken
#102 opened May 9, 2024 by coding22
Replace js-tiktoken BPE merge algorithm with faster heap based algorithm
#101 opened Apr 19, 2024 by mikolalysenko Loading…
3
How to support Llama 3?
#100 opened Apr 19, 2024 by wizd
Performance
#99 opened Apr 15, 2024 by steebchen
Add decode_with_offsets function (or PR guidance request)
#94 opened Mar 11, 2024 by Sam1320
An error occurred during the deployment of the Vercel edge function
#93 opened Mar 9, 2024 by bowencool
1
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
#92 opened Feb 13, 2024 by TranquilMarmot
1
'TextEncoder' is not defined - MongoDB Functions
#91 opened Feb 11, 2024 by georgeherby
1
Add support for the newest Open AI embeddings models
#90 opened Feb 9, 2024 by AleksTrpkovski
2
Memory access out of bounds
#84 opened Jan 17, 2024 by maxdeichmann
3
Crash on React Native: SyntaxError: Invalid RegExp: Invalid escape
#82 opened Dec 1, 2023 by julian-hecker
2
How to count tokens for functions defined in the prompt?
#78 opened Oct 21, 2023 by vrde
1
Support fine tunned models
#76 opened Oct 17, 2023 by italojs
1
Cannot find module error
#75 opened Oct 17, 2023 by thdoan
1
missing TiktokenModel for version 3.5-turbo-16k
#74 opened Sep 25, 2023 by hannahlaek-wt
2
gpt-3.5-turbo-instruct support
#73 opened Sep 22, 2023 by danny-avila
2
What does free actually do?
#72 opened Sep 19, 2023 by disbelief
9
Raise error when concurrent to call new Tiktoken
#70 opened Sep 12, 2023 by qkxie
2
Error: null pointer passed to rust
#69 opened Sep 6, 2023 by emeeks
3
NPM package is very huge
#68 opened Aug 29, 2023 by anzemur
5
WASM file is not included in Next.js Node runtime API routes
#67 opened Aug 22, 2023 by AaronFriel
ProTip! Follow long discussions with comments:>50.