Aaron Pham
|
0557deeab7
|
feat: tokenizers (#429)
* feat: tokenizers
This reverts commit d5a4db8321d232a1b9c0d86fc38e8dd516d15776.
* fix(inputs): #422
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
---------
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
|
2024-08-31 13:39:50 -04:00 |
|
yetone
|
d5a4db8321
|
Revert tokenizers (#423)
* Revert "fix: add missing "with" in README"
This reverts commit bf1e7f1f17c8b82687b15c41e5a8104ea03f70cf.
* Revert "feat: tokenizers (#407)"
This reverts commit d2095ba267abbfe169582708a4449e609aa9709b.
|
2024-08-31 22:45:31 +08:00 |
|
Aaron Pham
|
d2095ba267
|
feat: tokenizers (#407)
* feat: autobuild tiktoken lib and schenanigans
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: revert readme changes
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): windows
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
* chore(plugin): early load commands and base setup
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): make sync
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: rust go vroom vroom
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: scuffed afaf implementation binding go brrrr
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove dups
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(tokens): calculate whether we should do prompt_caching (fixes #416)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: ignore lockfiles
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* Update README.md
* Update crates/avante-tokenizers/README.md
* chore: remove unused
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove auto build
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
---------
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
Co-authored-by: yuchanns <me@yuchanns.xyz>
|
2024-08-31 07:19:59 -04:00 |
|
Wey Gu
|
2951217a68
|
docs: macOS tiktoken core install (#7)
also fix azure default api_version
|
2024-08-15 16:00:18 +08:00 |
|
yetone
|
9edd4202af
|
first commit
|
2024-08-15 01:45:38 +08:00 |
|