Yang Jun
|
6c10081899
|
fix: failed to download tokernizer from HF (#1060)
|
2025-01-09 18:09:33 +08:00 |
|
Aaron Pham
|
bdbbdec88c
|
feat(tokenizers): support parsing from public URL (#765)
|
2024-10-27 02:17:35 -04:00 |
|
Aaron Pham
|
41c78127e5
|
chore(rust): fix current clippy lint (#504)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
|
2024-09-03 22:18:53 -04:00 |
|
Aaron Pham
|
4ad913435c
|
feat(templates): avanterules filetype support (closes #254) (#466)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
|
2024-09-03 04:09:13 -04:00 |
|
Aaron Pham
|
0557deeab7
|
feat: tokenizers (#429)
* feat: tokenizers
This reverts commit d5a4db8321d232a1b9c0d86fc38e8dd516d15776.
* fix(inputs): #422
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
---------
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
|
2024-08-31 13:39:50 -04:00 |
|
yetone
|
d5a4db8321
|
Revert tokenizers (#423)
* Revert "fix: add missing "with" in README"
This reverts commit bf1e7f1f17c8b82687b15c41e5a8104ea03f70cf.
* Revert "feat: tokenizers (#407)"
This reverts commit d2095ba267abbfe169582708a4449e609aa9709b.
|
2024-08-31 22:45:31 +08:00 |
|
Aaron Pham
|
d2095ba267
|
feat: tokenizers (#407)
* feat: autobuild tiktoken lib and schenanigans
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: revert readme changes
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): windows
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
* chore(plugin): early load commands and base setup
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): make sync
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: rust go vroom vroom
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: scuffed afaf implementation binding go brrrr
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove dups
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(tokens): calculate whether we should do prompt_caching (fixes #416)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: ignore lockfiles
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* Update README.md
* Update crates/avante-tokenizers/README.md
* chore: remove unused
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove auto build
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
---------
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
Co-authored-by: yuchanns <me@yuchanns.xyz>
|
2024-08-31 07:19:59 -04:00 |
|