Aaron Pham
|
d2095ba267
|
feat: tokenizers (#407)
* feat: autobuild tiktoken lib and schenanigans
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: revert readme changes
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): windows
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
* chore(plugin): early load commands and base setup
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(build): make sync
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: rust go vroom vroom
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* feat: scuffed afaf implementation binding go brrrr
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove dups
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* fix(tokens): calculate whether we should do prompt_caching (fixes #416)
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: ignore lockfiles
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* Update README.md
* Update crates/avante-tokenizers/README.md
* chore: remove unused
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
* chore: remove auto build
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
---------
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Hanchin Hsieh <me@yuchanns.xyz>
Co-authored-by: yuchanns <me@yuchanns.xyz>
|
2024-08-31 07:19:59 -04:00 |
|