phyer/avante.nvim
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: enable streaming for o1 models (#896)

Browse Source 
As of a few days ago, o1 models support streaming responses. Please see:
https://community.openai.com/t/openai-o1-streaming-now-available-api-access-for-tiers-1-5/1025430
This commit is contained in:
Aaron Batilo 2024-11-24 02:28:27 -07:00 committed by GitHub
parent c8e688a0ac
commit e60ccd2db4
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
lua/avante/providers/openai.lua
View File

@ -147,7 +147,6 @@ M.parse_curl_args = function(provider, code_opts)
-- NOTE: When using "o1" set the supported parameters only -- NOTE: When using "o1" set the supported parameters only
local stream = true local stream = true
if base.model and string.find(base.model, "o1") then if base.model and string.find(base.model, "o1") then
stream = false
body_opts.max_tokens = nil body_opts.max_tokens = nil
body_opts.temperature = 1 body_opts.temperature = 1
end end