rony-llm-agent/pkg
Victor Vargas 838eef642a fix(openai): make streaming actually work; honor configured model
The Stream() path was broken end to end:
- requests always went out with "stream": false, so the SSE parser found
  no data lines and every stream ended empty
- Config.Model was discarded at construction, and the agent loop never
  sets req.Model, so requests carried an empty model (hard API error)
- tool-call deltas were ignored entirely: the agent never executed tools
  over a stream with this provider (which also backs the ollama type)
- usage was neither requested nor parsed, so token tracking stayed at 0

Now mirrors the proven llamacpp client: stream flag + stream_options
.include_usage, per-index tool-call fragment accumulation flushed on
finish_reason, usage passthrough, a 4MB SSE scanner buffer (64KB default
kills the stream on large tool arguments), and an empty-choices guard in
toResponse instead of a panic.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-12 16:14:01 -07:00
..
agent fix(agent): RunStream never surfaced tool calls to callers 2026-07-10 00:04:44 -07:00
config feat(config): add YAML config loader with hierarchical precedence 2026-06-30 23:53:20 -07:00
llm fix(openai): make streaming actually work; honor configured model 2026-07-12 16:14:01 -07:00
persona feat(agent): wire AGENTS.md discovery into the agent loop's system prompt 2026-07-08 23:27:17 -07:00
rag feat(rag): add SQLite+FTS5 backend, fix content/usage plumbing bugs 2026-07-06 00:05:30 -07:00
tools Fix tool call tracking and streaming assembly for all providers 2026-07-08 16:11:57 -07:00