diff options
| author | Paul Buetow <paul@buetow.org> | 2025-08-17 09:05:45 +0300 |
|---|---|---|
| committer | Paul Buetow <paul@buetow.org> | 2025-08-17 09:05:45 +0300 |
| commit | d5fbb6ef5957894eb5be0854bdb328a6774abddb (patch) | |
| tree | 7558a3d1c70db85d54f3367a5c81c28e7260392b /README.md | |
| parent | 5d9e197a394089f66539320e77abb3f3689b3381 (diff) | |
cli: stream responses in hexai when supported (OpenAI, Ollama)
- Add llm.Streamer optional interface
- Implement ChatStream for OpenAI (SSE) and Ollama (JSON stream)
- CLI uses streaming; LSP unchanged (non-streaming)
- README: document streaming behavior for CLI
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 1 |
1 files changed, 1 insertions, 0 deletions
@@ -58,6 +58,7 @@ Notes for `hexai` (CLI): - Prints LLM output to stdout. - Prints provider/model immediately to stderr, and a summary to stderr at the end (time, input bytes, output bytes, provider/model). - Default response style: short answers. If the prompt asks for commands, outputs only the commands with no explanation. Include the word `explain` anywhere in the prompt to request a verbose explanation. +- Streams output: when supported by the provider (OpenAI, Ollama), `hexai` streams tokens and prints them to stdout as they arrive. Copilot falls back to non-streaming. ### Hexai CLI behavior |