diff options
| author | Paul Buetow <paul@buetow.org> | 2025-07-15 21:12:18 +0300 |
|---|---|---|
| committer | Paul Buetow <paul@buetow.org> | 2025-07-15 21:12:18 +0300 |
| commit | 9c77f2a7bef485fa137f123cbf55b42cacb2b285 (patch) | |
| tree | d4ee67a4d3de0c17fc86e465f24480b768e80d13 /GPT4O_AUDIO_NOTE.md | |
| parent | b2e1d035ab8d32f6c3351ae5f0a514e569294ef0 (diff) | |
feat: add OpenAI gpt-4o-mini-tts support with voice instructions
- Add support for OpenAI's new gpt-4o-mini-tts model with customizable voice instructions
- Add OpenAIInstruction field to audio configuration for natural language voice control
- Update CLI with --openai-instruction flag for runtime voice customization
- Enhanced cache key generation to include voice instructions
- Update default model to gpt-4o-mini-tts with Bulgarian-optimized instructions
- Add support for new voices: ash, ballad, coral, sage, verse
- Improve error handling for models requiring special API access
- Update documentation with examples and model information
- Create .totalrecall.yaml.example with comprehensive configuration options
Note: The gpt-4o-mini-tts model requires special API access and may not be available to all accounts yet.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
Diffstat (limited to 'GPT4O_AUDIO_NOTE.md')
| -rw-r--r-- | GPT4O_AUDIO_NOTE.md | 35 |
1 files changed, 35 insertions, 0 deletions
diff --git a/GPT4O_AUDIO_NOTE.md b/GPT4O_AUDIO_NOTE.md new file mode 100644 index 0000000..a227c60 --- /dev/null +++ b/GPT4O_AUDIO_NOTE.md @@ -0,0 +1,35 @@ +# GPT-4o Audio Support Note + +## Current Status + +The standard OpenAI Text-to-Speech API (`/v1/audio/speech`) currently supports only: +- `tts-1` - Standard quality +- `tts-1-hd` - High definition quality + +## GPT-4o Audio Capabilities + +According to OpenAI documentation, GPT-4o models have audio capabilities, but these work differently: + +1. **Realtime API**: GPT-4o audio generation might be part of the new Realtime API, which uses WebSockets for bidirectional audio streaming. + +2. **Chat Completions with Audio**: GPT-4o might support audio output through the chat completions API with special modality parameters, but this requires different request/response handling than the standard TTS API. + +3. **Model Names**: Models like `gpt-4o-audio-preview` or `gpt-4o-mini` with audio capabilities might not be compatible with the standard TTS endpoint. + +## Experimental Usage + +You can try experimental model names with the `--openai-model` flag: +```bash +./totalrecall "word" --openai-model gpt-4o-audio-preview +``` + +However, this will likely result in a 404 error as these models require different API endpoints. + +## Future Implementation + +To properly support GPT-4o audio generation, we would need to: +1. Implement support for the Realtime API (WebSocket-based) +2. Or implement the chat completions API with audio modalities +3. Handle different request/response formats for audio data + +For now, stick with `tts-1` or `tts-1-hd` for reliable audio generation.
\ No newline at end of file |
