- Fixed-window CUDA-graph codec decode for streaming (TTS_GRAPH_DECODE=0 disables) - Per-request chunk_size (2-24) on /v1/audio/speech - prebuffer_ms (0-10000) to hold back audio before sending - Stop generation on client disconnect - Recommend --max-seq-len 2048 for the streaming container Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| docker-compose.simple.yml | ||
| docker-compose.yml | ||