mARTin-B78 92e2381d0b Reduce latency: CUDA warmup, chunk_size=4, max-seq-len 2048 ... - run_server.py: warm up CUDA graphs at server startup via lifespan event so the first real request does not pay the 7-8s graph- compilation penalty; uses modern lifespan API instead of deprecated on_event - generate_voices.py: set chunk_size=4 per voice so streaming clients receive first audio after ~333ms instead of ~1s - docker-compose.yml: add --max-seq-len 2048 (halves static KV cache, reduces VRAM and graph-capture time) - config/benchmark_api.py: new script to measure TTFA, RTF and speed against the live API endpoint Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>		2026-05-11 20:43:21 +02:00
..
speakers	Initial release: Faster-Qwen3-TTS for DGX Spark GB10	2026-04-14 00:06:05 +02:00
auto_transcribe.py	Initial release: Faster-Qwen3-TTS for DGX Spark GB10	2026-04-14 00:06:05 +02:00
benchmark_api.py	Reduce latency: CUDA warmup, chunk_size=4, max-seq-len 2048	2026-05-11 20:43:21 +02:00
generate_voices.py	Reduce latency: CUDA warmup, chunk_size=4, max-seq-len 2048	2026-05-11 20:43:21 +02:00
run_server.py	Reduce latency: CUDA warmup, chunk_size=4, max-seq-len 2048	2026-05-11 20:43:21 +02:00