Commit Graph

7 Commits

Author SHA1 Message Date
ecd833cb89 feat: opt-in torch.compile of the code predictor loop (TTS_COMPILE_PREDICTOR=1)
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-11 19:18:31 +02:00
79909a6fb8 build: pin PyTorch stack to GB10-validated versions
A fresh build pulled torch 2.14.0 from the cu130 index, which has not
been validated with CUDA graph capture on SM121. Pin torch 2.12.1,
torchvision 0.27.1 and torchaudio 2.11.0 (the versions in the running
images) and document the v6.11 image tags.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 20:21:07 +02:00
62a2ad9e7c fix: pin upstream faster-qwen3-tts to avoid Transformers 5 mismatch
Fresh builds cloned upstream main, which since v0.4.0 requires
Transformers 5 (qwen-tts-hf). qwen-asr then downgraded transformers to
4.57.6, breaking Qwen3TTSModel.from_pretrained at startup.

Pin upstream to 7cdef7e (v0.2.6, as in the released images) and pin
qwen-tts==0.1.1 / qwen-asr==0.0.6. FASTER_QWEN3_TTS_REF now accepts a
commit SHA, tag or branch.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 18:02:23 +02:00
3c389b0292 v6.7: Native speed control and zip word-level timestamps 2026-06-26 11:11:13 +02:00
1fc2f9c909 fix: add --max-seq-len to patch and remove || true from Dockerfile
The upstream openai_server.py gained --max-seq-len after v5 was built.
Add it to the patch so every build gets explicit sequence length control.
Also add max_seq_len=args.max_seq_len to FasterQwen3TTS.from_pretrained()
so the argument is actually used.

Remove || true from git apply so patch failures fail the build instead
of silently producing a broken image.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-30 14:40:23 +02:00
3d8d444e0b fix: remove --max-seq-len from voiceclone command, fix Dockerfile comment
--max-seq-len is not in the current :latest image's openai_server.py (upstream
added it after v5 was built). Remove it from voiceclone command so the
container starts; upstream default (4096) applies. Will be re-added explicitly
once v6 image is built with current upstream.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-30 14:36:59 +02:00
60db1b181f Initial release: Faster-Qwen3-TTS for DGX Spark GB10
Run Qwen3-TTS with CUDA graph acceleration on NVIDIA DGX Spark
(ARM64 / SM 121 / CUDA 13) as an OpenAI-compatible TTS API server.

- Dockerfile targeting nvidia/cuda:13.0.2-base-ubuntu24.04 with ARM64 cu130 PyTorch wheels
- Patch for max-seq-len support to handle long reference audio without crashes
- OpenWebUI + SillyTavern compatible API endpoints (/v1/models, /v1/audio/voices, /speakers)
- Voice management: auto-generate voices.json from speaker reference audio files
- Auto-transcription helper script for generating reference text from audio

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-04-14 00:06:05 +02:00