Run Qwen3-TTS with CUDA graph acceleration on NVIDIA DGX Spark (ARM64 / SM 121 / CUDA 13) as an OpenAI-compatible TTS API server. - Dockerfile targeting nvidia/cuda:13.0.2-base-ubuntu24.04 with ARM64 cu130 PyTorch wheels - Patch for max-seq-len support to handle long reference audio without crashes - OpenWebUI + SillyTavern compatible API endpoints (/v1/models, /v1/audio/voices, /speakers) - Voice management: auto-generate voices.json from speaker reference audio files - Auto-transcription helper script for generating reference text from audio Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
6 lines
198 B
Plaintext
6 lines
198 B
Plaintext
# Path to your local Qwen3-TTS model weights
|
|
MODEL_PATH=/path/to/Qwen3-TTS-12Hz-1.7B-Base
|
|
|
|
# Optional: HuggingFace token (only needed if model requires authentication)
|
|
# HF_TOKEN=hf_your_token_here
|