Skip to main content

Remote Server

Deploy VieNeu-TTS as a high-performance API server powered by LMDeploy.

Quick Start​

docker run --gpus all -p 23333:23333 pnnbao/vieneu-tts:serve

With Public Tunnel​

docker run --gpus all -p 23333:23333 pnnbao/vieneu-tts:serve --tunnel

Run 0.3B Model (Faster)​

docker run --gpus all pnnbao/vieneu-tts:serve --model pnnbao-ump/VieNeu-TTS-0.3B --tunnel

Serve a Fine-tuned Model​

docker run --gpus all \
  -v $(pwd)/finetune/output:/workspace/models \
  pnnbao/vieneu-tts:serve \
  --model /workspace/models/merged_model --tunnel

Connecting Clients​

See Remote Mode for client SDK usage.