Urdu is listed as supported, but Urdu TTS generation is not working correctly

#3
by mahwizzzz - opened

Urdu is among the 43 supported languages however while testing the model for Urdu I have not been able to obtain satisfactory Urdu speech.

Zyphra org

Hi ! Thank you for your interest in the model.
The model was trained on Urdu speech, but we did not evaluate the final model's performance on this language in ZTTS2-Eval.
I ran a small internal evaluation over Urdu speech, and found the model does somewhat well, achieving 15.3% WER.

Could you let me know how exactly the model is failing for you ?

Thanks !
George

its cloning the voice quite well but I'm noticing some inconsistencies in Urdu word pronunciation certain words don't sound natural or are not pronounced correctly which is affecting the overall quality.

Zyphra org

We're working on a finetuning framework which should let you adapt the model in such a way to improve performance for a particular language; I'll post here once it's available.

im waiting for it, thank you

Sign up or log in to comment