| Voicebuilding for Text-to-speech Synthesis (WS 2016/17) |
|---|
| Group 1 |
| Christophe Biwer, Dana Ruiter, Andrew Johnson |
The data repository called voice-andrew-us can be found here.
Notes for the group report can be found here (registration required to edit).
In order to work with this voice, the following command must be executed (on ubuntu) to get the desired dependencies:
sudo apt install sox praat speech-tools
There may be other requirements which need to be obtained via your package manager (e.g. apt).
The evaluation script is written in Python 3 and needs matplotlib and python3-tk:
sudo pip3 install matplotlib
sudo apt install python3-tk
cd to your desired directory and execute git clone https://github.com/yoshegg/voice-andrew-us.git. cd to the new directory.
Run
./gradlew legacyInit
followed by
./gradlew build
(which may take some time depending on your computer).
To actually test the voice, enter
./gradlew run
and go to localhost:59125.
run
./gradlew run & disown
./gradlew runCrossValidation
This will evaluate the voice by regenerating the utterances while blacklisting the original ones. The output is quite self-explaining. In order to do so, mary-tts must be running (which can of course also be done in another terminal.)
In order to save this data, do the following:
./gradlew rCV > evaluation/temp.txt ; tail -n +6 evaluation/temp.txt | head -n -4 > evaluation/results.txt ; rm evaluation/temp.txt
Plotting this data can be done with our plotting.py script (Python 3).
cd evaluation
python3 plotting.py
Keep in mind that building the HTS voice actually breaks the Unit selection voice. You might want to backup the build folder to easily switch between both versions of our voice.
... as explained here
Execute the dockerfile contained in the root folder of the projet (which originates from https://github.com/psibre/marytts-dockerfiles) and run it with
sudo docker build --build-arg HTKUSER=***** --build-arg HTKPASSWORD=***** -t marytts-builder-hsmm .
replace HTKUSER and HTKPASSWORD with the desired credentials (Registration needed).
The unit selection based voice must already be installed to continue!
Download the MaryTTS Builder and unpack it to some location
Go to the build directory of this project and run some location/bin/voiceimport.sh. Click on Settings and set db.marybase to /marytts. Don't forget to save.
Run the HMMVoiceFeatureSelection component.
Go to the build folder and start the docker container. By using the following command, you automatically execute the needed tasks:
sudo docker run -v `pwd`:`pwd` -w `pwd` -it marytts-builder-hsmm /bin/bash 'dockerScript.sh'
(the dockerScript.sh contained in the root folder of the project is the one that is tracked by git. Running ./gradlew legacyInit copies it to the build folder)
Alternatively you cant run the following command:
sudo docker run -v $PWD:$PWD -t marytts-builder-hsmm bash -c "cd $PWD; /marytts/target/marytts-builder-5.2/bin/voiceimport.sh HMMVoiceDataPreparation HMMVoiceConfigure HMMVoiceMakeData HMMVoiceMakeVoice"
You can track the process by running the following in another terminal window:
tail -f hts/log-XXX
docker run -v $PWD:$PWD -t marytts-builder-hsmm bash -c "cd $PWD; /marytts/target/marytts-builder-5.2/bin/voiceimport.sh HMMVoiceCompiler"
It won't succeed but don't worry, that's perfectly fine.
You may now have to change permissions because the created folders belong to root
chown yourName:yourName -R build/mary/voice-XXX
Run the gradle script in the folder build/mary/voice-XXX with gradle run or gradle build.
and go to localhost:59125.