Skip to content
Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Download Free Animation Software – Let's Learn How to Do Everything!

  • Step-by-Step MMD instructions
  • DOWNLOADS
  • Troubleshoot, Fix MMD
  • Site Contents
  • Reggie Replies Q&A
  • Homework!
  • What IS MMD?
    • Download MikuMikuDance Newest Latest Version of MMD
  • “HOW TO”
    • Raycast RAY-MMD Effect Tutorials
  • BONUS PAGES
    • Why convert PMD models to PMX?
  • HALL of CHAMPIONS
  • Tutorial Categories
  • About
    • Privacy Policy
  • Toggle search form
  • o_ShaderCustomSet_v0_3 effect applies gentle color modification MMD Tutorials
  • First Steps for the Beginner MMD MikuMikuDance artist Welcome to LearnMMD.Com!
  • Running MikuMikuDance in Linux using Wine and DXVK Linux running MMD
  • Video Dojo Expo 2 – Holiday Song “Diva Performance”! CONTESTS
  • Updated LearnMMD Metronome Instructions for Use Metronome
  • Breathing “SOUL” into MMD models and scenes using Fine Art Techniques Advanced Shader Technique
  • LearnMMD.com: The MMD Instructions you have been looking for! MMD Basics
  • My new “Ring Around the Moon” MMD video is on YouTube "the making of" my video

Speech Synthesizer gives MMD Models a voice!

Posted on March 15, 2017June 9, 2017 By Trackdancer No Comments on Speech Synthesizer gives MMD Models a voice!

A feature article on LearnMMD by Trackdancer2015!How do I make my Vocaloid model talk instead of sing? Where can I get a speech synthesizer to read my script? How can I give a voice to my MMD model?

Vocaloid software is basically a speech synthesis application. But it is designed specifically for singing rather than for speaking… and on top of that, since almost all Vocaloid software is made in Japan to sing in Japanese, it is not readily applicable for use in English speech applications!

By speech here, I mean “talking”…

Use a speech synthesizer to lend a speaking-voice to your MMD model!Making your
Vocaloid talk…

Speech Synthesizer gives MMD Models a voice!

So why would you want your Vocaloid to be able to talk? Well, there’s tons of things you can do with them if you can make them talk. For example they can tell jokes or act in drama animations. There’s tons of these types of animations on YouTube but they all tend to use speech clips from TV programs or movies… which is fine if you just want to make a parody, as many people do.

But what if you want “original” speech; to make them say exactly what you want?

There are two methods:

  1. Have someone do the voice acting for you. This is probably the best method but the problem is finding someone that you can trust to do a proper job; and this can be really hard. Apart from anything else, the voice actor needs to be able to “act”. Also, the logistics of using this method can be difficult to organize.
  2. Use a speech synthesizer; and that’s what we will discuss in this article as it is relatively easy and cheap to do.

So what will you need to do a talking animation?

  • MMD
  • Audacity
  • A script
  • A speech synthesizer
  • Some method to record the speech

Creating the motion and lip sync for a speech animation uses exactly the same software as other MMD animation projects and these are covered in articles elsewhere. To sum up you need MMD to make the main animation and MOGG Face and Lips for making the lip sync (or you can do this manually in MMD also).

Write your script to be
“read aloud” by the speech synthesizer…

As far as the script is concerned; this is best typed into either a word processor or notepad. But, you won’t necessarily type-out the words as they are normally written; instead, write them the way they are to be spoken by the device. Most speech synthesizers will sound a little mechanical and can also do


ADVERTISEMENT


funny things with pronunciations… like they will not know the difference between words like “read” (reed) and “read” (red) as in the sentence “I read the book”… so you might want to intentionally misspell or mis-punctuate as you write in order to trick the synthesizer into pronouncing the words as you intend. Also, voice synthesizers are terrible with timing. Simply; they will process an entire script without pause even though in real life, we don’t speak in a stream of talk; as besides anything else, we need to breathe! But I’ll come back to explain how to do this with a speech synthesizer after we find one that can be used.

And we’re going to be really cheap too. You don’t need to buy one as there’s some around for free…

Free Speech Synthesizers…

If your script is in English, the speech synthesizer in MS Office is an ideal candidate. It’s called Lisa and is usually used as an aid for people who have some need to be able to hear what was typed into a word document. Lisa is very mechanical, at least in the version of her that I have which is bundled into the MS Office 2003 package.

Then again, you can get away with a Vocaloid sounding somewhat mechanical. After all, their singing isn’t exactly “human” sounding either.

But you can also use the speech synthesizer built into Google Translate which is almost human sounding. Speaking in Japanese or other languages of this type, it sounds very natural and the voice quality is very pleasant too. Plus of course, it is totally free. In fact, you can type your script in English and have the program speak the Japanese translation. Google Translate has a speech function for all of the world’s major languages.

To use it is really simple. Paste in your script one paragraph at a time. Then have the program speak it by accessing the speaker icon and record it.
Google Translate speech synthesizer can "read" your text out loud!
To record it, simply use the microphone on your laptop to record the speech as it is being read. Unless your laptop speakers are really good, I suggest you use a set of good external speakers to produce the audio.

In case this is not obvious, you will want to be in a really quiet space when recording. You will also need a program that can manage the recording process and Audacity serves well for this function.

Record one paragraph at a time…
… and edit the clips together.

Now since you’re recording one paragraph of the script at a time, you’ll end up with a whole collection of audio clips. To make it into an integral whole you will need to splice it together with Audacity – this allows you to mess with the timing and this is how to add pauses in your final audio. You also want to break up your script as the Google translate speech synthesizer can be problematic with huge amounts of text.

You can also use Audacity to change the voice quality. Since the Google Translate speech synthesizer uses an adult voice, raising the pitch, for example, will make it sound younger; and adding more treble will make it sound brighter. In fact, you will be surprised at how much you can change in terms of the final voice quality. So for example, you can make a male voice sound female and vice versa.

Once you have your final speech engineered just export it as a WAV file and you’re ready to do the rest of the animation. It really is that simple.

Anyway, I’ll include some example videos that I did using some of the methods outlined here.

The first example simply uses an audio clipping from the Lord of the Rings DVD.

The second example also uses an audio clipping from the same DVD, but the original speech was spoken by Aragon, who is a guy; at least the last time we checked. But in the clip I have Neru making the same speech. To make the speech sound “female”, I re-engineered the clip with Audacity.

But to make an original speech animation, I used MS Office 2003’s Lisa and tweaked it so that it sounds like it is being spoken by a chibi. Arguably, Google Translate’s voice synthesizer would have produced a much more natural sounding voice, but when this video was made that wasn’t an option.

Thanks for reading.

CREDITS:
Top Image:
Chibi IA v2.0 – Mqdl/Kiyo/Trackdancer
MMD 9.26
Image processed using Irvanview

 


– SEE BELOW for MORE MMD TUTORIALS…


— — —


– _ — –


Visit the LearnMMD.com Homepage! Plenty of Mikumikudance instruction and info!

More MMD Tutorials...

2023: Hatsune Miku is 16 Years Old by design and in reality!

Finally, in 2023, Hatsune Miku is 16 years old! When did Miku make her first ...read more

SEARCH LearnMMD.com... it's Easy!

Search LearnMMD.com to find your answers! With the posting of this article, LearnMMD.com has 758 tutorials ...read more

Download MMD CyberMiku Black ver1.5 with Glowing Wings and an attitude!

Download MMD CyberMiku Black ver1.5 with Glowing Wings and an attitude to match! A treasure... Yesterday I ...read more

Create your Most Attractive YouTube Thumbnail image

Is a custom YouTube thumbnail important? How do I get my MMD video to be ...read more

Download the beautiful LUKA MEGURINE HIPSTERBLACK by PS-2002

Where can I download LUKA MEGURINE HIPSTERBLACK by PS-2002? How can I get a new ...read more

Use YouTube Video Analytics Attract Maintain Viewers

How can I use YouTube Video Analytics to learn how to make popular MMD videos? ...read more

Making Soundtracks, MMD Tutorials, Speech Synthesizer, Trackdancer2015

Post navigation

Previous Post: The Making of “Viva La Vida MMD” by Zazi The Angel
Next Post: The Making Of my “I Know Those Eyes / This Man Is Dead MMD” video

Related Posts

  • An MMD town stage: Making Kerorin Town Great Again – Part 2 MMD Stages
  • Export Import MMD Models Using Blender and PMXE Blender
  • Japanese MMD mod allows Automatic Breathing action in MMD models MMD Tutorials
  • Kaitensora effect gives moving clouds background in your MMD scene Kaitensora Moving Clouds
  • MMD Camerawork makes your video exciting!
    No more boring MMD Camerawork – Keep it moving! Camera Motion
  • LearnMMD.com _ MikuMikuDance MMD Tutorials
    Almost Photo-realistic renders in MMD using Shaders and Effects Advanced Shader Technique

More Related Articles

Ray-MMD Localized Fog Effects for stunning MMD scenes MMD Tutorials
Make an MMD Music Video Bo Beep Bo Beep! "the making of" my video
PocketMQO(with MMD) MikuMikuDance in an Android environment! MMD Tutorials
Ray-MMD Godrays… argggh!!! MMD Tutorials
Removing Double Vertices to Create Continuous UV Maps Mae Blythe
How to sign up and Upload to Piapro! HollyLawliet

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Download the latest version of MikuMikuDance!
See the MMD Step-by-Step instructions page!
Learn how to make your own MMD motions!
LearnMMD.com
  • Use Stage Changes in MMD to Make an Interesting Video Koneko the MMD Fairy
  • MMD Fill Lights Part 2 – (Ray-MMD) MMD Tutorials
  • Public Domain and Ethical Release for MMD Bandages
  • With some practice, Rin can dance the sample dance as well as Miku!
    Let’s Play the Sample Dances and Learn About MikuMikuDance Intro to MikuMikuDance
  • ObjectLuminous Haku and Teto
    Using The ObjectLuminous Effect in MikuMikuDance Accessory Manipulation/Adjust
  • Ghost Effect for MME
    How to Use the Ghost Effect for MME! ARIZONA
  • Build your own stage for MMD using Blender 2.69 Blender
  • You Are My Senpai MMD Meme Project Download MMD Memes

Copyright © 2022 Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software and Instructions..

Powered by PressBook Premium theme

Go to mobile version