Skip to content
Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Download Free Animation Software – Let's Learn How to Do Everything!

  • Step-by-Step MMD instructions
  • DOWNLOADS
  • Troubleshoot, Fix MMD
  • Site Contents
  • Reggie Replies Q&A
  • Homework!
  • What IS MMD?
    • Download MikuMikuDance Newest Latest Version of MMD
  • “HOW TO”
    • Raycast RAY-MMD Effect Tutorials
  • BONUS PAGES
    • Why convert PMD models to PMX?
  • HALL of CHAMPIONS
  • Tutorial Categories
  • About
    • Privacy Policy
  • Toggle search form
  • Cycles materials for textures model and nodes
    Cycles Materials For Textures in Blender: Nice Textures for MMD Fast! Blender
  • Beamman's WEater Effect can be very realistic.
    BeamMan’s Water Effects really look wet! Beamman's Water v5
  • Make your own READ ME files so you can track your Sources Keep the Faith-MMD Credits/Sharing
  • MMD 8.06 Low Power button allows you to Multi-task MMD Basics
  • Best Way to Run MMD on a Mac Kazumi
  • Add Shadows to MMD .X Accessories Tutorial MMD Basics
  • MMD model 1052C China Qipao Miku download
    Introducing MMD model 1052C China Qipao Miku "the making of" my video
  • Make MMD Model Hands from scratch in Blender Blender
Register often to get sharp, crisp lip-sync animation movements. LearnMMD,com MMD 7.39

Create MMD Lip-Sync Animation as a Separate File

Posted on March 17, 2013November 21, 2016 By Reggie_Dentmore 7 Comments on Create MMD Lip-Sync Animation as a Separate File

How do I do lip-syncing animation to match my music in A Feature Article by Reggie Dentmore on LearnMMD.comMMD? Is there an easy way to lipsync in MikuMikuDance? How can I match my model’s mouth movements to my music WAV file?

Lip-Sync Animation is Detailed Work!

I wish there were some secrets to making it easy … but I haven’t found any yet … it is simply tedious work to be enjoyed, if you can, until you have matched your soundtrack from end to end.

The basic rule is to use only two or three sliders at a time. I set the grin at about a 25% value and then leave it alone for now. Then, using the “a” the most often (to control the open mouth) … and the “I” (to control the width of the mouth) … and adding some “u” or “o” to get those sounds) you are off and running. Almost all of those other possible mouse settings can be used for facial effects … but they don’t help you to “see” the pronunciation of the words.

Just start at the beginning. SAY the first phrase to yourself and feel your mouth change shape as you say each word … I … won’t … grow … up. Exaggerate the motion of your lips as you say those words. Imagine you are in front of a large audience with no microphone. You want to speak loudly and clearly … how does your mouth move?  First, your mouth is calm, maybe a little open as you breath and smile … Now “feel” your lips and your mouth as you slowly, in an exaggerated way, say: EYEeee … WO..N.’T … G.R..OOO … Uh.P.

Have “Play WAV with Frame” turned on, keep an eye on your oscilloscope so that you can see the start of each word. NOTE that the Play WAV with Frame is not precisely accurate. Rely more on the oscilloscope for precise syllable placement. NOTE, too, that it is often best to start the animated mouth movement just a frame, or two, before the start of the visible wave … just works out better, for me.

As you work, you will want crispRegister often to get sharp, crisp lip-sync animation movements. LearnMMD,com MMD 7.39 movements. Feel how quickly your lips change shape as you read this sentence out loud. You don’t want MikuMikuDance to make smooth motions from one lip position into the next. Say “Lip Position” … it’s two words. You can feel the stop between them. You would want to animate a single frame of slightly open mouth between the two P sounds. To get the sharp movements, you have to register all of the mouse vowels you are using almost every time you need to change shapes. Like cutting camera scenes, you want to register the previous position right before you create the new position. The movements need to be sharp and crisp, not smoothly flowing as MMD is always trying to do.

There is only one real shortcut …

There is only one real shortcut in the process of creating your lip-sync animation: most songs have some repetition of the lyrics … so you can carefully lip-sync your way through that lyric the first time … and then copy/paste those diamonds into place every time that phrase comes around. “Oh baby baby I love you!”  or, in my example “I won’t grow up!” … You may have to do some fine tuning to get the pasted data to better-fit the soundtrack … but it’s a lot faster than creating a new sequence for each repetition.

Make your motions boldly …

Make your motions in a bold way. Open that mouth … flap those lips. A little too extreme is better than not enough action. At the bottom of the EDIT MENU is “Multiply of Facial Expression”. You can use that function to pump up your motions if you didn’t make them strong enough to begin with … and you can also tone down the motions if you feel you’ve made them too strong … better to start with them a bit strong so that we can see the lips flapping on that small mouth in the distance rather than so weak that we see nothing, at all. Stronger motions provide good data for the “Multiply of Facial Expression” tool.

You will find that different models require more or less “boldness” in your mouth motions. That’s another place where the “Multiply of Facial Expression” tool can help you … you can match the motions to your model’s requirements.

Do your Lip-Sync Animation in a separate dance file!

When you are working on a new project, it’s easier to do your lip-sync work with a model that is standing still!  If you have already begun your new dance and have your models in motion, the model’s gyrations may keep you from seeing the model’s mouth well enough for you to get the job done.

The first step in any project is to get your soundtrack finished. Add some silence for the first few moments … then maybe add some applause … start your music so that it overlaps the applause a little bit … add some silence in the middle if you need to … and maybe a bit of applause and a bit of silence at the end, as well.

With your soundtrack complete, you can start your MikuMikuDance project! You could do the mouthing of the words first … before any other motions are created. That way it will be done! … and you can start work on the dance, itself. But the lip-sync animation is so tedious that you won’t be able to wait until that’s finished before you start on the fun part … the actual animation. A 3-minute song can take five or six hours spread over several days of sliding those mouse (mouth) sliders to get what you want.

So … to get right into the animation while I am still excited about it, I can start my project and, then, make a separate dance-file just for the lip-flapping lip-sync animation. When that is finally complete, you can “select all facial” using the Range Select function and do a SAVE MOTION to create a VMD file … or you can copy/paste the motion into your main project file.

Good lip-sync animation adds so much to your finished video! See, for instance, the Departures memes on YouTube. That meme is all about perfect lip-sync: http://youtu.be/NrKqGwlWzAY

Enjoy!


– SEE BELOW for MORE MMD TUTORIALS…


— — —


– _ — –


Visit the LearnMMD.com Homepage! Plenty of Mikumikudance instruction and info!

More MMD Tutorials...

Create 450-Frame MMD animation from scratch!

How do I create a 450-Frame MMD animation from scratch? How do I start making ...read more

Create MMD Dance Motion from Scratch - a beginners guide

How can I make my own Dance Motion from scratch? Is it easy to make ...read more

PMXE Plugin adds Arm IK bones allowing automatic MMD model interaction

The simplest interactions between people in real life can be very difficult to animate; especially ...read more

Animate MMD ballet pirouette motion

Over the last few years several people have asked me how to animate an MMD ...read more

Animation Styles: Park and Bark vs. Choreography

Q: What is choreography? What is "park & bark"? How can these tools improve my ...read more

How to Lip-Sync in MMD using MoggProject Face and Lips

What's the easiest way to lip-sync in MMD? How do I use the Face and ...read more

Creating Motions

Post navigation

Previous Post: Translate Japanese Models to English with Google Translate and PMDE
Next Post: Creating Black Model Silhouettes in MikuMikuDance

Related Posts

  • Making MikuMikuDance Original Animation Videos "the making of" my video
  • How to Lip-Sync in MMD using MoggProject Face and Lips Animation Shortcuts
  • Smooth camera moves and soft focus make for smooth scene transitions in MMD 7.39 . LearnMMD.com
    Smooth Scene Transitions featured in new MMD Departures video "the making of" my video
  • Use The Background AVI to Make Realistic Animations in MMD ARIZONA
  • Making good MMD lip-syncs! Creating Motions
  • Animation Styles: Park and Bark vs. Choreography Creating Motions

More Related Articles

Zooming Out of MMD City Stage. Working with Large Stages In MikuMikuDance ARIZONA
Let your MMD model breathe and move while standing still! Creating Motions
Making MikuMikuDance Original Animation Videos "the making of" my video
How to Lip-Sync in MMD using MoggProject Face and Lips Animation Shortcuts
Create Motion Data – So you think you can’t dance? Creating Motions
Making good MMD lip-syncs! Creating Motions

Comments (7) on “Create MMD Lip-Sync Animation as a Separate File”

  1. Alexis says:
    June 29, 2018 at 1:20 pm

    When I use the models lips to make a song their lips move before the wave starts how do i stop that from happening?

    Reply
    1. Reggie_Dentmore says:
      June 30, 2018 at 6:06 pm

      The biggest thing when creating ANY motion is the set-up for that motion. Let’s say you want your model to have an A sound on it’s lips in frame 60. If all you do is go to frame 60 and adjust the mouth, MMD will create a smooth transition from frame zero to frame 60… so it will look to you like the mouth started to open before the music starts… by frame 5, the mouth will look open. So… go to frame zero and register that closed mouth… you get a red diamond. Copy that red diamond using the Copy button, right there under the frame chart, go out to frame 59 and Paste that diamond. NOW when you press PLAY, the mouth will stay closed and suddenly snap open in frame 60. Move that closed-mouth diamond a frame, or two, back, Frame 57… if you want to make a more gentle motion. ALL motions work like this.
      https://learnmmd.com/http:/learnmmd.com/short-sharp-sudden-motions-require-mikumikudance-skill/
      https://learnmmd.com/http:/learnmmd.com/mmd-make-your-own-motions/

      Reply
  2. Marie says:
    May 20, 2017 at 11:47 am

    My lip movement is SUPER EXTRA SLOWWW
    Someone help RIGHT NOW PLEASE!!

    Reply
    1. KillerBeer says:
      May 20, 2017 at 12:22 pm

      Is your graphic card driver updated to the latest version?

      Reply
  3. Tonya Ramsey says:
    October 21, 2014 at 8:04 am

    Thanks for the info I am starting to make my own projects and this might help thanks a bunch :)

    Reply
  4. Fia Phoenix says:
    May 17, 2014 at 9:29 pm

    i have to say that video sings better than real miku. and i needed this tutorial badly.

    Reply
  5. Arizona says:
    March 17, 2013 at 7:53 am

    Hey Reg!
    Good info! I also checked out the video! How FUN! 8D

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Download the latest version of MikuMikuDance!
See the MMD Step-by-Step instructions page!
Learn how to make your own MMD motions!
LearnMMD.com
  • Download MME v037 in English install MikuMikuEffects special effects Download MME MikuMikuEffects
  • Using The Floor Light Art Effect in MMD. ARIZONA
  • Kaito and the SpotLight Effect.
    Using the SpotLight Effect in MikuMikuEffects ARIZONA
  • RAY-MMD: Using the Time of Night skybox MMD Tutorials
  • mikumati NXDE G-IDLE models dance "No Thanks" by Hyolyn - Download Links
    mikumati NXDE G-IDLE models dance “No Thanks” by Hyolyn – Download Links "the making of" my video
  • VDE-3 Champion: Kazumi Video Dojo Champions
  • modified MMD effects can yield NEW surprises!
    Modified MME Effects Files yield NEW Effects for MMD! Customize MME effects
  • Try Reggie’s Evil Eye Effect for an Anime-style effect MMD Tutorials

Copyright © 2022 Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software and Instructions..

Powered by PressBook Premium theme

Go to mobile version