-
Visit LearnMMD.com on Facebook!.
Keep the Faith-MMD... Learn to be a responsible MMDer! .
.

Set up Kinect 360 motion capture for MMD!


See all of the articles by LearnMMD's Kurea Urusuta!How do I set up Kinect 360 to do motion capture for MMD? Which Kinect do I need to work with MMD? What software do I need to connect Kinect to MMD? Can I use Windows 10 with the Kinect 360 for MMD motion capture?

Ever wondered if you could use motion capture with MMD? With the Xbox 360 Kinect, that is possible! And I will show you how to set up your Kinect and get it to work on MMD using these steps.

Set up Kinect 360 for motion capture for MMD!

Which model of Kinect do I need?

The XBOX 360 Kinect is the one you need as you set up Kinectt 360 for MMD motion capture.

The Kinect model that will work on computers is this model: KinectLPF-00006 which is the Kinect Adventures one. Other models, including the Xbox One Kinect, do not work on MMD because there is no software compatibility. Microsoft does allow software for the Xbox One Kinect to install on your computer, but it doesn’t work with MMD.


EDITORS NOTE 9/24/2017:
Windows 10 users CAN do motion capture with Kinect. See this video by Remington Graphics on YouTube. He is connecting his Kinect with Windows 10 so as to do motion capture into Blender. … LOTS of info there.


So… how do I set up the Kinect 360?

If you follow the basic Microsoft installation, https://www.microsoft.com/en-au/download/details.aspx?id=44561, the Kinect for Windows SDK which is the official installation, the Kinect will be installed on your computer… but that installation is not compatible with MMD!

We will be installing the Kinect manually, in pieces, in a certain order… which can be tricky to do. If not installed correctly, the result can come with errors and won’t work.

Only for Windows XP, Vista and Windows 7…

My method seems to be compatible only with Windows XP, Vista and 7 computers. Windows 8 and up seems to block the software and prevent you from using it a second time after you first successfully use it.

Let’s start, shall we?

1.

First of all, the plug on the Kinect cannot be used to plug it into the PC straight away, you will need to buy an adapter.Your Kinect 360 needs a special USB AC power adaptor in order to connect to your computer.

You can find them on eBay. I see one called USB AC Adapter Power Supply Cable Cord for Microsoft Xbox 360 Kinect

I connected the power supply cable to the Kinect and plugged the USB connector into my computer, then plugged in the power supply. I live in Australia and so I needed to use an adapter to plug the AC unit into an outlet.

Your computer will then recognize the Kinect and see the monitor and the sensor. It has audio, too, but that is not needed.

New devices detected, not recognized…

Then your computer will say that these devices detected are not understood or recognized. In device manager, they will both have a yellow question mark next to them in the USB port section.

Green light on Kinect?

Check if your Kinect is flashing a green light. If it is, that’s a good sign: it is working properly. If it isn’t, then check your connection again.

2.

You will need to download these software: make sure to install them in the order I show you to in my instructions.

  1. Download this as a folder and unzip it (SensorKinect-unstable): http://www.mediafire.com/file/uvqcqnf5qpaup24/SensorKinect-unstable.zip
  2. OpenNI: http://www.mediafire.com/file/igzqdbb654ba72m/OpenNI-Win32.msi
  3. NITE: http://www.mediafire.com/file/7br210rla6z9aw4/NITE-Win32.msi
  4. DX OpenNI: http://www.mediafire.com/file/jpvybdejokdzba3/DxOpenNI.zip
  5. You will need to install C++ 2008 Redistributable Package (x86): https://www.microsoft.com/en-us/download/details.aspx?displaylang=en&id=29

3.

Now go to device manager and go to the USB section where you will see your Kinect sensor, monitor and generic USB hub monitor listed. Uninstall them except Generic USB hub and now


ADVERTISEMENT


disconnect your USB adapter. Plug it in again… and right click on the monitor to update the driver, you will be given the option to look for the driver hardware on your computer, browse for the Sensor Kinect folder: go to “Platform” -> “Win32” folder and push “OK”, then it will start installing the drivers, do the same for the sensor.

4.

Now install OpenNI as normal.

Then go back to the Sensor Kinect folder and go to the bin folder and install the SensorKinect093-Bin-Win32-v5.1.2.1.msi file.

Install NITE.

5.

Now go to your program files in your C drive and find the folder OpenNI, then go to samples -> bin -> and delete the file NiUserTracker.exe. The purpose of this is so you can see your room when you use the Kinect in MMD. You don’t have to delete this if you don’t want to.

6. Now open the folder DxOpenNI and copy the files DxOpenNI.dll and SamplesConfig.xml and paste it into MMD’s data folder.

7.

Restart your computer so you can give it a fresh start-up before opening MMD. Now open MMD, enter a model in model mode, select all of your models bones, click on the motion capture tab and click on Kinect!

Now let’s make motion capture easy!

  • Make sure that you put your Kinect in a wide and open space with no furniture or rubbish around, 4 meters wide and long. That should be enough because if the Kinect cannot see your whole body, it will fail to capture parts it can’t see, so you need to make a very clear and empty space. The reason for this is that it automatically pinpoints where you are standing, so if it cannot see your feet, you will be walking in mid air.
  • If you turn around, it cannot record that because it is only a single camera. It can only see what is in front of it… unlike professional motion capture which may use over 20 cameras from all angles to record turns.
  • Use a nice lighted room, not too bright, not too dark… Kinect is a camera, after all. If you recall directing a normal camera to a bright lighted or dark area when you can’t see, it is the same for the Kinect. So if it is not capturing you properly, dim or light-up your room a little.

How to use the Kinect:

When you click on the Kinect in the motion capture tab, another button will come up that will say “Start recording”, click on that and it will say 3, 2, 1 and it will start recording until you press the “stop recording” button.

As you can see, in the bone/frame manipulation, it is all filled with dots which tells you that it records every single move and frame. That makes it difficult to edit! Kinect does not record interpolation curves into the newly recorded motion, so the movements may appear slower than your motions at the time of recording.

HAVE FUN DOING MOTION CAPTURE with KINECT!!!


– SEE BELOW for MORE MMD TUTORIALS…




Visit the LearnMMD.com Homepage! Plenty of Mikumikudance instruction and info!

11 Comments

  1. mmd noob mmd noob
    November 27, 2017    

    i did all it said, and still cant read the DxOpenNI.dll, am i doing something wrong?

    • Reggie_Dentmore Reggie_Dentmore
      November 29, 2017    

      I checked with Kazuki Matsuoka, author of that tutorial, she says: Those errors usually come up if you haven’t installed the software correctly, you have to uninstall the software and try again. If it appears again, give it a few days for the software to reel in before trying again.

  2. mokona mokona
    November 11, 2017    

    ok nevermind i fixed that error but now it says

    InitFromXmlFile failed: can’t create any node of the requested type!

    and:

    cannot find kinect sensor

  3. mokona mokona
    November 11, 2017    

    I followed the setup instructions exactly, but i get the following errors when i try to use the kinect motion capture in mmd:

    The procedure entry point xnOSSeekFile64 could not be located in the dynamic link library OpenNI.dll

    and:

    The procedure entry point _xnDumpFileClose could not be located in the dynamic link library OpenNI.dll

    what do i do to fix this

  4. Mikey Mikey
    August 30, 2017    

    When I bring up the “motion capture” tab, there’s a selection that says,
    “load oni-file(O).” What does this mean exactly?

  5. Mikey Mikey
    August 30, 2017    

    After setting up the Kinect (EXACTLY) the way you instructed me to do so, an error still pops up saying,

    “Cannot move OpenNI.
    OpenNI might be failed install.”

    P.S. I did it right. If not, please send me detailed instructions with images to know if I’m doing it right.

  6. mecha crafter mecha crafter
    August 16, 2017    

    i have a Xbox One Kinect is there still no software to make it work for mmd?

  7. Kiyoshi Kiyoshi
    March 10, 2017    

    Hi.
    I have a question.
    I’ve seen all the model of kinect and i’m so confused that it’s look same each other.
    Does all the “KinectLPF-00006” are have a same model 1414?

  8. noname007 noname007
    March 10, 2017    

    I read a comment on youtube:
    “iPi can use a single kinect, but it will still not look as good as 3+ cameras or 2 Kinect’s because the more angles you get, the better it looks. I’ll always recommend 3+ cameras or 2 Kinects.

    iPi has 3 versions:
    Express (only 1 kinect, no camera support): $400 (currently on sale for $200)”
    Is that true?
    I search nothing at all about 2 kinect with MMD. do you know how to captrue motion with 2 kinect +MMD ?
    Thanks.

  9. suo suo
    December 11, 2016    

    Thank you~

Leave a Reply

Your email address will not be published. Required fields are marked *

Download the latest version of MMD MikuMikuDance! Step-by-step instructions to help you make an MMD Music Video! bo-beep-bo-beep! LearnMMD's Step-by-Step MMD instructions for MikuMikuDance!

MMD Tutorials:


Really Learn MMD as you face the 15-second Animation Challenge!

Visit LearnMMD.com on Facebook!