Skip to content
Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software

Download Free Animation Software – Let's Learn How to Do Everything!

  • Step-by-Step MMD instructions
  • DOWNLOADS
  • Troubleshoot, Fix MMD
  • Site Contents
  • Reggie Replies Q&A
  • Homework!
  • What IS MMD?
    • Download MikuMikuDance Newest Latest Version of MMD
  • “HOW TO”
    • Raycast RAY-MMD Effect Tutorials
  • BONUS PAGES
    • Why convert PMD models to PMX?
  • HALL of CHAMPIONS
  • Tutorial Categories
  • About
    • Privacy Policy
  • Toggle search form
  • Download VMDSpectrum Analyzer to create VMD files MMD Tutorials
  • Customize MME Effects by Editing .fx Files Customize MME effects
  • Raycast Ray-MMD Toon Shader
    Ray-MMD Toon Shading Basics MMD Tutorials
  • About changing models skirts using PMD Editor PMXE KillerBeer
  • Download Reggie Dentmore's "Hand Pose Collection" on LearnMMD.com
    MMD Hand Poses make Animation Easier Animation Shortcuts
  • YouTube serves video playback quality to best suit your viewing-screen HD Videos in MMD
  • Luka with Body Pane with Vignette
    Hair Falling through the Body in MMD Models and How to Fix It Fixing Broken Models
  • Hatsune Miku type N model download
    Download Hatsune Miku type N models from 2010… a set of 6! Downloading New Models

Set up Kinect 360 motion capture for MMD!

Posted on December 9, 2016July 7, 2024 By Kazuki Matsuoka 41 Comments on Set up Kinect 360 motion capture for MMD!

See all of the articles by LearnMMD's Kurea Urusuta!How do I set up Kinect 360 to do motion capture for MMD? Which Kinect do I need to work with MMD? What software do I need to connect Kinect to MMD? Can I use Windows 10 with the Kinect 360 for MMD motion capture?

Ever wondered if you could use motion capture with MMD? With the Xbox 360 Kinect, that is possible! And I will show you how to set up your Kinect and get it to work on MMD using these steps.

Set up Kinect 360 for motion capture for MMD!

Which model of Kinect do I need?

The XBOX 360 Kinect is the one you need as you set up Kinectt 360 for MMD motion capture.

The Kinect model that will work on computers is this model: KinectLPF-00006 which is the Kinect Adventures one. Other models, including the Xbox One Kinect, do not work on MMD because there is no software compatibility. Microsoft does allow software for the Xbox One Kinect to install on your computer, but it doesn’t work with MMD.


EDITORS NOTE 9/24/2017:
Windows 10 users CAN do motion capture with Kinect. See this video by Remington Graphics on YouTube. He is connecting his Kinect with Windows 10 so as to do motion capture into Blender. … LOTS of info there.


So… how do I set up the Kinect 360?

If you follow the basic Microsoft installation, https://www.microsoft.com/en-au/download/details.aspx?id=44561, the Kinect for Windows SDK which is the official installation, the Kinect will be installed on your computer… but that installation is not compatible with MMD!

We will be installing the Kinect manually, in pieces, in a certain order… which can be tricky to do. If not installed correctly, the result can come with errors and won’t work.

Only for Windows XP, Vista and Windows 7…

My method seems to be compatible only with Windows XP, Vista and 7 computers. Windows 8 and up seems to block the software and prevent you from using it a second time after you first successfully use it.

Let’s start, shall we?

1.

First of all, the plug on the Kinect cannot be used to plug it into the PC straight away, you will need to buy an adapter.Your Kinect 360 needs a special USB AC power adaptor in order to connect to your computer.

You can find them on eBay. I see one called USB AC Adapter Power Supply Cable Cord for Microsoft Xbox 360 Kinect

I connected the power supply cable to the Kinect and plugged the USB connector into my computer, then plugged in the power supply. I live in Australia and so I needed to use an adapter to plug the AC unit into an outlet.

Your computer will then recognize the Kinect and see the monitor and the sensor. It has audio, too, but that is not needed.

New devices detected, not recognized…

Then your computer will say that these devices detected are not understood or recognized. In device manager, they will both have a yellow question mark next to them in the USB port section.

Green light on Kinect?

Check if your Kinect is flashing a green light. If it is, that’s a good sign: it is working properly. If it isn’t, then check your connection again.

2.

You will need to download these software: make sure to install them in the order I show you to in my instructions.

  1. Download this as a folder and unzip it (SensorKinect-unstable): http://www.mediafire.com/file/uvqcqnf5qpaup24/SensorKinect-unstable.zip
  2. OpenNI: http://www.mediafire.com/file/igzqdbb654ba72m/OpenNI-Win32.msi
  3. NITE: http://www.mediafire.com/file/7br210rla6z9aw4/NITE-Win32.msi
  4. DX OpenNI: http://www.mediafire.com/file/jpvybdejokdzba3/DxOpenNI.zip
  5. You will need to install C++ 2008 Redistributable Package (x86): https://www.microsoft.com/en-us/download/details.aspx?displaylang=en&id=29

3.

Now go to device manager and go to the USB section where you will see your Kinect sensor, monitor and generic USB hub monitor listed. Uninstall them except Generic USB hub and now


ADVERTISEMENT


disconnect your USB adapter. Plug it in again… and right click on the monitor to update the driver, you will be given the option to look for the driver hardware on your computer, browse for the Sensor Kinect folder: go to “Platform” -> “Win32” folder and push “OK”, then it will start installing the drivers, do the same for the sensor.

4.

Now install OpenNI as normal.

Then go back to the Sensor Kinect folder and go to the bin folder and install the SensorKinect093-Bin-Win32-v5.1.2.1.msi file.

Install NITE.

5.

Now go to your program files in your C drive and find the folder OpenNI, then go to samples -> bin -> and delete the file NiUserTracker.exe. The purpose of this is so you can see your room when you use the Kinect in MMD. You don’t have to delete this if you don’t want to.

6. Now open the folder DxOpenNI and copy the files DxOpenNI.dll and SamplesConfig.xml and paste it into MMD’s data folder.

7.

Restart your computer so you can give it a fresh start-up before opening MMD. Now open MMD, enter a model in model mode, select all of your models bones, click on the motion capture tab and click on Kinect!

Now let’s make motion capture easy!

  • Make sure that you put your Kinect in a wide and open space with no furniture or rubbish around, 4 meters wide and long. That should be enough because if the Kinect cannot see your whole body, it will fail to capture parts it can’t see, so you need to make a very clear and empty space. The reason for this is that it automatically pinpoints where you are standing, so if it cannot see your feet, you will be walking in mid air.
  • If you turn around, it cannot record that because it is only a single camera. It can only see what is in front of it… unlike professional motion capture which may use over 20 cameras from all angles to record turns.
  • Use a nice lighted room, not too bright, not too dark… Kinect is a camera, after all. If you recall directing a normal camera to a bright lighted or dark area when you can’t see, it is the same for the Kinect. So if it is not capturing you properly, dim or light-up your room a little.

How to use the Kinect:

When you click on the Kinect in the motion capture tab, another button will come up that will say “Start recording”, click on that and it will say 3, 2, 1 and it will start recording until you press the “stop recording” button.

As you can see, in the bone/frame manipulation, it is all filled with dots which tells you that it records every single move and frame. That makes it difficult to edit! Kinect does not record interpolation curves into the newly recorded motion, so the movements may appear slower than your motions at the time of recording.

HAVE FUN DOING MOTION CAPTURE with KINECT!!!


– SEE BELOW for MORE MMD TUTORIALS…


— — —


– _ — –


Visit the LearnMMD.com Homepage! Plenty of Mikumikudance instruction and info!

More MMD Tutorials...

Reader asks how to create MMD artwork... stuff like posing, camerawork?

A reader asks... Is there a tutorial on how to create MMD artwork, like those you ...read more

Learn MikuMikuDance in Small Steps! New LearnMMD Video Series

Learn MikuMikuDance in Small Steps. Where can I find easy-to-follow MMD instructions on YouTube? How ...read more

Apply Multiple Effects on an Entire MMD Model Using M4Layer Effect

How can I apply multiple effects to an MMD model? Can I use more than ...read more

MMD Plugin Manager... I Found a Treasure!

What sorts of MMD Plugins are there? MMD Plugin Manager? MMD Plugins. Plugin MMD. More ...read more

2023: Hatsune Miku is 16 Years Old by design and in reality!

Finally, in 2023, Hatsune Miku is 16 years old! When did Miku make her first ...read more

SEARCH LearnMMD.com... it's Easy!

Search LearnMMD.com to find your answers! With the posting of this article, LearnMMD.com has 758 tutorials ...read more

Kazuki Matsuoka, MMD Tutorials, Motion Capture

Post navigation

Previous Post: Why does MMD HAVE to be EXCRUCIATINGLY CONFUSING?
Next Post: Creating Hand IK Bones with the IKMakerX PMXE plugin

Related Posts

  • Top-10 Best “motion-maker” MMDers on YouTube Intro to MikuMikuDance
  • Ray-MMD shading Mech-Girls!
    Ray-MMD Shading Mech Girls brings those beauties to life! MMD Tutorials
  • Ray-MMD advanced lighting techniques for MMD MikuMikuDance
    Ray-MMD Advanced Lighting: A Night on the Town MMD Tutorials
  • Reader asks how to create MMD artwork… stuff like posing, camerawork? MMD Basics
  • Make an MMD Music Video Bo Beep Bo Beep! "the making of" my video
  • No Diamonds Appear in Frame Chart in MMD and How to Fix It Mae Blythe

More Related Articles

How to make AutoLuminous work on a PMX Model AutoLuminous MME / PMDE
Widescreen MMD “Kiss Me” animation too long but I wanted More! "the making of" my video
Creating an animation using MMD, MikuMikuDance! "the making of" my video
Top-10 Best “motion-maker” MMDers on YouTube Intro to MikuMikuDance
VOCALOID 3 Tutorial – The whole interface on a basic level Kazuki Matsuoka
Play games within MMD using MMD as a Game Engine! Creating Motions

Comments (41) on “Set up Kinect 360 motion capture for MMD!”

Comments navigation

Older comments
  1. kozen key says:
    December 14, 2023 at 8:32 pm

    hello im trying whit the kinect from xbox one but i can´t make it to work there is some solution or something like?

    Reply
    1. KillerBeer says:
      December 16, 2023 at 6:38 am

      Sorry, but if this tutorial (and nothing found in comments) haven’t helped you, then probably nothing will. Kinect support in MMD is pretty much abandoned concept.

      Reply
  2. Minu says:
    May 7, 2022 at 3:11 pm

    Oh! Someone figured out how to do this with Kinect V2!
    https://nellab.net/archives/00512/

    Reply
    1. Reggie_Dentmore says:
      May 7, 2022 at 6:59 pm

      Great! … thank you!

      Reply
  3. Paithong says:
    October 24, 2021 at 3:11 am

    Is it available for kinect v2?

    Reply
    1. Reggie_Dentmore says:
      October 24, 2021 at 12:55 pm

      You are on your own, here. As I understand it, at best, it was the original Kinect and a Windows 7 PC that was required for any kind of success. The world has moved on… and I do not have an answer for your question.

      Reply
  4. Gentoo says:
    April 29, 2021 at 8:48 am

    “Now go to device manager and go to the USB section where you will see your Kinect sensor, monitor and generic USB hub monitor listed. Uninstall them except Generic USB hub and now” is unclear on my end. I just see xbox NUI motor under other devices, and the generic usb hub I plugged it in to under usb controllers. OpenNI had issue and rolled back.
    I don’t know where my other two comments went under the thread.

    Reply
    1. Gentoo says:
      May 6, 2021 at 10:46 am

      Update: I’ve followed this guide to get the drivers working. https://www.youtube.com/watch?v=4W6hiW3Qhuo
      It is working on the 32bit program which is good enough. Thank you all for the help, Reggie_Dentmore and KillerBeer.
      Specifically the prepagaged program does not work, you have to download v932 32 bit version and copy over the MoggNuiCoinfig, DxOpenNI.dll into the Data directory before you can use the kinect. These will fit the motions (tracking is okay), the legs are a bit wonky and depth perception is mdeiocre but they can be edited manually and with much less effort than doing it all by hand.

      Reply
      1. Reggie_Dentmore says:
        May 6, 2021 at 7:42 pm

        Wow… amazing… great work… Maybe you could write the basis of a tutorial to help other MMDers to work with Kinect… email it to me and I can tune-it-up to become an update article on LearnMMD. … and we can link to the new one from that old, existing tutorial.
        I am using a new email… [email protected]
        … and my older addresses are all still working.

        Reply
  5. Gentoo says:
    April 10, 2021 at 6:25 pm

    I see it’s a 32 bit files, if you have 64bit mmd program running will there be problems?
    Can the konnect be set up using 64 bit program files?

    Reply
    1. Reggie_Dentmore says:
      April 10, 2021 at 7:01 pm

      All you can do is give it a try. You will note in this tutorial that the Kinect motion capture routine was for Windows 7. … You will need to GOOGLE and search dA for others who have been successful with the Kinect motion capture for MMD.

      Reply
      1. Gentoo says:
        April 12, 2021 at 1:01 am

        What are alternative more reliable ways to input human motion data into MMD? the one that gives you the least technical difficulty.

        Reply
        1. KillerBeer says:
          April 12, 2021 at 5:41 am

          There’s none.

          Reply
          1. Gentoo says:
            April 29, 2021 at 8:20 am

            Well, I got the usb power cord yesterday. I tried figuring out the usb location (it was generic driver on port 02 hub 03; generic usb driver) I tried updateing driver as per instructions and windows said “Windows has determined the best driver for this device is already installed. There may be better drivers on windows update or device manufactures website.” Not sure how to proceed. I tried the second step (opening up and running openNI-Win32) and it had some undesernable error (I do not have error log at this time), I figure it’s because the driver had failed to install.

            Reply
            1. Gentoo says:
              April 29, 2021 at 8:25 am

              for clarification the model is 1414 and the power plug model is SND-3601

              Reply
  6. Purulin says:
    July 31, 2020 at 6:30 pm

    I followed the steps correctly and this didn’t work for me… problem with OpenNI (“Cannot move OpenNI.
    OpenNI might be failed install.”) I have a kinect 360 model 1473….

    Reply
    1. Reggie_Dentmore says:
      July 31, 2020 at 6:46 pm

      I don’t have an answer for you… I Googled “Cannot move OpenNI”… and got several results, dating back to 2012…… and I think, using the Kinect for MMD has only been somewhat successful… and THAT was using a Windows 7 computer… so… you will have to be an innovative problem-solver to find an answer… maybe you can write an article for us when you figure it out!

      Reply

Comments navigation

Older comments

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Download the latest version of MikuMikuDance!
See the MMD Step-by-Step instructions page!
Learn how to make your own MMD motions!
LearnMMD.com
  • NCHLShader2 adds realistic depth to MMD models Advanced Shader Technique
  • Use Professional Tricks to Make MMD Animating Faster and Easier Random Thoughts & Visions
  • Smooth camera moves and soft focus make for smooth scene transitions in MMD 7.39 . LearnMMD.com
    Smooth Scene Transitions featured in new MMD Departures video "the making of" my video
  • Download Reggie’s Cafeteria Table and Chair accessory! New Stage Accessory
  • Download Reggie’s MMD DeckPanel when you just need a place to sit or stand! Make your own Accessories
  • How to make a Portal in MMD: blast a hole in the wall! Customize MME effects
  • GaussianVariable MME Effect Blurs your entire scene! GaussianVariable
  • ikUnderwater Effect submerges your MMD animation! ikUnderwater Effect

Copyright © 2022 Learn MikuMikuDance – MMD Tutorials – Free 3D Animation Software and Instructions..

Powered by PressBook Premium theme

Go to mobile version