Kinect + MikuMiku Dance = Ultimate Combo

mmd.jpg

Miku fans are delighted that Kinect is finally doing something useful – the system has been hacked to serve as a motion capture device for MikuMiku Dance.

MikuMiku Dance is a freeware 3D modelling tool designed specifically for creating 3D CG Vocaloid MADs.

The major weakness of MMD modelling has frequently been a lack of accessible motion capture to provide smooth and convincing dancing – with Kinect used as a motion capture device, this issue can be neatly sidestepped, although MAD creators will still need a competent dancer to capture.

The system in action:

Aside from some overactive clothing and hair physics, and the usual atrocious clipping issues, the results are most convincing indeed.

Some of the other functionality now available to MMD maestros:

Kinect itself is proving a most impressive piece of hardware as well:

Whilst even all this is unlikely to save Kinect in Japan, it does look set to provide a new generation of motion-captured MADs – quite an improvement.


    Post Comment »
    143 Comments
    Sort by: Date | Score
    Avatar of network19
    Comment by network19
    14:20 20/12/2010 # ! Quality (+1.0)

    Has potential as long you can download skins of your favorite anime.

    Avatar of King Tiger
    Comment by King Tiger
    14:29 20/12/2010 # ! Quality (+1.0)

    it is official:
    General Hatsune has manage to conquer Kinect we will use this as an advancement base to "spring board" our operations to the U.S.

    Invasion is eminent >:]

    Avatar of KomariMax
    Comment by KomariMax
    14:39 20/12/2010 # ! Quality (+1.0)

    Its all according to plan. Another step towards world domination

    Avatar of HouseLife
    Comment by HouseLife
    15:57 20/12/2010 # ! Quality (+1.0)

    As I expected, the Kinect is an incredible piece of technology with wide-reaching capabilities, it's just a little out of left field for gaming potential. Unfortunately for gaming it's not going to do too much, but its technological achievement will certainly birth much better creations in the future.

    Avatar of Satonaka
    Comment by Satonaka
    16:51 20/12/2010 # ! Quality (+1.0)

    And there you have it folks. the number one and probably one of the very few reasons to own a Kinect.

    With this the Kinect actually has a shot at the "motion wars" between the systems.

    While it may not be used for the 360, this alone will get it some sales to at least appear on sales charts being used outside of it's intended system, which is sad since the Kinect will probably never work as well as it does here, albeit a few dropped motions in said videos here and there. But it's still much better than anything I've seen lately in videos on the actual games for it on the 360.

    Now as for Miku saving the 360's Kinect... I dunno what to think about that...

    But as long as it's miku that alone is a step in the right direction. :D

    Avatar of HouseLife
    Comment by HouseLife
    19:49 20/12/2010 # ! Quality (+0.8)

    That I believe is the honest issue with these systems. The Wii is a toy to most, sales grew slowly in the mid-level and hardcore gamers as better publishers reached it, but really there is nothing special I have determined about anything with the Wii outside of the first-party developers. Even then, its true strengths are limited to FP-swords, sports, exercise, and some rather awkward FPS aiming in my experience. The issue isn't the technology or anything else. It's that the families who all bought the Wii and now have 2 games on average are done with the gimmick if they even still use it.

    These controllers will never truly offer the precision of a traditional controller, and as such will not be able to handle much of the complexity in the hardcore gamer market. The impressive aspects of the tech are spent, and the Move and Kinect are essentially old news before they even came out. The casual market knows 'Nintendo' from the old days and that helped them considerably. Nintendo is synonymous with childhood in more than a few generations, for better or for worse.

    Really the true revolution in gaming won't come for a generation or two of consoles with VR-level stuff. My only hope is by then it will stop being suppressed how dangerous cell phone radiation and the like is in regards to electronic devices emitting EMF fields near the human mind and body, and Virtual Reality will be careful to make sure we won't have a 'Vietnam Communicator' situation where all of them died of brain cancer from using those massive phones.

    If this discovery for the Kinect to make office models can be utilized effectively though, you will watch production costs diminish to reasonable levels again and the golden age of this console generation could finally be around the corner.

    Comment by Anonymous
    15:04 20/12/2010 # ! Good (+0.8)

    all according keikaku

    Comment by Anonymous
    20:41 20/12/2010 # ! Good (+0.6)

    This made me jizz my pants, it's fucking great.

    Avatar of guarayakha
    Comment by guarayakha
    15:10 20/12/2010 # ! Good (+0.6)

    TL NOTE: Keikaku means plan.

    Comment by Anonymous
    15:39 20/12/2010 # ! Good (+0.6)

    on both videos the testers are dudes... yet miku have very feminine moves... i wonder

    Comment by Anonymous
    00:45 21/12/2010 # ! Good (+0.6)

    ALL HAIL MIKU!

    Comment by Anonymous
    22:48 20/12/2010 # ! Good (+0.6)

    IT WORKS!?

    Avatar of Shippoyasha
    Comment by Shippoyasha
    18:07 20/12/2010 # ! Good (+0.4)

    Well, HouseLife, the thing is, Kinect is still in its infancy in the hands of game developers. If they decide to get truly creative, then we can see the result of one of the most technologically creative forces in the gaming industry. I hope for the best. That said, more devs needs to make use of the Wiimote/Move as well. More proper and innovative use.

    Avatar of Yuuki
    Comment by Wisteria Berlitz
    01:37 21/12/2010 # ! Neutral (+0.2)

    If I knew how to hack a Kinect,I would seriously try this!

    Avatar of HarukiSOS
    Comment by HarukiSOS
    17:43 03/01/2011 # ! Neutral (0)

    Next stop: .Hack//The World!!!!!!!!!!

    Avatar of Hatsune Miku
    Comment by Hatsune Miku
    14:54 20/12/2010 # ! Quality (+0.8)

    Hatsune Miku FTW!!! I just think these 3D technology is just simply amazing. If you watched her concert in HD, you would know what I mean.

    Comment by flood
    05:44 21/12/2010 # ! Neutral (0)

    I miss MMD.... Good ol' times~~~

    Avatar of Kitsunemimi6
    Comment by Kitsunemimi6
    14:42 20/12/2010 # ! Good (+0.6)

    That's the best thing that has ever happened to Kinect, ever...

    Can't fucking wait for the Invasion...

    Comment by Anonymous
    20:45 20/12/2010 # ! Neutral (+0.2)

    Microsoft here your ticket to better sales in japan so get off your asses and refine this tech.

    Avatar of Yoshii-kun
    Comment by Yoshii-kun
    14:29 20/12/2010 # ! Quality (+1.0)

    Miku in water was an awesome effect.
    I thoroughly enjoyed that 3mins of goodness ^^

    Avatar of PewPewPew!
    Comment by PewPewPew!
    14:47 20/12/2010 # ! Neutral (+0.2)

    Up Next, 3D disco party using your customize Miku Miku Dance model as your avatar.^^

    Avatar of Risui
    Comment by Risui
    15:16 20/12/2010 # ! Neutral (0)

    Not only that, the mix of famous dances(among MMD MADs)was very amusing, I recognized almost all of 'em.
    Now all they need is to mail Kozue to perform some awesome routines and Miku might shine with a new light, a "thorough-motion-capture" light.

    Comment by Anonymous
    14:33 20/12/2010 # ! Good (+0.6)

    Remember when Miku was going to raise in popularity in the west and that it would become global?

    Yeah....

    Still waiting, lol..

    Avatar of Megidola
    Comment by Megidola
    21:51 20/12/2010 # ! Good (+0.6)

    Rome wasn't built in a day, you know!

    18:24 21/12/2010 # ! Neutral (0)

    He must be hungry.

    Comment by Anonymous
    07:45 21/12/2010 # ! Neutral (0)

    You're comparing Rome to your lunch..?

    Comment by Anonymous

    My lunch was made in 3mins. :3

    Avatar of Riiku
    Comment by Riiku
    20:42 20/12/2010 # ! Good (+0.4)

    I dont get MS. All it would take them to make Kinect games awesome is shown in the first video - a direct movement data feed, complete with hair and clothes physics. Yet they used only 10% of Kinect's potential making all those preanimated moves in their games, while some non-profit programmers showed us what their device can actually do? Modern physics engines can easily produce an impressive model+environment interaction.

    Are they retarded? What the hell are they thinking? Srsly, I sooo dont get it.

    Comment by Anonymous
    01:15 21/12/2010 # ! Neutral (+0.2)

    It's kind of a blessing that they are retarded this time.

    Imagine how the price would skyrocket if they planned to make this a professional-class device. Just look at the Adobe softwares: made with the intent of getting bought by businesses and corporations, while usual grunts with the will to create but little resource have to give an arm and a leg to get them. How else do you think Adobe was INCREASING their profit while it seemed like everyone's pirating and no one paying? The answer: overprice it against corporate purchasers.

    Avatar of Neferius
    Comment by Neferius
    23:54 21/12/2010 # ! Neutral (0)

    Now I finally also get M$'s prices for Windows-7.
    It's like they already know people are going to pirate the hell out of their product, so why bother making it available for the general public in the first place?

    Back on Topic though... it's nice to see that Kinect will at least have SOME application.

    Avatar of Shippoyasha
    Comment by Shippoyasha
    17:51 20/12/2010 # ! Neutral (+0.2)

    An official Kinect game with this kind of motif can sell bazillion copies. It looks so fun even without a true goal to it. A great looking trinketry. It'd be nice if Xbox Indie game section has a hold of this and you can download a Miku dance character 'game/trinket' on the 360.

    Also, I would assume this is a perfect way for closet crossdressers to see how they would look digitally. lol. Man, Miku already looks cute even being danced by a dude.

    Comment by Anonymous
    01:08 21/12/2010 # ! Good (+0.6)

    Digital crossdressing FUCK YEAH! ...

    ...You've spoiled it for me. Soon when motion mods for 3DCustomGirl start spilling out, it would make me feel awkward knowing that a guy did the mo-cap for all the orgasm-twitching and ass-bending...

    GOD DAMN YOU, SHIPPOYASHA! GOD DAMN YOU!!!!

    Comment by Anonymous
    00:04 21/12/2010 # ! Neutral (0)

    The only problem I can point out so far is that the guys having their motions captured appear to have their legs wider apart than Miku's, so when she tries to walk, it looks awkward...

    Avatar of PewPewPew!
    Comment by PewPewPew!
    14:51 20/12/2010 # ! Neutral (0)

    Reminds me of the 3D Miku holgram from her concert from before. So if this gets upped and all will we see a 3D Miku perform alongside the JabbaWockeeZ?

    Avatar of Kitsunemimi6
    Comment by Kitsunemimi6
    14:34 20/12/2010 # ! Neutral (0)

    Yeah, that is what I would truly want from this...

    Guess I was wrong when I said that Kinect was finished, that was clearly not the case...

    Avatar of Atzumo Kayami
    Comment by Atzumo Kayami
    20:30 20/12/2010 # ! Neutral (0)

    You can create the characters with 3DCG

    Comment by Anonymous
    19:59 20/12/2010 # ! Neutral (0)

    creating 3d hentai with your favorite anime character would be sooooo much easier now ;D

    Avatar of exousia
    Comment by exousia
    14:22 20/12/2010 # ! Good (+0.6)

    used to take a $25k+ vicon camera with an elaborate stage setup just to record motion data, and now it's so trivial you can do it with a kinect and feed it to mikumiku dance in realtime. yay technology!

    Avatar of alidan
    Comment by alidan
    14:37 20/12/2010 # ! Good (+0.4)

    the tech in kinect is nothing trivial, its more that hardware got so advanced it can filter through the data fast enough now. i mean whats easier, seeing glowing balls or going through 1000's of dots of light figuring out their distance, and than mapping both to a 3d plane.

    Comment by Anonymous
    01:20 21/12/2010 # ! Neutral (0)

    He wasn't referring to Kinect's technology when he said 'trivial'.

    He's predicting that motion capture won't be that big of a deal anymore, now that a device that costs even less than a PS2 can make it happen. Kinect's ability is still very limited in that field, but give them a few more years, or override the limitations yourself by coding in the software, and it's a decent mo-cap device.

    Comment by Anonymous
    14:51 20/12/2010 # ! Neutral (0)

    And yet I won't be satisfied until I'm in Full Surround Sound in a 3D plane ^^

    Comment by Anonymous
    04:06 21/12/2010 # ! Neutral (0)

    The interactive full surround where you can feel the stuff and actually interact in real time so yah 20 years from now tech.

    I was thinking the stuff you can get in movies in some Imax theatres that actually have special effects add full interaction to it with a kinect like a controller and good graphics and you got a game ^^

    Think the end of that video where miku is dancing with them and imagine you as miku and you see and hear everything as your dancing with them as if you were there tech lv :P

    Avatar of alidan
    Comment by alidan
    17:43 20/12/2010 # ! Neutral (0)

    where you see the shit? or where the whole room is in 3d? one can be done today, the other give tech 20 or so years.

    Comment by PhillB
    14:21 20/12/2010 # ! Good (+0.6)

    I WANT!
    I want so badly!

    Coming to think of it, it looks a lot more real than the "holographic" dancing Miku in that concert.

    Comment by Anonymous
    21:03 20/12/2010 # ! Neutral (+0.2)

    Maybe even fan-groups can make Miku concerts like that with this "cheap motion capturer", as long as thost technologies are free, all you need is a Kinect Camera, a Computer a wise head and a nice body of course.

    Comment by Anonymous
    23:54 20/12/2010 # ! Neutral (0)

    And not just Miku... just imagine what a step up this can be for indie games. You can just use your Kinect to record the moves of your characters and to at least help you with your maps and 3D models.

    Comment by Anonymous
    20:05 20/12/2010 # ! Neutral (+0.4)

    next stage, ishihara will comment "people who dance to miku over Kinect have corrupted DNA"

    Avatar of JSRF
    Comment by JSRF
    14:29 20/12/2010 # ! Good (+0.4)

    Ladies and gentleman, this is the future.

    Avatar of Blue Dragon
    Comment by Blue Dragon
    15:20 20/12/2010 # ! Neutral (0)

    You gonna dig this!

    Avatar of Kitsunemimi6
    Comment by Kitsunemimi6
    14:37 20/12/2010 # ! Neutral (0)

    ...MY GOD..it is simply lovely...

    Comment by Anonymous
    14:41 20/12/2010 # ! Neutral (0)

    MAD creators will still need a competent dancer to capture.

    Well the dude created the program and added the dancers can't expect him to be godly at everything Respect ^^.

    On the Street On the Street The Concept of Love
    sorry couldn't help it :p






    Post Comment »

Popular

Recent News

Recent Galleries

Recent Comments