kinect integration

[ebkc]

well after two full days of work,

I got my kinect to control TD !

The kinect xbox360 is pluged to one laptop,

I get my infos with purededata pix_openni

choose the elements I want to track, make them fit a right value range

and send it as OSC message to my other (better) computer on lan to a chop OSC in who assign the values to different points of a FBX character rig I found online.

Right now it's very shitty lookink, I calculate to angles of the shoulder with position in XY of the shoulder and the hand, imagine a triangle and atan opposite/adjacent (trigonometry

same for the legs. I'll keep on, and maybe post a video if it start looking like something

cheers

[rodberry]

did you have pix_openni working on a windows machine? (have not tried it yet)

[rodberry]

@ebk don't forget you can use the Screengrab TOP as a dirty way to get the image from GEM across to touch if you need to.
r.

[rodberry]

Using kinect, is there a way to have the position of a hand etc. be registered by a panel component to take advantage of the panel chop info for interaction?

I have tried it with the kinect driving a mouseOut CHOP but i'd rather have it separate from the mouse so I can use the mouse without interfering with each other.

should I be looking at the multitouch component for clues?

I really want to be able to at least hover over a widget and have its panel CHOP know I'm there. I'll probably use hovering-in-place to trigger a click ot perhaps use changes in z-location of the hand as clicks in some cases.

rod.

Rod.

[ebkc]

Well my first goal was to use the skeleton, but I might look the screengrab when I get the skeleton working. Though I'm sure it eats a lot of ressources and I hate that

about skeleton and pix_openni, thanks to his developer I got it to work on my linux(I'm more windows), I didn't try on windows but I've read it's less efficient.

Thing is he told me his angle calculation frmo translation system was a bit buggy, and I started trying to make my own.

could seem easy, a bit of trigonometry and a gimbal lock fix but after two more days, I'm still not there. getting very closer though, all written on PD

when I'll be done with this part I'll start having fun with TD :=)

[rodberry]

would it work to just bring the joint translation values into touch and let touch calculate the joint angles for you? what are the angles relative to?

r.

[ebkc]

hey !

Well I don't know if there is a module that convert translations in rotations in TD.

Also I don't think translations on skeleton work great(but haven't tryed yet:)

And finaly the idea I have is to let the most of the calculations to my shitty laptop with PD so the big one with TD only has to do the 3D(for ressources reasons)

Since yesterday I've finished my algorythm, but it doesn't work properly, I think the bug is in the gimbal lock fix. I'm now trying to find somebody who is good with mathematics of phisics, cause I've stoped school very early and even when I was there I didn't listen so maybe I forgot something

let you know when up and running

[rodberry]

would this thing be useful in helping incorporate other features of the 1.5 kinect for windows stuff? (for example voice commands etc.)

http://pytools.codeplex.com/wikipage?title=PyKinect

sorry if that's a naive question. still getting my head around python and what it can and can't do in "touch.

rod.

[eco_bach]

a bit late to the game...rod, were you able to incorporate any 1.5 features yet into TD (facial recognition, etc)?

[rodberry]

not yet, wrestling with other stuff at present but will get back to this later.

rod.