kinect integration

I’ll try to test it with the old one in the next day or so. I’m a bit flat-out right now.

Hi Rod,

have you tested the original kinect?

The XBOX 360 Kinect will not work. The commercially legal SDK that Microsoft released only works with the Windows verison, sorry.

time to sell the old kinect then. :slight_smile:

rod.

I’ve tested the Kinect in touch, and it’s awesome. Especially the skeleton tracking. So easy. I also made an OSC patch that take every info and send them to Max/Msp.

I didn’t succeed to do anything with the depth map, but it’s fully functional.

Now, i’m trying to import a 3d model and animate it with the kinect. Any advice ?

Anyone converted the depth image to a pointcloud with Touch yet? And is it possible to enable the near view ?

Hey Derivative folks, is the kinect integration fully available in the basic FTE version of Touch?

or does it require FTE commercial or Pro?

Rod.

You can use both KINECT TOP and CHOP with the Standard FTE wich give you the IR&RGB cam and bone position respectively.

I’m adding support for near mode right now. However note that near mode with the Kinect 1.0 runtime doesn’t support skeletal tracking, only full body (one position per person).

looks like the new Kinect for Windows 1.5 runtime, around end of May, will allow some types of skeletal tracking in near mode, including one for seated use. also it’s meant to be backwards compatible with applications still using 1.0

blogs.msdn.com/b/kinectforwindow … -peek.aspx

there are some update posts there too.

rod.

Hey Malcom, or anyone,

Do you have any Hint on how we can use the Kinect Top Depth mode for blob detection and distance?

Thank you!

I assume you would use the chroma top to select the distance range you want to isolate, then feed the result to a blob detect TOP which is then linked to an info Chop or Dat. If memory serves me right, that should give you the number of blobs and the centroid(?) of each?

Rod.

Thats great Malcolm! Can’t wait!

And a ps question, is there an easy-ish way of generating a pointcloud out of images? I’ve converted the kinect depth to camera-space positions, but havn’t found a way to construct points besides doing copies or scatters…

-theo

having huge fun. gotta remember to sleep and get work done but the kinect with touch so far is so easy. so now I’m getting greedy. how would I get to the speech recognition stuff with the kinect? I assume that this uses the stuff in the OS, not in the kinect hardware itself? I like the idea of kids yelling as well as leaping around in front of this thing…

rod.

yeah, I know, bed time…
[url]https://vimeo.com/42034276[/url]
(might be half an hour before vimeo put it up)
it’s actually two-player but everyone’s sensibly in bed.

rod.

[vimeo]http://www.vimeo.com/42049836[/vimeo]
kinect_imagespace.13.PAINT_two_player.12.toe (12.7 KB)

in the above .toe, kinect_imagespace.13.PAINT_two_player.12.toe , there are a bunch of operators in /project1/p1 colored blue that I want to ask people about to see if there’s a better way to do it…

the channels from the kinect have names like p1/hand_r:tx p1/hand_r:ty etc. then also some p1_hand_l_tracked and p1:ty

For the component, I want to make each instance the same inside so p2 can be a clone of p1.

So, I need to strip out the p1/ or p2: or p2_ from the channel name. I’m also replacing the last ‘:’ with an underscore for tidiness.
so far, I’m converting to DATs then using a chain of evaluate DATs to clean things up.

This makes it quite readable but I’m wondering if there’s a more efficient way to do it to do it all in one hit, say, by using an expression in a rename CHOP for example?

… also, I notice that, periodically, /project1/p1/chopto1 glitches to add a second row.

any idea what’s causing that? I’m using select3 to get rid of it but it might be a bug when converting hundreds of channels? I don’t see anything in the chop that inputs the chopto DAT

thanks,

Rod.

argh !

I first bough a second hand kinect … realise there is no USB connector so I get the adaptor to now realise xbox360 wont work on TD !..

no solution really ? pm :slight_smile:

cheers

Unfortunately no, the Kinect SDK only works with the Kinect For Windows device.