Page 1 of 2

Kinect Feature Request -User Silhouette Extraction

PostPosted: Fri Jun 07, 2013 3:49 pm
by momothemonster
One of the most useful utilities of a Kinect is getting the silhouette of a tracked user to use as a mask or generative starting point. I believe that the player id is embedded into the depth data coming from the Kinect. Is this data still available in the depth map output by the current version of the Kinect Top (SDK 1.7)?

If not, I'd love to see an implementation of this. I believe there's an example included with the Developer's Toolkit on how this information is extracted, also explained in this StackOverflow post.

Thanks for the consideration!

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Fri Jun 07, 2013 8:11 pm
by emintzer
Try using a Kinect Top connected to a Cache top. Cache the incomming kinect background.

Then using a composite subtract top you can subtract you cached backround kinect image with your live kinect feed which should leave you with a silhouette. some hsv adjust or other tops can clean the noise.

Let me know how this works for you!

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Sat Jun 08, 2013 8:59 pm
by momothemonster
Hey emintzer, thanks for the reply but it's not what I'm looking for. The idea here is that the Kinect can do this actively - using a user's tracked skeleton and known depth, it can detect whether a given pixel belongs to a person or not. In this way, you can use it with any kind of busy background, and even things moving in front of the user while still detecting a pretty clean outline.

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Wed Jul 10, 2013 6:23 pm
by teflonjf

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Tue Jul 30, 2013 6:27 pm
by sunspider
I need this too. +1

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Wed Jul 31, 2013 4:28 pm
by xzQuinn
me too!

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Thu Aug 08, 2013 12:39 pm
by malcolm
How would you want this data to be made available to you? As a different texture or embedded in the current depth map texture as another channel?

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Thu Aug 08, 2013 1:20 pm
by sunspider
Another texture seems the simplest to deal with. Are there any advantages to having it in a separate channel?

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Thu Aug 08, 2013 6:17 pm
by momothemonster
I vote for a separate texture, as well. Otherwise we'd just have to extract it from the depth texture in order to use it, right?

Re: Kinect Feature Request -User Silhouette Extraction

PostPosted: Sat Aug 10, 2013 2:58 pm
by teflonjf
Doesn't make much difference to me either way, it is easy enough to pull the channel we need if there's a benefit on your side to keeping it all in one input.