Login | Register 
FEATURES
APPLICATIONS
DOWNLOADS
EDUCATION
BLOG
WIKI
FORUM
STORE

Kinect Feature Request -User Silhouette Extraction

Discuss graphics hardware, computer hardware, and input/output devices to use with TouchDesigner

Kinect Feature Request -User Silhouette Extraction

Postby momothemonster » Fri Jun 07, 2013 3:49 pm

One of the most useful utilities of a Kinect is getting the silhouette of a tracked user to use as a mask or generative starting point. I believe that the player id is embedded into the depth data coming from the Kinect. Is this data still available in the depth map output by the current version of the Kinect Top (SDK 1.7)?

If not, I'd love to see an implementation of this. I believe there's an example included with the Developer's Toolkit on how this information is extracted, also explained in this StackOverflow post.

Thanks for the consideration!
MMM Labs - Concert Visuals and Interactive Awesomeness
User avatar
momothemonster
 
Posts: 64
Joined: Fri Jun 01, 2012 1:30 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby emintzer » Fri Jun 07, 2013 8:11 pm

Try using a Kinect Top connected to a Cache top. Cache the incomming kinect background.

Then using a composite subtract top you can subtract you cached backround kinect image with your live kinect feed which should leave you with a silhouette. some hsv adjust or other tops can clean the noise.

Let me know how this works for you!
emintzer
 
Posts: 166
Joined: Thu Aug 30, 2012 11:30 am

Re: Kinect Feature Request -User Silhouette Extraction

Postby momothemonster » Sat Jun 08, 2013 8:59 pm

Hey emintzer, thanks for the reply but it's not what I'm looking for. The idea here is that the Kinect can do this actively - using a user's tracked skeleton and known depth, it can detect whether a given pixel belongs to a person or not. In this way, you can use it with any kind of busy background, and even things moving in front of the user while still detecting a pretty clean outline.
MMM Labs - Concert Visuals and Interactive Awesomeness
User avatar
momothemonster
 
Posts: 64
Joined: Fri Jun 01, 2012 1:30 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby teflonjf » Wed Jul 10, 2013 6:23 pm

teflonjf
 
Posts: 244
Joined: Wed Nov 14, 2007 3:01 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby sunspider » Tue Jul 30, 2013 6:27 pm

I need this too. +1
- Ivan DelSol
sunspider
 
Posts: 173
Joined: Mon May 07, 2012 8:20 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby xzQuinn » Wed Jul 31, 2013 4:28 pm

me too!
User avatar
xzQuinn
 
Posts: 87
Joined: Wed Nov 14, 2007 3:05 pm
Location: Italy

Re: Kinect Feature Request -User Silhouette Extraction

Postby malcolm » Thu Aug 08, 2013 12:39 pm

How would you want this data to be made available to you? As a different texture or embedded in the current depth map texture as another channel?
User avatar
malcolm
Staff
 
Posts: 4428
Joined: Tue Nov 13, 2007 1:11 am

Re: Kinect Feature Request -User Silhouette Extraction

Postby sunspider » Thu Aug 08, 2013 1:20 pm

Another texture seems the simplest to deal with. Are there any advantages to having it in a separate channel?
- Ivan DelSol
sunspider
 
Posts: 173
Joined: Mon May 07, 2012 8:20 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby momothemonster » Thu Aug 08, 2013 6:17 pm

I vote for a separate texture, as well. Otherwise we'd just have to extract it from the depth texture in order to use it, right?
MMM Labs - Concert Visuals and Interactive Awesomeness
User avatar
momothemonster
 
Posts: 64
Joined: Fri Jun 01, 2012 1:30 pm

Re: Kinect Feature Request -User Silhouette Extraction

Postby teflonjf » Sat Aug 10, 2013 2:58 pm

Doesn't make much difference to me either way, it is easy enough to pull the channel we need if there's a benefit on your side to keeping it all in one input.
teflonjf
 
Posts: 244
Joined: Wed Nov 14, 2007 3:01 pm

Next

Return to Hardware

Who is online

Users browsing this forum: No registered users and 4 guests