Login | Register 
FEATURES
APPLICATIONS
DOWNLOADS
EDUCATION
BLOG
WIKI
FORUM
STORE

Kinect2 - Projector Calibration

Share your components here. First one to 100 wins!

Re: Kinect2 - Projector Calibration

Postby acroscene » Thu May 09, 2019 6:50 am

It worked perfectly fine at home but when Im at the theatre where I shall run a show Im constantly getting error message. "error to high, try again" when I am trying to calibrate.

Anyone who knows what that means?
acroscene
 
Posts: 48
Joined: Fri Mar 10, 2017 3:47 pm

Re: Kinect2 - Projector Calibration

Postby snaut » Fri May 10, 2019 12:59 pm

Hey Acroscene,

I would first check the lighting conditions and if the camera sees the checkboard ok. I also find it useful to project the checkboard onto a black surface rather than a white one. You can play around with the Grid Level Parameter to see if you get better results.
Also projecting onto reflective material can be difficult.

Essentially the message tells you that the reprojection error is too high meaning in essence that the algorithm figures the combined errors are so high that it can't return a satisfactory solution for the camera position.

Regarding the delay, this is how TouchDesigner receives the data from the Kinect. The delay can be reduced by turning off Joint Smoothing in the Kinect CHOP though....

Best
Markus
User avatar
snaut
Staff
 
Posts: 896
Joined: Mon Nov 12, 2007 6:21 pm
Location: Toronto

Re: Kinect2 - Projector Calibration

Postby knut » Sat May 11, 2019 6:14 am

Hi Markus
I would like to project the mask, that I derive from the kincet player index on the moving player.
Is there a way, that I can use the camera data out of this calibration for that purpose?
greetings knut
knut
 
Posts: 24
Joined: Sun Apr 19, 2015 9:12 am

Re: Kinect2 - Projector Calibration

Postby snaut » Sat May 11, 2019 5:38 pm

Hi Knut,

that should be possible. Your Kinect is assumed to be positioned at root (0,0,0) looking straight down the z axis. Trick would be to position a rectangle now in front of the kinect (straight down the z axis, no other translation or rotation) that holds the video texture from the kinect. A good question is how far out it would have to be - Needs to be far enough to be seen by the TouchDesigner Camera.. Maybe you would have to play around with distance and size a bit to get it right..

Best
Markus
User avatar
snaut
Staff
 
Posts: 896
Joined: Mon Nov 12, 2007 6:21 pm
Location: Toronto

Re: Kinect2 - Projector Calibration

Postby knut » Sat May 11, 2019 6:40 pm

Hi Markus
OK i understand. I will try that.
Thnx for your help
Knut
knut
 
Posts: 24
Joined: Sun Apr 19, 2015 9:12 am

Re: Kinect2 - Projector Calibration

Postby Juddy » Tue May 14, 2019 12:30 am

Does this work for Player Index? If so , any pointers pls

Thanks

Justin
Juddy
 
Posts: 52
Joined: Wed Oct 16, 2013 7:04 am

Re: Kinect2 - Projector Calibration

Postby knut » Tue May 14, 2019 7:11 am

I tried to follow the advice from markus with no success.
Need a little Bit of Time to understand where the problem is and to come back with questions if necessary.
Knut
knut
 
Posts: 24
Joined: Sun Apr 19, 2015 9:12 am

Re: Kinect2 - Projector Calibration

Postby harveymoon » Sun Jun 23, 2019 5:48 pm

I was trying to get this to work with the Intel Realsense for awhile.

I couldn't get any reliable results. I consider two things may be an issue.
It may be that the camera FOV is different for the Kinect vs Realsense so I tried the different OpenCV toggles to guess focal length and aspect, didn't help.

The next guess was that the realsense rgb camera doesn't have the same FOV as the 3d depth image. I would guess if the point pairs are compared, it would be sampling an incorrect position.
I tried the "depth aligned to color" settings, but it seems like the pointcloud top doesn't have this option. The "color aglined to depth" doesn't find any checkerboards.

Any more suggestions about what to try to get the realsense to calibrate?

I was also guessing that the depth data would have different values considering the realsense can be used closer proximity. But that shouldn't matter the calibration shouldn't need actual distances, should it?


Sometimes It appeared that the depth data was not discovered on the white board I was holding. Would that record 3d position of -1 or discard the point pair?
harveymoon
 
Posts: 102
Joined: Mon Jun 29, 2015 8:42 pm

Re: Kinect2 - Projector Calibration

Postby knut » Mon Jun 24, 2019 11:17 am

I dont have no realsense so I cant comment on that.

But some learnings from using the kinect a lot
1. 7 to 10 point pairs a normally sufficient with a kinect 2.
2. Lots of problems if I try to get data when using a short throw projector. If I include data
from checkerboards that are closer to the edges of the projection area, the data becomes unreliable - the projected image does not hit the person any more.
Never saw that on projectors with a "normal" lens. Seems to be a problem of the projectors lens
although I would expect that the calibration would cover that..
3. still problems to use the kinect player index to project a mask on the person. I cant get it
to work in my enviroment

good luck
knut
 
Posts: 24
Joined: Sun Apr 19, 2015 9:12 am

Previous

Return to Shared .tox Components

Who is online

Users browsing this forum: No registered users and 3 guests