AR sandbox

Hello everyone,

I’m learning Touchdesigner and wanted to build an AR sandbox (similar to this: youtube.com/watch?v=YLYO0YhY83w) as my first big project.

I got the Kinect working and change color based on depth but I’m having a hard time calibrating with my projector. . I haven’t build a physical box yet but I’m testing it out by just pointing both the Kinect and the projector at a corner in my living room. I’m thinking that if it can map the correct color onto the correct physical space, I should be good. I used katanMapper but could map the room out correctly. I realize that since the projector and the Kinect are in separate physical space, they see slightly different version of my room and therefore the projected image doesn’t match. This leads me to find a way to calibrate the Kinect and projector together. I have tried to use genekogan toolkit (github.com/genekogan/KinectProjectorToolkit) but couldn’t make it work. I’m very new to all of this so I hope some of you can point me to the right direction. Thanks!