Palette:depthExtract and Palette:cameraBrowser: Difference between pages

From Derivative
(Difference between pages)
Jump to navigation Jump to search
No edit summary
 
No edit summary
 
Line 2: Line 2:
|opFamily=COMP
|opFamily=COMP
|opType=container
|opType=container
|opClass=Palette:depthExtract Ext
|opClass=Palette:cameraBrowser Ext
|opLicense=
|opLicense=
|short=
|short=
|long=The depthExtract COMP uses a realSense TOP with a depth image to select the range of depth using the near and far parameters.
|long=The cameraBrowser is a collection of TOP outputs available on the RealSense device using the realSense TOP. With the viewer active click and drag the image into the network to create a TOP reference.  
   
 
To use the RealSense device in Touchdesigner, install the camera driver software (DCM) for the particular model of RealSense camera you have and a Realsense SDK. There are two SDKs available for the RealSense device Windows only SDK and a cross-platform library. Some features on the Windows only SDK are not available using the cross-platform library.
To use the RealSense device in Touchdesigner, install the camera driver software (DCM) for the particular model of RealSense camera you have and a Realsense SDK. There are two SDKs available for the RealSense device Windows only SDK and a cross-platform library. Some features on the Windows only SDK are not available using the cross-platform library.


Download the latest Windows only SDK and camera driver software [https://software.intel.com/en-us/realsense-sdk-windows-eol here.] <br> Download the RealSense cross-platform library [https://github.com/IntelRealSense/librealsense here.] <br> For more information on using the RealSense in Touchdesigner see [https://docs.derivative.ca/RealSense RealSense.]
Download the latest Windows only SDK and camera driver software [https://software.intel.com/en-us/realsense-sdk-windows-eol here.] <br> Download the RealSense cross-platform library [https://github.com/IntelRealSense/librealsense here.] <br> For more information on using the RealSense in Touchdesigner see [https://docs.derivative.ca/RealSense RealSense.]
   
   
     }}
     }}
{{ParameterPage
{{ParameterPage
|opFamily=COMP
|opFamily=COMP
|pageName=Depth Extract
|pageName=Camera Browser
|pageSummary=
|pageSummary=
|items={{Parameter
|items={{Parameter
Line 88: Line 86:
|parType=Menu
|parType=Menu
|parReadOnly=
|parReadOnly=
|parSummary=Select the device to use.
|parSummary= Select the device to use.
|parOrder=4
|parOrder=4
|parItems=}}
|parItems=}}
Line 94: Line 92:
|opFamily=
|opFamily=
|opType=
|opType=
|parLabel=Near
|parLabel=Color Image
|parName=Near
|parName=Color
|parType=Float
|parType=Toggle
|parReadOnly=
|parReadOnly=
|parSummary=This control allows you to designate the near clipping planes. Depth values less than this value will not be selected
|parSummary=The video from the color sensor.
|parOrder=5
|parOrder=5
|parItems=}}
|parItems=}}
Line 104: Line 102:
|opFamily=
|opFamily=
|opType=
|opType=
|parLabel=Far
|parLabel=Depth Image
|parName=Far
|parName=Depth
|parType=Float
|parType=Toggle
|parReadOnly=
|parReadOnly=
|parSummary=This control allows you to designate the far clipping planes. Depth values greater than this will not be selected.
|parSummary=The calculated depth value for each pixel. The data is re-range to be between 0 and the 'Max Depth' parameter, specified in Meters. A pixel value of 0 means 0 meters from the camera while a pixel value of 1 means 'Max Depth' or more pixels from the camera.
|parOrder=6
|parOrder=6
|parItems=}}
|parItems=}}
}}
{{Parameter
{{OutputsPage
|opFamily=
|opFamily=COMP
|opType=
|opOutputs={{OPOutput
|parLabel=Raw Depth
|opFamily=TOP
|parName=Rawdepth
|outputIndex=0
|parType=Toggle
|outputName=out1
|parReadOnly=
|outputSummary=}}
|parSummary=The raw depth value for each pixel from the SDK. Not well documented by the SDK. The data is re-range to be between 0 and the 'Max Depth' parameter, specified in Meters. A pixel value of 0 means 0 meters from the camera while a pixel value of 1 means 'Max Depth' or more pixels from the camera.
|parOrder=7
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Visualized Depth
|parName=Visualizeddepth
|parType=Toggle
|parReadOnly=
|parSummary=The depth values as output from the SDK when requesting a RGBA image. This output is useful for visualizing the depth, but the pixels values are dyanmically re-ranged by the SDK so it can't be used to determine a pixel's actual depth from the camera.
|parOrder=8
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Depth to Color UV Map
|parName=Depthtocoloruv
|parType=Toggle
|parReadOnly=
|parSummary=A RG 32-bit float texture that is the UV values needed to remap the Depth image to line up with the Color image. Use a Remap TOP with this and the Depth image to produce something that will be aligned with the Color image.
|parOrder=9
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Color to Depth UV Map
|parName=Colortodepthuv
|parType=Toggle
|parReadOnly=
|parSummary=A RG 32-bit float texture that is the UV values needed to remap the Color image to line up with the Depth image. Use a Remap TOP with this and the Color image to produce something that will be aligned with the Depth image.
|parOrder=10
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Depth Aligned to Color
|parName=Depthalignedtocolor
|parType=Toggle
|parReadOnly=
|parSummary=
|parOrder=11
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Color aligned to Depth
|parName=Coloralignedtodepth
|parType=Toggle
|parReadOnly=
|parSummary=
|parOrder=12
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Infrared Image
|parName=Infrared
|parType=Toggle
|parReadOnly=
|parSummary=The raw video from the infrared sensor.
|parOrder=13
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Point Cloud
|parName=Pointcloud
|parType=Toggle
|parReadOnly=
|parSummary= Literally a cloud of points in 3d space (X, Y, Z coordinates) or data points created by the scanner of the RealSense Camera.
|parOrder=14
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Point Cloud Color UVs
|parName=Pointcloudcoloruv
|parType=Toggle
|parReadOnly=
|parSummary= Which can be used to get each point’s color from the Color image stream.
|parOrder=15
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Segmented Color (with Alpha)
|parName=Segmentedcolor
|parType=Toggle
|parReadOnly=
|parSummary=Which outputs masked color image of the detected person in front of the camera.
|parOrder=16
|parItems=}}
{{Parameter
|opFamily=
|opType=
|parLabel=Mirror Image
|parName=Mirror
|parType=Toggle
|parReadOnly=
|parSummary=Flip the image horizontally.
|parOrder=17
|parItems=}}
}}
}}
{{History}}
{{History}}

Revision as of 17:15, 17 May 2019

Summary
[edit]

The cameraBrowser is a collection of TOP outputs available on the RealSense device using the realSense TOP. With the viewer active click and drag the image into the network to create a TOP reference.

To use the RealSense device in Touchdesigner, install the camera driver software (DCM) for the particular model of RealSense camera you have and a Realsense SDK. There are two SDKs available for the RealSense device Windows only SDK and a cross-platform library. Some features on the Windows only SDK are not available using the cross-platform library.

Download the latest Windows only SDK and camera driver software here.
Download the RealSense cross-platform library here.
For more information on using the RealSense in Touchdesigner see RealSense.

PythonIcon.pngPalette:cameraBrowser Ext


Parameters - Camera Browser Page

Help Help - Opens this page.

Version Version - Current version of this COMP.

API Api - -

  • RealSense SDK for Windows RealSense_SDK_for_Windows -
  • RealSense Cross Platform API RealSense_Cross_Platform_API -

Model Model - - Select the model of device to use.

  • F200 f200 -
  • SR300 sr300 -

Sensor Sensor - Select the device to use.

Color Image Color - The video from the color sensor.

Depth Image Depth - The calculated depth value for each pixel. The data is re-range to be between 0 and the 'Max Depth' parameter, specified in Meters. A pixel value of 0 means 0 meters from the camera while a pixel value of 1 means 'Max Depth' or more pixels from the camera.

Raw Depth Rawdepth - The raw depth value for each pixel from the SDK. Not well documented by the SDK. The data is re-range to be between 0 and the 'Max Depth' parameter, specified in Meters. A pixel value of 0 means 0 meters from the camera while a pixel value of 1 means 'Max Depth' or more pixels from the camera.

Visualized Depth Visualizeddepth - The depth values as output from the SDK when requesting a RGBA image. This output is useful for visualizing the depth, but the pixels values are dyanmically re-ranged by the SDK so it can't be used to determine a pixel's actual depth from the camera.

Depth to Color UV Map Depthtocoloruv - A RG 32-bit float texture that is the UV values needed to remap the Depth image to line up with the Color image. Use a Remap TOP with this and the Depth image to produce something that will be aligned with the Color image.

Color to Depth UV Map Colortodepthuv - A RG 32-bit float texture that is the UV values needed to remap the Color image to line up with the Depth image. Use a Remap TOP with this and the Color image to produce something that will be aligned with the Depth image.

Depth Aligned to Color Depthalignedtocolor -

Color aligned to Depth Coloralignedtodepth -

Infrared Image Infrared - The raw video from the infrared sensor.

Point Cloud Pointcloud - Literally a cloud of points in 3d space (X, Y, Z coordinates) or data points created by the scanner of the RealSense Camera.

Point Cloud Color UVs Pointcloudcoloruv - Which can be used to get each point’s color from the Color image stream.

Segmented Color (with Alpha) Segmentedcolor - Which outputs masked color image of the detected person in front of the camera.

Mirror Image Mirror - Flip the image horizontally.

TouchDesigner Build:

Palette
Palette • Palette:arcBallCamera • Palette:arcBallGeometry • Palette:audioAnalysis • Palette:audioSet • Palette:battery • Palette:bitwigClip • Palette:bitwigClipSlot • Palette:bitwigDeviceRemotes • Palette:bitwigMain • Palette:bitwigNote • Palette:bitwigProjectRemotes • Palette:bitwigRemotesDevice • Palette:bitwigRemotesProject • Palette:bitwigRemotesTrack • Palette:bitwigSelect • Palette:bitwigSong • Palette:bitwigTrack • Palette:bitwigTrackRemotes • Palette:blendModes • Palette:bloom • Palette:camera • Palette:cameraBrowser • Palette:cameraViewport • Palette:camSchnappr • Palette:changeColor • Palette:changeToColor • Palette:checker • Palette:chromaKey • Palette:colorThreshold • Palette:compareComp • Palette:convolve • Palette:cornerPinSOP • Palette:cppParsTemplateGen • Palette:customAttributes • Palette:debugControl • Palette:dent • Palette:depthExtract • Palette:dilate • Palette:encoder • Palette:equalizer • Palette:feedback • Palette:feedbackEdge • Palette:firmata • Palette:gal • Palette:geoPanel • Palette:gestureCapture • Palette:graphPlot • Palette:histogram • Palette:hsvBlur • Palette:imageSearch • Palette:julia • Palette:kantanMapper • Palette:kinectCalibration • Palette:kinectPointcloud • Palette:leapPaint • Palette:lightTunnel • Palette:logger • Palette:mandelbrot • Palette:materialDesignIcons • Palette:mesh • Palette:monochrome • Palette:motionSense • Palette:movieEngine • Palette:moviePlayer • Palette:moviePlaylist • Palette:multiLevel • Palette:multiMix • Palette:noise • Palette:onScreenKeyboard • Palette:operatorPath • Palette:opticalFlow • Palette:pixelate • Palette:pixelRelocator • Palette:pointGenerator • Palette:pointillize • Palette:pointMerge • Palette:pointRender • Palette:pointRepack • Palette:pointTransform • Palette:pointWeight • Palette:popDialog • Palette:probe • Palette:projectorBlend • Palette:pushPins • Palette:puzzle • Palette:quadReproject • Palette:radialBlur • Palette:recorder • Palette:remotePanel • Palette:rgbaBlur • Palette:rgbaDelay • Palette:rgbContrast • Palette:sceneChanger • Palette:search • Palette:searchReplace • Palette:sharpen • Palette:sickEngine • Palette:signalingClient • Palette:signalingServer • Palette:softenAlpha • Palette:solarize • Palette:sopRender • Palette:splitter • Palette:stitcher • Palette:stoner • Palette:superFormula • Palette:SVG • Palette:sweetSpot • Palette:sweetSpotPreviz • Palette:synchroCache • Palette:synchroClient • Palette:synchroFrameIn • Palette:synchroFrameOut • Palette:synchroNDIIn • Palette:synchroSDIIn • Palette:synchroVideoOut • Palette:tdBitwigPackage • Palette:TDVR • Palette:transitMap • Palette:twirl • Palette:vectorScope • Palette:virtualFile • Palette:waveformMonitor • Palette:webBrowser • Palette:webRTC • Palette:webRTCPanel • Palette:webRTCPanelRcv • Palette:xyScope