Kinect for Windows version 2, problem with Depth Data

Recently i purchase a new kinect for windows (V2). i need to capture depth data. therefore i installed SDK 2 for this reason. i captured depth data with Depth D2D or WPF in SDK 2. but i see the depth data that kinect captured,is very different from real
depth. also we can see that many depth data will change suddenly into a random value of pixel(something like above 238, 140 or 3). And we also find that many black and white pixel appear on the display which also means that there exists an extreme sudden change
between zero and a great value.
What makes this happen and how can I correct it
thanks

Depth is generated based on the time of flight infrared(IR) data that is acquired from the sensor. Time of flight is different from structured light sensor than v1. In a particular frame, each pixel is going to have a valid depth value or unknown. The
only way to correct is to average the data acquire from the SDK. Each frame can be compared to the previous given a constant that the camera didn't move. Based on that each pixel can be averaged with previous frames(more than one) and that should level off
to a point.
Since this is all based on IR data, the reflective properties of the surfaces/environment will determine the amount of noise. With time of flight, the ir data is actively filtered to only look for the wavelengths the sensor has emitted into the area.
If you are highly reflective areas(lots of glass, mirrors, shiny metal, amount of direct sunlight) that is going to affect how the IR gets bounced back into the sensor. This also applies to materials that absorb IR.
The only things you can do is determine how the IR data looks using IR basics and if you are seeing a lot of pure black and bright white that is going to affect what depth can be detected in those areas.
Carmine Sirignano - MSFT

Similar Messages

  • SAPGUI for Windows via Portal - problem with frame

    We are launching SAPGUI for Windows via Portal to drive single sign-on via AD.  Our problem is that when SAPGUI launches, it is contained within an IE browser frame that causes some of the SAPGUI screens to not fit on the screen well.  Those same screens fit just fine if we launch SAPGUI directly.
    Is there any way to launch SAPGUI from Portal, with SSO enabled, but without the IE frame around it?

    Lonny,
    The best way to authenticate users when they logon using SAP GUI for Windows, is to use SNC authentication in SAP GUi. Then, the browser iview will launch the GUI and the GUI will authenticate the user using their AD credentials issued during the Windows logon. You will need to setup an SNC library on both the ABAP system which the user is logged onto, and the workstation where SAP GUI is installed.
    If you don't use SNC, and you just launch SAP GUI for Windows from browser, then an SSO2 ticket is used to authenticate the user to the ABAP stack, and this is not secure due to the fact that the SAP GUI session which is used to pass the SSO2 ticket is not protected - anybody can intercept the SAP GUI session, take the SSO2 ticket from this traffic and logon as that user - clearly this is bad security and needs SNC to make it secure.
    Thanks,
    Tim

  • Kinect for Windows V2 Device cannot start

    I was able to use my Kinect for Windows V2 sensor yesterday with all of the applications in the SDK browser but the next day after restarting my computer I was no longer able to use the device. Looking at the device manager I get this message under the properties
    for WDF KinectSensor Interface 0 (the only device listed under Kinect sensor devices):
    This device cannot start. (Code 10)
    {Operation Failed}
    The requested operation was unsuccessful.
    I'm plugged into a USB 3.0 input. Any ideas?

    I encounter the exact same issue:
    WDF KinectSensor Interface 0
    This device cannot start. (Code 10)
    {Operation Failed}
    The requested operation was unsuccessful.
    I'm using an Intel 4ghz i7 processor plugged into an ASUS Sabertooth Mk1 Z97 Motherboard. The ASMedia on the board had some issues, so i'm using a USB 3.0 PCI/E card by Manhatten. Diagnostics indicates that everything but depth checks out. Depth fails because
    the camera reports all black.
    This is particularly frustrating since I built this computer to offer USB 3.0 support specifically so I could do work with Kinect and Unity. This was before I knew the issues Kinect has with ASMedia, so for me this has been a significant investment for a
    black screen.
    Edit: To clarify, the Kinect is plugged into the PCI/E card (Manhatten 150491) and not into the board or a case slot.
    Additonal note: The Kinect does not function properly plugged into my old PC (a USB 2.0 with an i7) or into my Surface Pro (1st gen)
    - Matt Eland

  • Which PC is recommended by Microsoft that ACTUALLY meet the requirements to work with software development for kinect for windows?

    My PC serves the minimum requirements described in the kinect page, but when installing the device, the software says that the computer does not meet the minimum requirements and therefore will not work with efficiency. Alternatively, theorize buy a new
    computer.
    Which PC is recommended by Microsoft that ACTUALLY meet the requirements to work with software development for kinect for windows?

    Getting a definitive answer from Microsoft will be difficult as to my understanding, requirements are still subject to change; and unless it's their brand of PC  I doubt they will give free advertisement to buy a specific make/model.
    There are other threads where people discuss specific machines that work with the Kinect V2.  
    The only compatibility problems I've had with getting it to work are: It has to be run Windows 8; It has to have a compatible USB 3.0;  The 'Compatible' USB 3.0 requirement seems to be the most difficult.

  • Kinect for Windows v1 with 3D Builder isn't recognized

    I have a Kinect for Windows v1 that I am trying to use with 3D Builder. The success of using the v1 will determine whether I will bother with the v2. 
    I regularly use the v1 with the Skanect software on the same machine I have installed 3D Builder onto, so I know the Kinect is functional. 
    Any insight into how I can get 3D Builder to recognize the v1 would be appreciated. 

    3D builder only works with v2, since v1 is not supported in Windows Store environments. You can use the SDK samples as alternatives to scan in desktop apps and import the meshes into 3D Builder.
    Carmine Sirignano - MSFT

  • Download a Project file for Visual Studio regarding the Kinect for Windows v2? Getting Started with Kinect Development in Visual Studio

    I am currently trying to make an application for Kinect for Windows v2 but I am entirely new to Visual Studio and Kinect development and could use some help getting started. I honestly have no idea where or how to start and I figured the easiest thing would
    be to obtain a simple project file and examine how it works myself, but I have been unable to find one. The easiest thing would be if I could obtain a project file for Visual Studio that is an application which overlays the Skeletal model over people in real
    time, though similar project files would also be appreciated. The app I am making largely involves things similar to overlaying the skeletal model on bodies so this would get me off to a great start and show me how the code is laid out within visual studio
    simultaneously. (I would prefer the code to be in C# if that is possible but other languages also work).
    I have checked out some of the guides for kinect development but they all assume you know how visual studio works so I cannot get very far in them. Thus if you know of a good guide to get me started with visual stuido AND the Kinect then I would be glad
    to here that as well.
    Alternatively, and I know this is not the right place for this, I have Matlab, which I know works for the Kinect v1 but can't find support for it regarding the v2, so if you could point me in the right direction on how to get it to work with the Kinect v2
    THAT would also work incredibly well as I am much more familiar with Matlab.
    I already have Visual Studio Ultimate 2013 installed, as well as the Kinect SDKv2.0, the physical Kinect for Windows v2, and my laptop meets all of the requirements for development so those are not issues.
    Thanks in advance for any advice you can give me!

    Hi Jicnon,
    Thank you for posting in MSND forum.
    Since this forum is discuss: Visual Studio WPF/SL Designer, Visual Studio Guidance Automation Toolkit, Developer Documentation and Help System, and Visual Studio Editor. About your issue, I think that it is
    more related to the Kinect for Windows v2, so I suggest you can post this issue directly to Kinect for Windows v2 SDK forum:https://social.msdn.microsoft.com/Forums/en-US/home?forum=kinectv2sdk
    ,maybe you will get better support.
    In addition, I find a similar thread about your issue, maybe you will get some useful message.
    https://social.msdn.microsoft.com/Forums/en-US/92b23946-53d2-419c-8624-66e6c390617f/information-to-start-project-with-kinect-for-windows-v2?forum=kinectv2sdk
    Thanks for your understanding.
    Best Regards,
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • Maximum number of Kinect for Windows v2 Cameras on one PC?

    There is a question about the previous iteration of the Microsoft Kinect for Windows (no longer on sale) here: https://social.msdn.microsoft.com/Forums/en-US/63c7c52e-1290-452e-8e04-74330822d16f/maximum-number-of-kinect-cameras-on-one-pc?forum=kinectsdk.
    How many Kinect for Windows v2 sensors can be used on a single PC? And if this is limited to 1, is this a software, or a hardware restriction?

    Are there plans for this to change, or be lifted?
    No.  No product roadmap anyway.
    The reasoning requires you to look at it from an engineering standpoint.  The Kinect uses a lot (more than half) of the available bus bandwidth to operate normally.  So even though you could physically connect two or more sensors, there is no feasible
    way to have them both sustain enough of a data rate for them to operate normally using the existing hardware.
    I'm no hardware expert, but from what I have been told, the solution is harder than just having multiple USB 3.0 controllers in the same PC.
    As for "plans for this to change", rest assured that people want this, and that there are clever engineers thinking about solutions, but due to technical limitations, there is no product roadmap yet that allows for multiple kinects sensors on a
    single PC.  And because of the technological limitations, it will never just be "lifted".  The hardware needs to change for this to work.
    Another thing to consider is that, from a physics standpoint, Kinects
    do interfere with each other (slightly) when operating in the same space.  It's not at all dissimilar from two people trying to have a conversation in the same room -- some words of the conversation will be missed.  The more people in the
    room, the more difficult it is to hear one another.  For the Kinect, the quality of the depth results, for example, is diminished by having two kinects operating in the same space, but the visible light cameras continue to operate unimpeded.  The
    sensor is cleverly designed to "tolerate" the light patterns from other kinects, but they can't completely ignore those patterns and conflicts do occur --  so it
    does degrade slightly with noise from each additional sensor.  It's using invisible light, so the problem tends to be "out of sight, out of mind" for us as users.  But at some (modest) limit, it becomes mathematically impossible
    to multiplex the light patterns from additional Kinects using the current specs (somewhere around 16 kinects based on the patterns, IIRC).
    So there are other physical and technological hurdles to overcome with operating multiple Kinects in the same space, even if they were all connected to different PCs connected in a network cluster or something like that.

  • Does Kinect for Windows V2 provide facial recognition API? Thanks

    Does Kinect for Windows V2 provide facial recognition API? Thanks

    For facial recognition with the Kinect, you can use the Developer Toolkit (v1.5.1). The API for the FaceTracking tools can be found
    here: http://msdn.microsoft.com/en-us/library/jj130970.aspx.
    You can also refer: How
    To: Kinect for Windows SDK Face Recognition Series
    Facial Recognition with Kinect
    Kinect
    for Windows: SDK and Runtime version 1.5 Released
    As mentioned in the article: Kinect for Windows:
    Frequently asked questions
    Does Kinect for Windows SDK offer facial recognition capabilities?
    Since version 1.5, the Kinect for Windows SDK and toolkit have supported real-time face tracking. Face tracking is not intended for facial recognition or identification. Face tracking detects and tracks the positions and orientations of faces in real time and
    provides animated three-dimensional (3D) meshes that are positioned in 3D over the Kinect depth sensor data. Face tracking can animate, in real time, eyebrow positions and mouth shape, as well as provide a high-resolution 3D mesh of the face than can be animated.
    With the SDK 2.0, Kinect can also track whether eyes are open or closed, the position of the nose, facial expressions, and the direction the face is pointing. The resolution of the tracked face has been increased by 20 times with a 1,360-point mesh, so that
    faces look more realistic. Conventional face-recognition algorithms can be used with the Kinect for Windows sensor’s RGB stream; we continue to investigate how the Kinect for Windows sensor's extra capabilities can be used.
    For more details you can Ask a Question @ Kinect
    for Windows v2 SDK
    Rachit
    Please mark as answer or vote as helpful if my reply does

  • Inquire about the best laptop specifications for Developing Windows Apps and 3D modelling Animation using "Kinect for Windows v2"?

    I need some help in choosing laptop that is most compatible with "Kinect for Windows v2"; in order to develop Windows Apps, and 3D modelling Animation and Character Design. Which is better (Specifications):
    HP Pavilion Notebook PC 15-p150ne 
    AMD A10-5745M +
    AMD Radeon R7 M260 (2 GB DDR3L dedicated) +
    4 GB 1333 MHz DDR3, OR
    HP Pavilion Notebook PC 15-p034ne 
    Intel Core i5-4210U + NVIDIA GeForce 840M (2 GB DDR3 dedicated) + 4 GB 1600 MHz DDR3L

    The second system with the Intel chipset will more than likely have the Intel USB3 chipset required for Kinect. As for GPU they are similar, but the i5 with DDR3 1600MHZ ram is a better option. Keep in mind, if you are doing anything in-depth for
    3D, a laptop isn't the best options, but if you have to go mobile then you have to decide what is best for your requirements.
    Carmine Sirignano - MSFT

  • Where can I download example projects for Kinect for Windows v2?

    so for a project I am working on regarding the Kinect v2 I had initially planned on using Matlab to code for the Kinect. However, the code on the Mathworks website regarding the Kinect seems to only work with the Kinect v1 and I cannot figure out how to
    get the v2 to work with Matlab. Now I am in the predicament that I need to use Visual Studio and have never done so before. To make matters worse, all of the guides I can find about programming for the Kinect assume you are very familiar with Visual Studio
    so I get lost before I can even get through the setup (I have no idea what kind of project is best for Kinect, though I intend to use C# as my programming language, or where these settings they are changing are located). If I could just find an example project
    file to download I feel like it would help me a lot, but I cannot seem to find one.
    So my question is thus, is there a place where we can download project files for Visual Studio? I really just need to see what one looks like and what kind of settings it runs on so I know where to get started. It would be awesome if the project file involved
    overlaying the skeletal model on top of people in real time as well.
    If this is not possible, even a video that explains in depth how to go about using visual studio and the Kinect at the same time would be greatly appreciate, or a workaround to get Matlab to work with the Kinect v2.

    Hi Jicnon,
    When you download and install the Kinect SDK, it comes with the Kinect SDK Browser application. This applicaiton is a web based application that contains a bunch of sample projects for getting started with Kinect for windows programming.
    There is also the jumpstart videos here:
    https://social.msdn.microsoft.com/Forums/en-US/8428671a-781c-4850-a56d-905ab28f8f8f/mva-jump-start-programming-kinect-for-windows-v2-videos?forum=kinectv2sdk
    To get to the SDK Browswer app just hit the windows button type in "Kinect SDK" and this application should appear.
    There are also some samples in Kinect Common Bridge and a dicussion on using Matlab here:
    https://social.msdn.microsoft.com/Forums/en-US/2aa59712-c2ab-48e2-98bd-5eed9a40ec44/matlab-link?forum=kinectv2sdk
    Sr. Enterprise Architect | Trainer | Consultant | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer |blog: http://dgoins.wordpress.com

  • AsRock Extreme9 X79 + Kinect for Windows V.2 + 3D Builder App: USB 3.0 Issue !

    Hello everyone!
    I have a tremendous problem!
    I recently bought a "Kinect for Windows V.2".
    I suspected it was broken, so, I sent it to the Microsoft XBOX
    replacement
    Support Centre in Germany and they have replaced it with a new one.
    Therefore, the problem persists!
    The Problem:
    - I connect the Kinect 2 to my PC with Motherboard AsRock X79 Extreme9, and the USB 3.0 controller Texas Instruments
    crash with Error 43! (Not supported)
    So, now I have bought on Amazon a "Targus TS-DPU3" external USB 3.0 Hub, that was confirmed that run with Kinect 2.
    I hope it will work correctly, with sufficient bandwidth by connecting it to the onboard USB 3.0 port !
    (USB 3.0 Texas Instruments + USB 3.0 Targus External Hub (compatible with Kinect 2)= 5Gb/s)
    -Somebody have another suggestion for the compatibility between my "AsRock
    Extreme9
    X79" + "USB 3.0" + "Kinect 2" ???
    Please help me!
    Thank you very much!

    As you are aware, TI USB3 host controllers/chipset is not supported. Only Intel and Renesas are supported given the testing that was done at time of release. Plugging the hub into that is not going to work, since you have not corrected the
    internal issue.
    You need to purchase a PCI Express Gen 2.0 USB3 expansion card that will plug into a PCI Express slot that is Gen 2.0 enabled.
    Carmine Sirignano - MSFT

  • Kinect for Windows not installing on Bootcamp

    I'm trying to install the Kinect for Windows v2 SDK on the latest version of Windows 8.1, on a Mac with Bootcamp. I have the latest Mac Book Pro 15" and my graphics card is the NVIDIA GeForce GT 750M. What gives I thought this would for sure work,
    please help!

    What's the error you're getting? Run it with admin permissions.
    Have you seen the trouble shooting steps from here:
    https://social.msdn.microsoft.com/Forums/en-US/20dbadae-dcee-406a-b66f-a182d76cea3b/troubleshooting-and-common-issues-guide?forum=kinectv2sdk
    Sr. Enterprise Architect | Trainer | Consultant | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer |blog: http://dgoins.wordpress.com

  • I want to read the values of the inside accelerometer on Kinect for Windows v2 sensor.

    I had used the inside accelorometer on Kinect for Windows v1. So I want to use it for Kinect for Windows v2 application. However I can't find any function or method on Kinect for Windows SDK v2.0. But it is near the Ir camera of K4W v2. I found the Kionix
    chip. Do you have any plan to access this chip? 

    I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
    http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
    Align the y-axis to gravity
    –Tilt correct with
    FloorClipPlane.xyz
    •Falls back to accelerometer when no floor is found
    •Rotate
    scene such that “up” is (0,1,0)
    So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?    

  • Support phone number or chat for Kinect for Windows v2? 3D Builder won't work

    I have a Dell Inspiron 5000, Xbox One Kinect and adapter for use of the Kinect sensor with a Windows PC.  The sensor works fine or as well as can be expected on the Xbox One.  I've tried using it with 3D Builder which is the first app that Microsoft
    offers for the Kinect with PC after connecting it and downloading the drivers.  Unfortunately, it says that my rate is too slow so I was looking for support to see if this is an Inspiron issue or not.  The USB 3.0 ports may or may not support the
    bandwidth but I can't really tell.
    Does anyone know if there is a support number or chat area for Kinect for Windows as I keep getting transferred to the Xbox group and no one there seems to know anything about Kinect for Windows?  I'll also settle for if anyone can tell me if there
    is a problem with that application or the Dell Inspiron 5000.
    Thanks,
    Reinaldo

    The technology 3D builder is using requires a very specialized graphics card to be able to work at full speed. Laptop systems typically only can achieve the very minimal amount of processing which will work but very slowly.
    If you have a desktop system with an NVidia GeForce GT 670 or other in the same processing class of GPU's you should be able to achieve 30fps. Otherwise with lower end or laptop based systems even the highest end Alienware we have seen ~27fps. My experiences
    have been typically anywhere from ~1-8fps with Intel Based on-board gpu's(4000 series), ~15-22fps with mobile NVidia GT 750M chipsets and 23-30fps with GeForce GT 760 desktop system.
    Carmine Sirignano - MSFT

  • Support on Kinect for Windows V2

    We’ve purchased Kinect Windows V2 and we are trying to find x,y,z real co-ordinates of a point.
    The method given in the sample guide is 'MapcolourframetoCameraspace'. This method takes the argument
    Array<CameraSpacePoint>^ cameraSpacePoints
    What is the meaning of this argument, especially the ‘^’ sign?

    I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
    http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
    Align the y-axis to gravity
    –Tilt correct with
    FloorClipPlane.xyz
    •Falls back to accelerometer when no floor is found
    •Rotate
    scene such that “up” is (0,1,0)
    So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?    

Maybe you are looking for

  • Issue: SOAMANAGER using Web service in ECC 6.0

    Hi Experts, I created a WebService in SAP ECC6.0 using a Remote enabled function module which has one input field and Six output fields. In ECC 6.0 WSCONFIG,WSADMIN and LPCONFIG Tcodes are obsolete .So i have using tcode SOAMANAGER settings like Appl

  • Getting ipaddress or host name for virtual server

    I want to get the ipaddress or host name for virtual server in a cluster environment. If i do java.net.InetAddress.getLocalHost().getHostName() it returns the ipaddress of the physical node currently running virtual server. Is there any way to get th

  • Instalation error in premiere cs4

    Hello, I had adobe premiere cs3 since à long time, and this week, I upgrade my pc to windows 7.  I installed cs3 it with sucess. After, I saw that premiere CS4 was better for 7, so I download the trial. But, when I install it, I had an error message

  • Syntax Error on Mac

    I am trying to use the following expression: Math.sin(time * effect("Speed")("Slider")) * 45 I got the expression from this tutorial:  AFTER EFFECTS TUTORIAL - Animate Butterfly / Bird - YouTube I've not worked with expressions before... but some Goo

  • Accessing WebLogic EJBs from Tomcat 3.2

    Has anyone out there tried to access EJBs in a WebLogic 5.10 SP6 app server from a servlet in Tomcat 3.2? I'm operating under Win2K. When I try to create the initial naming context, the following exception is thrown: java.lang.NoClassDefFoundError: C