Finding the XYZ real world coordinates of the Kinect for Windows V2

Hi Everyone;
I am new to Kinect development and this might be sort of a basic question but I searched online and still confused about the matter.
So I have a depth image that I obtained from the Kinect for windows V2 and through some algorithm that I developed on MATLAB, I was able to output the Z distance in mm.
So now I want to have the X,Y real world coordinates as well. 
So to do that I am using the following equations that I found for the old system:
 x_world = (x_screen - c_x) * B/f_x;
 y_world = (y_screen - c_y) * B/f_y;
where x_screen is the midpoint of the IR camera ( I am using the IR stream=512/2=256) and the y_screen (424/2=412)
B is my distance in Zmm
F_x and F_y is the focal length of the lens in x n y direction that I obtained through my own calibration.
So am I doing it correctly?
Is there any way I can use to double check the results I am getting?
Thanks;
Ali

You can use the coordinate mapper as this will take into account the camera intrinsics:
http://msdn.microsoft.com/en-us/library/microsoft.kinect.kinect.icoordinatemapper.mapdepthpointstocameraspace.aspx
http://msdn.microsoft.com/en-us/library/windowspreview.kinect.coordinatemapper.mapdepthframetocameraspace.aspx
Carmine Sirignano - MSFT

Similar Messages

  • How can I get the rotation information of my wrists in Kinect for Windows v2 ?

    Hi,all
    Assuming we make human wrist as the coordinate origin point of a three-dimensional space Cartesian coordinate, then when moving the wrist freely, what is the wrist rotation information in the coordinate system? Can kinect V2 describe it just like the degree
    of roll, pitch and yaw in Face Basics demo given in the V2 SDK Browser?
    Based on Kinect Studio 2.0 on 3D View model, it gives a vector arrow at each joint in real time, when I move, the direction of arrows changes correspondingly. So I think this may help me to get the information I want.  
    Here are my questions:
    1. Could I use Kinect V2 SDK to detect and output this information directly? If not, any suggestion to use the data which SDK output to get rotation information?    
    2. If the Q1 answer is yes, what is the accuracy of the sensor about the degree of roll, pitch and yaw on wrist?
    3. I have read Kinect V2 SDK documentation about the body class, the JointOrientations property description says that "the joint orientations of the body", what I want to know is the joint orientation based on
    what frame of reference? The specific value of body.JointOrientations looks what kind of data?
    Any advise or guidance would be greatly
    appreciated. 

    Thanks Carmine. It's really helps. But I still have some questions to ask.
    As you said "a quaternion value, where the
    Y component rotation is around the direction vector from the parent",and you also said "The
    orientation value is ...not the rotation from the parent",my English is poor so I am a little bit confused. 
    About the accuracy, What is the level of accuracy under ideal conditions?
    And in what circumstance
    that "value could be 180 rotated" thing could happen?
    Thank you for your time

  • Code works in the real world - fails in the emulator

    If you want to test this try http://hatemytory.com/java/deploy.wml
    Anyway, my code loads an image over the network using http. This (appears) to work fine in the real world but in the WTK emulator it chokes by only downloading the first 16358 bytes of the image and then failing on the createImage call.
    Apologies for the code being a bit choppy - I've been fiddling with it to see why it might fail - is this me or is it the WTK?
    private void loadToryImage()throws IOException {
              HttpConnection hc = null;
              DataInputStream in = null;
              String torylist = null;
              byte[] data = null;
              int index = 0;
              int length = 0;
              try {
                   String baseurl =
                   "http://hatemytory.com/tory-cgi/getpngtory.pl?name=";
                   String word = mTory.replace(' ', '+');
                   String coords = "&x=" + x_width + "&y=" + y_height;
                   String url = baseurl + word + coords;
                   hc = (HttpConnection) Connector.open(url);
                   length = (int)hc.getLength();
                   if (length != -1) {
                        data = new byte[length];
                        in = new DataInputStream(hc.openInputStream());
                        in.readFully(data);
                   else {
                        //read in in chunks
                        int chunkSize = 0;
                        int readLength = 0;
                        in = new DataInputStream(hc.openInputStream());
                        chunkSize = (int)hc.getLength();
                        data = new byte[chunkSize];
                        do {
                             if (data.length < index + chunkSize) {
                                  byte[] newData = new byte[index + chunkSize];
                                  System.arraycopy(data, 0, newData, 0, data.length);
                                  data = newData;
                             readLength = in.read(data, index, chunkSize);
                             index += readLength;
                        }while (readLength == chunkSize);
                        length = index;
                   logo = Image.createImage(data, 0, length);
              catch (IOException ioe) {
                   logo = null;
                   return;
              finally {
                   if (in != null) in.close();
                   if (hc != null) hc.close();
              return;
         }

    If you want to test this try http://hatemytory.com/java/deploy.wml
    Anyway, my code loads an image over the network using http. This (appears) to work fine in the real world but in the WTK emulator it chokes by only downloading the first 16358 bytes of the image and then failing on the createImage call.
    Apologies for the code being a bit choppy - I've been fiddling with it to see why it might fail - is this me or is it the WTK?
    private void loadToryImage()throws IOException {
              HttpConnection hc = null;
              DataInputStream in = null;
              String torylist = null;
              byte[] data = null;
              int index = 0;
              int length = 0;
              try {
                   String baseurl =
                   "http://hatemytory.com/tory-cgi/getpngtory.pl?name=";
                   String word = mTory.replace(' ', '+');
                   String coords = "&x=" + x_width + "&y=" + y_height;
                   String url = baseurl + word + coords;
                   hc = (HttpConnection) Connector.open(url);
                   length = (int)hc.getLength();
                   if (length != -1) {
                        data = new byte[length];
                        in = new DataInputStream(hc.openInputStream());
                        in.readFully(data);
                   else {
                        //read in in chunks
                        int chunkSize = 0;
                        int readLength = 0;
                        in = new DataInputStream(hc.openInputStream());
                        chunkSize = (int)hc.getLength();
                        data = new byte[chunkSize];
                        do {
                             if (data.length < index + chunkSize) {
                                  byte[] newData = new byte[index + chunkSize];
                                  System.arraycopy(data, 0, newData, 0, data.length);
                                  data = newData;
                             readLength = in.read(data, index, chunkSize);
                             index += readLength;
                        }while (readLength == chunkSize);
                        length = index;
                   logo = Image.createImage(data, 0, length);
              catch (IOException ioe) {
                   logo = null;
                   return;
              finally {
                   if (in != null) in.close();
                   if (hc != null) hc.close();
              return;
         }

  • I want to read the values of the inside accelerometer on Kinect for Windows v2 sensor.

    I had used the inside accelorometer on Kinect for Windows v1. So I want to use it for Kinect for Windows v2 application. However I can't find any function or method on Kinect for Windows SDK v2.0. But it is near the Ir camera of K4W v2. I found the Kionix
    chip. Do you have any plan to access this chip? 

    I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
    http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
    Align the y-axis to gravity
    –Tilt correct with
    FloorClipPlane.xyz
    •Falls back to accelerometer when no floor is found
    •Rotate
    scene such that “up” is (0,1,0)
    So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?    

  • Download a Project file for Visual Studio regarding the Kinect for Windows v2? Getting Started with Kinect Development in Visual Studio

    I am currently trying to make an application for Kinect for Windows v2 but I am entirely new to Visual Studio and Kinect development and could use some help getting started. I honestly have no idea where or how to start and I figured the easiest thing would
    be to obtain a simple project file and examine how it works myself, but I have been unable to find one. The easiest thing would be if I could obtain a project file for Visual Studio that is an application which overlays the Skeletal model over people in real
    time, though similar project files would also be appreciated. The app I am making largely involves things similar to overlaying the skeletal model on bodies so this would get me off to a great start and show me how the code is laid out within visual studio
    simultaneously. (I would prefer the code to be in C# if that is possible but other languages also work).
    I have checked out some of the guides for kinect development but they all assume you know how visual studio works so I cannot get very far in them. Thus if you know of a good guide to get me started with visual stuido AND the Kinect then I would be glad
    to here that as well.
    Alternatively, and I know this is not the right place for this, I have Matlab, which I know works for the Kinect v1 but can't find support for it regarding the v2, so if you could point me in the right direction on how to get it to work with the Kinect v2
    THAT would also work incredibly well as I am much more familiar with Matlab.
    I already have Visual Studio Ultimate 2013 installed, as well as the Kinect SDKv2.0, the physical Kinect for Windows v2, and my laptop meets all of the requirements for development so those are not issues.
    Thanks in advance for any advice you can give me!

    Hi Jicnon,
    Thank you for posting in MSND forum.
    Since this forum is discuss: Visual Studio WPF/SL Designer, Visual Studio Guidance Automation Toolkit, Developer Documentation and Help System, and Visual Studio Editor. About your issue, I think that it is
    more related to the Kinect for Windows v2, so I suggest you can post this issue directly to Kinect for Windows v2 SDK forum:https://social.msdn.microsoft.com/Forums/en-US/home?forum=kinectv2sdk
    ,maybe you will get better support.
    In addition, I find a similar thread about your issue, maybe you will get some useful message.
    https://social.msdn.microsoft.com/Forums/en-US/92b23946-53d2-419c-8624-66e6c390617f/information-to-start-project-with-kinect-for-windows-v2?forum=kinectv2sdk
    Thanks for your understanding.
    Best Regards,
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • Is there a manual I can PRINT for the Airport Utility Software Version 5.5.3 for Windows?

    Is there a manual I can print for the Airport Utility Software Version 5.5.3 for Windows?
    If there is, I can't seem to find it anywhere (in the Software, by using Google, etc).

    I dont' believe there were manuals out there for different versions of the utility. That would be quite a few different manuals.
    There are different manuals for the different base stations however...

  • I can't get the latest version of iTunes 12.0.1 for Windows (64-bit) to work on my laptop.

    I can't get the latest version of iTunes 12.0.1 for Windows (64-bit) to work on my laptop. It says it has successfully downloaded and installed, but when I try to connect my new iPhone 6 to iTunes i get an error message 'need to install new software' but i thought i had! Please help me as i have had to connect my phone to someone else's mac and therefor don't have my music etc on my phone HELP!  I have had IT support at work trying to figure it out and no one can!

    For general advice see Troubleshooting issues with iTunes for Windows updates.
    The steps in the second box are a guide to removing everything related to iTunes and then rebuilding it which is often a good starting point unless the symptoms indicate a more specific approach. Review the other boxes and the list of support documents further down page in case one of them applies.
    Your library should be unaffected by these steps but there is backup and recovery advice elsewhere in the user tip.
    tt2

  • Inquire about the best laptop specifications for Developing Windows Apps and 3D modelling Animation using "Kinect for Windows v2"?

    I need some help in choosing laptop that is most compatible with "Kinect for Windows v2"; in order to develop Windows Apps, and 3D modelling Animation and Character Design. Which is better (Specifications):
    HP Pavilion Notebook PC 15-p150ne 
    AMD A10-5745M +
    AMD Radeon R7 M260 (2 GB DDR3L dedicated) +
    4 GB 1333 MHz DDR3, OR
    HP Pavilion Notebook PC 15-p034ne 
    Intel Core i5-4210U + NVIDIA GeForce 840M (2 GB DDR3 dedicated) + 4 GB 1600 MHz DDR3L

    The second system with the Intel chipset will more than likely have the Intel USB3 chipset required for Kinect. As for GPU they are similar, but the i5 with DDR3 1600MHZ ram is a better option. Keep in mind, if you are doing anything in-depth for
    3D, a laptop isn't the best options, but if you have to go mobile then you have to decide what is best for your requirements.
    Carmine Sirignano - MSFT

  • Need the Oracle Developer Suite 10.1.2.3 for Windows XP & Windows 7

    Hi All,
    Need the Oracle Developer Suite 10.1.2.3 for Windows XP & Windows 7 for developing Custom Forms and Reports to be used in R12.1.3. Please provide a link from where I can down the same.
    Thanks in Advance,
    Kiran Panditi.

    The base release is available here:
    http://www.oracle.com/technetwork/developer-tools/forms/downloads/index.html
    In order to get to 10.1.2.3, you must then install Patch ID 5983622
    Installation on Windows 7 is only supported for Win7 (32bit) and requires special installation instructions found in MOS Note 1292919.1 . Not following these instructions will result in failure to install the product properly.

  • I bought the student and teacher version of CS5 extended for windows. Can I download the Mac version to my new  apple computer  and use the same serial number after removing phtoshop from my PC?

    i bought the student and teacher version of CS5 extended for windows. Can I download the Mac version to my new  apple computer  and use the same serial number after removing phtoshop from my PC?

    Can I download the Mac version to my new  apple computer  and use the same serial number after removing phtoshop from my PC?
    Short answer: not for CS5.
    Platform swaps are available but only for CS6
    Order product | Platform, language swap

  • Which PC is recommended by Microsoft that ACTUALLY meet the requirements to work with software development for kinect for windows?

    My PC serves the minimum requirements described in the kinect page, but when installing the device, the software says that the computer does not meet the minimum requirements and therefore will not work with efficiency. Alternatively, theorize buy a new
    computer.
    Which PC is recommended by Microsoft that ACTUALLY meet the requirements to work with software development for kinect for windows?

    Getting a definitive answer from Microsoft will be difficult as to my understanding, requirements are still subject to change; and unless it's their brand of PC  I doubt they will give free advertisement to buy a specific make/model.
    There are other threads where people discuss specific machines that work with the Kinect V2.  
    The only compatibility problems I've had with getting it to work are: It has to be run Windows 8; It has to have a compatible USB 3.0;  The 'Compatible' USB 3.0 requirement seems to be the most difficult.

  • Kinect for windows speech basics : could not find kinect speech

    hello 
    i am try to run the basic example of sdk 2 for kinect
    but i get this message:
    could not find kinect speech recognizer....
    any solution
    sdk 2 for kinect install
    sdk speech and language pack enUs and itIta install
    any solution??

    hello am new to the forum ...
    I need a good tutorial on voice recognition kinect for windows sdk 2
    I tried the basic example of the SDK but I ridponde: Could not find kinect speech recognizer.....
    any solution??
    i have install:
    kinect sdk 2 for win
    speech sdk and language pack ita and en

  • HT4839 the  iPhone Configuration Utility 3.6/2.2 for Windows will not start up/load anymore.

    Hello.
    the  iPhone Configuration Utility 3.6 for Windows will not start up/load anymore.
    It worked fine at first, then I tried to start it up today and I got an error:
    failed to create an ipc port access is denied
    Now there is no message at all. Just wont launch.
    I find NO support at Apple. I have seen about 20 other cries for help on these forums and no seems to have received any help for this. Does anyone know how to get this Utility working?
    I am using Windows XP SP3
    I have tried upgrdading to .NET 4 SP1 from .NET 3.5 SP1 and that didnt work so went back the other way and still no change.
    I tried completely uninstalling and deleting all references in Regedit and reinstalling from the start about 4 times.
    I tried completely uninstalling and then going back to an older version (2.2) and it doesn't work either.
    Unfortunately there is no help on Apply that I can find and trying to find an -actual email support for Apple software or products is a joke- (man, nothing is more aggravating when you need product help and the provider hides or completely does away with any way to contact them for help ro sends you on an hour long search for it...)
    I need to get this working as I am providing an easy iphone configure for my VPN service. Can anyone help?
    THanks!!
    Tres

    Hello.
    the  iPhone Configuration Utility 3.6 for Windows will not start up/load anymore.
    It worked fine at first, then I tried to start it up today and I got an error:
    failed to create an ipc port access is denied
    Now there is no message at all. Just wont launch.
    I find NO support at Apple. I have seen about 20 other cries for help on these forums and no seems to have received any help for this. Does anyone know how to get this Utility working?
    I am using Windows XP SP3
    I have tried upgrdading to .NET 4 SP1 from .NET 3.5 SP1 and that didnt work so went back the other way and still no change.
    I tried completely uninstalling and deleting all references in Regedit and reinstalling from the start about 4 times.
    I tried completely uninstalling and then going back to an older version (2.2) and it doesn't work either.
    Unfortunately there is no help on Apply that I can find and trying to find an -actual email support for Apple software or products is a joke- (man, nothing is more aggravating when you need product help and the provider hides or completely does away with any way to contact them for help ro sends you on an hour long search for it...)
    I need to get this working as I am providing an easy iphone configure for my VPN service. Can anyone help?
    THanks!!
    Tres

  • Software Update does not detect the upgrade of Boot Camp to 3.1 for Windows

    I want to install Windows 7 HP 64 bit. I invoked Software Update so Boot Camp Assistant could be upgraded to ver. 3.1 that has Win 7 support. It said my system is up to date. I have Snow Leopard 10.6.2, but I still have BC 3.06, not the new 3.1.
    When I went to Apple support site to download the new version in 64 bit, the download turned out to be a Windows executable file. I cannot install that in the MacOS. How do I get the necessary upgrade to 3.1 so I can use Boot Camp to dual boot. I have to install XP first so I can use my Windows 7 upgrade DVD.
    Thanks

    Thanks for your reply, but I am still confused about two things. First, how do I obtain the updated Boot Camp Assistant so I have the 3.1 compatibility for Windows 7? Second, I read in the Boot Camp guide that unless I have an earlier version of Windows already dual booting with OSX, that I should only install Win7 using the full retail DVD rather than the upgrade. I have an unused copy of XP and I already have the upgrade Win7 package, so I thought I would do a quick basic install of XP and then do a custom install of Win7.
    Will Boot Camp react badly if I try to use the upgrade Win7 as you suggested, doing a custom install without entering the product key and then immediately reinstalling the upgrade over itself a second time?
    Thanks, I really appreciate your help on this. I am very new to the Mac world.

  • How does mackeeper 2012 work? and what is the benefit? is that same with kaspersky for windows? tks

    How does mackeeper 2012 work and its benefit? Is that same with Kaspersky for windows?

    Good, be sure not to use their uninstaller, which can cause more havoc, use the instructions in my first link.
    Real shame they can advertize this junk on most every Mac site!
    ClamXAV, free Virus scanner...
    http://www.clamxav.com/
    Free Sophos...
    http://www.sophos.com/products/enterprise/endpoint/security-and-control/mac/
    Little Snitch, stops/alerts outgoing stuff...
    http://www.obdev.at/products/littlesnitch/index.html

Maybe you are looking for