Finding the XYZ real world coordinates of the Kinect for Windows V2
Hi Everyone;
I am new to Kinect development and this might be sort of a basic question but I searched online and still confused about the matter.
So I have a depth image that I obtained from the Kinect for windows V2 and through some algorithm that I developed on MATLAB, I was able to output the Z distance in mm.
So now I want to have the X,Y real world coordinates as well.
So to do that I am using the following equations that I found for the old system:
x_world = (x_screen - c_x) * B/f_x;
y_world = (y_screen - c_y) * B/f_y;
where x_screen is the midpoint of the IR camera ( I am using the IR stream=512/2=256) and the y_screen (424/2=412)
B is my distance in Zmm
F_x and F_y is the focal length of the lens in x n y direction that I obtained through my own calibration.
So am I doing it correctly?
Is there any way I can use to double check the results I am getting?
Thanks;
Ali
You can use the coordinate mapper as this will take into account the camera intrinsics:
http://msdn.microsoft.com/en-us/library/microsoft.kinect.kinect.icoordinatemapper.mapdepthpointstocameraspace.aspx
http://msdn.microsoft.com/en-us/library/windowspreview.kinect.coordinatemapper.mapdepthframetocameraspace.aspx
Carmine Sirignano - MSFT
Similar Messages
-
How can I get the rotation information of my wrists in Kinect for Windows v2 ?
Hi,all
Assuming we make human wrist as the coordinate origin point of a three-dimensional space Cartesian coordinate, then when moving the wrist freely, what is the wrist rotation information in the coordinate system? Can kinect V2 describe it just like the degree
of roll, pitch and yaw in Face Basics demo given in the V2 SDK Browser?
Based on Kinect Studio 2.0 on 3D View model, it gives a vector arrow at each joint in real time, when I move, the direction of arrows changes correspondingly. So I think this may help me to get the information I want.
Here are my questions:
1. Could I use Kinect V2 SDK to detect and output this information directly? If not, any suggestion to use the data which SDK output to get rotation information?
2. If the Q1 answer is yes, what is the accuracy of the sensor about the degree of roll, pitch and yaw on wrist?
3. I have read Kinect V2 SDK documentation about the body class, the JointOrientations property description says that "the joint orientations of the body", what I want to know is the joint orientation based on
what frame of reference? The specific value of body.JointOrientations looks what kind of data?
Any advise or guidance would be greatly
appreciated.Thanks Carmine. It's really helps. But I still have some questions to ask.
As you said "a quaternion value, where the
Y component rotation is around the direction vector from the parent",and you also said "The
orientation value is ...not the rotation from the parent",my English is poor so I am a little bit confused.
About the accuracy, What is the level of accuracy under ideal conditions?
And in what circumstance
that "value could be 180 rotated" thing could happen?
Thank you for your time -
Code works in the real world - fails in the emulator
If you want to test this try http://hatemytory.com/java/deploy.wml
Anyway, my code loads an image over the network using http. This (appears) to work fine in the real world but in the WTK emulator it chokes by only downloading the first 16358 bytes of the image and then failing on the createImage call.
Apologies for the code being a bit choppy - I've been fiddling with it to see why it might fail - is this me or is it the WTK?
private void loadToryImage()throws IOException {
HttpConnection hc = null;
DataInputStream in = null;
String torylist = null;
byte[] data = null;
int index = 0;
int length = 0;
try {
String baseurl =
"http://hatemytory.com/tory-cgi/getpngtory.pl?name=";
String word = mTory.replace(' ', '+');
String coords = "&x=" + x_width + "&y=" + y_height;
String url = baseurl + word + coords;
hc = (HttpConnection) Connector.open(url);
length = (int)hc.getLength();
if (length != -1) {
data = new byte[length];
in = new DataInputStream(hc.openInputStream());
in.readFully(data);
else {
//read in in chunks
int chunkSize = 0;
int readLength = 0;
in = new DataInputStream(hc.openInputStream());
chunkSize = (int)hc.getLength();
data = new byte[chunkSize];
do {
if (data.length < index + chunkSize) {
byte[] newData = new byte[index + chunkSize];
System.arraycopy(data, 0, newData, 0, data.length);
data = newData;
readLength = in.read(data, index, chunkSize);
index += readLength;
}while (readLength == chunkSize);
length = index;
logo = Image.createImage(data, 0, length);
catch (IOException ioe) {
logo = null;
return;
finally {
if (in != null) in.close();
if (hc != null) hc.close();
return;
}If you want to test this try http://hatemytory.com/java/deploy.wml
Anyway, my code loads an image over the network using http. This (appears) to work fine in the real world but in the WTK emulator it chokes by only downloading the first 16358 bytes of the image and then failing on the createImage call.
Apologies for the code being a bit choppy - I've been fiddling with it to see why it might fail - is this me or is it the WTK?
private void loadToryImage()throws IOException {
HttpConnection hc = null;
DataInputStream in = null;
String torylist = null;
byte[] data = null;
int index = 0;
int length = 0;
try {
String baseurl =
"http://hatemytory.com/tory-cgi/getpngtory.pl?name=";
String word = mTory.replace(' ', '+');
String coords = "&x=" + x_width + "&y=" + y_height;
String url = baseurl + word + coords;
hc = (HttpConnection) Connector.open(url);
length = (int)hc.getLength();
if (length != -1) {
data = new byte[length];
in = new DataInputStream(hc.openInputStream());
in.readFully(data);
else {
//read in in chunks
int chunkSize = 0;
int readLength = 0;
in = new DataInputStream(hc.openInputStream());
chunkSize = (int)hc.getLength();
data = new byte[chunkSize];
do {
if (data.length < index + chunkSize) {
byte[] newData = new byte[index + chunkSize];
System.arraycopy(data, 0, newData, 0, data.length);
data = newData;
readLength = in.read(data, index, chunkSize);
index += readLength;
}while (readLength == chunkSize);
length = index;
logo = Image.createImage(data, 0, length);
catch (IOException ioe) {
logo = null;
return;
finally {
if (in != null) in.close();
if (hc != null) hc.close();
return;
} -
I want to read the values of the inside accelerometer on Kinect for Windows v2 sensor.
I had used the inside accelorometer on Kinect for Windows v1. So I want to use it for Kinect for Windows v2 application. However I can't find any function or method on Kinect for Windows SDK v2.0. But it is near the Ir camera of K4W v2. I found the Kionix
chip. Do you have any plan to access this chip?I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
Align the y-axis to gravity
–Tilt correct with
FloorClipPlane.xyz
•Falls back to accelerometer when no floor is found
•Rotate
scene such that “up” is (0,1,0)
So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info? -
I am currently trying to make an application for Kinect for Windows v2 but I am entirely new to Visual Studio and Kinect development and could use some help getting started. I honestly have no idea where or how to start and I figured the easiest thing would
be to obtain a simple project file and examine how it works myself, but I have been unable to find one. The easiest thing would be if I could obtain a project file for Visual Studio that is an application which overlays the Skeletal model over people in real
time, though similar project files would also be appreciated. The app I am making largely involves things similar to overlaying the skeletal model on bodies so this would get me off to a great start and show me how the code is laid out within visual studio
simultaneously. (I would prefer the code to be in C# if that is possible but other languages also work).
I have checked out some of the guides for kinect development but they all assume you know how visual studio works so I cannot get very far in them. Thus if you know of a good guide to get me started with visual stuido AND the Kinect then I would be glad
to here that as well.
Alternatively, and I know this is not the right place for this, I have Matlab, which I know works for the Kinect v1 but can't find support for it regarding the v2, so if you could point me in the right direction on how to get it to work with the Kinect v2
THAT would also work incredibly well as I am much more familiar with Matlab.
I already have Visual Studio Ultimate 2013 installed, as well as the Kinect SDKv2.0, the physical Kinect for Windows v2, and my laptop meets all of the requirements for development so those are not issues.
Thanks in advance for any advice you can give me!Hi Jicnon,
Thank you for posting in MSND forum.
Since this forum is discuss: Visual Studio WPF/SL Designer, Visual Studio Guidance Automation Toolkit, Developer Documentation and Help System, and Visual Studio Editor. About your issue, I think that it is
more related to the Kinect for Windows v2, so I suggest you can post this issue directly to Kinect for Windows v2 SDK forum:https://social.msdn.microsoft.com/Forums/en-US/home?forum=kinectv2sdk
,maybe you will get better support.
In addition, I find a similar thread about your issue, maybe you will get some useful message.
https://social.msdn.microsoft.com/Forums/en-US/92b23946-53d2-419c-8624-66e6c390617f/information-to-start-project-with-kinect-for-windows-v2?forum=kinectv2sdk
Thanks for your understanding.
Best Regards,
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey. -
Is there a manual I can print for the Airport Utility Software Version 5.5.3 for Windows?
If there is, I can't seem to find it anywhere (in the Software, by using Google, etc).I dont' believe there were manuals out there for different versions of the utility. That would be quite a few different manuals.
There are different manuals for the different base stations however... -
I can't get the latest version of iTunes 12.0.1 for Windows (64-bit) to work on my laptop. It says it has successfully downloaded and installed, but when I try to connect my new iPhone 6 to iTunes i get an error message 'need to install new software' but i thought i had! Please help me as i have had to connect my phone to someone else's mac and therefor don't have my music etc on my phone HELP! I have had IT support at work trying to figure it out and no one can!
For general advice see Troubleshooting issues with iTunes for Windows updates.
The steps in the second box are a guide to removing everything related to iTunes and then rebuilding it which is often a good starting point unless the symptoms indicate a more specific approach. Review the other boxes and the list of support documents further down page in case one of them applies.
Your library should be unaffected by these steps but there is backup and recovery advice elsewhere in the user tip.
tt2 -
I need some help in choosing laptop that is most compatible with "Kinect for Windows v2"; in order to develop Windows Apps, and 3D modelling Animation and Character Design. Which is better (Specifications):
HP Pavilion Notebook PC 15-p150ne
AMD A10-5745M +
AMD Radeon R7 M260 (2 GB DDR3L dedicated) +
4 GB 1333 MHz DDR3, OR
HP Pavilion Notebook PC 15-p034ne
Intel Core i5-4210U + NVIDIA GeForce 840M (2 GB DDR3 dedicated) + 4 GB 1600 MHz DDR3LThe second system with the Intel chipset will more than likely have the Intel USB3 chipset required for Kinect. As for GPU they are similar, but the i5 with DDR3 1600MHZ ram is a better option. Keep in mind, if you are doing anything in-depth for
3D, a laptop isn't the best options, but if you have to go mobile then you have to decide what is best for your requirements.
Carmine Sirignano - MSFT -
Need the Oracle Developer Suite 10.1.2.3 for Windows XP & Windows 7
Hi All,
Need the Oracle Developer Suite 10.1.2.3 for Windows XP & Windows 7 for developing Custom Forms and Reports to be used in R12.1.3. Please provide a link from where I can down the same.
Thanks in Advance,
Kiran Panditi.The base release is available here:
http://www.oracle.com/technetwork/developer-tools/forms/downloads/index.html
In order to get to 10.1.2.3, you must then install Patch ID 5983622
Installation on Windows 7 is only supported for Win7 (32bit) and requires special installation instructions found in MOS Note 1292919.1 . Not following these instructions will result in failure to install the product properly. -
i bought the student and teacher version of CS5 extended for windows. Can I download the Mac version to my new apple computer and use the same serial number after removing phtoshop from my PC?
Can I download the Mac version to my new apple computer and use the same serial number after removing phtoshop from my PC?
Short answer: not for CS5.
Platform swaps are available but only for CS6
Order product | Platform, language swap -
My PC serves the minimum requirements described in the kinect page, but when installing the device, the software says that the computer does not meet the minimum requirements and therefore will not work with efficiency. Alternatively, theorize buy a new
computer.
Which PC is recommended by Microsoft that ACTUALLY meet the requirements to work with software development for kinect for windows?Getting a definitive answer from Microsoft will be difficult as to my understanding, requirements are still subject to change; and unless it's their brand of PC I doubt they will give free advertisement to buy a specific make/model.
There are other threads where people discuss specific machines that work with the Kinect V2.
The only compatibility problems I've had with getting it to work are: It has to be run Windows 8; It has to have a compatible USB 3.0; The 'Compatible' USB 3.0 requirement seems to be the most difficult. -
Kinect for windows speech basics : could not find kinect speech
hello
i am try to run the basic example of sdk 2 for kinect
but i get this message:
could not find kinect speech recognizer....
any solution
sdk 2 for kinect install
sdk speech and language pack enUs and itIta install
any solution??hello am new to the forum ...
I need a good tutorial on voice recognition kinect for windows sdk 2
I tried the basic example of the SDK but I ridponde: Could not find kinect speech recognizer.....
any solution??
i have install:
kinect sdk 2 for win
speech sdk and language pack ita and en -
Hello.
the iPhone Configuration Utility 3.6 for Windows will not start up/load anymore.
It worked fine at first, then I tried to start it up today and I got an error:
failed to create an ipc port access is denied
Now there is no message at all. Just wont launch.
I find NO support at Apple. I have seen about 20 other cries for help on these forums and no seems to have received any help for this. Does anyone know how to get this Utility working?
I am using Windows XP SP3
I have tried upgrdading to .NET 4 SP1 from .NET 3.5 SP1 and that didnt work so went back the other way and still no change.
I tried completely uninstalling and deleting all references in Regedit and reinstalling from the start about 4 times.
I tried completely uninstalling and then going back to an older version (2.2) and it doesn't work either.
Unfortunately there is no help on Apply that I can find and trying to find an -actual email support for Apple software or products is a joke- (man, nothing is more aggravating when you need product help and the provider hides or completely does away with any way to contact them for help ro sends you on an hour long search for it...)
I need to get this working as I am providing an easy iphone configure for my VPN service. Can anyone help?
THanks!!
TresHello.
the iPhone Configuration Utility 3.6 for Windows will not start up/load anymore.
It worked fine at first, then I tried to start it up today and I got an error:
failed to create an ipc port access is denied
Now there is no message at all. Just wont launch.
I find NO support at Apple. I have seen about 20 other cries for help on these forums and no seems to have received any help for this. Does anyone know how to get this Utility working?
I am using Windows XP SP3
I have tried upgrdading to .NET 4 SP1 from .NET 3.5 SP1 and that didnt work so went back the other way and still no change.
I tried completely uninstalling and deleting all references in Regedit and reinstalling from the start about 4 times.
I tried completely uninstalling and then going back to an older version (2.2) and it doesn't work either.
Unfortunately there is no help on Apply that I can find and trying to find an -actual email support for Apple software or products is a joke- (man, nothing is more aggravating when you need product help and the provider hides or completely does away with any way to contact them for help ro sends you on an hour long search for it...)
I need to get this working as I am providing an easy iphone configure for my VPN service. Can anyone help?
THanks!!
Tres -
Software Update does not detect the upgrade of Boot Camp to 3.1 for Windows
I want to install Windows 7 HP 64 bit. I invoked Software Update so Boot Camp Assistant could be upgraded to ver. 3.1 that has Win 7 support. It said my system is up to date. I have Snow Leopard 10.6.2, but I still have BC 3.06, not the new 3.1.
When I went to Apple support site to download the new version in 64 bit, the download turned out to be a Windows executable file. I cannot install that in the MacOS. How do I get the necessary upgrade to 3.1 so I can use Boot Camp to dual boot. I have to install XP first so I can use my Windows 7 upgrade DVD.
ThanksThanks for your reply, but I am still confused about two things. First, how do I obtain the updated Boot Camp Assistant so I have the 3.1 compatibility for Windows 7? Second, I read in the Boot Camp guide that unless I have an earlier version of Windows already dual booting with OSX, that I should only install Win7 using the full retail DVD rather than the upgrade. I have an unused copy of XP and I already have the upgrade Win7 package, so I thought I would do a quick basic install of XP and then do a custom install of Win7.
Will Boot Camp react badly if I try to use the upgrade Win7 as you suggested, doing a custom install without entering the product key and then immediately reinstalling the upgrade over itself a second time?
Thanks, I really appreciate your help on this. I am very new to the Mac world. -
How does mackeeper 2012 work and its benefit? Is that same with Kaspersky for windows?
Good, be sure not to use their uninstaller, which can cause more havoc, use the instructions in my first link.
Real shame they can advertize this junk on most every Mac site!
ClamXAV, free Virus scanner...
http://www.clamxav.com/
Free Sophos...
http://www.sophos.com/products/enterprise/endpoint/security-and-control/mac/
Little Snitch, stops/alerts outgoing stuff...
http://www.obdev.at/products/littlesnitch/index.html
Maybe you are looking for
-
Report that shows the PO and PR number for each FI doc # of invoice posting
Hi I want a report in SAP for PO and PR no. for each FI doc. Thanks & Regards
-
Attachments from Workflow to ABAP Webdynpro launched from UWL
Hi All, You might have seen a recent post from me for sending attachments from ABAP Webdynpro to Workflow. I could do that by just calling SAP_WAPI_ATTACHMENT_ADD. I didnt have to create an instance of the SOFM object by passing the ATT_ID from this
-
I had some problems after updating the iTunes, and at the end, I decided to use Time Machine. Picked a date before iTunes update, but after finishing, I could not logon. The filevault came with a warning, not able to logon to "my acount name", due to
-
Add custom fields to Interaction History Search.
Hi, My requirement is to add two new attributes to the interaction history search screen. 1) Process Type 2) Creatyed By I have added these two fields to the Search Query Structure through Append Structure. Now problem is to do the backend logic.Mean
-
What is the best application to make party flyers for facebook
Hi, I recently started working as a promoter, but it involves creating lots of party flyers. Which is the best app for this task?