Does Kinect for Windows V2 provide facial recognition API? Thanks

For facial recognition with the Kinect, you can use the Developer Toolkit (v1.5.1). The API for the FaceTracking tools can be found
here: http://msdn.microsoft.com/en-us/library/jj130970.aspx.
You can also refer: How
To: Kinect for Windows SDK Face Recognition Series
Facial Recognition with Kinect
Kinect
for Windows: SDK and Runtime version 1.5 Released
As mentioned in the article: Kinect for Windows:
Frequently asked questions
Does Kinect for Windows SDK offer facial recognition capabilities?
Since version 1.5, the Kinect for Windows SDK and toolkit have supported real-time face tracking. Face tracking is not intended for facial recognition or identification. Face tracking detects and tracks the positions and orientations of faces in real time and
provides animated three-dimensional (3D) meshes that are positioned in 3D over the Kinect depth sensor data. Face tracking can animate, in real time, eyebrow positions and mouth shape, as well as provide a high-resolution 3D mesh of the face than can be animated.
With the SDK 2.0, Kinect can also track whether eyes are open or closed, the position of the nose, facial expressions, and the direction the face is pointing. The resolution of the tracked face has been increased by 20 times with a 1,360-point mesh, so that
faces look more realistic. Conventional face-recognition algorithms can be used with the Kinect for Windows sensor’s RGB stream; we continue to investigate how the Kinect for Windows sensor's extra capabilities can be used.
For more details you can Ask a Question @ Kinect
for Windows v2 SDK
Rachit
Please mark as answer or vote as helpful if my reply does

Similar Messages

Kinect for windows sensor does not start when using remote WMI

Scenario:
I have written a software (lets call it kinectRecorder.exe) that uses "kinect for windows sensor" to record images. The machine that connects to the kinect sensor has windows 8.1 and kinect v2 installed. The software is able to successfully records
images from kinect sensor when running locally. (meaning if I hit f5 from vs2013, frames are recorded to local disk)
Due to resource constraint and other requirement, I have to remotely kickoff kinectRecorder.exe on the windows 8.1 machine from a windows 7 machine. on the windows 7 machine, I remotely kick off the kinectRecorder.exe using windows WMI infrastructure.
The credential used for windows 8.1 machine and windows 7 machine are the same under same windows domain. the credential used to authenticate in wmi is also the same, I can see the user name running kinectRecorder.exe after kinectrecorder.exe is started
remotely.
Problem:
The result is that kinectRecorder.exe starts ok, but after the kinectsensor.open call, isavailable property changed to false, meaning sensor not detected.
Question:
What's stopping kinect sensor to be detected/opened (i'm not sure what the correct jargon is here)?
I have been search the web, In msdn documentation (known issues), I cannot find the problem being mentioned. I wonder if I'm the only person who has encountered this issue before.
Any pointer is hugely appreciated.

Kinect is not supported within the context of a service because of the underlying need for a user session, see
https://social.msdn.microsoft.com/Forums/en-US/72cecf8b-ac64-47e2-b54b-ddbd1dc237c9/calling-kinect-sdk-apis-from-a-windows-service-is-not-possiblesupported?forum=kinectv2sdk
Can determine that the system has at least one logged in user and can you launch the application within that users session? KinectMontior/KinectService must be running for the runtime to get any data from the sensor. If you use Remote
Desktop to log into that user session, you can confirm this works by running any of the samples and they should work without issue(remember to ensure that your audio remoting is left on the server, see troubleshooting guide
https://social.msdn.microsoft.com/Forums/en-US/20dbadae-dcee-406a-b66f-a182d76cea3b/troubleshooting-and-common-issues-guide?forum=kinectv2sdk).
Carmine Sirignano - MSFT

Kinect for windows sdk 2 speech

hello am new to the forum ...
I need a good tutorial on voice recognition kinect for windows sdk 2
I tried the basic example of the SDK but I ridponde: Could not find kinect speech recognizer.....
any solution??
i have install:
kinect sdk 2 for win
speech sdk and language pack ita and en

GTX460 is not a DirectX 11 based GPU. Additionally given that is the GPU chances are you are not running a supported USB3 chipset as provided in the link.
See the troubleshooting guide: https://social.msdn.microsoft.com/Forums/en-US/20dbadae-dcee-406a-b66f-a182d76cea3b/troubleshooting-and-common-issues-guide?forum=kinectv2sdk
Carmine Sirignano - MSFT

Inquire about the best laptop specifications for Developing Windows Apps and 3D modelling Animation using "Kinect for Windows v2"?

I need some help in choosing laptop that is most compatible with "Kinect for Windows v2"; in order to develop Windows Apps, and 3D modelling Animation and Character Design. Which is better (Specifications):
HP Pavilion Notebook PC 15-p150ne
AMD A10-5745M +
AMD Radeon R7 M260 (2 GB DDR3L dedicated) +
4 GB 1333 MHz DDR3, OR
HP Pavilion Notebook PC 15-p034ne
Intel Core i5-4210U + NVIDIA GeForce 840M (2 GB DDR3 dedicated) + 4 GB 1600 MHz DDR3L

The second system with the Intel chipset will more than likely have the Intel USB3 chipset required for Kinect. As for GPU they are similar, but the i5 with DDR3 1600MHZ ram is a better option. Keep in mind, if you are doing anything in-depth for
3D, a laptop isn't the best options, but if you have to go mobile then you have to decide what is best for your requirements.
Carmine Sirignano - MSFT

Maximum number of Kinect for Windows v2 Cameras on one PC?

There is a question about the previous iteration of the Microsoft Kinect for Windows (no longer on sale) here: https://social.msdn.microsoft.com/Forums/en-US/63c7c52e-1290-452e-8e04-74330822d16f/maximum-number-of-kinect-cameras-on-one-pc?forum=kinectsdk.
How many Kinect for Windows v2 sensors can be used on a single PC? And if this is limited to 1, is this a software, or a hardware restriction?

Are there plans for this to change, or be lifted?
No. No product roadmap anyway.
The reasoning requires you to look at it from an engineering standpoint. The Kinect uses a lot (more than half) of the available bus bandwidth to operate normally. So even though you could physically connect two or more sensors, there is no feasible
way to have them both sustain enough of a data rate for them to operate normally using the existing hardware.
I'm no hardware expert, but from what I have been told, the solution is harder than just having multiple USB 3.0 controllers in the same PC.
As for "plans for this to change", rest assured that people want this, and that there are clever engineers thinking about solutions, but due to technical limitations, there is no product roadmap yet that allows for multiple kinects sensors on a
single PC. And because of the technological limitations, it will never just be "lifted". The hardware needs to change for this to work.
Another thing to consider is that, from a physics standpoint, Kinects
do interfere with each other (slightly) when operating in the same space. It's not at all dissimilar from two people trying to have a conversation in the same room -- some words of the conversation will be missed. The more people in the
room, the more difficult it is to hear one another. For the Kinect, the quality of the depth results, for example, is diminished by having two kinects operating in the same space, but the visible light cameras continue to operate unimpeded. The
sensor is cleverly designed to "tolerate" the light patterns from other kinects, but they can't completely ignore those patterns and conflicts do occur -- so it
does degrade slightly with noise from each additional sensor. It's using invisible light, so the problem tends to be "out of sight, out of mind" for us as users. But at some (modest) limit, it becomes mathematically impossible
to multiplex the light patterns from additional Kinects using the current specs (somewhere around 16 kinects based on the patterns, IIRC).
So there are other physical and technological hurdles to overcome with operating multiple Kinects in the same space, even if they were all connected to different PCs connected in a network cluster or something like that.

Kinect for Windows v2 cannot reliably remain online for prolonged periods

We are developing a .NET 4.5 app that records Kinect frame streams to a huge disk array, 24/7. However, it appears that a vanilla installation of the Kinect cannot remain online for prolonged periods. After a day or so, frames simply stop arriving for no
apparent reason. There is nothing in the Windows Events Viewer that seems related; Device Manager also does not show any problem for the Kinect devices.
Could somebody look into this issue?
We have just disables power management on the whole chain of hardware (PCI express -> USB 3.0 controller -> Kinect) and will see if it helps.

Are you using any custom code to write the Kinect Frames to disk? or are you using Kinect Studio?
If using your own custom code, check to make sure you're releasing all frames (Disposing them) appropiately. Not doing so, even in the most subtle way could easily cause this behavior.
Sr. Enterprise Architect | Trainer | Consultant | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer |blog: http://dgoins.wordpress.com

Kinect for windows speech basics : could not find kinect speech

hello
i am try to run the basic example of sdk 2 for kinect
but i get this message:
could not find kinect speech recognizer....
any solution
sdk 2 for kinect install
sdk speech and language pack enUs and itIta install
any solution??

hello am new to the forum ...
I need a good tutorial on voice recognition kinect for windows sdk 2
I tried the basic example of the SDK but I ridponde: Could not find kinect speech recognizer.....
any solution??
i have install:
kinect sdk 2 for win
speech sdk and language pack ita and en

I want to read the values of the inside accelerometer on Kinect for Windows v2 sensor.

I had used the inside accelorometer on Kinect for Windows v1. So I want to use it for Kinect for Windows v2 application. However I can't find any function or method on Kinect for Windows SDK v2.0. But it is near the Ir camera of K4W v2. I found the Kionix
chip. Do you have any plan to access this chip?

I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
Align the y-axis to gravity
–Tilt correct with
FloorClipPlane.xyz
•Falls back to accelerometer when no floor is found
•Rotate
scene such that “up” is (0,1,0)
So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?

Finding the XYZ real world coordinates of the Kinect for Windows V2

Hi Everyone;
I am new to Kinect development and this might be sort of a basic question but I searched online and still confused about the matter.
So I have a depth image that I obtained from the Kinect for windows V2 and through some algorithm that I developed on MATLAB, I was able to output the Z distance in mm.
So now I want to have the X,Y real world coordinates as well.
So to do that I am using the following equations that I found for the old system:
x_world = (x_screen - c_x) * B/f_x;
y_world = (y_screen - c_y) * B/f_y;
where x_screen is the midpoint of the IR camera ( I am using the IR stream=512/2=256) and the y_screen (424/2=412)
B is my distance in Zmm
F_x and F_y is the focal length of the lens in x n y direction that I obtained through my own calibration.
So am I doing it correctly?
Is there any way I can use to double check the results I am getting?
Thanks;
Ali

You can use the coordinate mapper as this will take into account the camera intrinsics:
http://msdn.microsoft.com/en-us/library/microsoft.kinect.kinect.icoordinatemapper.mapdepthpointstocameraspace.aspx
http://msdn.microsoft.com/en-us/library/windowspreview.kinect.coordinatemapper.mapdepthframetocameraspace.aspx
Carmine Sirignano - MSFT

Support phone number or chat for Kinect for Windows v2? 3D Builder won't work

I have a Dell Inspiron 5000, Xbox One Kinect and adapter for use of the Kinect sensor with a Windows PC. The sensor works fine or as well as can be expected on the Xbox One. I've tried using it with 3D Builder which is the first app that Microsoft
offers for the Kinect with PC after connecting it and downloading the drivers. Unfortunately, it says that my rate is too slow so I was looking for support to see if this is an Inspiron issue or not. The USB 3.0 ports may or may not support the
bandwidth but I can't really tell.
Does anyone know if there is a support number or chat area for Kinect for Windows as I keep getting transferred to the Xbox group and no one there seems to know anything about Kinect for Windows? I'll also settle for if anyone can tell me if there
is a problem with that application or the Dell Inspiron 5000.
Thanks,
Reinaldo

The technology 3D builder is using requires a very specialized graphics card to be able to work at full speed. Laptop systems typically only can achieve the very minimal amount of processing which will work but very slowly.
If you have a desktop system with an NVidia GeForce GT 670 or other in the same processing class of GPU's you should be able to achieve 30fps. Otherwise with lower end or laptop based systems even the highest end Alienware we have seen ~27fps. My experiences
have been typically anywhere from ~1-8fps with Intel Based on-board gpu's(4000 series), ~15-22fps with mobile NVidia GT 750M chipsets and 23-30fps with GeForce GT 760 desktop system.
Carmine Sirignano - MSFT

Support on Kinect for Windows V2

We’ve purchased Kinect Windows V2 and we are trying to find x,y,z real co-ordinates of a point.
The method given in the sample guide is 'MapcolourframetoCameraspace'. This method takes the argument
Array<CameraSpacePoint>^ cameraSpacePoints
What is the meaning of this argument, especially the ‘^’ sign?

I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
Align the y-axis to gravity
–Tilt correct with
FloorClipPlane.xyz
•Falls back to accelerometer when no floor is found
•Rotate
scene such that “up” is (0,1,0)
So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?

Kinect for windows v2 SDK and v1 sensors

Before upgrading to win 8 to utilize the Kinect for Windows SDK 2.0 I want to know if it is backwardly compatible with the v1 of the sensors.
Thanks

There are technical ways of doing it but requires that you create your own separate .dll's that will wrap the v1 and v2 libraries in their own wrapper so the namespace collisions don't occur. Then you use your .dll within your application. I have a snippet
of code of how to do this in my GitHub account:https://github.com/carmines/workshop/tree/master/WPF/KinectV2andV1
Then there are the image resolution and camera intrinsic values you need to concern yourself with if you intend to try and mix the values together.
Carmine Sirignano - MSFT

Kinect for Windows V2 Device cannot start

I was able to use my Kinect for Windows V2 sensor yesterday with all of the applications in the SDK browser but the next day after restarting my computer I was no longer able to use the device. Looking at the device manager I get this message under the properties
for WDF KinectSensor Interface 0 (the only device listed under Kinect sensor devices):
This device cannot start. (Code 10)
{Operation Failed}
The requested operation was unsuccessful.
I'm plugged into a USB 3.0 input. Any ideas?

I encounter the exact same issue:
WDF KinectSensor Interface 0
This device cannot start. (Code 10)
{Operation Failed}
The requested operation was unsuccessful.
I'm using an Intel 4ghz i7 processor plugged into an ASUS Sabertooth Mk1 Z97 Motherboard. The ASMedia on the board had some issues, so i'm using a USB 3.0 PCI/E card by Manhatten. Diagnostics indicates that everything but depth checks out. Depth fails because
the camera reports all black.
This is particularly frustrating since I built this computer to offer USB 3.0 support specifically so I could do work with Kinect and Unity. This was before I knew the issues Kinect has with ASMedia, so for me this has been a significant investment for a
black screen.
Edit: To clarify, the Kinect is plugged into the PCI/E card (Manhatten 150491) and not into the board or a case slot.
Additonal note: The Kinect does not function properly plugged into my old PC (a USB 2.0 with an i7) or into my Surface Pro (1st gen)
- Matt Eland

Kinect for Windows v2 Hand Pointer Gestures

Hi, how can I use Kinect for Windows v2 WPF control ? I would like to write some app which will use a hand and finger pointer. I saw that this is possible in Windows Store application but I want to write in WPF. Is it possible ? I think I should use a
KinectRegion and KinectUserViewer but I don't know how I can use it in WPF project.

We have provided controls for WPF, have a look at the controls basics-wpf sample.
Carmine Sirignano - MSFT

Private forum for kinect for windows developer preview

Hello all,
I received notification email from Microsoft regarding Kinect for Windows developer preview. In the beginning of the content, it is written:
"Until the program agreement is signed you cannot get access to the pre-release sensor, the SDK and documentation, or the private forum. Please check your junk or span folder. If you still are not able to locate the Docusign agreement please let us
know and we will resend it to you."
After checking my junk folder, I could not find any, so I replied the email asking to resend the document, I got email response suggesting me to use technical support in the private forum for 'Kinect for Windows developer preview'. But if I clicked the link,
I got message "no results were found". I think I still don't have access to the private forum.
I appreciate any suggestion.
Thank you in advance.

Kinect forums are over here.
http://social.msdn.microsoft.com/Forums/en-US/home?category=kinectsdk
Regards, Dave Patrick ....
Microsoft Certified Professional
Microsoft MVP [Windows]
Disclaimer: This posting is provided "AS IS" with no warranties or guarantees , and confers no rights.

Does Kinect for Windows V2 provide facial recognition API? Thanks

Similar Messages

Maybe you are looking for