Record data (depth and audio) - Kinect for Windows v2

Hi,
I am trying to record data from the kinect by using this class: KStudioEventStreamSelectorCollection to get access to IR, Depth, UncompressedColor. I also want audio, but I think i can not use this to get it
At the moment I can create a XEF or XRF file with those data. However the size of the generated file is too big, something around 1GB per 10 seconds. 
So, I have two problems/questions:
1st - Is there an way to decrease the size of the generated file?
2nd - Is there an way to also record audio and put it together with the other data, creating a xef file with everything?
I know that Kinect Studio can do this, so I think it is possible. But I do not know how.
Thank you

1. No not really, if you are recording Color it is a raw uncompressed format which will be very large in comparison to other streams. If you don't have a need for color, don't record it.
2. Since Kinect Studio is a shell around these same api's, and Audio is a function of the tool then you will be able to record this as well. It looks like the KStudioEventStreamDataTypeId is missing. You should be able to create a Guid object with
the following value and pass this in. 
Guid Audio = new Guid(0x787c7abd, 0x9f6e, 0x4a85, 0x8d, 0x67, 0x63, 0x65, 0xff, 0x80, 0xcc, 0x69);

Similar Messages

  • Kinect for Windows version 2, problem with Depth Data

    Recently i purchase a new kinect for windows (V2). i need to capture depth data. therefore i installed SDK 2 for this reason. i captured depth data with Depth D2D or WPF in SDK 2. but i see the depth data that kinect captured,is very different from real
    depth. also we can see that many depth data will change suddenly into a random value of pixel(something like above 238, 140 or 3). And we also find that many black and white pixel appear on the display which also means that there exists an extreme sudden change
    between zero and a great value.
    What makes this happen and how can I correct it
    thanks

    Depth is generated based on the time of flight infrared(IR) data that is acquired from the sensor. Time of flight is different from structured light sensor than v1. In a particular frame, each pixel is going to have a valid depth value or unknown. The
    only way to correct is to average the data acquire from the SDK. Each frame can be compared to the previous given a constant that the camera didn't move. Based on that each pixel can be averaged with previous frames(more than one) and that should level off
    to a point.
    Since this is all based on IR data, the reflective properties of the surfaces/environment will determine the amount of noise. With time of flight, the ir data is actively filtered to only look for the wavelengths the sensor has emitted into the area.
    If you are highly reflective areas(lots of glass, mirrors, shiny metal, amount of direct sunlight) that is going to affect how the IR gets bounced back into the sensor. This also applies to materials that absorb IR.
    The only things you can do is determine how the IR data looks using IR basics and if you are seeing a lot of pure black and bright white that is going to affect what depth can be detected in those areas.
    Carmine Sirignano - MSFT

  • Inquire about the best laptop specifications for Developing Windows Apps and 3D modelling Animation using "Kinect for Windows v2"?

    I need some help in choosing laptop that is most compatible with "Kinect for Windows v2"; in order to develop Windows Apps, and 3D modelling Animation and Character Design. Which is better (Specifications):
    HP Pavilion Notebook PC 15-p150ne 
    AMD A10-5745M +
    AMD Radeon R7 M260 (2 GB DDR3L dedicated) +
    4 GB 1333 MHz DDR3, OR
    HP Pavilion Notebook PC 15-p034ne 
    Intel Core i5-4210U + NVIDIA GeForce 840M (2 GB DDR3 dedicated) + 4 GB 1600 MHz DDR3L

    The second system with the Intel chipset will more than likely have the Intel USB3 chipset required for Kinect. As for GPU they are similar, but the i5 with DDR3 1600MHZ ram is a better option. Keep in mind, if you are doing anything in-depth for
    3D, a laptop isn't the best options, but if you have to go mobile then you have to decide what is best for your requirements.
    Carmine Sirignano - MSFT

  • My iphone doesn't conect with my computer. He says you can't use it you softwear is not up to date please uninstall itunes and install itunes for windows 64bit. I do that but it doesn't work. So what can i do?

    my iphone doesn't conect with my computer. He says you can't use it you softwear is not up to date please uninstall itunes and install itunes for windows 64bit. I do that but it doesn't work. So what can i do?

    It won't pass 10.3.
    What does this mean?
    I figured it out. Thanks!!!
    What did you figure out? How about posting how you resolved it?

  • Kinect for windows v2 SDK and v1 sensors

    Before upgrading to win 8 to utilize the Kinect for Windows SDK 2.0  I want to know if it is backwardly compatible with the v1 of the sensors.
    Thanks

    There are technical ways of doing it but requires that you create your own separate .dll's that will wrap the v1 and v2 libraries in their own wrapper so the namespace collisions don't occur. Then you use your .dll within your application. I have a snippet
    of code of how to do this in my GitHub account:https://github.com/carmines/workshop/tree/master/WPF/KinectV2andV1
    Then there are the image resolution and camera intrinsic values you need to concern yourself with if you intend to try and mix the values together.
    Carmine Sirignano - MSFT

  • Kinect for windows sensor does not start when using remote WMI

    Scenario:
    I have written a software (lets call it kinectRecorder.exe) that uses "kinect for windows sensor" to record images. The machine that connects to the kinect sensor has windows 8.1 and kinect v2 installed. The software is able to successfully records
    images from kinect sensor when running locally. (meaning if I hit f5 from vs2013, frames are recorded to local disk)
    Due to resource constraint and other requirement, I have to remotely kickoff kinectRecorder.exe on the windows 8.1 machine from a windows 7 machine. on the windows 7 machine, I remotely kick off the kinectRecorder.exe using windows WMI infrastructure. 
    The credential used for windows 8.1 machine and windows 7 machine are the same under same windows domain. the credential used to authenticate in wmi is also the same, I can see the user name running kinectRecorder.exe after kinectrecorder.exe is started
    remotely. 
    Problem:
    The result is that kinectRecorder.exe starts ok, but after the kinectsensor.open call, isavailable property changed to false, meaning sensor not detected. 
    Question:
    What's stopping kinect sensor to be detected/opened (i'm not sure what the correct jargon is here)?
    I have been search the web, In msdn documentation (known issues),  I cannot find the problem being mentioned. I wonder if I'm the only person who has encountered this issue before. 
    Any pointer is hugely appreciated. 

    Kinect is not supported within the context of a service because of the underlying need for a user session, see
    https://social.msdn.microsoft.com/Forums/en-US/72cecf8b-ac64-47e2-b54b-ddbd1dc237c9/calling-kinect-sdk-apis-from-a-windows-service-is-not-possiblesupported?forum=kinectv2sdk
    Can determine that the system has at least one logged in user and can you launch the application within that users session? KinectMontior/KinectService must be running for the runtime to get any data from the sensor. If you use Remote
    Desktop to log into that user session, you can confirm this works by running any of the samples and they should work without issue(remember to ensure that your audio remoting is left on the server, see troubleshooting guide
    https://social.msdn.microsoft.com/Forums/en-US/20dbadae-dcee-406a-b66f-a182d76cea3b/troubleshooting-and-common-issues-guide?forum=kinectv2sdk).
    Carmine Sirignano - MSFT

  • Maximum number of Kinect for Windows v2 Cameras on one PC?

    There is a question about the previous iteration of the Microsoft Kinect for Windows (no longer on sale) here: https://social.msdn.microsoft.com/Forums/en-US/63c7c52e-1290-452e-8e04-74330822d16f/maximum-number-of-kinect-cameras-on-one-pc?forum=kinectsdk.
    How many Kinect for Windows v2 sensors can be used on a single PC? And if this is limited to 1, is this a software, or a hardware restriction?

    Are there plans for this to change, or be lifted?
    No.  No product roadmap anyway.
    The reasoning requires you to look at it from an engineering standpoint.  The Kinect uses a lot (more than half) of the available bus bandwidth to operate normally.  So even though you could physically connect two or more sensors, there is no feasible
    way to have them both sustain enough of a data rate for them to operate normally using the existing hardware.
    I'm no hardware expert, but from what I have been told, the solution is harder than just having multiple USB 3.0 controllers in the same PC.
    As for "plans for this to change", rest assured that people want this, and that there are clever engineers thinking about solutions, but due to technical limitations, there is no product roadmap yet that allows for multiple kinects sensors on a
    single PC.  And because of the technological limitations, it will never just be "lifted".  The hardware needs to change for this to work.
    Another thing to consider is that, from a physics standpoint, Kinects
    do interfere with each other (slightly) when operating in the same space.  It's not at all dissimilar from two people trying to have a conversation in the same room -- some words of the conversation will be missed.  The more people in the
    room, the more difficult it is to hear one another.  For the Kinect, the quality of the depth results, for example, is diminished by having two kinects operating in the same space, but the visible light cameras continue to operate unimpeded.  The
    sensor is cleverly designed to "tolerate" the light patterns from other kinects, but they can't completely ignore those patterns and conflicts do occur --  so it
    does degrade slightly with noise from each additional sensor.  It's using invisible light, so the problem tends to be "out of sight, out of mind" for us as users.  But at some (modest) limit, it becomes mathematically impossible
    to multiplex the light patterns from additional Kinects using the current specs (somewhere around 16 kinects based on the patterns, IIRC).
    So there are other physical and technological hurdles to overcome with operating multiple Kinects in the same space, even if they were all connected to different PCs connected in a network cluster or something like that.

  • Does Kinect for Windows V2 provide facial recognition API? Thanks

    Does Kinect for Windows V2 provide facial recognition API? Thanks

    For facial recognition with the Kinect, you can use the Developer Toolkit (v1.5.1). The API for the FaceTracking tools can be found
    here: http://msdn.microsoft.com/en-us/library/jj130970.aspx.
    You can also refer: How
    To: Kinect for Windows SDK Face Recognition Series
    Facial Recognition with Kinect
    Kinect
    for Windows: SDK and Runtime version 1.5 Released
    As mentioned in the article: Kinect for Windows:
    Frequently asked questions
    Does Kinect for Windows SDK offer facial recognition capabilities?
    Since version 1.5, the Kinect for Windows SDK and toolkit have supported real-time face tracking. Face tracking is not intended for facial recognition or identification. Face tracking detects and tracks the positions and orientations of faces in real time and
    provides animated three-dimensional (3D) meshes that are positioned in 3D over the Kinect depth sensor data. Face tracking can animate, in real time, eyebrow positions and mouth shape, as well as provide a high-resolution 3D mesh of the face than can be animated.
    With the SDK 2.0, Kinect can also track whether eyes are open or closed, the position of the nose, facial expressions, and the direction the face is pointing. The resolution of the tracked face has been increased by 20 times with a 1,360-point mesh, so that
    faces look more realistic. Conventional face-recognition algorithms can be used with the Kinect for Windows sensor’s RGB stream; we continue to investigate how the Kinect for Windows sensor's extra capabilities can be used.
    For more details you can Ask a Question @ Kinect
    for Windows v2 SDK
    Rachit
    Please mark as answer or vote as helpful if my reply does

  • Where can I download example projects for Kinect for Windows v2?

    so for a project I am working on regarding the Kinect v2 I had initially planned on using Matlab to code for the Kinect. However, the code on the Mathworks website regarding the Kinect seems to only work with the Kinect v1 and I cannot figure out how to
    get the v2 to work with Matlab. Now I am in the predicament that I need to use Visual Studio and have never done so before. To make matters worse, all of the guides I can find about programming for the Kinect assume you are very familiar with Visual Studio
    so I get lost before I can even get through the setup (I have no idea what kind of project is best for Kinect, though I intend to use C# as my programming language, or where these settings they are changing are located). If I could just find an example project
    file to download I feel like it would help me a lot, but I cannot seem to find one.
    So my question is thus, is there a place where we can download project files for Visual Studio? I really just need to see what one looks like and what kind of settings it runs on so I know where to get started. It would be awesome if the project file involved
    overlaying the skeletal model on top of people in real time as well.
    If this is not possible, even a video that explains in depth how to go about using visual studio and the Kinect at the same time would be greatly appreciate, or a workaround to get Matlab to work with the Kinect v2.

    Hi Jicnon,
    When you download and install the Kinect SDK, it comes with the Kinect SDK Browser application. This applicaiton is a web based application that contains a bunch of sample projects for getting started with Kinect for windows programming.
    There is also the jumpstart videos here:
    https://social.msdn.microsoft.com/Forums/en-US/8428671a-781c-4850-a56d-905ab28f8f8f/mva-jump-start-programming-kinect-for-windows-v2-videos?forum=kinectv2sdk
    To get to the SDK Browswer app just hit the windows button type in "Kinect SDK" and this application should appear.
    There are also some samples in Kinect Common Bridge and a dicussion on using Matlab here:
    https://social.msdn.microsoft.com/Forums/en-US/2aa59712-c2ab-48e2-98bd-5eed9a40ec44/matlab-link?forum=kinectv2sdk
    Sr. Enterprise Architect | Trainer | Consultant | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer |blog: http://dgoins.wordpress.com

  • Satellite A305 S6872 audio driver for windows 7

    hello,
    i am facing some problem with my microphone. my microphone is not working and sound from the speaker is working well.  it was working some days before but now i m facing some problem. i m not heard to whom i call. i checked and tested the microphone but it doesnt take any sound.
    plz help this problem ASAP.

    Satellite A305-S6872
    Won't hurt to reinstall the driver. There are three listed for your model. The first two have the same version and release date, but the file size is different. Try them all.
       Realtek Audio Driver for Windows 7 (32/64) (Version 6.0.1.5904 - Released 09/04/09)
       Realtek Audio Driver for Windows 7 (32/64) (Version 6.0.1.5904 - Released 09/04/09)
       Realtek Audio Driver for Windows 7 (32bit/64bit) (Version 6.0.1.5859 - Released 07/13/09)
    -Jerry

  • Kinect for Windows v2 cannot reliably remain online for prolonged periods

    We are developing a .NET 4.5 app that records Kinect frame streams to a huge disk array, 24/7. However, it appears that a vanilla installation of the Kinect cannot remain online for prolonged periods. After a day or so, frames simply stop arriving for no
    apparent reason. There is nothing in the Windows Events Viewer that seems related; Device Manager also does not show any problem for the Kinect devices.
    Could somebody look into this issue?
    We have just disables power management on the whole chain of hardware (PCI express -> USB 3.0 controller -> Kinect) and will see if it helps.

    Are you using any custom code to write the Kinect Frames to disk? or are you using Kinect Studio?
    If using your own custom code, check to make sure you're releasing all frames (Disposing them) appropiately. Not doing so, even in the most subtle way could easily cause this behavior.
    Sr. Enterprise Architect | Trainer | Consultant | MCT | MCSD | MCPD | SharePoint TS | MS Virtual TS |Windows 8 App Store Developer | Linux Gentoo Geek | Raspberry Pi Owner | Micro .Net Developer | Kinect For Windows Device Developer |blog: http://dgoins.wordpress.com

  • I want to read the values of the inside accelerometer on Kinect for Windows v2 sensor.

    I had used the inside accelorometer on Kinect for Windows v1. So I want to use it for Kinect for Windows v2 application. However I can't find any function or method on Kinect for Windows SDK v2.0. But it is near the Ir camera of K4W v2. I found the Kionix
    chip. Do you have any plan to access this chip? 

    I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
    http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
    Align the y-axis to gravity
    –Tilt correct with
    FloorClipPlane.xyz
    •Falls back to accelerometer when no floor is found
    •Rotate
    scene such that “up” is (0,1,0)
    So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?    

  • Finding the XYZ real world coordinates of the Kinect for Windows V2

    Hi Everyone;
    I am new to Kinect development and this might be sort of a basic question but I searched online and still confused about the matter.
    So I have a depth image that I obtained from the Kinect for windows V2 and through some algorithm that I developed on MATLAB, I was able to output the Z distance in mm.
    So now I want to have the X,Y real world coordinates as well. 
    So to do that I am using the following equations that I found for the old system:
     x_world = (x_screen - c_x) * B/f_x;
     y_world = (y_screen - c_y) * B/f_y;
    where x_screen is the midpoint of the IR camera ( I am using the IR stream=512/2=256) and the y_screen (424/2=412)
    B is my distance in Zmm
    F_x and F_y is the focal length of the lens in x n y direction that I obtained through my own calibration.
    So am I doing it correctly?
    Is there any way I can use to double check the results I am getting?
    Thanks;
    Ali

    You can use the coordinate mapper as this will take into account the camera intrinsics:
    http://msdn.microsoft.com/en-us/library/microsoft.kinect.kinect.icoordinatemapper.mapdepthpointstocameraspace.aspx
    http://msdn.microsoft.com/en-us/library/windowspreview.kinect.coordinatemapper.mapdepthframetocameraspace.aspx
    Carmine Sirignano - MSFT

  • Support on Kinect for Windows V2

    We’ve purchased Kinect Windows V2 and we are trying to find x,y,z real co-ordinates of a point.
    The method given in the sample guide is 'MapcolourframetoCameraspace'. This method takes the argument
    Array<CameraSpacePoint>^ cameraSpacePoints
    What is the meaning of this argument, especially the ‘^’ sign?

    I just went through the slides of "Programming Kinect for Windows v2 Jump Start" of the MS Virtual Academy, and in slide #11 of slide deck #07 (Advanced Topics: Skeletal Tracking and Depth Filtering,
    http://www.microsoftvirtualacademy.com/training-courses/programming-kinect-for-windows-v2-jump-start), it says:
    Align the y-axis to gravity
    –Tilt correct with
    FloorClipPlane.xyz
    •Falls back to accelerometer when no floor is found
    •Rotate
    scene such that “up” is (0,1,0)
    So, just to make sure I understand, you are saying that the information provided in the slide deck (and in the video) is erroneous and we cannot access the accelerometer info?    

  • Kinect for Windows V2 Device cannot start

    I was able to use my Kinect for Windows V2 sensor yesterday with all of the applications in the SDK browser but the next day after restarting my computer I was no longer able to use the device. Looking at the device manager I get this message under the properties
    for WDF KinectSensor Interface 0 (the only device listed under Kinect sensor devices):
    This device cannot start. (Code 10)
    {Operation Failed}
    The requested operation was unsuccessful.
    I'm plugged into a USB 3.0 input. Any ideas?

    I encounter the exact same issue:
    WDF KinectSensor Interface 0
    This device cannot start. (Code 10)
    {Operation Failed}
    The requested operation was unsuccessful.
    I'm using an Intel 4ghz i7 processor plugged into an ASUS Sabertooth Mk1 Z97 Motherboard. The ASMedia on the board had some issues, so i'm using a USB 3.0 PCI/E card by Manhatten. Diagnostics indicates that everything but depth checks out. Depth fails because
    the camera reports all black.
    This is particularly frustrating since I built this computer to offer USB 3.0 support specifically so I could do work with Kinect and Unity. This was before I knew the issues Kinect has with ASMedia, so for me this has been a significant investment for a
    black screen.
    Edit: To clarify, the Kinect is plugged into the PCI/E card (Manhatten 150491) and not into the board or a case slot.
    Additonal note: The Kinect does not function properly plugged into my old PC (a USB 2.0 with an i7) or into my Surface Pro (1st gen)
    - Matt Eland

Maybe you are looking for

  • How do you add 7 chords to smart guitar chord patterns

    Trying to create a song with G7 chords.  How do you add the V7 chord in the chord patterns on the smart guitar in GB iPad?

  • Find ths format of an image

    Hi, I'm actually triing to create an Java (JSP/Servlet) web-app witch di that : Read a temp file (per example Lds2456.tmp) witch is an image, but the suffix do not say the format of the image (it's ".tmp", NOT ".jgp", ".gif",....). I would use javax.

  • Access GW mail account with SOAP?

    I will need to be able to bypass the browser and GW email program in order to access a GW mail account. Is SOAP how I would do this? I really don't know what I'm doing, yet, so any help would be appreciated. Thanks

  • IPad 1 and HDMI out

    Does HDMI out also mirror iPad 1? It fully mirrors iPad 2, but does it for 1? I'm thinking about getting it.

  • HAL is not automounting

    I have hal in my daemons array in rc.conf and it starts up properly but when I connect a device to my system, HAL does not automount it. what is the problem?