Using TDM VI in Lv 7.1 to stream data to disk

I found the TDM VI and the structure of the data is very interesting for my application.
I try to use it to stream an array of waveform data but the TDM VI goes very slow.
after that, I see in the documentation that TDM file can't support streaming to disk, but I think it's really a basic function.
futhermore,the TDM VI write binary data, so normally it must work !.
is there another possibily with TDM file to stream data to disk ?
Thanks in advance for your help.
GHELEYNS Nicolas
Phénix Industries s.a.

Hi,
The LabVIEW Storage VIs do not yet support streaming data to disk. However, you can benefit from the storage VIs structured approach to saving data by:
Streaming data to disk using standard binary write VIs
Reading data back in and writing it back out to disk using the storage VIs after acquisition
Deleting the original binary file
Although there is the extra step of writing data to an intermediate binary file, you benefit because you can structure your data and save it with the descriptive properties that the storage VIs offer.
Regards.
JorisV

Similar Messages

Streaming data from disk to analog output (using the PCI-6713)

I have a question about the PCI-6713. I want to stream data from the hard disk to all of the card's 8 outputs at its maximum update rate of 1 MS/s. Using single precision (32-bit) variables, this works out to a 32 MB/s transfer rate. That seems to be pushing the limits of most hard disks.
However, the output card only has 12-bit resolution. Is there a way - using LabView or some other software - to store the data on the disk using only 12-bit numbers? This would drastically decrease the transfer rate required.
Thanks for your help.

You could use 8 or 16 bit integers in LabVIEW rather than using 32-bit single precision numbers. I'm sure integers don't have the precision you're wanting though. That is the only way to reduce the size of the numbers you are writing. I am fairly positive there is no way in LabVIEW to do what you are wanting.
Regards,
Todd D.

How can I optimally stream data to disk at 5 MS/s on 4 channels using a PCI-6110?

I am using a PCI-6110 to acquire data streaming from a camera. Data arrives on all four analog input channels at 5 MHz. An A2D clock is attached to PFI8, also originating from the camera and operating at 5 MHz. Finally, there is a Valid-data signal from the camera that signals when the data stream coming in on the four analog channels is actual data (each Validate pulse is about 132 samples wide). This is attached to PFI0. Ideally, I would like to have a program that captures data at the full rate and is correctly synchronized with the Valid-data line. It should also be able to stream to disk for several seconds at least before pausing for the buffer.
Though I'm something of an inexper
ienced programmer, I have attempted programs both in LabView and C (using DAQmx) to resolve this, but I have experienced much slower behavior than I'd like. In LabView, this seems to be the result of slow streaming to disk, such that I have to pause and reset the task every frame (132x512 samples per channel). Using DAQmx in C, I have found it necessary to restart the task after every line (132 samples per channel) in order to correctly trigger from the Validata pulse. Both are far from optimal. I would appreciate any advice that those of you with more experience reading at very high rates from this card may have to offer.
Thanks,
Steven Israel
Duke University

I'm not sure if I fully understand your application, but maybe some of these hints will help.
First your streaming to disk rate is going to vary widely depending on your system. Sometimes using a faster processor helps, but most of the time using a faster hard drive will give you the best performance increase.
Second, writing less data will often have a dramatic impact in streaming to disk applications. If you're reading back scaled data, I would strongly recommend switching to unscaled or raw reads and storing off the scaling constants so you can scale the data off line. This could reduce the required streaming to disk bandwidth by a factor of 4 alone.
Third, since the 6110 is a 12 bit device, you can try compressing two 12 bit samples into one 24 b
it piece of data. This will allow you to store in three bytes what used to take four.
Last, you might consider using your signal on PFI0 as a pause trigger. Depending on the frequency of the pulses on your Valid-data signal, this could significantly reduce the required bandwidth of both the PCI bus and your hard drive. However, since the 6110 uses pipelined ADCs, you need to be careful if the time between valid data pulses is greater than one millisecond. This would violate the minimum sampling frequency of the board and the points in the pipeline that are returned after unpausing (3 in this case) might not be digitized at the full accuracy specification for the device. Because of the pipelining, you also need to be careful how you correlate the data. The first time you unpause for the Valid-data pulse, the first three points will be garbage points. The second and subsequent times you unpause, the first three points are really the last three points from the previous Valid-dat
a pulse. See the Device Considerations->Timing chapter in the NI-DAQmx Help file for more information on timing considerations with pipelined ADCs.
I hope this information helps. Good luck!

Q: Re: Q: Acquiring data using two E series devices connected by RTSI and streaming data to disk

<< (My first posting)
I use two E series PCI Cards, connected by RTSI. I'd like to stream the data
from both cards to a binary file and to add a header to it.
I also need to somehow read (plot) the stored data, this with another VI.
The whole should be then integrated into an existing program, that used just
one acquisition card.
Till now I have tried to combine "Two E-series Shared ScanClk.vi" and "High
Speed Data Logger.vi" into another VI, and I have tried to read the stored
data with the "High Speed Data Reader.vi". The problem is that I fight with
one error after another, what prevents me from going further.
I use LabView 6.1, under Windows 2K.
Has somebody by chance already done something similar and would agree to
share with me their experience? TIA for any suggestion.
Regards,
Victor Manta
>>
"Ben" wrote in message
news:[email protected]...
> Hi Victor,
>
> I have done a lot of similar work.
>
> Exactly what did you try and what specific errors did you encounter?
>
> What you are trying is do-able provided the hardware you have suuports
> it.
>
> Please post (both here and to the DAQ group)
> the details of the hardware you are using,
> versions of software being used,
> Examples that you are using,
> error codes that occured,
> posibly post example code showing the problem.
>
> Ben
Hi Ben,
I use two PCI-MIO-16E-1 cards, connected by RTSI. I'd like to stream the
data from both cards in real time to a binary file, after having added a
header to it.
For tests, on the channel 0 of each card is applied the same square wave,
100 Hz.
Yes, the hardware support RTSI. I use LabView 6.1.
Till now I have:
1. Combined the "Two E-series Shared ScanClk.vi" and the "High
Speed Data Logger.vi" into a DAQ VI. To do this, I have "doubled" and
adapted the "High Speed Data Logger.vi". For testing purposes the data are
stored in two files, always the same ones (the old ones being overwritten
after each acquisition).
2. "Doubled" and adapted "High Speed Data Reader.vi" into another VI, for
reading from both files, mentioned earlier.
What already works:
- The headers for both files are correctly stored (VI point 1.)
- The acquired data from the first card (device 1) are correctly stored (VI
point 1.)
- The VI (point 2.) that reads both files and displays the results works
What doesn't work:
- The acquired data from the second card aren't stored at all (VI point 1.)
- An error message says: "Error -10608 occurred at AI Buffer Read. Possible
reason: NI-DAQ LV: No transfer is in progress for the specified resource."
I think that I understand this message, but I don't know how to continue.
The DAQ VI can be downloaded from (please click the link, then the link on
that page; about 100K, zipped):
http://www.swissheartnet.unibe.ch/labview.htm
Thanks a lot in advance.
Regards,
Victor Manta
PS. I don't know which DAQ group you mean.

"Filipe A." wrote in message
news:[email protected]...
> Victor;
>
> You can definitely accomplish that task with the DAQ boards you have
> and Labview.
>
> It would be good if you could be more specific as far as what type of
> errors you are seeing and how you are integrating both VIs.
>
> Regards
> Filipe A.
> Applications Engineer
> National Instruments
Maybe Mr. Filipe A. could help me? Please see below, and TIA.
Regards,
Victor Manta
"Victor Manta" wrote in message
news:[email protected]...
> << (My first posting)
> I use two E series PCI Cards, connected by RTSI. I'd like to stream the
data
> from both cards to a binary file and to add a header to it.
>
> I also need to somehow read (plot) the stored data, this with another VI.
>
> The whole should be then integrated into an existing program, that used
just
> one acquisition card.
>
> Till now I have tried to combine "Two E-series Shared ScanClk.vi" and
"High
> Speed Data Logger.vi" into another VI, and I have tried to read the stored
> data with the "High Speed Data Reader.vi". The problem is that I fight
with
> one error after another, what prevents me from going further.
>
> I use LabView 6.1, under Windows 2K.
>
> Has somebody by chance already done something similar and would agree to
> share with me their experience? TIA for any suggestion.
>
> Regards,
> Victor Manta
> >>
>
> "Ben" wrote in message
> news:[email protected]...
> > Hi Victor,
> >
> > I have done a lot of similar work.
> >
> > Exactly what did you try and what specific errors did you encounter?
> >
> > What you are trying is do-able provided the hardware you have suuports
> > it.
> >
> > Please post (both here and to the DAQ group)
> > the details of the hardware you are using,
> > versions of software being used,
> > Examples that you are using,
> > error codes that occured,
> > posibly post example code showing the problem.
> >
> > Ben
>
> Hi Ben,
>
> I use two PCI-MIO-16E-1 cards, connected by RTSI. I'd like to stream the
> data from both cards in real time to a binary file, after having added a
> header to it.
>
> For tests, on the channel 0 of each card is applied the same square wave,
> 100 Hz.
>
> Yes, the hardware support RTSI. I use LabView 6.1.
>
> Till now I have:
>
> 1. Combined the "Two E-series Shared ScanClk.vi" and the "High
> Speed Data Logger.vi" into a DAQ VI. To do this, I have "doubled" and
> adapted the "High Speed Data Logger.vi". For testing purposes the data are
> stored in two files, always the same ones (the old ones being overwritten
> after each acquisition).
>
> 2. "Doubled" and adapted "High Speed Data Reader.vi" into another VI, for
> reading from both files, mentioned earlier.
>
> What already works:
>
> - The headers for both files are correctly stored (VI point 1.)
> - The acquired data from the first card (device 1) are correctly stored
(VI
> point 1.)
> - The VI (point 2.) that reads both files and displays the results works
>
> What doesn't work:
>
> - The acquired data from the second card aren't stored at all (VI point
1.)
> - An error message says: "Error -10608 occurred at AI Buffer Read.
Possible
> reason: NI-DAQ LV: No transfer is in progress for the specified resource."
>
> I think that I understand this message, but I don't know how to continue.
>
> The DAQ VI can be downloaded from (please click the link, then the link on
> that page; about 100K, zipped):
>
> http://www.swissheartnet.unibe.ch/labview.htm
>
> Thanks a lot in advance.
>
> Regards,
>
> Victor Manta
>
> PS. I don't know which DAQ group you mean.

Q: Acquiring data using two E series devices connected by RTSI and streaming data to disk

I use two E series PCI Cards, connected by RTSI. I'd like to stream the data
from both cards to a binary file and to add a header to it.
I also need to somehow read (plot) the stored data, this with another VI.
The whole should be then integrated into an existing program, that used just
one acquisition card.
Till now I have tried to combine "Two E-series Shared ScanClk.vi" and "High
Speed Data Logger.vi" into another VI, and I have tried to read the stored
data with the "High Speed Data Reader.vi". The problem is that I fight with
one error after another, what prevents me from going further.
I use LabView 6.1, under Windows 2K.
Has somebody by chance already done something simi
lar and would agree to
share with me their experience? TIA for any suggestion.
Regards,
Victor Manta

<< (My first posting)
I use two E series PCI Cards, connected by RTSI. I'd like to stream the data
from both cards to a binary file and to add a header to it.
I also need to somehow read (plot) the stored data, this with another VI.
The whole should be then integrated into an existing program, that used just
one acquisition card.
Till now I have tried to combine "Two E-series Shared ScanClk.vi" and "High
Speed Data Logger.vi" into another VI, and I have tried to read the stored
data with the "High Speed Data Reader.vi". The problem is that I fight with
one error after another, what prevents me from going further.
I use LabView 6.1, under Windows 2K.
Has somebody by chance already done something similar and would agree to
share with me their experience? TIA for any suggestion.
Regards,
Victor Manta
>>
"Ben" wrote in message
news:[email protected]...
> Hi Victor,
>
> I have done a lot of similar work.
>
> Exactly what did you try and what specific errors did you encounter?
>
> What you are trying is do-able provided the hardware you have suuports
> it.
>
> Please post (both here and to the DAQ group)
> the details of the hardware you are using,
> versions of software being used,
> Examples that you are using,
> error codes that occured,
> posibly post example code showing the problem.
>
> Ben
Hi Ben,
I use two PCI-MIO-16E-1 cards, connected by RTSI. I'd like to stream the
data from both cards in real time to a binary file, after having added a
header to it.
For tests, on the channel 0 of each card is applied the same square wave,
100 Hz.
Yes, the hardware support RTSI. I use LabView 6.1.
Till now I have:
1. Combined the "Two E-series Shared ScanClk.vi" and the "High
Speed Data Logger.vi" into a DAQ VI. To do this, I have "doubled" and
adapted the "High Speed Data Logger.vi". For testing purposes the data are
stored in two files, always the same ones (the old ones being overwritten
after each acquisition).
2. "Doubled" and adapted "High Speed Data Reader.vi" into another VI, for
reading from both files, mentioned earlier.
What already works:
- The headers for both files are correctly stored (VI point 1.)
- The acquired data from the first card (device 1) are correctly stored (VI
point 1.)
- The VI (point 2.) that reads both files and displays the results works
What doesn't work:
- The acquired data from the second card aren't stored at all (VI point 1.)
- An error message says: "Error -10608 occurred at AI Buffer Read. Possible
reason: NI-DAQ LV: No transfer is in progress for the specified resource."
I think that I understand this message, but I don't know how to continue.
The DAQ VI can be downloaded from (please click the link, then the link on
that page; about 100K, zipped):
http://www.swissheartnet.unibe.ch/labview.htm
Thanks a lot in advance.
Regards,
Victor Manta
PS. I don't know which DAQ group you mean.

Data Upload using TDMS

Hi,
We are using TDMS for transferring the data and for scrambling as well and we need to explore if TDMS can be used for Data upload from SAP to SAP. If yes, how this can be acheived using which TDMS functionality.
Also, how can TDMS be integrated with SAP BODS tool?
Thanks and best regards,

Hello Amr,
TDMS can't be used for data upload.
Thanks
Anita

Error 6210 using TDMS C DLL

Hi,
I am trying to read a TDMS file using TDMS C DLL in visual studio 2012. I am getting the following error message. Error 6210 : The file passed to library is read only and cannot be modified, when I try to open the file using DDC_Openfile.The program I used is TDMSTesting.zip downloaded from this link
http://forums.ni.com/t5/LabWindows-CVI/TDMS-DLL/td-p/792269
The sample code given in the Zip file is properly running with the testtdms.tdms available in the file but I am getting the error 6210 with any other tdms files generated from labview.
It would be of great help if anyone could help me to resolve this and I have attached the sample tdms file which I used to run the code.
Thank you
Padma Priya

If you want to export to tdms
pszFileName = "C:\out.tdms"
use "TDMS" as file type.
If you want to export TDM
pszFileName = "C:\out.tdm"
use "TDM".
If you are looking for a simple way to export to tdm
http://zone.ni.com/devzone/cda/tut/p/id/2824
may be a solution for you. It has the capability to
write a tdm header to an existing binary file given in
a specified format (one header/one dll but TDM export only).
P.S.: What error code did you get?
Did a logfile appear?
What do you mean by DIAdem error?

How to deploy and use TDMS for ECC

Hello All,
We have a requirement of doing the system refresh from our production database using TDMS.
Please suggest how to use and deploy this tool
I am very new to it
Rohit Goyal

Hi,
check SAP Note 1003051 - TDMS 3.0 corrections - Composite SAP Note
Also, check master and operation guide on https://websmp107.sap-ag.de/~form/sapnet?_SCENARIO=01100035870000000202&_SHORTKEY=01100035870000689101
For this you have to first decided which will be your receiver, sender and control/central system. Then you have to install TDMS add-on's on all participating system. Then you can execute transaction CNV_MBT_TDMS to start data transfer from central/control system.
This is very high level. I will suggest you to go through the guides.
Thanks
Sunny

Logging Data using TDMS

Hey peope of the world, I have a question about how to use the TDMS write function. I have never used this form of file I/O and even still I'm not very good at even using write to spreadhseet functions. My attached project is based of the continuous measurement and logging template, and I know that they use TDMS in their program. My only issue is I dont quite understand what all theyre doing and quite frankly I dont believe my program requires such detail in the logging loop. I have a logging loop setup with a open/write/close TDMS functions connected, but I'm pretty positive im doing it wrong. Any suggestions/feedback would be greatly appreciated, thank you!!!
Attachments:
DC Motor Dyno Test.zip ‏501 KB

When you open a log from that test can you tell me when the log was started? When was it stopped? What computer was it ran on? What user was logged in when it ran? What is the time between samples, or sample rate? Did the test end due to an error? Or what was the test end reason? What was the settings to the test? Meaning what was the selected current, voltage, or loads? What was the UUT type? What was the UUT serial number? And I just realized what is the name of the data you recorded?
TDMS allows for properties to be set, which can be like meta data. Information about the data that can help you understand more about how the data was taken. This information is very useful in helping to understand an event that likely took place when someone wasn't around to see what happened.
To set properties use the TDMS Set Properties. If you give no group or channel name then the property is set on the file which will probably be fine for all the settings I mentioned.
Another thing is I highly recommend giving a Group name and Channel name to the data being logged. I actually thought the write VI had these terminals as required. Without it I have no idea what the data even is. Is it a pressure sensor? Is it in Voltage, or Current? Is it RPM? Is it Analog 0 or Analog 1? These types of things can be better understood with a channel name, and properties of the channel.
Oh and if your index file is too big at the end (it should be on the order of a few kb) then use a TDMS defrag on the file after the close to save space.
Unofficial Forum Rules and Guidelines - Hooovahh - LabVIEW Overlord
If 10 out of 10 experts in any field say something is bad, you should probably take their opinion seriously.

Using TDMS to create an HR only client?

Hi Everyone,
Just wanted to ask the question as to whether anyone has created an HR only client using TDMS? Was it done successfully? How long did the process take and were there many complications with it?
We have never done it before but may potentially do it, so wanted to gauge opinions.
Thanks.
Kevin.

Moving this discussion to the Creative Suite Enterprise Deployment forum.

How Do I Use One PC (Windows) To Run iCloud Photo Stream for Two Users?

How Do I Use One PC (Windows) To Run iCloud Photo Stream for Two Users? I and my wife have two Iphones (iOS 6.1.4) and we want to have use 2 iCloud accounts for one PC.

Disregard the question. The solution has nothing to do with any "Firefox bug". Turns out that my session wasn't being managed properly. Or rather, I was accidentally deleting other users' information when new users logged in. So if I had user 1 and user 2, and user 2 logged in after user 1, some of user 1's information would be deleted, resulting in the errors.
Oops; sorry about the false alarm. :)
(Was hoping to retract the question, but it looks like others have a similar problem.)

Need help to join two tables using three joins, one of which is a (between) date range.

I am trying to develop a query in MS Access 2010 to join two tables using three joins, one of which is a (between) date range. The tables are contained in Access. The reason
the tables are contained in access because they are imported from different ODBC warehouses and the data is formatted for uniformity. I believe this cannot be developed using MS Visual Query Designer. I think writing a query in SQL would be suiting this project.
ABCPART links to XYZPART. ABCSERIAL links to XYZSERIAL. ABCDATE links to (between) XYZDATE1 and ZYZDATE2.
[ABCTABLE]
ABCORDER
ABCPART
ABCSERIAL
ABCDATE
[ZYXTABLE]
XYZORDER
XYZPART
XYZSERIAL
XYZDATE1
XYZDATE2

Thank you for the looking at the post. The actual table names are rather ambiguous. I renamed them so it would make more sense. I will explain more and give the actual names. What I do not have is the actual data in the table. That is something I don't have
on this computer. There are no "Null" fields in either of the tables.
This table has many orders (MSORDER) that need to match one order (GLORDER) in GLORDR. This is based on MSPART joined to GLPART, MSSERIAL joined to GLSERIAL, and MSOPNDATE joined if it falls between GLSTARTDATE and GLENDDATE.
[MSORDR]
MSORDER
MSPART
MSSERIAL
MSOPNDATE
11111111
4444444
55555
2/4/2015
22222222
6666666
11111
1/6/2015
33333333
6666666
11111
3/5/2015
This table has one order for every part number and every serial number.
[GLORDR]
GLORDER
GLPART
GLSERIAL
GLSTARTDATE
GLENDDATE
ABC11111
444444
55555
1/2/2015
4/4/2015
ABC22222
666666
11111
1/5/2015
4/10/2015
AAA11111
555555
22222
3/2/2015
4/10/2015
Post Query table
GLORDER
MSORDER
GLSTARTDATE
GLENDDATE
MSOPNDATE
ABC11111
11111111
1/2/2015
4/4/2015
2/4/2015
ABC22222
22222222
1/5/2015
4/10/2015
1/6/2015
ABC22222
33333333
1/5/2015
4/10/2015
3/5/2015
This is the SQL minus the between date join.
SELECT GLORDR.GLORDER, MSORDR.MSORDER, GLORDR.GLSTARTDATE, GLORDR.GLENDDATE, MSORDR.MSOPNDATE
FROM GLORDR INNER JOIN MSORDR ON (GLORDR.GLSERIAL = MSORDR.MSSERIAL) AND (GLORDR.GLPART = MSORDR.MSPART);

How do I use my I cloud account to save all my data no my device? I purchase $ 100 dollars deal because my phone memory was almost full.

How do I use my I cloud account to save all my data no my device? I purchase $ 100 dollars deal because my phone memory was almost full.

If you're asking if there is a way to add memory to your device, there isn't. iOS devices have a fixed capacity that can't be expanded by using expansion cards or other hardware solutions.
If you're running out of capacity on your devices, the only solution is to store less on your phone. You can import your photos and videos to your computer as explained here: http://support.apple.com/kb/HT4083, then delete it from your device. If you still want some of the photos on your device, put them in a folder on your computer then select the folder on the Photos tab of your iTunes sync settings and sync your device.
You can also sync only some of your music to your device rather than your entire library, or subscribe to iTunes Match and stream it from iCloud. You can also not keep as many movies, tv shows and other media on your device.

HT204053 Some reason my iCloud acct on my phone is set up to the 'me' account which I don't use, and my computer is set up to icloud using my regular email. So, nothing is streaming & connecting. Can I delete the iCloud acct on my ph & re-sign in using o

All of my apple items are registered to iCloud using one account. Then when I updated my phone to iOS 6, it automatically registered my phone to iCloud using my old mobile me email. So, my phone isn't streaming to computer, etc. Can I just delete the account on my phone and re-sign in using my other email to connect ALL my devices in iCloud without losing any information? Or how do I go about fixing this problem???? Thanks.

If you want to change iCloud accounts and keep your data go to Settings>iCloud on your phone and turn all data you are syncing with iCloud (contacts, calendars, etc.) to Off. When prompted choose to keep the data on your iPhone. After everything is turned off, scroll to the bottom and tap Delete Account. Next, set up a new iCloud account (or sign into your other existing iCloud account) using your other ID, then turn syncing for your data (contacts, etc.) back to On. When prompted, choose Merge. This will upload the data to your new account.

I use only two channels, have plenty of memory in my hard disk, and external hard drive, no effects, and still having problems with Garage band. Giving messages as you have too many live channels

I'm frustrated, I am doing everything you recommend, I use only two channels, have plenty of memory in my hard disk, and external hard drive, no effects, and still having problems with Garage band. Giving messages as you ave too many live channels, the disk is slow prepare...can you help?

Quote from: Richard on 15-November-07, 20:33:05
tornado2003,
What you need to do is boot into Safe Mode. Then delete the VGA Drivers.
After that boot normally and install the latest nVidia ForceWare Drivers
Take Care,
Richard
i guess you missed that:
Quote from: tornado2003 on 15-November-07, 17:26:52
ive tryed booting xp in safe mode but it just freezes after it loads up a couple of needed files .
ive even formatted my hard drive and tryed installing a fresh xp on it but it just keeps locking up when it gets to the "starting windows setup" .(this is just after it loads all the drivers from the xp cd)

Using TDM VI in Lv 7.1 to stream data to disk

Similar Messages

Maybe you are looking for