Write Data [Channel] Replacing Data instead of Appending

Hey Guys,
Apologies if this is really straightforward but I can't seem to figure out why the write data block isnt appending data on the tdms file, instead its simply overwriting the last value of temperature in the file, so that only the last temperature value can be viewed.
Heres a screenshot of the tdms document, having only the last value of temperature aquired in it
and the block diagram, the stuff in red is the part writing it to a file and is definitley set to append data.
I thought it may be due to the fact its in the while loop, using write to measurement file works and its also inside the while loop (I dont wish to use it as it can't set as customisable properties).
I would really appreciate any help on the matter, I'm rather new to Labview.
Thanks,
Pete

Hey Pete,
I have written a simple VI which will show you how to use the lower level functions, rather than those express VI's that your using you have any questions about the functions that are being used please feel free to ask. I have set the group name as the date and channel name is strain, I've then just fed in random data. I have saved it to 2009 if you require it as an earlier version please let me know.
Regards
Andrew George @ NI UK
Attachments:
TDMS low level.vi ‏9 KB

Similar Messages

Write 32 channels thermistor data (temp in degree vs date/time) into xls file for all channels continuously.

i am acquiring 32 channels thermistor data (temp in degree vs date/time) in waveform plot using array to cluster function ,
now my problem is how to write this data into xls file for all channels continuously.
please help me at the earliest & i am new to Labview.

Hi Priyanka,
Writing to excel file continuously is not a good idea, you can use ".CSV" or TDMS file format and once data acquisition is completed you can convert that to excel file using report generation toolkit.
With Regards
Miraz
Kudos is better option to thank somebody on this forum

What is the best way to write 10 channels of data each sampled at 4kHz to file?

Hi everyone,
I have developed a vi with about 8 AI channels and 2 AO channels... The vi uses a number of parallel while loops to acquire, process, and display continous data.. All data are read at 400 points per loop interation and all synchronously sampled at 4kHz...
My questions is: Which is the best way of writing the data to file? The "Write Measurement To File.vi" or low-level "open/create file" and "close file" functions? From my understanding there are limitations with both approaches, which I have outlines below..
The "Write Measurement To File.vi" is simple to use and closes the file after each interation so if the program crashes not all data would necessary be lost; however, the fact it closes and opens the file after each iteration consumes the processor and takes time... This may cause lags or data to be lost, which I absolutely do not want..
The low-level "open/create file" and "close file" functions involves a bit more coding, but does not require the file to be closed/opened after each iteration; so processor consumption is reduced and associated lag due to continuous open/close operations will not occur.. However, if the program crashes while data is being acquired ALL data in the buffer yet to be written will be lost... This is risky to me...
Does anyone have any comments or suggestions about which way I should go?... At the end of the day, I want to be able to start/stop the write to file process within a running while loop... To do this can the opn/create file and close file functions even be used (as they will need to be inside a while loop)?
I think I am ok with the coding... Just the some help to clarify which direction I should go and the pros and cons for each...
Regards,
Jack
Attachments:
TMS [PXI] FINAL DONE.vi ‏338 KB

One thing you have not mentioned is how you are consuming the data after you save it. Your solution should be compatible with whatever software you are using at both ends.
Your data rate (40kS/s) is relatively slow. You can achieve it using just about any format from ASCII, to raw binary and TDMS, provided you keep your file open and close operations out of the write loop. I would recommend a producer/consumer architecture to decouple the data collection from the data writing. This may not be necessary at the low rates you are using, but it is good practice and would enable you to scale to hardware limited speeds.
TDMS was designed for logging and is a safe format (<fullDisclosure> I am a National Instruments employee </fullDisclosure> ). If you are worried about power failures, you should flush it after every write operation, since TDMS can buffer data and write it in larger chunks to give better performance and smaller file sizes. This will make it slower, but should not be an issue at your write speeds. Make sure you read up on the use of TDMS and how and when it buffers data so you can make sure your implementation does what you would like it to do.
If you have further questions, let us know.
This account is no longer active. Contact ShadesOfGray for current posts and information.

How to check if a physical data channel has data on it

I am aquiring data continuously and am trying to check if there is data on the physical line, if there is digital data I want it to be passed to the next stage, if there is not I want the data diguarded. Is there a way of checking this digital line for inactivity because when I suspend the data flow the clock continues to clock and my buffer just fills with empty data.
Thanks

You should get a timeout error from the DAQmx Read if there is no data availalbe. Are you not getting an error?
As for your consumer loop, there is no need to check to see if there is data in the queue. Just call the Dequeue Element. If there is no data in the queue, then it sleeps until there is data (assuming you don't use a timeout). It will then pass out the data as soon as it is available.
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines

Getting "Name0" should be "Name" from Write Data Channel vi

Can someone please explain this behavior? For some reason I'm getting "0's" apended to the Name string of my Write Data Channel vi.
Small write vi sample is attached.
thanks for any help
Attachments:
write[1].vi ‏316 KB

Mudda,
Thanks for the feed back. It looks like this behavior is tied to using the "Simulated Signal" express vi's. When the Simulated Signal vi is wired the Name field becomes the "Name/Channel Number" field. When you merge multiple Simulated Signal vi's and feed this into the Write Data Channel input you get "Name(n), Name(n+1)" etc. That is fine for merged inputs but for what it's worth I think we should be able to disable this "feature" when just using 1 Simulated Signal input. Sample of this is attached.
Attachments:
write_001.vi ‏382 KB

16 channels of data at 30kHz on the NI USB-6259 - is it possible?

Hello -- I would like to use the NI USB-6259 for electrophysiology. My application requires 16 channels of analog input digitized at 30kHz. This should be possible, as the listed aggregate digitization rate is 1MS/s. I've however run into several problems, all of which I believe may deal with how memory is handled in LabView (or maybe I'm just programming it wrong).
First off, if I pull in continuous voltage input using the DAQ assistant (DAQA) from anywhere from 5k to 30k samples at a time -- without any visualization -- things run alright. I record the data in binary format (TDMS) using the "Write to Measurement File (WTMF)" routine. However, I notice that the RAM used by LabView creeps up at a steady pace, roughly a megabyte every several seconds. This makes long-term recording unfeasible. Is there any way to avoid this? Basically I just have the DAQA and WTMF in a while loop that was automatically created when I set the acquisition mode to continuous.
Secondly, I would like to be able to visualize my data as I record it. If I set up 16 graphs -- one for each signal -- I need to raise the "Samples to Read" (STR) to 30k to ensure that the "Attempted to read samples that are no longer available" error [-200279]. This is annoying, as it makes the display look jerky, but is probably livable.
Now if I choose to display data in 16 charts rather than graphs (charts, as defined in LabView, display a bit of cumulative data along with the real-time signal), the amount of RAM used by LabView increases by several megabytes a second, regardless of whether or not I'm saving the data. After a short time, I get an "out of memory error".
Ideally I would like to be able to display 16 channels of 30kHz analog voltage data and save the data. As you see I'm having some level of trouble doing either of these things. Bare minimum requirements for my application would be to pull in the data with an STR of 30k, visualize the data in graphs, and save the data. Should this be possible in LabView 8.6 or 2009 (I use 8.6, but have tried these steps on the trial version of 2009 as well)? Even better, I would like to use an STR closer to 5k, and display the data in charts as it's saved. Should this be possible?
I'm using a reasonably powerful machine -- 32-bit Windows 7 with 3.24 gigs RAM, 2.4 GHz quad-core, etc.
Thanks

Hello!
I will admit right now that I can't stand any of the "assistants" and never use them. I don't like to have any part of my code invisible from me. Therefore, looking at your code gave me a headache. :-)
So, what I did is rewrite your code using the DAQ functions (basically what you'd see if you selected "Open Front Panel" on the DAQ assistant icon). You can go in and put the DAQ assistant back in if you so desire. This is just to give you an idea of the approach you should take. I'm grabbing 15000 points per loop iteration, just because I happen to like 500msec loop rates. You can tailor this number to your needs.
I have two parallel loops -- one collects the data and the other displays it on the front panel and writes it to a file. (I used the "Write waveform to file" function -- you can put your assistant back in there instead if you like.) The data is passed from the DAQ loop to the display loop using a queue. I use the "index array" function to select out the individual channels of data for display. I show 3 channels here, but you can easily expand that to accommodate all 16. You can also add your filtering, etc.
I am using a notifier to stop the two loops with a single button, or in case of an error. If "stop" is pressed, or an error occurs in the DAQ loop, a "T" value is sent to the notifier in the display loop (and that "T" value is used to stop the DAQ loop as well). That will cause the display loop to receive a "T" value, which will cause it to stop.
I don't have a 6259 on hand, so I simulated one in MAX. I didn't have a problem with the processor running at 100% -- on my clunky old laptop here, the processor typically showed ~40-50% usage.
I've added comments to the code to help you understand what I'm doing here. I hope this helps!
d
P.S. I have a question...how are you currently stopping your loop? You have "continuous samples" selected, and no stop button.
Message Edited by DianeS on 12-30-2009 07:28 PM
Attachments:
16 channel waveform display and write.vi ‏31 KB

How to remove spikes from a data channel

We wrote a module in DIAdem to look at each single point and used some logic to determine if it is a spike or not. If it is we replace it with the mean of neighbouring points.
BUT this takes a long time for big data channels
Is there a routine which does it faster/quicker

Hi,
A Formula using complete channels is much faster than a formula using a
loop over all values. Of course it depends on the logic you are using.
Here is an example for everything over 10 is a spike:
Call FormulaCalc("Ch('A'):= Ch('A') + (Ch('A')>10)*Novalue")
This Formula declares every value above 10 to Novalue. Using logical
coparissons in channel calculations can be a very helpfull in many
cases.
Now you can use the math function for novalue handling to replace every novalue thru interpolation.

Retrieving Replaced data

In the process of saving our information files were lost. In attempts to reverse the process THE MAIN AUDIO FILE that we use to create songs, was replaced by another file of the Same Name. My attempts at using time machine failed because it wont go further back in time. My question is Can i retrieve replaced data from the computer?

No. If you overwrite a file, which is apparently what you did, then the old file is unrecoverable. See,
Basics of File Recovery
If you simply put files in the Trash you can restore them by opening the Trash (left-click on the Trash icon) and drag the files from the Trash to your Desktop or other desired location. OS X also provides a short-cut to undo the last item moved to the Trash -press COMMAND-Z.
If you empty the Trash the files are gone. If a program does an immediate delete rather than moving files to the Trash, then the files are gone. Recovery is possible but you must not allow any additional writes to the hard drive - shut it down. When files are deleted only the directory entries, not the files themselves, is modified. The space occupied by the files has been returned to the system as available for storage, but the files are still on the drive. Writing to the drive will then eventually overwrite the space once occupied by the deleted files in which case the files are lost permanently. Also if you save a file over an existing file of the same name, then the old file is overwritten and cannot be recovered.
If you stop using the drive it's possible to recover deleted files that have not been overwritten with recovery software such as Data Rescue II, File Salvage or TechTool Pro. Each of the preceding come on bootable CDs to enable usage without risk of writing more data to the hard drive.
The longer the hard drive remains in use and data are written to it, the greater the risk your deleted files will be overwritten.
Also visit The XLab FAQs and read the FAQ on Data Recovery.

How to write one row of data at a time to "Write to File"

I am trying to write 10 parameters to the LV "Write to File". This is for just one row at a time. This happens evertime I get a failure in my test routine. I am not quite sure how to accomplish this task. If I get another failure I write one row again. I testing 4 DUTS at a time so I write this row of data to each file. I am sure it is very simple.
Thanks
Philip

Assuming your 10 parameters are an numeric array with 10 elements, use "write to spreadsheet" file with append set to true. (... and if they are scalars, built the array first ).
LabVIEW Champion . Do more with less code and in less time .

TDMS Data appears in row instead of column

Hi,
I am working on a program that reads in temperature data from a TDMS file, shifts the data through a 'normalising' equation and puts it back into the same TDMS file onto a different page.
The problem I am getting is when the normalised data gets written back into the TDMS file, the data that should appear in the columns now appears in rows. See picture attached that illustrates this.
Does anyone know how I can write the data to the file so that it appears in the column and not the row. In my VI you will see that I have had to transpose the 2D array otherwise all the data just appears in one single row.
Also several cells just containing 0 have appeared in my data set which should not be there.
I will attach my VI to this. I will also attach one of the TDMS data files.
Thanks in advance,
Rhys
Solved!
Go to Solution.
Attachments:
Row Column Switch.png ‏285 KB
normalising program.vi ‏36 KB
TDMS Files.zip ‏18 KB

Hi Rhys,
After looking into your normalising program.vi, I would recommend:
Don't use that Transpose 2D array, it doesn't solve your problem.
Write the "normalized" data to different channels, you get all the data just appears in one single column because you write all the “normalized” data to one single channel repeatedly, thus they'll appear in one column(channel).
Several cells containing zeros is because float64 y1[30] array in your normalising equation, you need remove the zero elements from y1[30] before writing to file.
I attached the modified normalising program.vi, hope this can do some help to your problem.
The snapshot below shows the data in Excel after "normalising" equation, the channel data appears in columns.
Attachments:
normalising program(updated).vi ‏37 KB

DATA CHANNEL

Hi all,
I want to have some of the channels through data portal by using "chncombobox" so is it possible to have only required channels in the list of combobox instead of having all the available channels in the portal, or is it possible to disable some of the channels?
Thanks
Nidhi

Hello Nidhi!
Unfortunately these controls are not influenced by practical experience (IMHO!). The consequence is that you have to implement this. In this case it is not so difficult. Just add a standard ComBox to your dialog and fill the'EventInitialize'-Event with this code:
Dim i
Call ComboBox1.Items.RemoveAll()
For i=1 To ChnNoMax
If ChnPropValGet(i, "unit_string") = "°C" Then
Call ComboBox1.Items.Add(ChnNameExt(i),i)
End If
Next
This code fill the box with all channels with a '°C' dimension. You have to add code to set/get the current value.
Matthias
Matthias Alleweldt
Project Engineer / Projektingenieur
Twigeater?

When i enter the 2nd data it replaces the 1st one

when i enter the 2nd data it replaces the 1st one,consequently i losed it.if someone know how i can enter multiple data and save each one in a specific row without losing any data
thanks

i was wondering if i will use a lot of clients(for example 2) do i have to use 2 sources not 1 in the Vi.
now i have in source1:dstp://localhost/emetteur1
source2:dstp://localhost/emetteur2
instead of having 1 source used for all clients:dstp://localhost/emetteur.
i'm really confused
and for sending continuously,i have to do it,because each client will not send data just 1 time.i think i missed something in the vi you gave me.what i'm expecting to have is when a client enter"nom- prenom-n candidat" in "emetteur.vi" i"ll see them in a table 1 time in 'recepteur.vi" and when a client enter "nom- prenom-n candidat" in "emetteur1.vi" i'll see them in the 2nd row of the table in "recepteur.vi" and so on.a lof of clients and one receiver without repeating data in reception
Attachments:
Pr du tableau à envoyer.zip ‏30 KB

StatBlockCalc without creating data channels for results

I am trying to create the min, max, and mean for a group of channels (3 of them) but I do not want to create/store them in new data channels - I would rather use the StatMin, StatMax, and StatArithMean variables. For example, using the script
StatClipCopy = 0StatClipValue = 0StatFormat = ""StatResChn = 1Call StatBlockCalc("Channel","2-254","'[1]/Amp-Hours' - '[1]/Temperature A1'") '... StatDirec,RowNoStr,ChnNoStr
causes 3 new channels (min/max/avg) with 3 items in each channelto be created in the data portal. Rather than creating channels, I change the StatResChn = 0 which I thought should only store the values in the variables StatMin, StatMax, and StatArithMean
StatClipCopy = 0
StatClipValue = 0StatFormat = ""StatResChn = 0Call StatBlockCalc("Channel","2-254","'[1]/Amp-Hours' - '[1]/Temperature A1'") '... StatDirec,RowNoStr,ChnNoStr
However this only appears to work is using a single channel (i.e. Amp-Hours or Temperature A1)
Is there a way to get multiple Statistics values (statmin, statmax, etc) over multiple channels without creating separate channels in the data portal?
Solved!
Go to Solution.

Jim,
When you calculate the statistics for a block of channels, the result cannot be stored in one of the channels. Instead, it goes into one of the result variables for the statistics calculation function:
The maximum would be stored in the StatTxt2(5) variable, a complete list of the result variables is below:
StatTxt2(1)
Index number
StatTxt2(2)
Measurement value sum
StatTxt2(3)
Measured value square sum
StatTxt2(4)
Minimum
StatTxt2(5)
Maximum
StatTxt2(6)
Arithmetic mean
StatTxt2(7)
Root mean square
StatTxt2(8)
Geometric mean
StatTxt2(9)
Harmonic mean
StatTxt2(10)
0.25 quantile (lower quartile)
StatTxt2(11)
0.50 quantile (median)
StatTxt2(12)
0.75 quantile (upper quartile)
StatTxt2(13)
Range
StatTxt2(14)
Standard deviation
StatTxt2(15)
Variance
StatTxt2(16)
Variation coefficient
StatTxt2(17)
Quartile distance
StatTxt2(18)
Relative variation coefficient
StatTxt2(19)
Average absolute deviation from mean
StatTxt2(20)
Average absolute deviation from median
StatTxt2(21)
Skewness
StatTxt2(22)
Kurtosis
StatTxt2(23)
Standard error
Hope that helps,
Otmar D. Foehner
Business Development Manager
DIAdem and Test Data Management
National Instruments
Austin, TX - USA
"For an optimist the glass is half full, for a pessimist it's half empty, and for an engineer is twice bigger than necessary."

Unpack data channels from cluster

Hi all,
I tried searching for this, it seems common enough, but I'm not sure I used the right set of words:
I'm receiving data from a device in packets. Each packet contains multiple frames, each frame contains two sub-frames, and each sub-frame contains several data channels. In my vi, the packet is a cluster, the frames are clusters, and the sub-frames are clusters, all typedef'ed.
What I want to do, is take the initial big cluster, and split the data into a cluster of arrays, one per data channel, without generating spaghetti.
The "decimate array" function would work beautifully to do the job, but alas, it only operates on arrays, not clusters, and it seems my clusters cannot be converted to arrays.
Is there something I'm missing? I've attached a high-level picture...note I'm not an artist. The values "n" and "m" are fixed, so there is no variability
Solved!
Go to Solution.
Attachments:
ClusterToClusters.png ‏11 KB

Right-click on Build Array and choose "Concatenate Inputs" so you'll get a 1-D array.
If you get rid of the "Header" and "Footer" elements, you can wire your overall cluster to Cluster to Array, which will give you an array of Frame clusters, which you can then put through a For loop with Cluster to Array, which will give you a 2-D array, that you can reshape/decimate/extract columns or rows as necessary. Or, in newer versions of LabVIEW, you can right-click on the loop output tunnel and choose the option to concatenate, giving you a 1-D array. However, I suspect that the 2-D array will actually work well for you - you'll have frames on one axis, and data channels on the other.
If you need the Header and Footer to remain part of the overall cluster, add one more level of nested cluster (there's no memory/speed penalty) containing all the frames, so that you can unbundle just the data.
Is there any possibility of reading the data into an array in the first place, instead of a cluster? That might be easier.

ERROR : End of TNS data channel

java.sql.SQLException: Io exception: End of TNS data channel
HI,
We have a websphere application and the backend is oracle 8.1.7 on NT.
We use JDBC for connectivity to Oracle.
We are coming across the above mentioned error for some of the transactions.
Also since no ORA- number is returned i'm unable to get to the cause of the error.
If anyone of u has come across a similar situation then pl let me know the cause of the error and the solution to it.
Thanks,
Ravi

ElectroD,
Try using "LEFT OUTER JOIN" instead of LEFT JOIN alone. It might get through.
Thanks,
Ishan

Write Data [Channel] Replacing Data instead of Appending

Similar Messages

Maybe you are looking for