Maximum write speed to log file, trying to get a log entry every 100ms.

I have a DAQmx application which data I want ot log. The aquistion is ran at a high speed, 1 KHz. I want to log the measurements to a text file which can read in Matlab or excel. I a wondering what the best approach is for this and what is the maximum speed.
I have created a program below to test. But it seems that the log is not consistent at 10 Hz alread. The log interval is set to 100 ms while the loop is running at 10 ms. If I look at the time between the sampes 6 of them are higher than the 100ms. The time between some steps is 700ms which is quite high. Is this implementation wrong or is this just due to the undeterminstic computer?

LennartM wrote:
But the program does not stop...It seems it is waiting on another notification to stop or something?
That is a very likely scenario. The simple solution here is to destroy the notifier after the top loop completes and make your bottom loop stop when there is an error from the Notifier (when it was destroyed). That would eliminate the need for the local variable and would ensure that both of your loops stopped.
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines

Similar Messages

Java.io.IOException: Failed to rename log file on attempt to rotate logs

Hello.
I'm currently using Weblogic 5.1 SP6 on WinNT Server 4.0 SP6.
I set the weblogic.properties file like this so that the "access.log" will
be rotated every day at midnight.
-- weblogic.properties --
weblogic.httpd.enableLogFile=true
weblogic.httpd.logFileName=D:/WLSlog/access.log
weblogic.httpd.logFileFlushSecs=60
weblogic.httpd.logRotationType=date
weblogic.httpd.logRotationPeriodMins=1440
weblogic.httpd.logRotationBeginTime=11-01-2000-00:00:00
-- weblogic.properties <end>--
The rotation has been working well, but one day when I checked my
weblogic.log, I was getting some errors.
I found out that my "access.log" wasn't being rotated (nor being written,
flushed) after this error came out.
After rebooting WebLogic, this problem went away.
Has anyone clues about why WebLogic failed to "rename log file?"
-- weblogic.log --
? 2 04 00:00:00 JST 2001:<E> <HTTP> Exception flushing HTTP log file
java.io.IOException: Failed to rename log file on attempt to rotate logs
at weblogic.t3.srvr.httplog.LogManagerHttp.rotateLog(LogManagerHttp.java,
Compiled Code)
at java.lang.Exception.<init>(Exception.java, Compiled Code)
at java.io.IOException.<init>(IOException.java, Compiled Code)
at weblogic.t3.srvr.httplog.LogManagerHttp.rotateLog(LogManagerHttp.java,
Compiled Code)
at
weblogic.t3.srvr.httplog.LogManagerHttp.access$2(LogManagerHttp.java:271)
at
weblogic.t3.srvr.httplog.LogManagerHttp$RotateLogTrigger.trigger(LogManagerH
ttp.java:539)
at
weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigg
er.java, Compiled Code)
at
weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java
, Compiled Code)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java,
Compiled Code)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java, Compiled Code)
? 2 04 00:00:25 JST 2001:<E> <HTTP> Exception flushing HTTP log file
java.io.IOException: Bad file descriptor
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java, Compiled Code)
at
weblogic.utils.io.DoubleBufferedOutputStream.flushBuffer(DoubleBufferedOutpu
tStream.java, Compiled Code)
at
weblogic.utils.io.DoubleBufferedOutputStream.flush(DoubleBufferedOutputStrea
m.java, Compiled Code)
at
weblogic.t3.srvr.httplog.LogManagerHttp$FlushLogStreamTrigger.trigger(LogMan
agerHttp.java, Compiled Code)
at
weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigg
er.java, Compiled Code)
at
weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java
, Compiled Code)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java,
Compiled Code)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java, Compiled Code)
-- weblogic.log <end> --
note:
? 2 04 00:00:25 JST 2001:<E> <HTTP> Exception flushing HTTP log file
java.io.IOException: Bad file descriptor
keeps coming out every minute after on.
I suppose this is because I have set the HTTP log to be flushed every one
minute.
Thanks in advance.
Ryotaro

I'm also getting this error on Weblogic 6.1.1.
It only occurs if you set the format to "extended".
Is there any fix or workaround for this?

Get Total DB size , Total DB free space , Total Data & Log File Sizes and Total Data & Log File free Sizes from a list of server

how to get SQL server Total DB size , Total DB free space , Total Data & Log File Sizes and Total Data & Log File free Sizes from a list of server

Hi Shivanq,
To get a list of databases, their sizes and the space available in each on the local SQL instance.
dir SQLSERVER:\SQL\localhost\default\databases | Select Name, Size, SpaceAvailable | ft -auto
This article is also helpful for you to get DB and Log File size information:
Checking Database Space With PowerShell
I hope this helps.

HT5191 the itunes library .itl fileis locked on a locked disk, or you dont have the write permission for this file. this is what it says every time i try and open itunes why ?

the itunes library .itl fileis locked on a locked disk, or you dont have the write permission for this file. this is what it says every time i try and open itunes why ?

Sounds like a permission issue.
Navigate to the iTunes Music Library.itl file
The path should be Username/Music/iTunes/
Right click on the iTunes Library.itl and select Get Info
The window will open on the left hand side. Go to the Sharing and Permissions section at the bottom
Click the padlock to allow changes and enter your Mac logon password
Select yourself and make sure you have Read & Write selected. Click padlock to lock it again
Close the Get Info window and try and start iTunes

Increasing Write Speeds while saving files?...

While i love Photoshop, its performance can be a huge concern. Lately, i upgraded my workstation from a 4 year old desktop and went all out...
Here are the specs of the new system.
2 x X5670 (12 Nehalem 2.93Ghz cores)
48GB of ECC RAM
3 x 50GB (raid 0 on LSI 5150 sata 3 raid card) Sandforce SSD drives that give me sequential read/write speeds of approx 800MBps.
My issue is that i hate the way photoshop writes data while saving PSD files. I cant seem to see photoshop write to disk at speeds greater than 12-15 MBps. This has become the slowest link in the entire photoshop work flow and is slowing me down considerably.
The other option i was trying to investigate is to edit loads of files and then do an equivalent of a bulk save but i cant find a trick to do that.
thoughts?

thanks Noel for the speedy response. I will admit that i oversimplified my setup but here is the full info for my setup...
I gave the save as tiff a go but DID see a dramatic increase!!
C Drive:
T Drive: 40GB Fusion i/o PCI card. Photoshop uses this as the scratch disk (under preferences --> general --> performance).
P.S: my systems temp variables (user and env) etc are all redirected to this drive.
I have a D Drive (Raid 5 across 6 x 2TB drives that i use purely for storage)
Here is what all i am doing...
Open a raw nef file,
Use define to reduce noise (automatic profile)
Use Viveza to adjust brightness/contrast/structure/warmth
save the file
These are some timings...
Loading photoshop --> 4.5 sec
Opening a D7000 16MPix raw image --> 8.5 sec (file opens in camera raw and then i click open to open in photoshop)
Times to save processed files...
PSD: 28.5 seconds!!!!
Tiff: 2.5 seconds!!! yes 2.5 seconds (you barely see it save!!)
You are the man...
i would assume that i have the CPU and RAM horsepower to have photoshop do a good job at the compression while saving but the diffrence is huge!!!
now please tell me what do i lose (if anything) in moving to the Tiff format (preserving all layers)

DVD burner not reaching maximum write speed

I have a PowerMac G4, and have purchased an internal PIONEER DVD-RW DVR-112D. After contacting the manufacturer and discovering what media to use, all fingers point towards VERBATIM. The drive writes DVD's at 18x speed. I have purchased 16x DVD-R media from Verbatim.
I have NEVER been able to reach a write speed ABOVE 8x! What is wrong? Anyone else have this issue??

Older Macs, such as the G4 quicksilver, were designed when the fastest DVD drives were only 2X, and use a slow ATA bus for the optical drive. The only way to get more than 8X is to use a faster bus for the DVD drive, such as one of the other ATA busses in a G4 MDD, or a PCI controller card. If you do that, though, the optical drive may not be bootable, and the Eject key may not work.
My previous Mac was a G4 Quicksilver, upgraded with a Pioneer 110 drive (16X). It would not burn faster than 8x. The Mac Pro with a Pioneer 112 will burn at 16X. With a Pioneer 115 it will burn at 20X (with Verbatim DVD-R 16X media).

Nohup.log files are not getting generated correctly

hai,
im a weblogic administrator. Here is my problem in weblogic. My partner has complained that nohup.logs are not getting generated properly. Like for every 5 mins a new nohup .log file is getting generated. But almost 4 to 5 logs are of 0 size and after that the 6 log file is very hug ( around MB). And the status of the managed servers is in FAILED state. When i checked the nohup logs, i can see "E297: Write Error In Swap File" and also the below error. But when i checked the disk space it is only 30 % full. Please suggest me something that can help me in this. Why is this behavior in the nohup.logs? have anyone faced anythign like this? Please help me.
But after the recycle everything is fine. But i want to know what went wrong and why it got recovered after the recycle.
<Feb 11, 2010 7:43:59 AM CST> <Error> <HTTP> <BEA-101246> <Error occurred while flushing HTTP log file for the Web server: wl38_managed1
java.io.IOException: Disk quota exceeded.
java.io.IOException: Disk quota exceeded
at java.io.FileOutputStream.writeBytes([BII)V(FileOutputStream.java:???)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at com.wily.introscope.agent.probe.io.ManagedFileOutputStream.write(ManagedFileOutputStream.java:423)
at weblogic.utils.io.DoubleBufferedOutputStream.flushBuffer(DoubleBufferedOutputStream.java:58)
at weblogic.utils.io.DoubleBufferedOutputStream.flush(DoubleBufferedOutputStream.java:157)
at weblogic.servlet.logging.LogManagerHttp$FlushLogStreamTrigger.trigger(LogManagerHttp.java:522)
at weblogic.time.common.internal.ScheduledTrigger.run(ScheduledTrigger.java:243)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:229)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:223)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:50)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)

according to error message, your partition size have not enough disk space from where you are running nohup command. check with df -kh.

Cannot shrink log file 2 because the logical log file located at the end of the file is in use ?

HI,
I am getting this error frequently.. any recomendations :
Executed as user: DB0\sqlservices. Processing database: dbin [SQLSTATE 01000] (Message 0)
Cannot shrink log file 2 (DB_log) because the logical log file located at the end of the file is in use. [SQLSTATE 01000] (Message 9008)
Processing database: DB_ [SQLSTATE 01000] (Message 0) DBCC execution completed. If DBCC printed error messages, contact your system administrator. [SQLSTATE 01000] (Message 2528)
Cannot shrink log file 2 (DB_log) because the logical log file located at the end of the file is in use. [SQLSTATE 01000] (Message 9008)
Processing database: DB [SQLSTATE 01000] (Message 0)
DBCC execution completed. If DBCC printed error messages, contact your system administrator. [SQLSTATE 01000] (Message 2528)
Backup, file manipulation operations (such as ALTER DATABASE ADD FILE) and encryption changes on a database must be serialized. Reissue the statement after the current backup or file manipulation operation is completed. [SQLSTATE 42000] (Error 3023)
Processing database: DB_AC [SQLSTATE 01000] (Error 0)
[SQLSTATE 01000] (Error 0) DBCC execution completed. If DBCC printed error messages, contact your system administrator. [SQLSTATE 01000] (Error 2528).
The step failed.
Please give any receomendations to avoid this error in future :
Yangamuni Prasad M

Hi Yangamuni,
Are there any progress?
Please have a look on the below threads with the similar issues as yours:
http://www.sqlservercentral.com/Forums/Topic652579-146-1.aspx
http://social.msdn.microsoft.com/forums/en-US/sqldatabaseengine/thread/ae4db890-c15e-44de-a2af-e85c04260331
The solution is change the recovery mode to SIMPLE, shrink log files and then change to the FULL recovery mode.
Thanks,
Weilin Qiao
Please remember to mark the replies as answers if they help and unmark them if they provide no help. This can be beneficial to other community members reading the thread.

How can I change the log file path instead of storing log in server.log

Hi,
I have created one domain and modified the attribute "log-file" in element "virtual-server" element to point to the new log file path.
But when I start up my domain, it still saying: "Log redirected to DOMAIN_LOCATION/logs/server.log.
Why?
Why it doesn't log to the file I specify? How can I change it?
Thanks.
Ken

I have changed the logging option to my specific path in admin console as what you said. I have also changed the logging in domains attribute too.
But still there is some logging info in domains/<dom_name>/logs/server.log instead of the path and file I specified.
Is it possbily related to linux user role setting? the Sunone AS is installed and configured by root user. But the domain is created for another user, hence I want to forward all logging info to that user's home path.

Problem with the log file path on the Data Logging Control Veristand

Hello everyone,
My problem is that I use a computer as a gateway on the network. It is connected to PXI in Real Time. I have another computer connected to the gateway to read the given PXI. I am unable to record on my local hard drive using the Data Logging Control VeriStand on the second computer. However, it can save me on the hard disk on the network. Moreover, I have no problem to record if the computer is a gateway.
Regards,
Kamal Bouamran

For simplicity, let's call the computer running Veristand Computer A and the gateway computer Computer B.
So, just to clarify, you're running the Veristand workspace on Computer A, which is connected to your network and the RT PXI (on which the system definition file is deployed) through a gateway, Computer B. With this setup, you can't use a data logging control to save a file to Computer A's hard drive. However, you are (from the workspace running on Computer A) able to save a file to Computer B's disk or to another drive elsewhere on your network. Is that all correct?
What happens when you try to configure the control to log to computer A's disk? Do you get an error (and if so, what error)? Does the file path default to a different location?
Also, what version of Veristand are you using? What version of Windows are you PCs running?
Regards,

When I place a 'write to measurement file' express I get an 'Error in prop page construction: Control Label: Streaming' Using Labview 8 on XP. Any ideas?

When I place express 'write to measurement file' I get an error
'Error in prop page construction:
Control Label: Streaming
Couldn't find control/constant on the instance.'
Help!!!!!
Please.
Regards
Derek

The error happens as soon as I place the symbol. The symbol is there and the properties are all accessible, but will not run.
I enclose word doc with error messages on.
Many thanks in anticipation
Derek
Attachments:
LabviewA.doc ‏86 KB

I am trying to get the average of every 10 points in my table...

I have a table of data and would like to get an output of the average every 10 points. For example, the average of points 1-10, then the average of points 11-20, then 21-30, etc.
The challenge is that I do not know ahead of time how many points the sensor will collect each run because it depends on some external factor. I have attached a picture with some made-up data to illustrate what my table looks like. In the example I attached, the averages would be (11+34+125+77+44+232+25+213+22+89)/10 and (90+45+77+26+1+22+57+67+360+33)/10.
My initial attempt used a case structure which found a running average and then reset whenever a multiple of 10 was reached. However, this method does not seem very efficient. Does anyone have any better ideas?
Solved!
Go to Solution.
Attachments:
sample data.JPG ‏43 KB

JarleEkanger wrote:
How about this? Use Delete array subset to extract chunks for averaging, and a shift register to retain the remaining array.
It is typically not advisable to use "delete from array" in a tight loop. The constant memory reallocations due to array resizing are probably inefficient.
Here's one simple way to do it..
(If the number of points is not divisible by 10, the excess tail is discarded. You can easily modify that behavior if desired.)
LabVIEW Champion . Do more with less code and in less time .
Attachments:
averages of 10.png ‏5 KB
averages of 10.vi ‏9 KB

I am trying to get my serial number every time I enter my redemption code it says invalid code wtf

This ? Is for adobe photoshop elements 10 pleez help I need this tonight

See this document http://kb2.adobe.com/cps/909/cpsid_90921.html. If you still have problems retrieving your serial number, contact Adobe Customer Support (http://www.adobe.com/aboutadobe/contact.html).
You mention the redemption code, so I assume you bought your product from Best Buy.

How to read Skype connection logs (.log files in /...

Hi all,
A funny problem but really important - please help!
I set up logging to find out causes of some tech problems occuring during my calls, as it described here: https://support.skype.com/en/faq/FA12321/how-do-i-create-log-files
So, I get now /Logs folder with .log files.
But they are not text files and I don't know what this format is and what tool can read them(
Skype tech support doesn't know as well. Please help, who knows, how to read these .log files?
Thanks!
ps my OS is Ubuntu Linux

It's somewhat odd that the Skype tech support staffer you spoke with doesn't know what to do with the logs, as the instructions you posted say to place them in a ZIP file and sent it to them. Since the log files I observed start with 'BLOGBEGIN,' there must be software to parse the file. Also...you never described the tech problems during calls which prompted you to enable logging; and if Skype Support suggested it (which seems doubtful, given they didn't know what to do with the files). Perhaps you can provide a description of the issue?

Locum error in log file ? HELP

Hi.
When i look in my log file i keep getting a log error ever 10-20 min ?
It keeps comming.
Feb 7 16:44:42 Mugge com.apple.launchd[118] (0x409b60.Locum[482]): Exited: Terminated
Feb 7 16:46:55 Mugge com.apple.launchd[118] (0x4099f0.Locum[494]): Exited: Terminated
Feb 7 16:48:21 Mugge com.apple.launchd[118] (0x4099a0.Locum[497]): Exited: Terminated
Feb 7 16:50:53 Mugge com.apple.launchd[118] (0x4099f0.Locum[513]): Exited: Terminated
Feb 7 16:51:23 Mugge com.apple.launchd[118] (0x408c90.Locum[520]): Exited: Terminated
Feb 7 16:51:54 Mugge com.apple.launchd[118] (0x4099f0.Locum[523]): Exited: Terminated
Feb 7 16:52:12 Mugge com.apple.launchd[118] (0x4099f0.Locum[525]): Exited: Terminated
Feb 7 16:53:47 Mugge com.apple.launchd[118] (0x409800.Locum[530]): Exited: Terminated
Feb 7 16:54:11 Mugge com.apple.launchd[118] (0x409800.Locum[532]): Exited: Terminated
Feb 7 16:54:46 Mugge com.apple.launchd[118] (0x409800.Locum[536]): Exited:
Feb 7 17:01:10 Mugge com.apple.launchd[118] (0x4098a0.Locum[569]): Exited: Terminated
Feb 7 17:01:29 Mugge com.apple.launchd[118] (0x409870.Locum[571]): Exited: Terminated
Feb 7 17:01:39 Mugge hdiejectd[580]: running
Feb 7 17:01:59 Mugge com.apple.launchd[118] (0x40ac90.Locum[591]): Exited: Terminated
Feb 7 17:19:01 Mugge com.apple.launchd[118] (0x409800.Locum[644]): Exited: Terminated
Feb 7 17:19:06 Mugge com.apple.launchd[118] (0x409800.Locum[645]): Exited: Terminated
Feb 7 17:19:10 Mugge com.apple.launchd[118] (0x409800.Locum[647]): Exited: Terminated
Feb 7 17:21:58 Mugge com.apple.launchd[118] (0x40a780.Locum[772]): Exited: Terminated
Feb 7 17:22:03 Mugge com.apple.launchd[118] (0x40a780.Locum[773]): Exited: Terminated
Feb 7 16:51:28 mugge com.apple.launchd[118] (0x409790.Locum[929]): Exited: Terminated
Feb 7 16:51:50 mugge com.apple.launchd[118] (0x409830.Locum[930]): Exited: Terminated
Feb 7 16:52:11 mugge com.apple.launchd[118] (0x409830.Locum[937]): Exited: Terminated
Anybody know what that means ?

Locum is a program that helps Finder delete some files when you empty the Trash.
It's normal to see that message in the log after the trash has been emptied. If it's showing up on its own every few minutes, I'd first try restarting the computer (in case something is causing Locum to launch), then try repairing permissions and restarting again.

Maximum write speed to log file, trying to get a log entry every 100ms.

Similar Messages

Maybe you are looking for