Semantic Logging - RollingFlatFileSink - Real-Time Logging

We're currently using semantic logging and are able to both save to rolling flat files and a sql database.
A difference we're seeing is that the sql sink inserts every x seconds while the rolling flat file sink doesn't insert data until the file rolls over or the service stops. 
Is there a way to have inserts happen in real-time for the rollingFlatFileSink?

Please post questions related to this product in their
forums at CodePlex.

Similar Messages

  • Real time logging: best practices and questions ?

    I've 4 couples of DS 5.2p6 in MMR mode on Windows 2003.
    Each server is configured with the default setting of "nsslapd-accesslog-logbuffering" enabled, and the log files are stored on a local file system, then later centrally archived thanks to a log sender daemon.
    I've now a requirement from a monitoring tool (used to establish correlations/links/events between applications) to provide the directory
    server access logs in real time.
    At a first glance, each directory generates about 1,1 Mb of access log per second.
    1)
    I'd like to know if there're known best practices / experiences in such a case.
    2)
    Also, should I upgrade my DS servers to benefit from any log management related feature ? Should I think about using an external disk
    sub-sytem (SAN, NAS ....) ?
    3)
    In DS 5.2, what's the default access logbuffering policy : is there a maximum buffer size and/or time limit before flushing to disk ? Is it configurable ?

    Usually log-buffering should be enabled. I don't know of any customers who turn it off. Even if you do, I guess it should be after careful evaluation in your environment. AFAIK, there is no configurable limit for buffer size or time limit before it is committed to disk
    Regarding faster disks, I had the bright idea that you could creating a ramdisk and set the logs to go there instead of disk. Let's say the ramdisk is 2gb max in size and you receive about 1MB/sec in writes. Say max-log-size is 30MB. You can schedule a job to run every minute that copies over the newly rotated file(s) from ramdisk to your filesystem and then send it over to logs HQ. If the server does crash, you'll lose upto a minute of logs. Of course, the data disappears after reboot, so you'll need to manage that as well. Sounds like fun to try but may not be practical.
    Ramdisk on windows
    [http://msdn.microsoft.com/en-us/library/dd163312.aspx]
    Ramdisk on solaris
    [http://wikis.sun.com/display/BigAdmin/Talking+about+RAM+disks+in+the+Solaris+OS]
    [http://docs.sun.com/app/docs/doc/816-5166/ramdiskadm-1m?a=view]
    I should ask, how realtime should this log correlation be?
    Edited by: etst123 on Jul 23, 2009 1:04 PM

  • Log users real time

    hi....
    how i can configurator a log file on real time....on unix solaris....
    thanks a lot....
    Best Regards...

    hi....
    how i can configurator a log file on real time....on unix solaris....
    thanks a lot....
    Best Regards...

  • Redirect tomcat logs in real-time to a browser window

    I have got a problem with logging and user interface. I need to display my web application's log in a browser window in real-time, i.e., as a message is logged in a log file, it should also get displayed in the browser window.
    Any help would be highly appreciated.
    Thanks in advance.

    Thanks Rohit.
    I used a similar approach given in http://www.devx.com/tips/Tip/13867 to run the "tail" command. I've partially succeeded in this way.
    Now I am able to display the log file content in a text area in my jsp page.
    The remaining problem is
    "Is there any way to push the contents from tomcat to jsp as soon as the log file changes?"
    Since I need to refresh the page periodically to get the latest contents from the log file.
    Thanks.

  • SIT Real-time data logging and passing data

    Hello all,
    I am pretty new to LabView real-time, so I just want to confirm a few things. I am also using the Simulation Interface Toolkit.
    Let's take the Sinewave.vi from the SIT examples. I have modified it to use sinewave.dll, and run on PXI-8101. If my understanding is correct, when I click "Play", the entire Sinewave.vi is deloyed into PXI-8101, and therefore the entire VI is running at the same pace. The front panel I see on my desktop is slower snapshots of what is actually happening?
    1) Let's pretend now that the sinewave model is time critical and must run every 10ms. How do I do that? I have noticed that within the "SIT_Indicator_Indices" loop, there is a Wait 50ms block. Is that accurate?
    2) I have also added a time elapsed block that will change the Frequency and Amplitude inputs as a function of time. I made them update every 2ms. What clock are we running on? If my sinewave.mdl suddenly calculate integration (time dependent), can I use that elapsed time block as my timer to pass into the model?
    3) How fast is the sinewave.vi running anyways?
    4) Let's say I want a log of the sinewave output (a data point every 10ms). I don't need the log in real-time, I just want to do some analysis on it later. How do I do it?
    Thanks.
    Attachments:
    Sine Wave.vi ‏104 KB

    Hi Bladhart,
    When running the in the Development Environment (pressing the run button on the Real-Time vi) there will be an extra thread to handle the front panel you see. This thread will be handled just like any other thread in Real-Time and will take processor time, thus slowing down your entire application to a certain extent.  
    1. You would need to make sure everthing inside the loop can execute within 10ms and change the wait time to 10ms. Or you can use a timed loop set to run every 10ms and get rid of the wait time but again you would need to ensure everything in the loop can execute in under 10ms.
    2. The elapsed time should be running off the Real-Time system clock. 
    3. The time that the Sinewave.vi is running is system dependent, there is no set speed.
    4. You can log the data by saving to a *.tdms file. You can then use the data from the *.tdms file to do processing later. 
    <Brian A | Applications Engineering | National Instruments> 

  • ISE offloading syslogs real time to MARS

    I am working on my implementation of ISE and I want to offload real time logs from ISE to MARS.  Is this possible and is there anything special that is needed to perform this?                  

    To collect logs externally, you configure external syslog servers, called targets.Logging targets are locations where the system logs are collected. In Cisco ISE, targets refer to the IP addresses of the servers that collect and store logs. You can generate and store logs locally, or you can FTP them to an external server. Cisco ISE has the following default targets, which are dynamically configured in the loopback addresses of the local system:
    •LogCollector—Default syslog target for the Log Collector.
    •ProfilerRadiusProbe—Default syslog target for the Profiler Radius Probe.
    To create an external logging target, complete the following steps:
    Step 1 From the ISE Administration Interface, choose Administration > System > Logging > Remote Logging Targets.
    The Remote Logging Targets page appears.
    Click Add.
    Step 2 The Log Collector page appears.
    Step 3 Configure the following fields:
    a. Name—Enter the name of the new target.
    b. Target Type—By default it is set to Syslog. The value of this field cannot be changed.
    c. Description— Enter a brief description of the new target.
    d. IP Address—Enter the IP address of the destination machine where you want to store the logs.
    e. Port—Enter the port number of the destination machine.
    f. Facility Code—Choose the syslog facility code to be used for logging. Valid options are Local0 through Local7.
    g. Maximum Length— Enter the maximum length of the remote log target messages. Valid options are from 200 to 1024 bytes.
    Step 4 Click Save.

  • How can I extract the data from a Real-time Execution Trace ".log" file?

    I would like to get the data for the traces from the Real-time Execution Trace toolkit ".log" file to read in Excel and generate a report.

    Hi Chuck,
    Have you tried reading it into a text or binary file first and then generating a report using the Report Generation VIs?
    Ipshita C.
    National Instruments
    Applications Engineer

  • How to get real time information about how many user are logged in and thei

    I use tomcat as my server platform in Ubuntu for a war file.
    I know in order to get real time information about how many user are logged in, we can count how many active sessions exist by a SessionCounter code. However, I have to permit HttpSessionListener in web.xml of tomcat. From other users' experiences, the configuration is complexed and has some errors.
    Here's the link:http://www.stardeveloper.com/article...1112001&page=1
    In order to get users' ip, in jsp, use request.getremotehost() or
    request.getremoteaddress() by editing the jsp file.
    I wonder if there's some open source software to use for these two purposes.
    Thank you!

    That url is missing a few bits. The ... in the middle doesn't help.
    we can count how many active sessions exist by a SessionCounter code.
    However, I have to permit HttpSessionListener in web.xml of tomcat.
    From other users' experiences, the configuration is complexed and has some errors.And have you tried it? The configuration isn't that complex.
    What errors do you mean? Errors in tracking people, variance in the count? Probably related to internet issues and nothing you can do will alleviate them.

  • Standby DB real time redo log apply problem

    Hi all,
    I am using Oracle 10g to create physical standby db. In the standby
    db, normal archived log apply does not have problem, but when I try to
    use redo log real time apply and issue command
    SQL> ALTER DATABASE RECOVER MANAGED STANDBY DATABASE USING CURRENT LOGFILE;
    it shows:
    ERROR at line 1:
    ORA-38500: USING CURRENT LOGFILE option not available without stand
    What is the problem??
    Thanks a lot !
    Steven

    Note:3633226.8 from Metalink states:
    Setting a standby's RealTimeApply property to ON when there are no standby
    redo logs on the standby or the standby is not in SYNC transport, will
    seemingly succeed. However, the apply engine will not start. The DRC log
    will report an error like ORA-38500. In this case, add standby redo logs
    and set the log transport mode for the standby to be SYNC and set the
    standby state to ONLINE.
    Workaround:
    Add Standby Redo Logs on the standby and set the following broker properties
    on the standby:
    LogXptMode to SYNC and reset RealTimeApply to ON.
    Then set the standby state to ONLINE.
    HTH

  • Data guard real time apply vs archived log apply on physical standby

    Dear DBA's,
    last week i configuared DR , now the phyiscal stanby database is archive apply mode,
    i want to confirm is it better to apply the archived log or should i cahnge it to real time apply .
    give me sugesstions.
    Thanks and Regards
    Raja...

    One question are you using ARCH transport to move the redo? or have you configured standby redo logs and logwr transport (either async or syncronous), if you are using the archiver to transport the logs then you can not use real time apply.
    If you are using log writer to transpor the redo the realtime apply reduces the recovery time required if you need to failover as trher should be less redo to apply to bring the standby up to date, which mode you use to transport redo will depend on what is acceptable in terms of data loss and the impact on performance.

  • Real - Time Apply some times uses Archived log file

    Hi All,
    I have a doubt on real time apply in Oracle 10g 10.2.0.4 version where arch process has been configured on primary database and standby has been configured for maximum performance mode with real time apply.
    But in standby alert log file i use to find below message rarely
    Media Recovery Log /oraclearch/oraarch/ctdr/5548.dbf
    Media Recovery Log /oraclearch/oraarch/ctdr/5549.dbfSo my doubt is why archived files are applied as standby has been configured for real time apply where it should apply only from standby online redo log files.
    Also i dont find any information on standby database in the view v$standby_log that these standby online log files have been archived in archived column, so how to find how much of data has been written by rfs process on SRL's...
    -Yasser

    hi,
    As the remote file server (RFS) process writes the redo data to standby redo log files on the standby database, log apply services can recover redo from standby redo log files as they are being filled.
    please check http://download.oracle.com/docs/cd/B19306_01/server.102/b14239/log_apply.htm
    thanks,
    baskar.l

  • Why can't read access log file in real-time? (Oracle Weblogic Server 10.3)

    We can't read access log file in real-time. If access log is rotation to new file so can read access log file but can't read real-time.
    *** Oracle Weblogic Server versions 10 R3

    what's your meaning? try this command "tail -f access.log".
    Threre is a buffer about 8K for WebLogic to write the access info into the log files, so you can't see the access info untill the buffer is full.

  • Log for Change of Real-Time Load Behavior

    Hi experts,
    is there a log for the change of the real-time load behavior?
    I checked SLG1, but I did not find any object / subobject that seemed to be helpful.
    Angie

    Firstly,
    How are you changing the real-time load behavior, are you using any process chain variant,in that case you can look at the process chain log..

  • CAD Real Time Stats show NA for agent state and call log

    Hello
    For our lab uccx, the agent/users CAD display shows NA for the agent state and call log.  I have
    Not Ready and Log out codes set and have the testers do those actions to generate data.
    I have rebooted the server and have also checked the services page and confirmed
    all the services are running.
    I went through the admin guide to see if I missed any configuration but does not appear so.
    I tried launching the real time stats tool from the UCCX Admin and it launches OK
    but I noticed that it shows not connected.
    Note this is over a VPN to the UCCX.
    So not sure if this is related.  I checked the relase notes and this is the base install
    of UCCX 8.5.  I am going to install the service updates but wanted to see if I can
    get this running before I schedule a maint window to do the upgrades.
    Thanks
    Mike Kana

    Hi
    you might be facing an issue where " uccxcaduser password" gets corrupted , which leads to the issue you are facing right now
    you have to contact TAC to reset that password for you and your issue will be fixed ,100%
    Note : Only TAC can reset this password

  • ITunes Makes Me Log in Every Time I Open It

    iTunes v. 12.0.1.26 and Yosemite updates recently installed. 2012 27" iMac
    iTunes makes me log in every time I open it. I thought the problem was fixed in THIS THREAD and it was a very helpful set of instructions by Linc but the problem keeps recurring.
    I reposted the question in that thread, but since the thread is marked as solved I'm afraid no one will see it. So I'm reposting here.
    Situation:
    Upon opening iTunes I get messages popping up telling me to
    Sign in to iTunes to use this computer for automatic downloads
    Sign in to iTunes for iTunes Radio to use autodowload
    Sign in to iTunes to check for downloads
    (repeat of) Sign in to iTunes to use this computer for automatic downloads
    Sign in to use iTunes Store
    These happen one after another, rapidly. Every time. I called Apple help as well and they didn't have any further help.
    I've repaired permissions, trashed my plist for iTunes from my Library, done all of Linc's instruction in the other thread.

    Back up all data before proceeding.
    Launch the Keychain Access application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Keychain Access in the icon grid.
    Select the login keychain from the list on the left side of the Keychain Access window. If your default keychain has a different name, select that.
    If the lock icon in the top left corner of the window shows that the keychain is locked, click to unlock it. You'll be prompted for the keychain password, which is the same as your login password, unless you've changed it.
    Right-click or control-click the login entry in the list. From the menu that pops up, select
              Change Settings for Keychain "login"
    In the sheet that opens, uncheck both boxes, if not already unchecked.
    From the menu bar, select
              Keychain Access ▹ Preferences ▹ First Aid
    If the box marked
              Keep login keychain unlocked
    is not checked, check it.
    Select
              Keychain Access ▹ Keychain First Aid
    from the menu bar and repair the keychain. Quit Keychain Access.

Maybe you are looking for

  • UTL_FILE.PUT_LINE   not writing to file in real time !!!

    Hi All I have 3 statements and I am writing some thing to a file using UTL_FILE.PUT_LINE after each statement is over. Each statement takes mentioned time to complete. I am opening file in append mode. statement1 (takes 2 mins) UTL_FILE.PUT_LINE stat

  • Changing Host IP on OBIA servers

    Hi, We have the need to change the IP address on the servers that host our OBIA environments. For most environments, we can just do the following: Stop all applications on the server. Change the IP address at the O/S level. Restart server and/or netw

  • SQL Query in Javascript

    Hi All, I have an SQL query which needs to be invoked when ever javscript function is called. Is it possible in Oracle Apex to embed a SQL query in the javascript function...If so, Please can anyone provide me with a right syntax ??? Regards, Sandeep

  • File to IDOC with some delay

    Hi Experts, My requirement is that i need to read text file line by line and post IDOC to R3 with 3 minutes delay. That means, between two idocs that got posted ot R3, there shuld be 3 minutes delay from XI. Is this possible, If it is possible how it

  • SE51 Screen Painter - can't not start graphical painter

    hello All, when we try to use SE51 - screen painter through a connection via saprouter the followin message appear: Password in router string. Cannot start graphical screen painter we have installed SAP GUI 7.10 patch 02 Thanks. Hernando