Usage of Correlation

Hi everybody,
I have configured BPM where I send messages to several business systems and then receive an answers from them. In SXMB_MONI I see that theese answers have "Processed Successfully" status that is a good sign, but also they have "Message has error status on outbd. side" red flag status that's not very good. Business process is stopped here and no further actions are executed. When clicking respective link "PE" in Outbound column near the flag there is a Event Queue Browser saying at the bottom of the screen that Receiver type is CORELLATION_MANAGER and Status is something unknown 'cos only "Waiting because of e" is readable.
Am I right that the problem is in correlation?
And what's your recommendations to use a correlation? For example I use Receiver Determination step to determine the quantity of receivers. And how then I need to set the parameter to distinguish message sent to one system from another message? As I understand correlation uses unique parameters to correlate send and receive steps.
Thank you,
Igor

Hi Varun,
Thank you for reply, I know this link.
Imagine the following process steps:
1. you have message with 2 elements
2. you need to send this message to 5 systems
3. you need to get answers from them.
How would you suggest to implement it?
Put Receiver Determination step between steps 1 and 2 or Transformation step?
How to make correlation between sent and received messages in this case:
Message for system 1:
<?xml version="1.0" encoding="UTF-8" ?>
<ns:mt_message xmlns:ns="http://sap.com/xi/message">
<DATA><id>id</id>
<key>key</key></DATA>
</ns:mt_message>
Response from system 1:
<?xml version="1.0" encoding="UTF-8" ?>
<ns:mt_response1 xmlns:ns="http://sap.com/xi/message">
<DATA><id>1</id>
<key>key</key></DATA>
</ns:mt_response1>
Message for system 2:
<?xml version="1.0" encoding="UTF-8" ?>
<ns:mt_message xmlns:ns="http://sap.com/xi/message">
<DATA><id>id</id>
<key>key</key></DATA>
</ns:mt_message>
Response from system 2:
<?xml version="1.0" encoding="UTF-8" ?>
<ns:mt_response2 xmlns:ns="http://sap.com/xi/message">
<DATA><id>2</id>
<key>key</key></DATA>
</ns:mt_response2>
and so on for the rest 3 systems.
If I make correlation using <key> element my BPM get stuck 'cos it doesn't have enough info to distinguish which message came from which system.
And how to solve it was my question.
Please no more links, I need real life experience.
Thank you,
Igor

Similar Messages

  • Regarding Correlation

    How and why is correlation used in a BPM sceanrio?
    Can anyone explain with an example the usage of Correlation?
    Edited by: swathi suresh on Mar 17, 2008 6:11 AM

    Dear Swathi
    Correlation used to assign messages that belong together to the same process instance.
    It joins messages that have the same valuefor one or more XML Elements.
    if u want to use the corelation in BPM on a particular filed then u have to do the following steps.
    in the corelation editor
    in the first column give any name to the corelation of type string
    in second column select the message interface for both the files u r getting and
    in the third column select the filed on which u want to set the corelation.
    U can go through the links below for moree details
    http://help.sap.com/saphelp_nw70/helpdata/en/11/13283fd0ca8443e10000000a114084/frameset.htm
    /people/sravya.talanki2/blog/2005/08/24/do-you-like-to-understand-147correlation148-in-xi

  • Populating Corrrelation ID on MQ Messages.

    Hi,
    I have a small Question regarding usage of correlation id for putting messages onto MQ from ESB using MQ Adapter,
    We have a requirement where we need to assign same correlation ID to header and line messages before putting the messages on the MQ.
    In our use case we receive one header message and multiple line/detail messages. Suppose if we have two order's placed we will get two header messages and multiple line/detail messages for both the header messages. We need to place all these messages on to the queue by assigning a correlation ID messages.
    When the partner tries to read the messages from the queue he will first check for the correlation ID and searches for the same id on other line messages and reads the respective messages.
    We tried to implement it on ESB but could not find a way of assigning correlation ID to the message before sending it to the Que.
    I was just wondering if any one had worked on the same requirement.
    Any pointers on this is greatly appreciated.
    Thanks
    Rao.

    James,
    Thanks for your reply,I tried that as well. I tried sending PASS_MSG_ID for ForMessageId. But no luck??...
    Am I correct in using FromMQInboundHeader-->CorrelationScheme-->ForMessageId or should I use
    MQOutboundHeaderAndProperties-->MQOutboundHeader-->CorrelationScheme-->ForMessageId?
    I am on SOA Suite10.1.3.4.0
    Here is my BPEL process...I will be lucky if you can spot ..if I am missing anything...Thanks a Lot
    Sunil
    <?xml version = "1.0" encoding = "UTF-8" ?>
    <!--
    Oracle JDeveloper BPEL Designer
    Created: Wed Sep 24 18:18:40 EDT 2008
    Author: satlluri
    Purpose: Empty BPEL Process
    -->
    <process name="MQTest07" targetNamespace="http://xmlns.oracle.com/MQTest07"
    xmlns="http://schemas.xmlsoap.org/ws/2003/03/business-process/"
    xmlns:xp20="http://www.oracle.com/XSL/Transform/java/oracle.tip.pc.services.functions.Xpath20"
    xmlns:bpws="http://schemas.xmlsoap.org/ws/2003/03/business-process/"
    xmlns:ns4="http://xmlns.oracle.com/pcbpel/adapter/aq/inbound/"
    xmlns:ids="http://xmlns.oracle.com/bpel/services/IdentityService/xpath"
    xmlns:ldap="http://schemas.oracle.com/xpath/extension/ldap"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema"
    xmlns:ns5="http://xmlns.oracle.com/pcbpel/adapter/mq/headerReport/"
    xmlns:client="http://xmlns.oracle.com/MQTest07"
    xmlns:ns6="http://xmlns.oracle.com/pcbpel/adapter/mq/header"
    xmlns:ora="http://schemas.oracle.com/xpath/extension"
    xmlns:xref="http://www.oracle.com/XSL/Transform/java/oracle.tip.xref.xpath.XRefXPathFunctions"
    xmlns:hwf="http://xmlns.oracle.com/bpel/workflow/xpath"
    xmlns:ns1="http://xmlns.oracle.com/pcbpel/adapter/file/InboundPL/"
    xmlns:ehdr="http://www.oracle.com/XSL/Transform/java/oracle.tip.esb.server.headers.ESBHeaderFunctions"
    xmlns:ns3="http://xmlns.oracle.com/pcbpel/adapter/mq/headerEQ/"
    xmlns:ns2="http://xmlns.oracle.com/pcbpel/adapter/opaque/"
    xmlns:bpelx="http://schemas.oracle.com/bpel/extension"
    xmlns:orcl="http://www.oracle.com/XSL/Transform/java/oracle.tip.pc.services.functions.ExtFunc">
    <!--
    PARTNERLINKS
    List of services participating in this BPEL process
    -->
    <partnerLinks>
    <partnerLink myRole="Read_role" name="InboundPL"
    partnerLinkType="ns1:Read_plt"/>
    <partnerLink name="EQ" partnerRole="Enqueue_role"
    partnerLinkType="ns3:Enqueue_plt"/>
    <partnerLink myRole="Dequeue_role" name="Report" partnerRole="Enqueue_role"
    partnerLinkType="ns5:Report_plt"/>
    </partnerLinks>
    <!--
    VARIABLES
    List of messages and XML documents used within this BPEL process
    -->
    <variables>
    <variable name="Receive_Opaque_Data_Read_InputVariable"
    messageType="ns1:Read_msg"/>
    <variable name="Header" element="ns4:Header"/>
    <variable name="Invoke_1_Enqueue_InputVariable_1"
    messageType="ns5:Enqueue_msg_out"/>
    <variable name="Outbound_Header" messageType="ns6:OutboundHeader_msg"/>
    </variables>
    <!--
    ORCHESTRATION LOGIC
    Set of activities coordinating the flow of messages across the
    services integrated within this business process
    -->
    <sequence name="main">
    <receive name="Receive_Opaque_Data" partnerLink="InboundPL"
    portType="ns1:Read_ptt" operation="Read"
    variable="Receive_Opaque_Data_Read_InputVariable"
    createInstance="yes"/>
    <assign name="Assign_1">
    <copy>
    <from variable="Receive_Opaque_Data_Read_InputVariable" part="opaque"
    query="/ns2:opaqueElement"/>
    <to variable="Invoke_1_Enqueue_InputVariable_1" part="opaque"
    query="/ns2:opaqueElement"/>
    </copy>
    <copy>
    <from expression="'NEW_MSG_ID'"/>
    <to variable="Outbound_Header" part="outboundHeader"
    query="/ns6:MQOutboundHeaderAndProperties/ns6:FromMQInboundHeader/ns6:CorrelationScheme/ns6:ForMessageId"/>
    </copy>
    <copy>
    <from expression="'12'"/>
    <to variable="Outbound_Header" part="outboundHeader"
    query="/ns6:MQOutboundHeaderAndProperties/ns6:FromMQInboundHeader/ns6:MsgId"/>
    </copy>
    </assign>
    <scope name="Scope_1">
    <invoke name="Invoke_1" partnerLink="Report" portType="ns5:Enqueue_ptt"
    operation="Enqueue"
    inputVariable="Invoke_1_Enqueue_InputVariable_1"
    bpelx:inputHeaderVariable="Outbound_Header"/>
    </scope>
    </sequence>
    </process>

  • Is there a documented correlation between high CPU/RAM usage and poor system performance?

    I realize this subject is not black and white and has quite a bit of depth to it as high usage of either the CPU or RAM does not necessarily mean that a computer is running slowly.
    However, is there any documentation, scientific research or academic journal that makes a correlation between poor system performance and the consumption of system resources.
    It goes without saying that if you use all your RAM then there won't be any available for additional programs, but can this be substantiated with metrical data?

    Check this:
    http://superuser.com/questions/78362/what-is-the-relationship-between-cpu-usage-and-ram
    http://www.computermemoryupgrade.net/memory-influence-on-performance.html
    Fouad Roumieh

  • Correlations - Usage and performance

    Hello forum users,
    I would like to know until where I can go with BPM using correlation.
    My need is to initiate a BPM with a first message and finish it at the arrival of a second one (different message) using a correlation Identifier. Such a standard case.
    My question is : It is a problem if the second message is able to arrive many weeks after the first. and during this time many and many other instance of the same BPM will be initiate....
    Must I care with performance issue ?
    How ?
    BPM steps in detail :
    Flat file representing a customer sales order is received  => Init BPM
    Syncrhonous BAPI call on R/3. Response give sd document number => Activation of correlation
    BPM send a first (technical) acknowledgement file to original sender.
    Now a second acknowledgement file (more business one) must be send when all the items are ok (It may have been errors in automatic integration...). In order to be in this configuration, user actions may be required and this can take a long time (many days, week)
    When user decide sd documents is full and ok, SAP R/3 send the second message that close the correlation and trigger the end of BPM (generating ack flat file N°2)
    (I imagine the second message as an ORDRSP trigger by an output SAP Control)
    Thanks for your advices.
    JC.

    hi,
    To explain you the correlation in simple terms...take a simple example of BPM with a send step(async request) and receive step(async response). I am sending a PO request using the send step and waiting for a PO response using the recieve step. Assume that i have two instances of this BPM running i.e two PO request's going simultaneously. when i get the response back for these two requests , there will be two recieve steps waiting for the response since there are two instances of BPM running. the response need to be assigned the corresponding requests. This is where correlation comes into picture. I can use PO number as my correlation field. i.e I activate my correlation in the send step and use this correlation in receive step (this is configurable in BPM).
    Example: PO number needs to be part both request and the response message structure.
    BPM instance1:
    send step -> activate correlation -> send message with PO Number1
    Receive step -> use correlation -> receive response message with PO Number 1.
    BPM instance1:
    send step -> activate correlation -> send message with PO Number2
    Receive step -> use correlation -> receive response message with PO Number 2.
    There are many different scenario's whre you can use the correlation..this is one of them...The weblog shows another way of using correlation.
    Also Refer SAP help...
    Correlating Messages
    Use
    You use a correlation to assign messages that belong together to the same process instance. A correlation joins messages that have the same value for one or more XML elements. A correlation is therefore a loose coupling of messages: at design time, it enables you to define which message a receive step must wait for, without knowing the message ID.
    For example, in a process, receivestep_1receives the message purchaseorder, while receivestep_2receives the message salesorder. Receivestep_1creates a correlation that defines that the corresponding sales order must have the same purchase order number. Receivestep_2uses this correlation. This means that an instance of the process processes a purchase order and the corresponding sales order, which has the same purchase order number.
    If it satisfies the relevant correlations, a message can be processed in multiple processes. However, a message is only delivered once per process.
    For more details.. visit the blog by sravya
    /people/sravya.talanki2/blog/2005/08/24/do-you-like-to-understand-147correlation148-in-xi
    Thanks,
    Vijaya

  • Data usage and battery drain has skyrocketed with iOS 8.1.2 (maybe earlier)

    3 weeks ago my wife got a text message on her iPhone 5 from AT&T that she had used 90% of her data for the month.  30 seconds later, she got another one saying that she had used 100%.  Granted, her data plan is small, 200 MB.  But, for the last two years she has used as little as 17 MB in a month and her largest prior to this latest month was 49 mb.  This month she got to 380 mb before we were able to shut off her cell data.  Otherwise, a second chunk of 200 MB and another $15 would have been added to the month.
    We had noticed that her battery had been draining rather rapidly in standby mode with no background apps running when she didn't have access to WiFi.  We have now correlated the two results, High Cell data usage, Quick battery drain and very warm phone.  In case anyone is wondering about her iPhone 5 being one in the recall, it is.  I took it in and had it tested.  Apple says the battery is fine.  It does hold a charge well.  When all network communications are shut down on her phone and it is in standby mode, there is no noticeable loss of charge in 24 hours (our longest test).
    Since I have a grandfathered Unlimited Data Plan with AT&T, I have been doing some testing on my iPhone 5s.  Sure enough, I've seen similar results.  With nearly everything turned off except Cell Data, I've seen 483 MB used in 24 hours.  Of that total, 479 MB was used for Documents & Sync.  I even have everything turned off in my iCloud account, Location services are turned off, no push notifications etc...
    The best I can figure, this has been a problem since we installed 8.1.2 and yesterday I installed 8.1.3 resulting in no positive effect on this issue.
    At this rate of data usage and no access to WiFi, my wife would have to have a 15 Gb data plan to keep from exceeding her limit.  I don't think AT&T even offers one that big anymore.  I might have to switch to Sprint or T-Mobile if this doesn't get resolved.
    Any ideas would be greatly appreciated.  Thanks in advance for your shared insights.

    Hey this is Brian, bjmcmurry, under a different user ID.  If I logged in as bmcmurry, original post, I was just getting a server error and couldn't get to this discussion nor post a comment anywhere.
    Anyway, let me be as brief as I can.  After an extensive analysis of replicating the problem on another phone to eliminate it being a hardware specific issue and that the test phone has an unlimited data plan, I was able to stop the excessive data usage and consequential battery drain.  I believe I have a reasonable explanation of the problem, an iOS logic bug.
    I had everything under my control clamped down on the test phone to minimize data usage.  Also, I was forcing all data usage to use the cell towers.  I determined that I was burning at least 11 to 13 Mb per hour doing nothing important.  I literally had everything turned off except 'Settings' was allowed to use Cell data providing a avenue to log into the Apple ID. 
    The two phones had 2 things in common, they were using the same Apple ID and the same version of the OS.  One was a iPhone 5 and the other was a 5s.
    Here is a synopsis of my experience via my written evaluation of the Apple support system (Apple Rep name's have been removed):
    After a couple of hours on the phone with an Apple Care Senior support Analyst, it was suggested that I go to the Apple Store to 1) get my battery replace in the iPhone 5 since it qualified for the replacement program and 2) see if the Genius could provide me with any insight in the data usage issue and battery drain.
    I'm certainly glad I had multiple reasons to visit the closest Apple store, a 45 min drive.  I got the battery replaced, thanks for that. 
    Regarding the important issue to me that brought me to the Genius Bar, excessive Cell data usage, I thought the Genius did a wonderful job listening and documenting the problem we were experiencing.  Unfortunately, educating us on the use of the product or replacing our phone was not going to solve the problem.  He eventually figured it out, this was not a user error or broken hardware.  We surmised that the reason I was sent to him was to verify and document that there was a problem.  I clearly had a problem.  After writing copious notes on the issue, The Genius smartly referred me back the the AppleCare Senior Advisor.  So, back to AppleCare Senior Analyst I went. She, knowing this was not a simple problem to solve i.e. beyond her level of expertise, got an Apple Software engineer involved.
    My primary frustration is that this should have been escalated to software engineering right away.  My trip to see the Genius was, I believe, a waste of time for both me and Apple regarding this issue.  Diagnosis of this type of problem is well beyond the Genius’ knowledge and job.  The Genius did a very good job doing what he could within the scope of his job.  He just couldn’t solve this problem and had no one within Apple to which he had access for help.
    However, that initial consult with the engineer was a bit feeble.  Not only could I not talk to him/her directly, his/her focus was still working with the ‘Black Box' approach.  Having Analyst ask me to do stuff like restore the Phone was more like trying to find a 'work around' than 'identifying the real problem.'  Maybe restoring the phone was going to fix some corrupted data on the phone sidesteping the real problem, the handling of this condition.  The engineer did listen to the fact that I had restored the test phone, the 5s, and only added the use of my Apple ID.  Duh, been there!!!
    Having been an previous owner of a software development company that I started in 1980 and retired in 2001, I can tell you that using the 'Black Box' method of debugging is extremely inefficient.  Instead, having access to an ‘Activity Manager’ type app to identify in real time what process was blowing up the data flow would have saved me a lost afternoon at the Apple store and hours on the phone with tech support.
    Ironically, I may have stumbled onto a "work around" solution short of turning off Cell Data that stopped the excessive Cell Data usage and consequential battery drain.  Just prior to leaving the Apple Store, I used one of their Macs to log in my Apple ID on the id.apple.com website to ‘Manage my Apple ID’, I was forced to upgrade the security level of my password.  Afterward, my cell data usage seemed to drop dramatically.
    I told the AppleCare Senior Analyst that I may have stumbled onto a workaround and I suggested that I give it a couple of days of monitoring.  We'd talk then and I would have results to report.  She agreed. 
    Sure enough, my Document & Sync usage was back to normal, about 1/2 Mb per day.  Am I happy that the excessive Cell Data usage has stopped?  You bet!  But, there was no intuitive reason that an end user would know to log in on the ID website to unknowingly solve this problem.  As I use to say to my employees, that is not the ‘Macintosh Way.’  And, rebooting the the 'Microsoft Way.'
    When I reported my findings to the Analyst, we both concluded that data usage was back to normal.  She did report to me that the engineer did provide a laundry list of suggested activities to help solve the problem.  Remarkably, they were everything that I had already done and were pretty much what the Analyst and the Genius tried to do.  All reasonable tasks.  But clearly, the engineer hadn't even ready the notes on the case before responding.  And, none of the things suggested would have uncovered the real problem, likely a logic bug in iOS.
    My advice now is to have the software engineering team rule out that there was an unresolvable state that a background process was fiercely trying to handle.  The iOS does not seem to know how to intervene and prompt the user with a requirement to upgrade their password.  If this does end up being the case, I would call it a logic bug, a perpetual exception that is not being handled properly.
    Anyway, I hope this helps you.

  • Massive memory hemorrhage; heap size to go from about 64mb, to 1.3gb usage

    **[SOLVED]**
    Note: I posted this on stackoverflow as well, but a solution was not found.
    Here's the problem:
    [1] http://i.stack.imgur.com/sqqtS.png
    As you can see, the memory usage balloons out of control! I've had to add arguments to the JVM to increase the heapsize just to avoid out of memory errors while I figure out what's going on. Not good!
    ##Basic Application Summary (for context)
    This application is (eventually) going to be used for basic on screen CV and template matching type things for automation purposes. I want to achieve as high of a frame rate as possible for watching the screen, and handle all of the processing via a series of separate consumer threads.
    I quickly found out that the stock Robot class is really terrible speed wise, so I opened up the source, took out all of the duplicated effort and wasted overhead, and rebuilt it as my own class called FastRobot.
    ##The Class' Code:
        public class FastRobot {
             private Rectangle screenRect;
             private GraphicsDevice screen;
             private final Toolkit toolkit;
             private final Robot elRoboto;
             private final RobotPeer peer;
             private final Point gdloc;
             private final DirectColorModel screenCapCM;
             private final int[] bandmasks;
             public FastRobot() throws HeadlessException, AWTException {
                  this.screenRect = new Rectangle(Toolkit.getDefaultToolkit().getScreenSize());
                  this.screen = GraphicsEnvironment.getLocalGraphicsEnvironment().getDefaultScreenDevice();
                  toolkit = Toolkit.getDefaultToolkit();
                  elRoboto = new Robot();
                  peer = ((ComponentFactory)toolkit).createRobot(elRoboto, screen);
                  gdloc = screen.getDefaultConfiguration().getBounds().getLocation();
                  this.screenRect.translate(gdloc.x, gdloc.y);
                  screenCapCM = new DirectColorModel(24,
                            /* red mask */    0x00FF0000,
                            /* green mask */  0x0000FF00,
                            /* blue mask */   0x000000FF);
                  bandmasks = new int[3];
                  bandmasks[0] = screenCapCM.getRedMask();
                  bandmasks[1] = screenCapCM.getGreenMask();
                  bandmasks[2] = screenCapCM.getBlueMask();
                  Toolkit.getDefaultToolkit().sync();
             public void autoResetGraphicsEnv() {
                  this.screenRect = new Rectangle(Toolkit.getDefaultToolkit().getScreenSize());
                  this.screen = GraphicsEnvironment.getLocalGraphicsEnvironment().getDefaultScreenDevice();
             public void manuallySetGraphicsEnv(Rectangle screenRect, GraphicsDevice screen) {
                  this.screenRect = screenRect;
                  this.screen = screen;
             public BufferedImage createBufferedScreenCapture(int pixels[]) throws HeadlessException, AWTException {
        //          BufferedImage image;
                DataBufferInt buffer;
                WritableRaster raster;
                  pixels = peer.getRGBPixels(screenRect);
                  buffer = new DataBufferInt(pixels, pixels.length);
                  raster = Raster.createPackedRaster(buffer, screenRect.width, screenRect.height, screenRect.width, bandmasks, null);
                  return new BufferedImage(screenCapCM, raster, false, null);
             public int[] createArrayScreenCapture() throws HeadlessException, AWTException {
                       return peer.getRGBPixels(screenRect);
             public WritableRaster createRasterScreenCapture(int pixels[]) throws HeadlessException, AWTException {
             //     BufferedImage image;
                 DataBufferInt buffer;
                 WritableRaster raster;
                  pixels = peer.getRGBPixels(screenRect);
                  buffer = new DataBufferInt(pixels, pixels.length);
                  raster = Raster.createPackedRaster(buffer, screenRect.width, screenRect.height, screenRect.width, bandmasks, null);
             //     SunWritableRaster.makeTrackable(buffer);
                  return raster;
        }In essence, all I've changed from the original is moving many of the allocations from function bodies, and set them as attributes of the class so they're not called every time. Doing this actually had a significant affect on frame rate. Even on my severely under powered laptop, it went from ~4 fps with the stock Robot class, to ~30fps with my FastRobot class.
    ##First Test:
    When I started outofmemory errors in my main program, I set up this very simple test to keep an eye on the FastRobot. Note: this is the code which produced the heap profile above.
        public class TestFBot {
             public static void main(String[] args) {
                  try {
                       FastRobot fbot = new FastRobot();
                       double startTime = System.currentTimeMillis();
                       for (int i=0; i < 1000; i++)
                            fbot.createArrayScreenCapture();
                       System.out.println("Time taken: " + (System.currentTimeMillis() - startTime)/1000.);
                  } catch (AWTException e) {
                       e.printStackTrace();
        }##Examined:
    It doesn't do this every time, which is really strange (and frustrating!). In fact, it rarely does it at all with the above code. However, the memory issue becomes easily reproducible if I have multiple for loops back to back.
    #Test 2
        public class TestFBot {
             public static void main(String[] args) {
                  try {
                       FastRobot fbot = new FastRobot();
                       double startTime = System.currentTimeMillis();
                       for (int i=0; i < 1000; i++)
                            fbot.createArrayScreenCapture();
                       System.out.println("Time taken: " + (System.currentTimeMillis() - startTime)/1000.);
                       startTime = System.currentTimeMillis();
                       for (int i=0; i < 500; i++)
                            fbot.createArrayScreenCapture();
                       System.out.println("Time taken: " + (System.currentTimeMillis() - startTime)/1000.);
                       startTime = System.currentTimeMillis();
                       for (int i=0; i < 200; i++)
                            fbot.createArrayScreenCapture();
                       System.out.println("Time taken: " + (System.currentTimeMillis() - startTime)/1000.);
                       startTime = System.currentTimeMillis();
                       for (int i=0; i < 1500; i++)
                            fbot.createArrayScreenCapture();
                       System.out.println("Time taken: " + (System.currentTimeMillis() - startTime)/1000.);
                  } catch (AWTException e) {
                       e.printStackTrace();
        }##Examined
    The out of control heap is now reproducible I'd say about 80% of the time. I've looked all though the profiler, and the thing of most note (I think) is that the garbage collector seemingly stops right as the fourth and final loop begins.
    The output form the above code gave the following times:
    Time taken: 24.282 //Loop1
    Time taken: 11.294 //Loop2
    Time taken: 7.1 //Loop3
    Time taken: 70.739 //Loop4
    Now, if you sum the first three loops, it adds up to 42.676, which suspiciously corresponds to the exact time that the garbage collector stops, and the memory spikes.
    [2] http://i.stack.imgur.com/fSTOs.png
    Now, this is my first rodeo with profiling, not to mention the first time I've ever even thought about garbage collection -- it was always something that just kind of worked magically in the background -- so, I'm unsure what, if anything, I've found out.
    ##Additional Profile Information
    [3] http://i.stack.imgur.com/ENocy.png
    Augusto suggested looking at the memory profile. There are 1500+ `int[]` that are listed as "unreachable, but not yet collected." These are surely the `int[]` arrays that the `peer.getRGBPixels()` creates, but for some reason they're not being destroyed. This additional info, unfortunately, only adds to my confusion, as I'm not sure why the GC wouldn't be collecting them
    ##Profile using small heap argument -Xmx256m:
    At irreputable and Hot Licks suggestion I set the max heap size to something significantly smaller. While this does prevent it from making the 1gb jump in memory usage, it still doesn't explain why the program is ballooning to its max heap size upon entering the 4th iteration.
    [4] http://i.stack.imgur.com/bR3NP.png
    As you can see, the exact issue still exists, it's just been made smaller. ;) The issue with this solution is that the program, for some reason, is still eating through all of the memory it can -- there is also a marked change in fps performance from the first the iterations, which consume very little memory, and the final iteration, which consumes as much memory as it can.
    The question remains why is it ballooning at all?
    ##Results after hitting "Force Garbage Collection" button:
    At jtahlborn's suggestion, I hit the Force Garbage Collection button. It worked beautifully. It goes from 1gb of memory usage, down to the basline of 60mb or so.
    [5] http://i.stack.imgur.com/x4282.png
    So, this seems to be the cure. The question now is, how do I pro grammatically force the GC to do this?
    ##Results after adding local Peer to function's scope:
    At David Waters suggestion, I modified the `createArrayCapture()` function so that it holds a local `Peer` object.
    Unfortunately no change in the memory usage pattern.
    [6] http://i.stack.imgur.com/Ky5vb.png
    Still gets huge on the 3rd or 4th iteration.
    #Memory Pool Analysis:
    ###ScreenShots from the different memory pools
    ##All pools:
    [7] http://i.stack.imgur.com/nXXeo.png
    ##Eden Pool:
    [8] http://i.stack.imgur.com/R4ZHG.png
    ##Old Gen:
    [9] http://i.stack.imgur.com/gmfe2.png
    Just about all of the memory usage seems to fall in this pool.
    Note: PS Survivor Space had (apparently) 0 usage
    ##I'm left with several questions:
    (a) does the Garbage Profiler graph mean what I think it means? Or am I confusing correlation with causation? As I said, I'm in an unknown area with these issues.
    (b) If it is the garbage collector... what do I do about it..? Why is it stopping altogether, and then running at a reduced rate for the remainder of the program?
    (c) How do I fix this?
    Does anyone have any idea what's going on here?
    [1]: http://i.stack.imgur.com/sqqtS.png
    [2]: http://i.stack.imgur.com/fSTOs.png
    [3]: http://i.stack.imgur.com/ENocy.png
    [4]: http://i.stack.imgur.com/bR3NP.png
    [5]: http://i.stack.imgur.com/x4282.png
    [6]: http://i.stack.imgur.com/Ky5vb.png
    [7]: http://i.stack.imgur.com/nXXeo.png
    [8]: http://i.stack.imgur.com/R4ZHG.png
    [9]: http://i.stack.imgur.com/gmfe2.png
    Edited by: 991051 on Feb 28, 2013 11:30 AM
    Edited by: 991051 on Feb 28, 2013 11:35 AM
    Edited by: 991051 on Feb 28, 2013 11:36 AM
    Edited by: 991051 on Mar 1, 2013 9:44 AM

    SO came through.
    Turns out this issue was directly related to the garbage collector. The default one, for whatever reason, would get behind on its collection at points, and thus the memory would balloon out of control, which then, once allocated, became the new normal for the GC to operate at.
    Manually setting the GC to ConcurrentMarkSweep solved this issue completely. After numerous tests, I have been unable to reproduce the memory issue. The garbage collector does an excellent job of keeping on top of these minor collections.

  • Weather App Affecting my Data Usage

    Hi Community,
    Back in October 2013 when I changed my IPhone from a 4S to a 5S I had to go from an “Unlimited” plan to Tiered plan.  I went to a tiered planned capped at 2 GB per billing cycle.  This didn’t bother me because I would never use all of my allocated data and I usually came in way under 2gb’s
    Under my new plan, I set up my data alerts to monitor my usage.   This past week on tuesday, I was notified that my usage was at 75% of the data allowed.   I immediately called VZW to ask how and the tech said that my phone had streamed for an inordinate amount of time around 18 hours while using a app, on the days where my usage was high.  The tech was unable to tell me which app, but advised me to take it into the store immediately.
    I took my phone into the store and luckily the manager had the same issue on his IPad.  He replaced the Sim Card and reset the settings on my phone and credited my account $20 to pay for the extra usage.   Really great customer service!!!
    Monitoring my data usage, I noticed that my phone would incrementally use the data plan even while on my wifi.    It would only do it in 8 hour increments, I was led to a previous post via Google (on the apple forums) and I found that the culprit may that I had set up my phone to automatically send diagnostic data.  
    I shut this feature off, being nosy I looked at the data that was being sent and noticed two odd diagnostic reports titled: Weather_2013_11.08_17:55 and Weather +Stacks 11/10 20:37:47.
    The latter (Weather +Stacks 11/10 20:37:47.) diagnostic report I can only assume was informing me that the weather app stayed opened beyond its allocated time.  Which prevented the phone from sleeping so it the OS finally crashed the crashed the program. 
    Also I assume that the report was informing me that informed me in the app it had stayed connected to the weather server for 66,447 seconds, which is about 18.45 hours and used 1147387904 bytes of data or just over 1 GB of usage…. 
    Now I’m not saying that these separate instances are related, but the interesting thing 11/10 I was shown according to VZW that I had amassed 66.51 MB’s.
    I am wondering if anyone else has seen this correlation.  I have attached screenshots to clarify any confusing parts of the story.   there are three pics, so scroll all the way down

    Settings > Cellular only counts cellular data.  I can verify that because I'm on AT&T and that carrier offers a service whereby you can telephone *DATA and receive a text message from them telling your month-to-date cellular data usage.  I can compare that number to what I see in Settings > Cellular and the two are pretty well equivalent.
    Again, I do a Settings > Cellular > Reset Statistics at the end of every billing month.
    UPDATE - I said "month-to-date cellular data usage" above.  I should have said "billing period to date."
    Message was edited by: sberman

  • At my wits end with Bt usage monitor

    I keep getting emails stating I have gone over my broadband usage stating I'm using 100+gb in a month.
    I know this is not the case as I have been logging into my homehub which tells a different story. It has been connected solid for 15 days and I have used around 5gb which is in line with what I expect for my usage.
    I rang the tech help and they said I have used around 20gb around 20 days into the month but this has not been amended or corrected.
    I have noticed since I have cancelled youview IP channels my usage has dropped dramatically and suspect this is e cause of massive usage.
    Am I likely to get a missive bill at the end of the month it's making me worried.

    A1944 wrote:
    vofsanity2 wrote:
    A1944: Can you confirm that the HH 3 A resets randomly without reconnecting ?.  HH 4 A resets the value of data up or down independantly  to 0 when the value reaches 4.3 GB  consistently.  Nobody in the community appears to have measured what value the 3 A resets at and just say around 5 GB or as you have indicated randomly.  
    When I say randomly, I am including those (rare) occasions when a reconnection does takes place.  Without reconnection it does seem to be around 5GB.  Without reading it every few minutes it is difficult to be certain of an exact figure but I do have a record of a reading of 5.7 on 4 Jan which surprised me.
    It is worth repeating that there is no correlation between the start of the month (when BT charging resets) and any reset to zero of the Home Hub.  Consequently, on the 1st of the month the hub may read anything between 0 and about 5GB. For example, my hub was 4.7 at 0815 on 31st Dec but by 1530 was showing 0.6.  The following morning (1st Jan) at 0930 it was already up to 1.2.
    A1944,
    Thank you for the update. 
    I agree that it is difficult getting the exact reset figure. I only got the 4.3 GB figure by spotting when it was close to that figure and then downloading a reasonable large file and regularly tapping refresh on the Home Hub  Internet Connection screen. It saves hanging around waiting for it to reset. 

  • SQL Bug in "Minus" in correlated subquery presence of index (11.2.0.1.0)

    SQL Bug in "Minus" in correlated subquery presence of index
    (Oracle Database 11g Release 11.2.0.1.0)
    Below, there is a small example that shows the bug. Further below,
    there are some more comments.
    drop table Country;
    create table Country
    (code VARCHAR2(4) constraint countrykey PRIMARY KEY,
    name VARCHAR2(35));
    -- if the key constraint is not given, the bug does not occur
    drop table City;
    create table City
    (name VARCHAR2(35),
    country VARCHAR2(4),
    population number);
    drop table Locatedon;
    create table Locatedon
    (city VARCHAR2(35),
    country VARCHAR2(4),
    island VARCHAR2(35));
    insert into country values('E','Spain');
    insert into country values('F','France');
    insert into country values('S','Sweden');
    insert into country values('GB','Sweden');
    insert into city values('Ajaccio','F',53500);
    insert into city values('Paris','F',2152423);
    insert into city values('Palma','E',322008);
    insert into city values('Madrid','E',3041101);
    insert into city values('Stockholm','S',711119);
    insert into city values('London','GB',6967500);
    insert into locatedon values('Ajaccio','F','Corse');
    insert into locatedon values('Palma','E','Mallorca');
    insert into locatedon values('London','GB','Great Britain');
    -- all countries that have a city that is not located on
    -- some island: should be E, F, S.
    Select c.name
    From country c
    Where exists
    ((Select name
    From city
    Where city.country=c.code)
    minus
    (Select city
    From locatedon
    Where locatedon.country=c.code)
    -- wrong answer: only Sweden; Spain and France not in the answer!
    select distinct country from
    ((Select name, country
    From city)
    minus
    (Select city, country
    From locatedon)
    -- correct answer: E, F, S
    Comments:
    The bug has been found by students in our SQL course.
    Using a larger database from that course, the bug can be reproduced
    (same queries as above) at
    http://www.semwebtech.org/sqlfrontend/
    (wrong: 142 answers, correct: 154 answers)
    During reducing it to a simple sample, there were some interesting
    observations: trying with smaller and simpler tables (without the keys)
    and synthetic data, the bug did not occur immediately. When
    restating the query after about one day, the bug occurred. Obviously,
    Oracle creates some index on its own in course of its internal
    optimization that (or more exactly, its usage) exhibits the bug. The
    query plan (showed in SQL Developer) was the same before and after.
    Wolfgang

    There's a typo in the test data - GB should presumably not be in Sweden. However....
    the bug did not occur immediatelyIt's possible. But what would have almost certainly happened is that the execution plan DID change at some point. There are various reasons why it might not be immediate.
    Obviously, Oracle creates some index on its own in course of its internal optimizationFar from obvious, what are you on about?
    The query plan was the same before and afterBet you it wasn't.
    A clear illustration of the issue and indication that it must be a bug is below.
    Simply by hinting a different access method, we can change the result. Therefore, bug.
    See [url http://support.oracle.com]Oracle Support and search for "wrong results".
    Please raise with Oracle Support to get confirmation of bug.
    There have been so many wrong results bugs recently, it's getting ridiculous.
    It's a real issue, IMHO.
    If you can't trust the DB to get your data right....
    Note that the query plan is very much NOT the same and it is the difference in query plan which s that is the root cause of the bug.
    SQL> select * from v$version;
    BANNER
    Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
    PL/SQL Release 11.2.0.2.0 - Production
    CORE    11.2.0.2.0      Production
    TNS for Linux: Version 11.2.0.2.0 - Production
    NLSRTL Version 11.2.0.2.0 - Production
    SQL> SELECT c.name
      2  FROM   country1 c
      3  WHERE  exists ((SELECT name
      4                  FROM   city1
      5                  WHERE  city1.country=c.code)
      6                  MINUS
      7                 (SELECT city
      8                  FROM   locatedon1
      9                  WHERE  locatedon1.country=c.code));
    NAME
    Sweden
    SQL> SELECT /*+ full(c) */
      2         c.name
      3  FROM   country1 c
      4  WHERE  exists ((SELECT name
      5                  FROM   city1
      6                  WHERE  city1.country=c.code)
      7                  MINUS
      8                 (SELECT city
      9                  FROM   locatedon1
    10                  WHERE  locatedon1.country=c.code));
    NAME
    Spain
    France
    Sweden
    SQL> explain plan for
      2  SELECT c.name
      3  FROM   country1 c
      4  WHERE  exists ((SELECT name
      5                  FROM   city1
      6                  WHERE  city1.country=c.code)
      7                  MINUS
      8                 (SELECT city
      9                  FROM   locatedon1
    10                  WHERE  locatedon1.country=c.code));
    Explained.
    SQL> select * from table(dbms_xplan.display);
    PLAN_TABLE_OUTPUT
    Plan hash value: 156929629
    | Id  | Operation                    | Name       | Rows  | Bytes | Cost (%CPU)| Time     |
    |   0 | SELECT STATEMENT             |            |     1 |    27 |    12  (25)| 00:00:01 |
    |   1 |  NESTED LOOPS                |            |       |       |            |          |
    |   2 |   NESTED LOOPS               |            |     1 |    27 |    12  (25)| 00:00:01 |
    |   3 |    VIEW                      | VW_SQ_1    |     6 |    24 |    10  (20)| 00:00:01 |
    |   4 |     MINUS                    |            |       |       |            |          |
    |   5 |      SORT UNIQUE             |            |     6 |   138 |            |          |
    |   6 |       TABLE ACCESS FULL      | CITY1      |     6 |   138 |     4   (0)| 00:00:01 |
    |   7 |      SORT UNIQUE             |            |     3 |    69 |            |          |
    |   8 |       TABLE ACCESS FULL      | LOCATEDON1 |     3 |    69 |     4   (0)| 00:00:01 |
    |*  9 |    INDEX UNIQUE SCAN         | COUNTRYKEY |     1 |       |     0   (0)| 00:00:01 |
    |  10 |   TABLE ACCESS BY INDEX ROWID| COUNTRY1   |     1 |    23 |     1   (0)| 00:00:01 |
    Predicate Information (identified by operation id):
       9 - access("VW_COL_1"="C"."CODE")
    Note
       - dynamic sampling used for this statement (level=4)
    26 rows selected.
    SQL> explain plan for
      2  SELECT /*+ full(c) */
      3         c.name
      4  FROM   country1 c
      5  WHERE  exists ((SELECT name
      6                  FROM   city1
      7                  WHERE  city1.country=c.code)
      8                  MINUS
      9                 (SELECT city
    10                  FROM   locatedon1
    11                  WHERE  locatedon1.country=c.code));
    Explained.
    SQL> select * from table(dbms_xplan.display);
    PLAN_TABLE_OUTPUT
    Plan hash value: 1378726376
    | Id  | Operation            | Name       | Rows  | Bytes | Cost (%CPU)| Time     |
    |   0 | SELECT STATEMENT     |            |     1 |    23 |    14  (15)| 00:00:01 |
    |*  1 |  FILTER              |            |       |       |            |          |
    |   2 |   TABLE ACCESS FULL  | COUNTRY1   |     4 |    92 |     4   (0)| 00:00:01 |
    |   3 |   MINUS              |            |       |       |            |          |
    |   4 |    SORT UNIQUE       |            |     1 |    23 |     5  (20)| 00:00:01 |
    |*  5 |     TABLE ACCESS FULL| CITY1      |     1 |    23 |     4   (0)| 00:00:01 |
    |   6 |    SORT UNIQUE       |            |     1 |    23 |     5  (20)| 00:00:01 |
    |*  7 |     TABLE ACCESS FULL| LOCATEDON1 |     1 |    23 |     4   (0)| 00:00:01 |
    Predicate Information (identified by operation id):
       1 - filter( EXISTS ( (SELECT "NAME" FROM "CITY1" "CITY1" WHERE
                  "CITY1"."COUNTRY"=:B1)MINUS (SELECT "CITY" FROM "LOCATEDON1" "LOCATEDON1"
                  WHERE "LOCATEDON1"."COUNTRY"=:B2)))
       5 - filter("CITY1"."COUNTRY"=:B1)
       7 - filter("LOCATEDON1"."COUNTRY"=:B1)
    Note
       - dynamic sampling used for this statement (level=4)
    27 rows selected.Just to show that it's related to query transformation:
    SQL> SELECT /*+ 
      2             no_query_transformation
      3         */
      4         c.name
      5  FROM   country1 c
      6  WHERE  exists ((SELECT name
      7                  FROM   city1
      8                  WHERE  city1.country=c.code)
      9                  MINUS
    10                 (SELECT city
    11                  FROM   locatedon1
    12                  WHERE  locatedon1.country=c.code));
    NAME
    Spain
    France
    Sweden
    SQL> Edited by: Dom Brooks on Jun 30, 2011 2:50 PM

  • High usage in memory

    Dear All,
    I have a situation here that high usage of system memory, When i check in st22  i cud see only short dump relating to it.
    I checked in st06, 80 % of my memory is being used, only 20 % left.
    When i check the same in sm37 and there are only three jobs running which took only low memory.system is paging, How do i exactly find out which job is taking high consumption of my memory.
    where can i check all these.
    Rgds,
    sinner

    Hi,
    When you activate an InfoCube, rebuild an aggregate, delete the data of an InfoCube or perform other operations, the SAP BW system creates fact tables. By default, data compression is not activated in these cases.However, usually the numeric values in a fact table are correlated or are located in a small segment of the value range. For this data, you can achieve good compression rates with less memory space requirements and a better utilization of the DB2 buffer pool and, therefore, less input and output.
    Reduces application server access to Database. Ie.g. set the number range buffer for one dimension to 500, the system will keep 500 sequential numbers in memory SAP OSS note 130253: Notes on upload of transaction data into BW
    After the load, reset the number ranges buffer to its original state: minimize unnecessary memory allocation.

  • Unable to create the service call usage entry. Exception details: System.ObjectDisposedException: Message is closed.

    Hello Community
    my ULS-logs are flooded with entries like
    w3wp.exe SharePoint Foundation Topology ajczh High Unable to create the service call usage entry. Exception details: System.ObjectDisposedException: Message is closed. at System.ServiceModel.Channels.BufferedMessage.get_Headers() at Microsoft.SharePoint.Administration.SPServiceCallUsageEntry.Create(Message message) at Microsoft.SharePoint.SPServiceContextBehavior.System.ServiceModel.Dispatcher.IClientMessageInspector.BeforeSendRequest(Message& request, IClientChannel channel)
    Searching for solutions did not succeed, as the EventID of ajczh is not found on the web. Anyone had this problem already?
    Best Regards
    Michael

    Hi Linda
    thanks a lot for help.
    I modified the ULS-logging to include verbose entries. The problem is correlated to Excel Services, which are functioning quite well on our side. Our Topology consists of an application server, 2 WFE and an office app server. We are using the BI features
    of PowerPivot via an additional BI-SQL-server in SharePoint-mode.
    Right before the strange entry in the logs we are getting these:
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Web Front End 145c Verbose ServerSession.ExecuteWithSecurityContext: Before issuing a new request to server http://XXXXX028:32843/[guid]/ExcelService*.asmx ServerRequestCount: 1, AllServersRequestCount: 2, workerThreads: 395, completionPortThreads: 400
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Web Front End 8k3v Verbose ServerInfo.AcquireHealthCheckPriviliges: Acquired HealthCheck priviliges for server 'http://XXXXX028:32843/[guid]/ExcelService*.asmx'
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Excel Calculation Services d51n Medium MossHost.GetEndpointAddress: Server endpoint Uri: http://XXXXX028:32843/[guid]/ExcelService.asmx.
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Excel Calculation Services d51b Verbose MossHost.CreateServiceChannel<IExcelServiceSoap>: About to create service channel in Claims mode.
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Excel Calculation Services d51c Verbose MossHost.CreateServiceChannel<IExcelServiceSoap>: Service channel created.
    02.26.2014 10:42:45.02 w3wp.exe Excel Services Application Web Front End abpw Verbose ServerSession.GetHealthScoreCallback: About to send a GetHealthScore call to server http://XXXXX028:32843/[guid]/ExcelService*.asmx
    02.26.2014 10:42:45.02 w3wp.exe SharePoint Foundation Topology e5mc Medium WcfSendRequest: RemoteAddress: 'http://XXXXX028:32843/[guid]/ExcelService.asmx' Channel: 'Microsoft.Office.Excel.Server.CalculationServer.Proxy.IExcelServiceSoap' Action: 'http://schemas.microsoft.com/office/Excel/Server/WebServices/ExcelServerInternalService/ExcelServiceSoap/GetHealthScore' MessageId: 'urn:uuid:61212e7d-cf02-41ad-9876-2adf17ec2807'
    02.26.2014 10:42:45.02 w3wp.exe SharePoint Foundation Topology ajczh High Unable to create the service call usage entry. Exception details: System.ObjectDisposedException: Message is closed. at System.ServiceModel.Channels.BufferedMessage.get_Headers() at Microsoft.SharePoint.Administration.SPServiceCallUsageEntry.Create(Message message) at Microsoft.SharePoint.SPServiceContextBehavior.System.ServiceModel.Dispatcher.IClientMessageInspector.BeforeSendRequest(Message& request, IClientChannel channel)
    that's it, unfortunately. These entries are repeating every 15 seconds.
    Best Regards
    Michael

  • Correlation Set With externals partners

    Hello,
    I have a question regarding correlation set and there usage.
    I'm currently making a samll poc on "correlation set" for testing the feature to determine if we could use it for our use case.
    I'm hitting some problems that I can't overcome for the moment, maybe someone could help me.
    First, here is my "test" use case :
    I have 1 BPEL exposing two webservices interface
    - 1 interface for creating the BPEL instance
    - 1 interface for consulting the status (or other thing) of the BPEL using a functionnal ID
    The BPEL logic goes like this :
    Receive > validate the request > generate a unique ID > reply to the consumer (attach the unique ID) > loop on the second receive (waiting for consumer calls)
    The consumer calls the second interface with the unique ID > The right instance is correlated using the unique ID > some treatment(is the response ready ? for example) > reply to the consumer (with the response if ready, otherwise "false")
    The two problems I encounter are the following :
    1 - I can't seem to be able to initialize the correlation set value anywhere in the BPEL except for the "Receive activity that create the instance". But that would assume that the consummer supply a unique ID (which is not likely in our case). Is it not possible to initialize the correlation set in the first reply ? or in any other activity in the BPEL ? The documentation doesn't say if you can or can't initialize the correlation set else where.
    2 - Whenever a consumer try to "consult" a BPEL status using an unknown ID, the call timeout after 45 seconds with a technical exception. It is not possible to handle such a case in order to supply a "functionnal fault" without waiting the 45 seconds ?
    remark :
    This is working totaly fine when I initialize the correlation set with the first request of the consummer but as stated above, my externals partners (several) will not be able to provide me unique ID.
    regards,
    mathieu
    Edited by: mathieu.d on Mar 12, 2013 5:58 AM

    Hi,
    I'm facing the same issue in 10.1.3.3 when trying to use a correlation set on an attribute of a regular xml message.
    Have you been able to figure out what the problem was in your case?
    Kind regards,
    Nathalie

  • Global Correlation Status

    Hello Everyone,
    i'm trying to enable global correlation, but, after apply the configuration, i see the status bellow:
    service global-correlation
    network-participation off
    global-correlation-inspection-influence aggressive
    test-global-correlation off
    exit
    service aaa
    exit
    service analysis-engine
    virtual-sensor vs0
    physical-interface GigabitEthernet0/1
    exit
    exit
    IPS-SITE-BACKUP#
    IPS-SITE-BACKUP#
    IPS-SITE-BACKUP#
    IPS-SITE-BACKUP# show health
    Overall Health Status                                   Green
    Health Status for Failed Applications                   Green
    Health Status for Signature Updates                     Green
    Health Status for License Key Expiration                Green
    Health Status for Running in Bypass Mode                Green
    Health Status for Interfaces Being Down                 Green
    Health Status for the Inspection Load                   Green
    Health Status for the Time Since Last Event Retrieval   Green
    Health Status for the Number of Missed Packets          Green
    Health Status for the Memory Usage                      Green
    Health Status for Global Correlation                    Not Enabled
    Health Status for Network Participation                 Green
    Why the status is "not enabled"?
    Obs: Downloads ok via proxy server.
    Thanks.
    Rafael

    Hello Rafael,
    Why the status is "not enabled
    The status is not enabled because the participation of your IPS in the global correlation is off.
    There are 3 states related to Global Correlation:
    -Full
    -Partial
    -Off
    Please change that and it should working, You need to have a DNS server set up in your IPS, if not Global Correlation will not work.
    Julio
    Rate the helpful posts

  • Global Correlation Update Failures

    I've recently turned on Global Correlation but we've failed to update every 5 minutes.
    PL-ASA-IPS# show stat global
    Network Participation:
       Counters:
          Total Connection Attempts = 2
          Total Connection Failures = 0
          Connection Failures Since Last Success = 0
       Connection History:
          Connection Attempt on February 16 2010, at 14:28:38 UTC = Successful
          Connection Attempt on February 16 2010, at 14:19:06 UTC = Successful
    Updates:
       Status Of Last Update Attempt = Failed
       Time Since Last Successful Update = never
       Counters:
          Update Failures Since Last Success = 4
          Total Update Attempts = 4
          Total Update Failures = 4
       Update Interval In Seconds = 300
       Update Server = update-manifests.ironport.com
       Update Server Address = 204.15.82.17
       Current Versions:
          config = 0
          drop = 0
          ip = 0
          rule = 0
    Warnings:
    I have a static NAT translation for the IPS, there are no proxy servers in our enviorment and it can ping outside as well as update-manifests.ironport.com (204.15.82.17). DNS is setup as well.
    In the logs I see this entry:
    16Feb2010 14:13:15.679 265.199 collaborationApp[491] rep/E A global correlation update failed: Failed download of ibrs/1.1/config/default/1236210407 : HTTP connection failed
    I guess I'm at a loss for what else I can check. We have no problems sending the Network Participation data but we can't get any data. Any suggestions?
    Cisco Intrusion Prevention System, Version 7.0(2)E3
    Signature Definition:
        Signature Update    S469.0                   2010-02-11
        Virus Update        V1.4                     2007-03-02
    OS Version:             2.4.30-IDS-smp-bigphys

    I have the same issue, i have no ASA or websense product between this device and the iNet.
    Does anyone have a fix or workaround?
    I have an AIM-IPS running 7.0(6)E4 with Signature versuon S599.0. All updates to date have been manualy d/l to a local ftp server
    the auto update "seems" to run but never gets any updates
    This is what i see
    # sh stat global
    Network Participation:
       Counters:
          Total Connection Attempts = 127
          Total Connection Failures = 127
          Connection Failures Since Last Success = 127
       Connection History:
          Connection Attempt on October 06 2011, at 10:46:32 UTC = Failed
          Connection Attempt on October 06 2011, at 09:24:32 UTC = Failed
          Connection Attempt on October 06 2011, at 08:03:04 UTC = Failed
          Connection Attempt on October 06 2011, at 07:59:52 UTC = Failed
          Connection Attempt on October 06 2011, at 06:36:57 UTC = Failed
    Updates:
       Status Of Last Update Attempt = Failed
       Time Since Last Successful Update = never
       Counters:
          Update Failures Since Last Success = 2702
          Total Update Attempts = 2702
          Total Update Failures = 2702
       Update Interval In Seconds = 300
       Update Server = update-manifests.ironport.com
       Update Server Address = Unknown
       Current Versions:
          config = 0
          drop = 0
          ip = 0
          rule = 0
    Warnings:
    #sh ver
    Application Partition:
    Cisco Intrusion Prevention System, Version 7.0(6)E4
    Host:
        Realm Keys          key1.0
    Signature Definition:
        Signature Update    S599.0                 2011-09-29
    OS Version:             2.6.14-Cavium-Octeon
    Platform:               AIM-IPS-K9
    Serial Number:          xxx
    Licensed, expires:      31-Mar-2012 UTC
    Sensor up-time is 9 days.
    Using 54726656 out of 454148096 bytes of available memory (12% usage)
    system is using 22.4M out of 80.0M bytes of available disk space (28% usage)
    application-data is using 46.8M out of 213.0M bytes of available disk space (23% usage)
    boot is using 54.4M out of 114.8M bytes of available disk space (50% usage)
    application-log is using 61.8M out of 513.0M bytes of available disk space (12% usage)
    MainApp            B-BEAU_2011_SEP_10_00_30_7_0_5_45   (Ipsbuild)   2011-09-10T00:32:09-0500   Running
    AnalysisEngine     B-BEAU_2011_SEP_10_00_30_7_0_5_45   (Ipsbuild)   2011-09-10T00:32:09-0500   Running
    CollaborationApp   B-BEAU_2011_SEP_10_00_30_7_0_5_45   (Ipsbuild)   2011-09-10T00:32:09-0500   Running
    CLI                B-BEAU_2011_SEP_10_00_30_7_0_5_45   (Ipsbuild)   2011-09-10T00:32:09-0500
    Upgrade History:
    * IPS-AIM-K9-7.0-6-E4       17:39:07 UTC Sat Sep 10 2011
      IPS-sig-S599-req-E4.pkg   07:59:08 UTC Wed Oct 05 2011
    Recovery Partition Version 1.1 - 7.0(6)E4
    Host Certificate Valid from: 25-Sep-2011 to 25-Sep-2013
    >
    as seen above there is no ip address listed for "update-manifests.ironport.com"
    NS lookup is able to resolve,
    why can't the IPS?
    I can i hard code the ip address?
    >Non-authoritative answer:
    >Name:    update-manifests.ironport.com
    >Address:  204.15.82.17

Maybe you are looking for

  • Ipod Touch 3rd Gen Wiped with Latest iTunes Update

    Hi, I had my ipod touch 3rd gen up to date with the latest firmware 5.x whatever it was. Then recently they released a new iTunes update which i downloaded and updated. Although doing this itunes update wiped everything off my ipod. I manually manage

  • 8320 - Can't use as mass storage device

    Hello all, I received this Blackberry from my dad, he works at this company and they gave him this blackberry a while ago, and eventually they gave him a new one so he gave me this one. Needless to say, it was registered with BES, with some restricti

  • Captilization of  the materil Via Stock Rote

    Hi I need some clarification Can we captilize the materil Via Stock Rote ,Please Explain How the materail can be booked to asset with Stock route (Blank Acct Assingement) Regards Sameer

  • Command line call of sqlplus with system-privileges

    Hello, I have the following problem: I like to run a sqlplus-command on sun-solaris with a 8.1.7 database which needs system-privileges. It works with every other user. When I use system I'll get an ORA-01017 (Invalid username/password). When I start

  • RAID status in Conky

    I wrote a tiny script to monitor the status of RAID arrays. It is written in awk and is meant to be used with conky. I have this in my conky config file: RAID: ${execi 60 gawk -f path-to-the-script /proc/mdstat} #!/bin/gawk -f # This script checks th