Issue with batch load into bpel through MQ    Urgent

Hi Guys,
I am stuck with an issue and need your help and suggestions.
I am working in a project where there is a synch bpel process in which there is a MQ adapter which picks up messages from a source queue which is populated by an external application. This bpel process calls another bpel process in which there is a sychronous call to an external webservice which updates the payload and bpel puts that payload in an output queue.
The input queue is continuously populated with a lost of messages like - 100k messages in 1 hr (in 2 or 3 intervals) and MQ picks up all the messages even if they are 100k in a second and gives it to bpel.
Everything runs fine until the external webservice which is called is up and running or it is completely down. But the issue is sometimes when the external webservice is up but is unresponsive for sometime(it does garbage collection or dump or something which we don't have control on) all the instances in bpel are in running and pending state until the response is given. And in this mean time MQ adapter still polls the source queue and gives it to bpel. so what is happening is the number of pending req's are getting increased by very percentage and soa is becoming unstable. Eventually when the external service is up all these instances are completed but will take long time to do it.
---> So the solutions which came to me was, block MQ adapter from sending messages to bpel when the external service is doing the garbage collection, but we dont seem to have any control of that sort on MQ adapter. if any please suggest.
There are 2 prop for MQ adapter -- inboundthreadcount and delaybetweenmessages which can be tried out but it will effect the overall throughput which is not desired.
---> Another was we tried to make the call to the external service asynch but we cannot do that as the external service is a synch process and we cannot call it ashyncronously.
---> The timeout value for the external webserive is 10sec but the issue here is when it is busy doin some other work, it is not taking the input from bpel and so not able to give timeout fault. And also the we are not getting a remote fault as the service is reachable and active.
---> There is one other property which is SyncMaxWaitTime in Oracle BPEL properties in enterprise console where we can set the max wait time for an instance to wait to get the reponse or it will time out at bpel level and that can be handled in bpel and continued with the flow. the default value is 45sec and by decreasing it we may achieve gud results but setting it at domain level will take effect to all the composites (and i dnt think client will be ok with it).
(If there is any property which we can set at composite level then Please suggest)
(One thing is we do not have control on the external webservice or the application which puts messages into the source queue.)
--> Another thought was to put a notification to the prod support when the pending requests are getting higher to shut off the first bpel process so that we are not accepting any more messages from the queue so that SOA is stable. but that doesnt seem feasible as after an e-mail goes to the support they need to instantly shut off otherwise it cause the same issue and they have to be available all the time to monitor it.
Please suggest your solutions guys...it will be very helpful for me.... thx all

Hi Guys,
I am stuck with an issue and need your help and suggestions.
I am working in a project where there is a synch bpel process in which there is a MQ adapter which picks up messages from a source queue which is populated by an external application. This bpel process calls another bpel process in which there is a sychronous call to an external webservice which updates the payload and bpel puts that payload in an output queue.
The input queue is continuously populated with a lost of messages like - 100k messages in 1 hr (in 2 or 3 intervals) and MQ picks up all the messages even if they are 100k in a second and gives it to bpel.
Everything runs fine until the external webservice which is called is up and running or it is completely down. But the issue is sometimes when the external webservice is up but is unresponsive for sometime(it does garbage collection or dump or something which we don't have control on) all the instances in bpel are in running and pending state until the response is given. And in this mean time MQ adapter still polls the source queue and gives it to bpel. so what is happening is the number of pending req's are getting increased by very percentage and soa is becoming unstable. Eventually when the external service is up all these instances are completed but will take long time to do it.
---> So the solutions which came to me was, block MQ adapter from sending messages to bpel when the external service is doing the garbage collection, but we dont seem to have any control of that sort on MQ adapter. if any please suggest.
There are 2 prop for MQ adapter -- inboundthreadcount and delaybetweenmessages which can be tried out but it will effect the overall throughput which is not desired.
---> Another was we tried to make the call to the external service asynch but we cannot do that as the external service is a synch process and we cannot call it ashyncronously.
---> The timeout value for the external webserive is 10sec but the issue here is when it is busy doin some other work, it is not taking the input from bpel and so not able to give timeout fault. And also the we are not getting a remote fault as the service is reachable and active.
---> There is one other property which is SyncMaxWaitTime in Oracle BPEL properties in enterprise console where we can set the max wait time for an instance to wait to get the reponse or it will time out at bpel level and that can be handled in bpel and continued with the flow. the default value is 45sec and by decreasing it we may achieve gud results but setting it at domain level will take effect to all the composites (and i dnt think client will be ok with it).
(If there is any property which we can set at composite level then Please suggest)
(One thing is we do not have control on the external webservice or the application which puts messages into the source queue.)
--> Another thought was to put a notification to the prod support when the pending requests are getting higher to shut off the first bpel process so that we are not accepting any more messages from the queue so that SOA is stable. but that doesnt seem feasible as after an e-mail goes to the support they need to instantly shut off otherwise it cause the same issue and they have to be available all the time to monitor it.
Please suggest your solutions guys...it will be very helpful for me.... thx all

Similar Messages

  • Issue with site load time when exported as HTML. Addressed?

    Has the issue with website load time been addressed?
    I believe the site attempts to load the entire image content at the initial visit - meaning any galleries with numerous pictures are all included when first getting to the site. This is causing a HUGE increase in load time. I was told when I last brought it up that it was an apparent issue that needed to be addressed.
    Any type of resolution coming?
    Site for reference: www.dkrecollection.com

    Major updates of Muse are targeted to release roughly every quarter. The 1.0 release was in mid-May. The 2.0 release was in mid-August. A fundamental change to image loading would only appear as part of a major update due to the engineering and testing efforts required.
    As provided in your previous thread http://forums.adobe.com/message/4659347#4659347 the only workaround until then is to reduce the number of images in the slideshow.

  • Issue with a load from R3 to BW 3.5

    Hi Guys,
    We are having an issue here with a load from R3 to BW 3.5 to an ODS and
    a transactional infocube.
    In a daily basis we are running loads to BW from R/3 infosets and all
    of them but one loads fine.
    The one that is having problems is actually the one that loads more
    data, therefore the infopackage is divided into two infopackages.
    In the update rule of the first ODS we are running an initial routine
    in which we are doing a RSDRD_SEL_DELETION (selective deletion) of the
    data to be loaded to both the ODS and the infocube, and is actually
    here where we got the core dump.
    Our first assumption was that maybe there was any yellow request in the
    transactional infocube avoiding the selective deletion but we have
    discarded this.
    We think that, as the only one failing is the one that divides into two
    infopackages, the problem might be that at the moment that the first is
    triying to delete the second one is loading data into the ods and there
    we get the dump.
    The question here is ¿Could this be the problem? ¿How could we
    workaround this if this is the case?
    Thanks for any suggestion.

    Hi,
    Be carefull on ODS activation, if you're using 2 infopackage and/or deleting data from an ODS which is lock for an activation, you'll occurs a dump.
    Check SM12 / ST22 / SM21 and job logs in SM37.
    And if pb still occurs for a load, debug it in start routine.
    Regards,

  • Did this resolve my Safari 5 issue with not loading pages as fast?

    I've been having this problem every since I got my laptop a month ago... I have a wireless router that's connected to a PC, and I use wireless on my laptop. My old laptop was a PC, and the internet connection was just fine on it. However, I'm having issues with my MacBook Pro. When I first turned on my laptop after taking it out of the box, Airport detected my wireless router and connected me to the internet. Obviously, I used Safari 5 as my browser and although it works... it doesn't load the pages as fast as it should. It even stops loading at times. Usually, I quit Safari and reopen Safari and it works and if it doesn't, I click on the reload button or just keep re-opening Safari until it does work... buttt I am tired of doing that now. So after a lot of attempts by trial and error, I think I found the solution and was wondering if anyone could confirm this with me. I went to my router's IP address and I looked at the settings. I looked at the router's DNS settings and I copied and pasted that router setting into the DNS settings on my laptop for the wireless network. Now, my internet seems to be working... but then again it has only been 5 minutes. So my question is... the router's DNS has to match the wireless network's DNS address?
    Sorry if this sounds like a stupid question... I'm not an expert when it comes to internet, LAN, proxies, and etc. settings. Thank you!

    Further investigation has revealed that the following error message is being generated within Safari during the first time the that the page is loading,
    "Refused to load from document base URL. URL found within request."
    The <base> directive in the HTML, in this instance, is referring to a different URL than the one that the page is running from. The page with the problem is running on a remote server and back referencing to the home server for the <base> reference. This fails when the page first loads but seems to be accepted if a page-reload is done. It also works on all other browsers that have been tested.
    Is this related to a security setting in the browser?

  • Having An Issue With Site Loading In Firebox

    Hello,
    I'm having a small issue that I could use some help with. I'm not really sure what is going on, but I'm having an issue with one of the pages from my site not loading when trying to view the page in Firefox. But if I load this page in Safari or Chrome, it loads just fine.
    Here's the page URL to take a look: <!-- deleted ~J99-->
    <sub >Specific link removed from display by moderator ~J99 </sub> <sitename>.com/top-10/top...services/
    <!-- thread now solved, link removed -->
    Any idea on why this could be happening or how to fix it? I'm not sure if it's just my computer, or if others are having the same issue.
    Thanks in advance,
    Mike

    Hello Mike,
    I have no problem loading and seeing the page <site>.com/top-10/...monitoring-services . General advice would be to try clearing cache and site cookies on the machine you are using.
    *see [[Firefox can't load websites but other browsers can]]
    I imagine you will have easy access to other machines on which you can test with Firefox so hopefully you will be able to test and demonstrate that the page does normally load on Firefox.
    Website design is outside the scope of this forum, but you probably have a professional team working on that.
    I did note from <sitenname>.com/disclosure/
    <blockquote>Disclosure <br /> In regards to the new FTC regulations, we are making this page to be compliant with 100% transparency regarding disclosure of incentive and paid reviews. <br /> Every page on this site has been created to generate revenue. <br /> This site generates income through banner advertisements and affiliate links on product reviews.</blockquote>

  • Performance issues with class loader on Windows server

    We are observing some performance issues in our application. We are Using weblogic 11g with Java6 on a windows 2003 server
    The thread dumps indicate many threads are waiting in queue for the native file methods:
    "[ACTIVE] ExecuteThread: '106' for queue: 'weblogic.kernel.Default (self-tuning)'" RUNNABLE
         java.io.WinNTFileSystem.getBooleanAttributes(Native Method)
         java.io.File.exists(Unknown Source)
         weblogic.utils.classloaders.ClasspathClassFinder.getFileSource(ClasspathClassFinder.java:398)
         weblogic.utils.classloaders.ClasspathClassFinder.getSourcesInternal(ClasspathClassFinder.java:347)
         weblogic.utils.classloaders.ClasspathClassFinder.getSource(ClasspathClassFinder.java:316)
         weblogic.application.io.ManifestFinder.getSource(ManifestFinder.java:75)
         weblogic.utils.classloaders.MultiClassFinder.getSource(MultiClassFinder.java:67)
         weblogic.application.utils.CompositeWebAppFinder.getSource(CompositeWebAppFinder.java:71)
         weblogic.utils.classloaders.MultiClassFinder.getSource(MultiClassFinder.java:67)
         weblogic.utils.classloaders.MultiClassFinder.getSource(MultiClassFinder.java:67)
         weblogic.utils.classloaders.CodeGenClassFinder.getSource(CodeGenClassFinder.java:33)
         weblogic.utils.classloaders.GenericClassLoader.findResource(GenericClassLoader.java:210)
         weblogic.utils.classloaders.GenericClassLoader.getResourceInternal(GenericClassLoader.java:160)
         weblogic.utils.classloaders.GenericClassLoader.getResource(GenericClassLoader.java:182)
         java.lang.ClassLoader.getResourceAsStream(Unknown Source)
         javax.xml.parsers.SecuritySupport$4.run(Unknown Source)
         java.security.AccessController.doPrivileged(Native Method)
         javax.xml.parsers.SecuritySupport.getResourceAsStream(Unknown Source)
         javax.xml.parsers.FactoryFinder.findJarServiceProvider(Unknown Source)
         javax.xml.parsers.FactoryFinder.find(Unknown Source)
         javax.xml.parsers.DocumentBuilderFactory.newInstance(Unknown Source)
         org.ajax4jsf.context.ResponseWriterContentHandler.<init>(ResponseWriterContentHandler.java:48)
         org.ajax4jsf.context.ViewResources$HeadResponseWriter.<init>(ViewResources.java:259)
         org.ajax4jsf.context.ViewResources.processHeadResources(ViewResources.java:445)
         org.ajax4jsf.application.AjaxViewHandler.renderView(AjaxViewHandler.java:193)
         org.apache.myfaces.lifecycle.RenderResponseExecutor.execute(RenderResponseExecutor.java:41)
         org.apache.myfaces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:140)
    On googling this seems to be an issue with java file handling on windows servers and I couldn't find a solution yet. Any recommendation or pointer is appreciated

    Hi shubhu,
    I just analyzed your partial Thread Dump data, the problem is that the ajax4jsf framework ResponseWriterContentHandler triggers internally a new instance of the DocumentBuilderFactory; every time; triggering heavy IO contention because of Class loader / JAR file search operations.
    Too many of these IO operations under heavy load will create excessive contention and severe performance degradation; regardless of the OS you are running your JVM on.
    Please review the link below and see if this is related to your problem.. This is a known issue in JBOSS JIRA when using RichFaces / ajaxJSF.
    https://issues.jboss.org/browse/JBPAPP-6166
    Regards,
    P-H
    http://javaeesupportpatterns.blogspot.com/

  • Cache refresh issue with PI Load Balanced HA setup.

    Dear Experts,
    Wei have installed a HA Load Balanced PI Production Server with the below specifications. Its a four node cluster. Two nodes for Application Cluster and another two nodes for Database Cluster.
    Node1
    Physical Hostname  : axsappci
    Virtual Hostname  : axsapp00
    Instances         : CI,SCS and ASCS.
    Node2
    Physical Hostname : axsappdi
    Virtual Hostname   : axsapp00
    Instances          : Dialog instance installed with physical hostname axsappdi
    Node3
    Physical Hostname : axsappd1
    Virtual Hostname   : axsappdb
    Instances  : DB Instance.
    Node4
    Physical Hostname : axsappd2
    Virtual Hostname   : axsappdb
    Instances  : Standby DB Instance (passive).
    Web Dispatcher Hostname : h2h
    Application Switchover : CI,SCS and ASCS to switchover to Node2 and dialog instance Node2 forcing to go down
    Database Switchover : DB Instance switchover to Node2 if Node1 fails.
    We have changed all the parameters according to note 951910 -> NW2004s High Availability Usage Type PI
    I am facing an issue with the cache Notifications in the Integration Repository and Directory. The cache notifications are not happening properly particularly with the ABAP Cache.
    I get the below error in my ID when i try to do the manual cache notification.
    Unable to notify integration runtime (ABAP) of data changes
    Unable to establish http connection "http://h2h:8002/sap/xi/cache?sap-
    client=001"
    Kindly assist.
    Thanks and Regards
    Raghu.

    Hi Srikanth,
    Thanks for the reply.
    I have configured my web disptacher to use default HTTP and HTTPS ports i.e 80 and 443. According to note 951910 i have changed parameters in exchange profile to use these ports.
    Regards
    Raghu.

  • Issue with Data Load Table

    Hi All,
           i am facing issue with apex 4.2.4 ,using the  Data Load Table concept's and in this look up used the
          Where Clause option  ,it seems to be not working this where clause ,Please help me on this

    hi all,
        it looks this where clause not filter with 'N'  data ,Please help me ,how to solve this or help me on this

  • Issue with SQL Loader and tha last field

    Hi
    I have a data file to load . The Load is running fine. But the last record comes with a a junk character. when loaded into the table.
    when we open the file it shows nothing.
    I tried replacing ^M and chr(10) but of no use.
    can you please asssit men in this.. We have a go live soon

    You need to provide us more details...
    SQL and PL/SQL FAQ
    By the way:
    Have you considered using external tables?
    They have more benefits than SQL*Loader...
    http://www.oracle-developer.net/display.php?id=204
    http://asktom.oracle.com/pls/apex/f?p=100:11:0::::P11_QUESTION_ID:6611962171229
    http://www.oracle-base.com/articles/9i/ExternalTables9i.php

  • Issue with ProRes importing into Premiere CC in Windows

    Hey all,
    I realize the futility of using ProRes in a Windows environment, so I figured I'd just get that out of the way right off the bat.  This is how I received the footage from the client and it's too much to try and convert into another codec (though if I must, I will, I'd just like to avoid it).  Even so, I didn't really have an issue with this until I tried to work in CC.
    I started this project in Premiere CS5 and was having no issues.  I received some AE files in CC and decided I'd bite the bullet and move to the latest and greatest rather than try and rebuild the projects in CS5.  I download, install, update, open up Premiere to rebuild the short edit, and then find that when I import ProRes files, all I get is audio, no video.  I can import other codecs just fine, it's just ProRes that's refusing.
    I've made sure Quicktime and the Windows QT Decoder for ProRes are updated, as well as Premiere CC.  I've currently got all my work files bundled up on a drive to take to my 9 to 5 and work on a Mac on my lunch break, but for obvious reasons, I'd like to be able to work at home.
    This client doesn't provide enough work to warrant a new Mac purchase, and I'm just at wit's end.  It worked fine in CS5, why not in CC?
    Here's my specs:
    Windows 7 Professional 64 bit
    Premiere Pro CC 7.0.1
    Quicktime (fully updated)
    Quicktime ProRes Decoder for Windows (fully updated)
    Any help you can provide is greatly appreciated!

    cc,
    cc_merchant wrote:
    Have you seen the WARNING here: Balanced Systems.
    The warning about Quicktime makes sense.  I was aware that Quicktime 7 has never been updated to 64-bit, but the obvious 4GB RAM limitation had never occured to me.  Makes sense. I have a very decent machine, yet all of my Canon DSLR and GoPro projects are more cumbersome to edit than even AVCHD files.  I've spent a little time thinking it over and running some side-by-side tests.  MOV vs. AVI (same video) Editing, scrubbing, playback—all while running Task Manager on top.  But I didn't need task manager to tell me that the AVI plays back, layers and layers, smooth as butter.  The .MOV footage struggled to keep up with my random access cuts to different locations within the same video file.
    cc_merchant wrote:
    most sane PC users would NEVER install QuickTime...
    So now I'm fascinated.  So many questions:  Why do so many cameras create .MOV or .MP4 files that require QuickTime components?  64-bit QuickTime X has aparently been available on the Mac for quite a while, yet I presume they won't allow anyone else to develop a 64-bit codec for Windows, so why hasn't someone sued Apple for monopoly, anti-trust, conflict-of-interest, etc?  And most importantly, how would a sane PC user go about editing MOV and MP4 files without going insane transcoding hours of footage?

  • Issue with GP getting into Erroneous State

    Hi Experts
    I have an issue with GP Process getting into Erroneous State. We have a series of steps in the Guided Procedure Process. The process instance passes a few of the initial steps in the procedure and getting struck at a particular step and leading the process to erroneous state.
    I am just trying to find out what would be the possible reasons for a process to get into erroneous state.
    Kindly get us all possible suggestions to find the root cause for this issue.
    Appreciate your help in advance.
    Kind Regards
    Ramamoorthy D

    Hi Louis Hunag
    Thanks a ton for responding to my query.
    It is a User Interface Callable Object. Can you please elaborate on this in detailed manner. I have assigned the right user account to manage the execution role. Below is what I have done.
    In the GP Process, there are 4 default roles 1. Owner, 2. Default Processor, 3. Overseer 4. Administrator. All these were mapped with one ID from UME. What is the problem in this? Kindly let me know.
    Tx.
    Best Regards
    Ramamoorthy D

  • Issue with Data Load to InfoCube with Nav Attrivutes Turned on in it

    Hi,
    I am having a issue with loading data to a InfoCube. When i turn
    on the navgational attributes in the cube the data load is failing
    and it just says "PROCESSED WITH ERRORS". when i turn them off
    the data load is going fine. I have done a RSRV test both on
    the infoobject as well as the cube and it shows no errors. What
    could be the issue and how do I solve it.
    Thanks
    Rashmi.

    Hi,
    To activate a navigation attribute in the cube the data need not be dropped from the cube.
    You can always activate the navigation attribute in the cube with data in the cube.
    I think you have tried to activate it in the master data as well and then in the cube or something like that??
    follow the correct the procedure and try again.
    Thanks
    Ajeet

  • Issues with site load time. (bg images)

    Hey, guys.
    Having an issue with a site uploaded with MUSE. None of the images are overly large, but the load time is 5 to 6 seconds where it should be instant.
    Looking at it, it appears as though all of the images are attempting to load simotaneously in one large chunk rather than in a line.  Is there anyway to remedy this?

    This isn't related to background images. It's how Muse is handling the loading of the ~100 images in the slideshow. Thanks for pointing this out. Until we have altered the loading method for these images, the only workaround I have is to decrease the number of images in the slideshow.

  • Problem with Batch Loader and FDM user regional settings

    Hi
    I am using FDM 11.1.2.1.
    When I use the English regional settings for my FDM user account, I can do Export Excel from FDM, but Batch Loader doesn't work (Error : "one or more parallel processes failed to start).
    When I use the French regional settings for my FDM user account, Export to Excel doesn't work anymore (Error: Conversion from string "12.0" to type 'Long' is not valid. Detail: InnerException1: Input string was not in a correct format.), but the Batch loader is ok.
    Any idea?
    Thanks in advance for your help
    Fanny

    Hi Mittal,
    By default, formats for date is determined by the report server language at run time. The report server language is the language of the operating system on which the report server is installed. So the formats for date is determined by the language of the
    operating system on which the report server is installed.
    When you deploy the report to SharePoint site that the regional setting is set to English (Australia), please also set the report language to ‘en-AU’. Then the date format can be also changes to English (Australia).
    If the issue is still exited, could you please tell us the date format of date parameters and the field? If possible, please post the screenshot about this, then we can make further analysis.
    Reference:
    Solution Design Considerations for Multi-Lingual or Global Deployments (Reporting Services)
    Thanks,
    Katherine Xiong
    Katherine Xiong
    TechNet Community Support

  • Issue with delta load from R/3 to BW

    Hi frnds,
    There is a standarded D.S  2LIS_05_ITEM in R/3. Evereday We extraceted data from R/3 to BW based on this standard Data Source with delta load.There are two fields ZX and ZY in BW ,some times the data haven't extracted for this 2 fields in BW with the delta update.But some times this 2 fields properly extracted in to BW with the same delta update.
    Why is it happen like this ? Please give some inputs on this.
    Regards,
    Satya.

    Hello,
    if its a standard field then its getting populated in correct way.
    if its custom field then you need to analyze the records for which its getting populated and for one which its not.
    Quite possible that some cutomization in CMOD results in this behaviour.
    Also,check underlying tables to see the correct values.
    Regards
    Ajeet

Maybe you are looking for

  • HT3939 I have a iPhone 4 and need to turn off iMessage how do I do that

    I have an iPhone 4 and need to turn off iMessage how do I do that

  • Firefox versus Safari? And how do I uninstall Firefox?

    I've always only used Safari. Firefox has been recommended to me in case I have to reinstall OS X while on the road and unable to update beyond the 10.4.6 of my retail OS X install disk. See: http://discussions.apple.com/thread.jspa?threadID=1897928&

  • New feature phones anytime soon?

    Are there going to be any new feature phones anytime soon? I haven't seen any that I like, and am just wondering if there will be any new ones in the near future. Most of the ones sold now are absolutely worthless and the rest (theres only 1 or 2 of

  • Sunpkcs11 in applet   force browser to use 32 bit jre

    I  am using sunpkcs11 in my applet for reading smartcard,sunpkcs11.jar is only available  in 32 bit jvm , so if a borwser has latest jdk and it has 64 bit version then my applet will fail  , please advice  are there any parameters in applet which wil

  • Yosemite - Safari crashes when opening new tab.

    I have just downloaded Yosemite for Mac and upgraded all my software (Keynote, numbers etc). My problem is now that every time I open Safari and try to pen a new tab, it crashes. In fact it doesn't crash properly, but just hangs there with that littl