Oracle Service Bus For loop getting out of memory error

I have a business service that is based on a JCA adapter to fetch an undertimed amout of records from a database.  I then need to upload those to another system using a webservice designed by an external source.  This web service will only accept upto to x amount of records.
The process:
for each object in the Jca Response
      Insert object into Service callout Request body
      if object index = number of objects in jca response or object index = next batch index
           Invoke service callout
           Append service callout Response to a total response object (xquery transform)
           increase next batch index by Batch size
           reset service callout to empty body
       endif
end for
replace body  with total response object.
If I use the data set that only has 5 records  and use a batch size of 2 the process works fine.
If I use  a data set with 89 records  and a batch size of 2 I get the below out of memory error  after about 10 service callouts
the quantity of data in the objects is pretty small, less than 1kB for each JCA Object
Server Name:
AdminServer
Log Name:
ServerLog
Message:
Failed to process response message for service ProxyService Sa/Proxy Services/DataSync:
java.lang.OutOfMemoryError: allocLargeObjectOrArray:
[C, size 67108880 java.lang.OutOfMemoryError: allocLargeObjectOrArray:
[C, size 67108880 at org.apache.xmlbeans.impl.store.Saver$TextSaver.resize(Saver.java:1700)
at org.apache.xmlbeans.impl.store.Saver$TextSaver.preEmit(Saver.java:1303) at
org.apache.xmlbeans.impl.store.Saver$TextSaver.emit(Saver.java:1234)
at org.apache.xmlbeans.impl.store.Saver$TextSaver.emitXmlns(Saver.java:1003)
at org.apache.xmlbeans.impl.store.Saver$TextSaver.emitNamespacesHelper(Saver.java:1021)
at org.apache.xmlbeans.impl.store.Saver$TextSaver.emitElement(Saver.java:972)
at org.apache.xmlbeans.impl.store.Saver.processElement(Saver.java:476)
at org.apache.xmlbeans.impl.store.Saver.process(Saver.java:307)
at org.apache.xmlbeans.impl.store.Saver$TextSaver.saveToString(Saver.java:1864)
at org.apache.xmlbeans.impl.store.Cursor._xmlText(Cursor.java:546)
at org.apache.xmlbeans.impl.store.Cursor.xmlText(Cursor.java:2436)
at org.apache.xmlbeans.impl.values.XmlObjectBase.xmlText(XmlObjectBase.java:1500)
at com.bea.wli.sb.test.service.ServiceTracer.getXmlData(ServiceTracer.java:968)
at com.bea.wli.sb.test.service.ServiceTracer.addDataType(ServiceTracer.java:944)
at com.bea.wli.sb.test.service.ServiceTracer.addDataType(ServiceTracer.java:924)
at com.bea.wli.sb.test.service.ServiceTracer.addContextChanges(ServiceTracer.java:814)
at com.bea.wli.sb.test.service.ServiceTracer.traceExit(ServiceTracer.java:398)
at com.bea.wli.sb.pipeline.debug.DebuggerTracingStep.traceExit(DebuggerTracingStep.java:156)
at com.bea.wli.sb.pipeline.PipelineContextImpl.exitComponent(PipelineContextImpl.java:1292)
at com.bea.wli.sb.pipeline.MessageProcessor.finishProcessing(MessageProcessor.java:371)
at com.bea.wli.sb.pipeline.RouterCallback.onReceiveResponse(RouterCallback.java:108)
at com.bea.wli.sb.pipeline.RouterCallback.run(RouterCallback.java:183)
at weblogic.work.ContextWrap.run(ContextWrap.java:41)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256) at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
Subsystem:
OSB Kernel
Message ID:
BEA-382005
It appears to be the service callout that is the problem (it calls another OSB service that logins and performs the data upload to the External service)  because If I change the batch size up to 100  the loop will load all the 89 records into the callout request and execute it fine.  If I have a small batch size then I run out of memory.
Is there some settings I need to change?  Is there a better way in OSB (less memory intensive than service callout in a for loop)?
Thanks.

hi,
Could you please let me know if you get rid off this issue as we are also facing the same issue.
Thanks,
SV

Similar Messages

  • Getting out of memory errors in Indesign 5.5. What can I do to fix it?

    Getting out of memory errors in Indesign 5.5. What can I do to fix it?

    Tell your dumb friend to pay you for a new phone as he damaged it. You cannot get help here for a phone that has been taken apart, as it is not user servicible. Your dumb friend also voided your warranty and, even if the warranty were expired Apple will never touch that phone.
    Time to get smarter friends.

  • Photoshop keeps on getting out of memory error after installing Premier Pro

    I just upgrade my CS to CC. Yesterday I installed Photoshop and did my work without any problem but today after installing Premier and After Effect, I keep on getting out of memory error when I'm working even though I don't have any other application running accept photoshop alone. The file I'm working on is a small file, iphone plus size interface. Basically I can open the file, add blur effect and try to type text I will get photoshop telling me that my system is out of memory. Restarting photoshop give the same problem, restarting my computer give the same problem, ie do one thing and next will give memory not enough.
    I don't think my system is slow as it is workstation with dual processor and 12 gig of ram, windows 7 64bits 1gb dedicated memory for graphic card.
    I uninstall Premier and After Effect and suddenly the problem go away. Photoshop work as per normal. I didn't have the time to reinstall premier again but will try to do it tonight or tomorrow
    Anyone experience such problem before?

    When you get that error leaver the error showing and use something the can show you how much free disk space there is left on Photoshop scratch disk.  It may be a problem with scratch storage space not ram storage space.  I see Photoshop use much more scratch space the ram.  I have seen Photoshop using less than 10GB of ram on my machine leaving 30GB of free ram on my system unused while using over 100GB of scratch space.

  • Getting 'Out of memory' error while opening the file. I have tried several versions of Adobe 7.0,9.0,X1. It is creating issue to convert PDF into TIFF. Please provide the solution ASAP

    Hello All,
    I am getting 'Out of memory' error while opening the file. I have tried several versions of Adobe 7.0,9.0,X1.
    Also, it is creating issue to convert PDF into TIFF. Please provide the solution ASAP.

    I am using Adobe reader XI. When i open PDF it gives "OUT of memory" error after scrolling PDF gives another alert "Insufficient data for an image". after clicking both alerts it loads full data of PDF. It is not happening with all PDFs. couple of PDFs are facing this issue. Because of this error my software is not able to print these PDFS into TIFF. My OS in window7*64. I tried it on win2012R2 and XP. Same issue is generating there.
    It has become critical issue for my production.

  • I am getting out of memory error message

    I am getting out of memory error message

    Your question is a bit light on information to help anyone help you.
    Version of Rh?
    When does this occur?
    Have you imported some topics and perhaps imported topics from an old output?
    See www.grainge.org for RoboHelp and Authoring tips
    @petergrainge

  • Hp D110 when printing works doc get out of memory error

    get out of memory error when print icon selected from Works

    I was finally able to get the files to work by opening and saving in FrameMaker numerous times.
    Re: your questions. . . I did not try importing directly. I linked and then generated. Yes, the linking did work with RH9 from the TCS 3.5.

  • Spooling to Text File - 30 million records - Getting Out of Memory Error

    Hi All,
    I have an extremely large oracle table that I need to spool to a .txt file. The table has approximately 30 million records. I'm using Toad For Oracle version 10.5 and I'm on Oracle 10g. I've tried running the following spool command a few times and it keeps crashing...I'm getting a "Out of Memory" error in my Toad window when I execute it as a script. Here's the code:
    Spool on
    set heading off
    SET PAGESIZE 0
    SET TRIMSPOOL ON
    SET LINESIZE 100
    set feedback off
    set echo off
    set termout off
    Spool "C:\spooledtext.txt"
    select
    column1
    from test_table
    order by
    column2,
    column1
    Spool off;
    An ideas as to how I can get this query to spool to a text file without crashing and running out of memory?
    Thanks

    use sqlplus.
    Or select smaller chunks and use copy to concat them afterwards.
    Sybrand Bakker
    Senior Oracle DBA

  • Why do I get out of memory errors when 10GB memory is free?

    I am on HP UNIX 64bit 11.23 titanium, running Oracle 10.2.0.3. . My server has 24GB memory and of that 10GB is free (as seen in glance). When I doing oracle exp or rman commands, I get:
    ORA-04030: out of process memory when trying to allocate 1049112 bytes (KSFQ heap,KSFQ Buffers)
    I checked both rman and exp are 64bit executables, so they should be able to access all the memory on the system.

    I have just one parameter in init.ora sga_target which controls everything in SGA. hw two instance I was reporting porblem have sga_target of 256M and 192M, Problems happen off and on, but 9 to 10GN free memory is alwyas available on server.
    Her is more information on the problem:
    1.     I do not think problem is with ulimit, but something is definitely not set correctly. Ulimit -a
    time(seconds) unlimited
    file(blocks) unlimited
    data(kbytes) 4194300
    stack(kbytes) 131072
    memory(kbytes) unlimited
    coredump(blocks) 4194303
    parameters are reasonable.
    2.     I have 10GB free memory. I run simple java command
    Java
    it works.
    3.     Now I increase memory for sga_target for one of my Oracle instance from 256M to 512M. I only hav eon eparameter sga_traget which controls everything in SGA. There are many other Oracle instances on the server. My Oracle instance starts without problems.
    4.     I now run java, it gives me:
    Out of memory error, so Oracle has exhausted some memory (probably shared memory) which is needed by java. I still have 9-10GB memory on my server, so why java is not using this memory.
    5.     After iOracle instance starts, off and on Oracle backups fail with ORA- error (not enough memory) I reported earlier.
    I hope HP engineers can figure this out.

  • Report with more than 600 kb image - BO Server getting Out Of memory Error

    Hi,
       We have a report which displays images and size is above 600 KB.We are getting an "Out Of memory" Error while previewing this report in Business Object Server.
    In another situation we tried by giving a dynamic path to the OLE object, but the report is not showing error. We are not able to view the image whose size is more than 600KB
    Notes: 1. Image is stored as a BLOB  in Oracle Database
               2. Connection used inside the report is OLEDB
               3. UNIX Environment
    Regards,
    Sathish

    Please re-post if this is still an issue to the Business Objects Forum or if you have a valid support contract create a case on line.

  • Keep getting Out of Memory error on InDesign CC 2014

    I work with 5 documents on a daily basis that can have over 150 images imported each. When I try to move around the document, it either freezes up and the wheel keeps turning or it comes up with an Out of Memory error message and locks up. It also will just quit.
    I had seen somewhere about being able to "assign" a certain amount of memory to the software using the "get info" panel, but I can't find any reference to memory on the "get info" panel.
    Any help would be greatly appreciated.
    Thanks
    CJ

    I inherited the file from a previous employee and they had lots of embedded files. I am slowly replacing them with linked as they are updated. Are linked or embedded better?

  • Hyperion IR : Getting out of memory error while fetching data for whole year through web client (wrokspace)

    Hi,
    While fetching data though IR wen client from workspace for a year(all 12 months) I am getting error as ("Out of Memory .Advice : Close other applications or windows and try again").
    If I am trying same through IR studio it does not give any output and show me same repoting front page.
    If i am selecting periods till 8 months it is giving the required data in both IR web client and IR studio.
    Could you please suggest how can we resolve this issue.
    Thanks,
    D.N.Rana

    Issue Cause :
    Sometimes this is due to excessive data which brings the size of the BQY file up around one gigabyte uncompressed in size (for processing may take twice as actual RAM, plus the memory space space for the plugin, and the typical memory limit on a 32-bit system is 2 gigabytes).
    Solution :
    To avoid excessive BQY size exceeding memory availability:
    Ensure that your computer has at least 2Gb of free RAM before he runs IR Studio.
    Put a limit to the number of rows that can be pulled down: Right click on Request label of Query section and put a value in Return First xxx Rows (and check the check box).
    Do not pull down more than 750 MB of data (remember it may be duplicated while processing).
    Place limits or aggregations in Query section (as opposed to Result section) to limit data entering the BQY.

  • Unable to create titles, getting "Out of memory" error message

    I am editing a project on FCE 2.0.3.
    I recently re-opened the project after about a year. It is stored on a 500GB external firewire hard-drive. I am working on a Mac G5 Powermac 7.2 with OS 10.4.11 with 1GB of RAM. I have my system settings on FCE set at 100% for memory usage and still cache. All my system settings on FCE are set to save to the external drive. I have 16GB available on my G5 memory.
    Every time I try to create a title using Title crawl, i get this error message:
    AE Effects Error: Out of memory using "title crawl."
    Also, every time I close the project and re-open it, I have to reconnect all the media and re-render everything, even though I save the project each time. I have also Saved As a different project name multiple times and this doesn't help.
    One other issue: The titles that I have on the project already look clear when the video is paused on a frame, but when they are moving they look very low-res and pixilated. The pixilated look also happens when I output my video to a QT movie. How can I make the titles look sharp?
    Please help!
    THANKS
    -Pierre
    Message was edited by: Pierre Degaillande1

    Before you do anything, trash your preferences exactly as detailed in this link:
    http://fcpbook.com/Misc1.html
    +"AE Effects Error: Out of memory using "title crawl.""+
    Try pushing down the memory usage and still cache a lot, and see if that helps. You only have 1GB of RAM, so keeping them at 100% is not a good idea. A computer can easily use about half a gigabyte just maintaining regular processes. To make sure you don't overload your RAM, you need to set the amount of memory FCE can use to a much smaller amount.
    +"Also, every time I close the project and re-open it, I have to reconnect all the media and re-render everything, even though I save the project each time. I have also Saved As a different project name multiple times and this doesn't help."+
    Are you moving files around on your scratch disk or renaming them? If so, you will have to reconnect them every time you change things.
    +"The titles that I have on the project already look clear when the video is paused on a frame, but when they are moving they look very low-res and pixilated. The pixilated look also happens when I output my video to a QT movie. How can I make the titles look sharp?"+
    Are you looking at the fully rendered movie? Click Option-R to render everything out.

  • Importing Word docs from RH for Word X5 - out of memory error

    I've tried a few times to import 537 Word docs (2,974) from a
    RH for Word project (RH X5 for Word, CHM output) into a new RH HTML
    5 project. Each time, RH HTML "hangs" and I've seen "out of memory"
    at least once at the very end. The original RH for Word project has
    conditional build tags defined, but only one tag has been assigned
    to one topic, so far. We've never been able to build an index in
    this RH for Word project (it's mostly blank), but we've built a
    search and contents without problems.
    Is an error related to Word? Is it a bug that was fixed for
    version 6? Is it somehow related to this fix:
    http://kb.adobe.com/selfservice/viewContent.do?externalId=kb401651&sliceId=1?
    If it's a known bug that was fixed with a later version, then
    it would further help me build a case for converting to RH 7, with
    the end result of converting the whole thing eventually to RH HTML.
    Thanks,
    Jim

    I don't do much import but if you are trying to import 537
    documents in one go, nothing would surprise me. Have you tried one
    at a time or a small batch at a time?
    The bug you point to arose in 6 and was fixed so it is not
    relevant.
    My guess is it is down to memory and that most PCs would
    baulk at 537 documents in one go.

  • Get out of memory error when linking Frame doc to RoboHelp project

    I just upgraded to TC Suite 5.
    Now I'm trying to link FrameMaker files to my RoboHelp project. The FrameMaker files are from a document that was done in Frame 9 (TC Suite 3.5) and now has been converted to Frame 11. It's working fine in Frame 11. No errors when opening any of the files in Frame 11.
    I created a new project in RH 11 and tried linking the FM files to it. Some work, but some bring on an Out of Memory message. Interestingly, one file that is 68MB worked fine, one file that's only 58MB brings that message.
    I'm going to try using an Externalize Graphics addon that worked well with the old Frame--I can only hope it works with FM 11 now.
    Does anyone have any ideas why this is happening, and any solutions besides externalizing the graphics and trying to reduce the file size?
    Thanks.

    I was finally able to get the files to work by opening and saving in FrameMaker numerous times.
    Re: your questions. . . I did not try importing directly. I linked and then generated. Yes, the linking did work with RH9 from the TCS 3.5.

  • Getting Out of memory error while using HashMap

    Hi,
    I'm using HashMap to have string as key, some object as value.
    oHm.put(sKey, oMyVal); //oHM - HashMap
    The actual number of entries i need to put is 200K....
    Buy my program is not crossing even for 100K....
    Its giving OutOfMemory error...... ( 1 GB memory, Win XP )
    Any pointers to resolve this?
    Thanks in Advance...
    Ashok

    Do we have any alternate other than increasing the memory for JVM?Did you read what I said on 8/04/2008 22:20 (reply 1 of 5)?
    It's still the best looking option, especially if this large number is going to grow.

Maybe you are looking for

  • Update Credit managment dispay in some of the orders with same Payer

    Hi, I have some sales orders created with same PO, same sold to party and same payer. In one of the Sales Order credit control area and credit account is updated but the other order's did not update with this information. I can see the Credit account

  • Build EJB Archive unsuccessfull

    I was just trying my hand at Module programming and thought i wud start off with "Step by step guide to develop a module for reading file name in a sender file adapter" by Krishnakumar Ramamoorthy. Seems alls done but the problem is when i try to cre

  • MST PVSTP interoperation

    Hello, I've read the "understanding MSTP article" from cisco's website and I have several uncertainties. These have deepened even more after performing several experiments. I've setup a test scenario with the following configuration: C1 Cisco PVST --

  • HT1212 hard reset for iphone 5

    My iphone 5 was stolen and then cleaned I want to hard reset how do I do a hard reset on a phone that has a lock code when I connect it to itunes it says it has lock code on it

  • Balances Carry Forward.

    Dear Folks, I had carry forwarded the balances of last fiscal year to this fiscal year. Later by mistake i had carry forwarded my balances to last year. now my balance sheet is showing wrong balances. (i.e. our fiscal year is reporting year. currentl