File Adapter Not Reading Large Files

Dear Experts,
Enviornment :-
OS:-Linux
Jdeveloper:- 11.1.1.6
SOA:-11.1.1.6
Weblogic:-10.3.6
JDK:-SUN
Allocated RAM:-16GB
Currently we are in UAT Phase and now we are facingan issue in reading large file.Below is the Design details of the service
FileAdapter(Read)-->Bpel(Business login,Using FlowN)-->FileAdapter(Write CSV),JMS Adapter(AQ JMS topics)
In this case at the time of read itself we are facing issue. File adapter reading xml file but in receive activity receives input data as
xmlDocKey:1C135990067411E3BFA6B5087B629F9DI
I really couldn;t understand about the error. Even i tried reading as Opaque format and still end up with same error.
In order to make sure i have create mediator and tried reading the file, in case i was able to read file upto 15mb with out any error.Also i tried as "read as Attachment" in Bpel component and able to read the attachment upto 7 mb file, but this is hitting the performance side.
I request some one please let me know why the file adapter is giving XmlDOCKey rather then XMLContent to the inputvariable
Regards,
Tarak

Can you check your BPEL Properties in EM?
Go to Soa-infra > right Click > SOA Administration > BPEL properties
increase the Dispatcher Engine Thread = 10, Dispatcher Invoke Threads = 60 and Dispatcher Engine Threads to 90
Click on "More BPEL Configuration Properties"
Increase the DispatcherMaxRequestDepth from 600 to 1000.
Bounce the server and see if works..
Bounce the server and try again.
If this fails, try get a threshold by increasing the file size until it fails again.

Similar Messages

File Adapter Not Processing Large File

Hi Everyone,
We are experiencing a problem in an interface that includes file adapter. The scenario is as follows:
1. A .csv file containing multiple records needs to be processed; for each line of the .csv file, an XML file should be genrated. We are using the 'Recordsets Per Message' field in the Content Conversion Parameters to achieve this. After the source .csv file is processed, it is deleted.
We were testing with small 15-30 records in each input file. For the purpose of testing scalability, we increased the number of records in a file to nearly 300. But the file adapter did not pick up the file.Comm.Channel in RWB is showing green, MDT contains no entries and SXMB_MONI also shows no messages. What can be the problem? Is there any limit on the size of file that can be converted in this way?
Awaiting your replies,
Regards,
Amitabha

Amitabha,
300 records should not be a problem at all. If you are not getting any error msg in CC monitoring, then it is time you take a look into VA logs.
Ref: /people/michal.krawczyk2/blog/2005/09/07/xi-why-dont-start-searching-for-all-errors-from-one-place
Regards,
Jai Shankar

FILE ADAPTER NOT READING FILE.

HI, GUYS.
I'M USING A FILE ADAPTER TO READ A FILE THAT HAVE 4 REGISTERS AND EACH REGISTER ONLY HAS ONE FIELD THAT IS NUMBER TYPE.
I CREATE THE FILE ADAPTER, AND I LET BPEL TO CREATE THE SCHEMA. THE IDE CALLS THES FIELD "C1". I ALSO CONFIGURE THAT THE FILE THAT MUST RAD IS THE PATTERN "*.TXT" AND EVERY 5 SECONDS.
THEN A CREATE A RECEIVE ACTIVITY THAT RECEIVES WHAT WAS READ FROM THE FILE ADAPTER IN A VARIABLE.
THEN I CREATE AN ASSIGN ACTIVITY AND I ASSIGN THE VALUE FROM THE RECEIVE ACTIVITY VARIABLE TO A NUMBER VARIABLE THAT IS THE INPUT OF A WEB SERVICE.
THEN I DEPLOY THE BPEL, AND I INITIATE IT, BUT I GOT AN ERROR THAT SAYS THAT THE FIELD "C1" IS EMPTY. SO LOOKS LIKE THE FILE ADAPTER IS NOT READING THE FILE. I WOULD THANK ANY HELP THAT YOU CAN BRING ME.

caps off
You're sure the interface of the fileadapter (client partnerlink) is the same as your data-file which needs to be picked up?
can you paste the content of the file and the content of the xsd of the process.

Sender file adapter not polling the file

hi all,
i have configured a filexifile scenario....
but the file sender adapter is not polling the file at all....
i dont c any message either in RWB or in SXMB_MONI
i checked the adapter framework url at http://<ximachine>;<port>/AdapterFramework....and the status for the file adapter is green...
but the message it gives there is
Sender Adapter v1014 for Party '', Service 'TASL_FILE_SENDER':
Configured at 03:07:24 2006-02-02
Up and running - no message processing until now
last poll interval started 04:01:24 2006-02-02
length 60,000 secs
y is the sender adapter not polling the file..
i am using NFS as my File System....i gave the source directory as d:/test_dir/
is this way of specifying the source directory on a windows machine correct...
thanks
pavan

There is probably something wrong with the File Adapter. You will need to go to the RunTime Workbench >> Component Monitoring >> Display >> Click on the Adapter Engine >> More information will display and click on the button 'Adapter Monitoring' >> A new window will display and click on the arrow next to your adapter engine. This displays a list of adapters running on your system. Green light means good; Red, you have a configuration problem. Look at the error and try and resolve it.

Sender File adapter not picking the file ABCD.PRN extension file

Hi
Am doing File to Abap Proxy scenario. My source will be in text format of fixed length of fileds 7.
My souce file will be generated by a third party machine with the extension EEE150809.PRN. In my scenario my file adapter should pick the file and update the same in ECC via a Proxy.
I have configured the Sender File adapter with Message Protocol - Content Conversion but file adapter is not picking the file. I have checked the Communication channel and status is fine. But the same Communication Channel works for .XML file.
What are the parameters that I have to consider with the file extension .PRN using File adapter?
Thanks.
S.

Hi Swarna,
You dont need to worry about the extension when picking the file. You can try using EEE* so that is picks all the files starting with EEE. If you have the fixed name then you can try giving EEE150809.*. Also EEE150809.PRN should not have any issue. Try to see in sender commu ication cahnnel for anyerrors. Probably there might be some network issues or authorisation issues. If you are reading with NFS then ask them to give necessary permissions. If you are reading through FTP check the user id and pwd you are using.
Regards,
---Satish

File Adapter Not picking the files

Hi All,
We have a process wherein the file adapter picks up the file from a particular location and it processed thereafter. We get the files once every month. We noticed that if the files that are being dazzled are of the same, i.e if the same nomenclature is there for the file that was dazzled the previous month, the adapter does not pick up the file. Only after renaming the file, it picks the file and processed them.
Any idea why the files that are dazzled with the same name are not being picked up.
Thanks in Advance...!!

Hi,
While configuring file adapter to pick up the files cross verify with file name putting in the directory location against the
"Includes files with name pattern" "Excludes file with name pattern" file name..
let say if u kept .*txt if picks the files txt with any name and one more think once after picking up the file from particular location are u enabling (delete file once read) option in configuration(It all depends on ur req)..
cross check the schema element of the file pattern.

File Adapter to read Zip file and send it as input to another webservice

Hi,
I have the below requirement:
1. A service will generate 3 attachments and place it in a particular directory.
2. SOA service has to pick those 3 files and send those files as input to another custom application which will email.
Design :
1. First SOA will create an archive file of those 3 attachements and then file adapter will poll for that zip file in that location and send that file as a whole to the custom application.
Query:
Now my question, is the above design feasible? If so, how to configure the file adapter to pass the file as input to that custom application?
Kindly do the needful
Thanks,
Priya

You can accomplish this via java embedding activity...Create a java embedding, which will create a zip file.. this java code is easy to implement..
You can also do away with un-necessary polling file adapter.. and you can use "Synchronous File Read" operation of File Adapter.. For Sync Read, you'll have to pass the zip file name, which you can easily fetch from java embedding activity..
Let me know, if this doesn't work.

File adapter not reading file suddenly

Hi,
My File to IDOC scenario was working properly. Suddenly the file adapter is not picking the file from the location. I have not changed any code. I checked all users, are in unlocked mode only. The log file throws error. Let me know any solution to resolve this
========
1.5#001A4B4C508E007400000577000019F40004558D5E8AFB9D#1219965571787#/Applications/ExchangeInfrastructure/AdapterFramework/Services/Trex##com.sap.aii.af.service.trex.impl.Util.Util: getIndex()#J2EE_GUEST#0####02305f1074b511ddaa1a001a4b4c508e#SAPEngine_Application_Thread[impl:3]_27##0#0#Error#1#com.sap.aii.af.service.trex.impl.Util#Java###SLDException couldn't get the SLD instance name. Therefore the index ID couldn't be inititialized. - Message: ; To-String: .#2#Could not read SLD instance name, due to: undefSldAccessor#com.sap.aii.af.service.sld.SLDException: Could not read SLD instance name, due to: undefSldAccessor#
#1.5#001A4B4C508E007400000579000019F40004558D5E8AFCB3#1219965571787#/Applications/ExchangeInfrastructure/AdapterFramework/Services/Trex##com.sap.aii.af.service.trex.TrexManager.TrexManager: getTrexConfiguration()#J2EE_GUEST#0####02305f1074b511ddaa1a001a4b4c508e#SAPEngine_Application_Thread[impl:3]_27##0#0#Error#1#com.sap.aii.af.service.trex.TrexManager#Java###TrexException: thrown by any problem related to the DataAccess: Message: .#1#Class: com.sap.aii.af.service.trex.TrexException : SLDException in Method: Util: getIndex(). Couldn't get the SLD instance name. Therefore the index ID couldn't be inititialized. - Message: Could not read SLD instance name, due to: undefSldAccessor; To-String: com.sap.aii.af.service.sld.SLDException: Could not read SLD instance name, due to: undefSldAccessor#
#1.5#001A4B4C508E00740000057B000019F40004558D5E8AFDE1#1219965571787#/Applications/ExchangeInfrastructure/AdapterFramework/Services/Trex##com.sap.aii.af.service.trex.TrexScheduler.TrexScheduler: run()#J2EE_GUEST#0####02305f1074b511ddaa1a001a4b4c508e#SAPEngine_Application_Thread[impl:3]_27##0#0#Error#1#com.sap.aii.af.service.trex.TrexScheduler#Java###TrexException: thrown by any problem related to the Trex processing. Message: .#1#Class: com.sap.aii.af.service.trex.TrexException : TrexException in Method: TrexManager: getTrexConfiguration(). Thrown by any problem related to the DataAccess. Message: Class: com.sap.aii.af.service.trex.TrexException : SLDException in Method: Util: getIndex(). Couldn't get the SLD instance name. Therefore the index ID couldn't be inititialized. - Message: Could not read SLD instance name, due to: undefSldAccessor; To-String: com.sap.aii.af.service.sld.SLDException: Could not read SLD instance name, due to: undefSldAccessor#
========

Hi,
1)Stop and start the Communication Channels.
2) Activate the scenario.
3) If u r using FTP may be ur credentials wereexpired.check the credentials.
"Award Points if helpful"
Regards,
jayasimha

File adapter not reading (not starting polling interval)

Hello,
I've got one communication channel trying to read a file each 10 seconds.
The file adapter is configured correctly and the channel is started but sometimes it stops the polling interval process and I don't know why.
For example the channel was working fine until Friday but with no reason it stopped to attempt to read the file on the directory... what can it be?
And another question. What's the difference about communication channel with "Automatic control" or "Started" manually?

Hi,
And another question. What's the difference about communication channel with "Automatic control" or "Started" manually?
Whenever you create new communication channel in Integration directory and activate it,its status in control data is Automatically and whenever you change it in RWB (Stop/Start) its status changes to Mannually.
Thanks!

File Adapter not picking the file

Hi Experts,
I am trying to create a Legacy-XI-R/3 scenario. I am using a file adapter as the sender communication channel and a ABAP proxy at the receiver end. I have given the path of my input file in the legacy system, but the file is not picked up by the adapter. Can any one tell me where I might have gone wrong?

Hi,
Just want to add one more suggestion.
Check the Host name, where the File is kept and try to use the directory path as
<HostName>\<DirName>.
Hope this help.
Aj.

File Adapter-Problem Reading Huge Files

Hi,
Here is the issue that i am facing
When reading huge file(csv file upto 6MB-8MB) the communication channel configured as File Adapter with a polling interval of 7 min(420 sec) is inconsistent in reading the complete file.Sometimes it reads the the complete file of 6 MB and sometimes it reads a part of the file say 3MB/6MB.Can this inconsistent behaviour be resolved.??
Your suggestions highly appreciated.
Regards
Pradeep

Hi Pradeep !
8mb is not a huge file for XI, I think it is a small one. Maybe your problem is not the size..please check if XI is not starting to read the file before it is completely written to the source folder. If you are creating that csv file from another application directly to the poll source directory of the XI scenario specified in the file adapter, and your poll interval is small, XI could start reading the file while you are still writing it. If this is the case, try to put the file with a different extension or filename than the specified in file adapter comm channel and when the file is completely written, rename it to its final filename and check if you are still having that misbehavior.
You can write the file to a temp directory and the move it to the XI directory once finished.
Regards,
Matias.

Sender File Adapter Not Picking Any File

Dear Expert,
I am newbie in PI. Just tried to create File Content Conversion Scenario. Details as follow :
1. Source Directory ..\file\log\test_q.txt
2. Target Directory ..\file\log\xml\test_q.xml
Transport Protocol : NFS
Message Protocol : File Content Conversion
Adapter Engine : Integration Engine
I have completed all the design and configuration in IR and ID. However, when I produce the log file in the directory, nothing happen.
Hacing checked in the RWB as well, I could not find any clue. simply nothing happen.
Would you please advise me on how to trigger the interface? As per my understanding, sender file adapter will be activated directly once the file is created.
Thank you very much in advance.
Best Regards,
Y

Hi Yonisiwa,
Things you should check here are:
1) If the sender file adapter is active or not.
2) If the source directory is correctly spelt or not. (Check if you are using the correct slash \ or /)
3) The file name/mask is correct or not.
4) The polling interval is too long.
Alternatively, you can check the message monitoring in RWB at the adapter level and go into the audit log if the message.
There you can see the reason for the file not being picked up.
Also check the Communication Channel status in the Component Monitoring link in RWB.
Regards,
Ravi Kanth Talagana

File adapter not writing the file correctly

Hi,
I am facing an issue where the file created on the destination is not with the correct data. eventhough the payload that was sent out from XI to the adapter is correct.
Issue was with a mltiple element which was written once eventhough the payload shows multiple existance.
we had changed the occurance of that element from 1 to unbounded.
If anyone has any idea do let me know
Regards
Nikhil

I tried to redo the config objects but still the same issue is there. anyone has any idea

Invoke File Adapter to read just once.

Hello all,
I want to invoke a partnerlink which is using File Adapter to poll for a file every fixed interval. I want the File adapter to read the file just once. In other words, what would be the behaviour of the File Adapter when i invoke it syn or asyn way? Would the file adapter read the file only once? Is there anyway to do this? I read in some post about it but i cannot find or recall the thread.
Thanks for your help.

I think I need to explain the scenario in order to give you some more idea as to why i need to poll file just once.
I am trying to create a schedular using Quartz and If i have this BPEL process scheduled to trigger at say some time, the process would keep on polling. Whereas i just need to poll when the trigger is fired that is once per every trigger fired.
Can anybody throw some ideas on this?

Read Large Files Using BPEL File Adapter

Hi,
I have a scenario, where files of large size in text format are to be read and send to 3rd party. MTOM Policy has to be attached. Files of size 3MB or less are polled and size greater than 3 MB are not Retrieved. How can I resolve the issue. Do I have to break the file and send the data? If so how?
Thanks
Ranga

You have to use streaming feature of the JCA file adapter for handling huge file.
You could go through the following link
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#CIAHHEBF

File Adapter Not Reading Large Files

Similar Messages

Maybe you are looking for