Weird problem in File Adapter polling

Hi Guys,
My BPEL process is working fine not until today wherein the File Adapter cannot poll for new files in the target directory. I tried restarting the bpel server and still my bpel process was not able to poll for new files. I tried creating a test bpel process and configure the file adapter (see below):
Operation Type: Read
Archive processed files: Enable
Delete files after successfule: Enable
Include files with pattern: *.csv
Publish messages in batches of: 1000
Polling frequency: 5 seconds
Minimum file age: 0 seconds
Sample File: test.csv
12345,12345,12345
When I tried testing it, the file was deleted but it was not able to archive the file and bpel process did not appear in the instance tab of BPEL console. I have check the domain.log and orabpel.log files and it didn't show any exceptions or error (log level is set to error)
Any idea how to fix this problem?
FYI, I'm using the version 10.1.3.1.
thanks,

What does your process do other than poll files, does it call any other adapter / service. This is more likely the issue although I have seen issues with the file and ftp adapter in 10.1.3.3 and 10.1.3.1. I never sorted the issue it just seemed to affect that process.
10.1.3.1 is really out of date and has a number of issues you should look at upgrading to 10.1.3.4 or 10.1.3.5 but I have seen some posts that have issues with 10.1.3.5.
cheers
James

Similar Messages

Problem with file adapter polling on Unix

Hi everybody,
I'm trying to run my BPEL process with receive activity of File adapter partner link. Everything is working OK on Windows file system - folder polling is set correctly and when the new file appears and is at least 2 minutes old, the process starts. But when I try to run the process on the UX server with BPEL (folders are changed to the correct values as '/home/myfolder', rights for this folder are set to RWX for everybody and process is deployed successfully to the appropriate domain) nothing is done when the new file appears in the folder.
I really don't know, where is the problem. Any hint from you?
Thanks,
Milan K.

Hi Suraj,
From The Note ``
"lock" option:- This is the option that is almost similar to the above; The key difference being in very rare circumstances, the first option may still allow channels to be run on both server nodes. When this option is set, file adapter acquires a enqueue service lock. Lock is taken on channel object and it is exclusive and non-cumulative such that no second message(even it is from the same channel) can fetch the files from configured FTP/File directories unless and until first message has completed(success/fail) its processing.
This is exactly my requirement.
but when I see the end time of the message its they are withing second only as
14:02:38     14:02:39
14:02:48     14:02:48
14:02:58     14:02:58
14:03:08     14:03:08
14:03:18     14:03:18
14:03:28     14:03:28
14:03:38     14:03:38
14:03:48     14:03:48
14:03:58     14:03:58
14:04:08     14:04:08
14:04:18     14:04:19
14:04:28     14:04:29
14:04:38     14:04:39
14:04:49     14:04:49
14:04:59     14:04:59
14:05:09     14:05:09
14:05:19     14:05:19
14:05:29     14:05:29
14:05:39     14:05:39
14:05:49     14:05:49
14:05:59     14:05:59
14:06:09     14:06:09
14:06:19     14:06:19
14:06:29     14:06:31
14:06:39     14:06:40

Problem with FIle Adapter

Hi
We r facing typical problem with file adapter.
Lets say there are 30 files to be processed by placing an copy in arichive folder by file adapter based on pooling
parameters.
All the 30 files are picked up and we can see the copies in archive folder.
But when we go to RWB and check the audit log,
there we could see only 25 files , the 5 files are missing.
no trace found therre about the 5 files.
This is happening only some times and not to all the files placed in the FTP. Later when the same file is placed back from the Archive folder to the Source folder, the file is being picked and processed succesfully.
unfortunately this is happening on Production server
Any pointers which could trouble shoot this issue.
Regards
shekar chandra

Hi,
Couple of thing which you can try....
1. Use EOIO QoS and check if you still face the issue.
Is some program or application writing files to the directory? If yes I would recommend the use of a temporary name to write the files and then rename them.
Sometimes when an external application connects via FTP and transfers the files...
The file could be picked up by the adapter poll even before the transfer of data is done.
Which is why you will find that the file is archived but there is no xml message created for the same in the Integration engine.
Try increasing the poll interval. This helps sometimes.
Regards,
Sidharth

File Adapter polls all the files from the directory when deployed again

Hi,
File Adapter polls all the files from the inbound directory irrespective of the timestamp when deployed again.
For ex. when the BPEL process with file adapter is deployed, it starts polling the directory based on the timestamp as and when the directory is written with the files. I did not opt for deleting the files after read by the File Adapter.
But, when BPEL process is modified and deployed again, this time, the file adapter picks up all the files in the inbound directory and doesn't consider the timestamp.
My guess is that it should not pick all the files but based on timestamp only.
I guess I can observe the same behavior if I bounce the Application Server also
Do I have an option to achieve this?
Thanks,
Sasi Bhushan.

try this:
1- create a File object for the directory. (look at isDirectory() )
2- create a File[] that represents the files in that directory. (.listFiles())
3- if (file[x].isDirectory()) {recursive method call;}
4- else {
process file;
If you want more help--do some work on it, and come back with specific questions relating to specific lines in your code and specific error messages you've been receiving.

Problem in file-Adapter during polling with u00E4,u00F6 etc.

Hallo,
i have the problem described above. Is there any help?
Thanks,
Frank

Hi,
Please change the File Encoding in the sender file adapter to ISO-8859-1.
Please look into this link,.
http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/content.htm
--> File Type.
File Type
Specify the document data type.
○ Binary
○ Text
Under File Encoding, specify a code page.
The default setting is to use the system code page that is specific to the configuration of the installed operating system. The file content is converted to the UTF-8 code page before it is sent.
Permitted values for the code page are the existing Charsets of the Java runtime. According to the SUN specification for the Java runtime, at least the following standard character sets must be supported:
■ US-ASCII
Seven-bit ASCII, also known as ISO646-US, or Basic Latin block of the Unicode character set
■ ISO-8859-1
ISO character set for Western European languages (Latin Alphabet No. 1), also known as ISO-LATIN-1
■ UTF-8
8-bit Unicode character format
■ UTF-16BE
16-bit Unicode character format, big-endian byte order
■ UTF-16LE
16-bit Unicode character format, little-endian byte order
Regards
Bhavesh

File adapter polls before the processing is finished in R3

Hi,
Polling in sender file adapter is set as 4 secs. The problem arises when more than one files with same Service Order number are uploaded and the corresponding IDOCs are simultaneously received in R3 system. As one IDOC is already processing the Service Order, the other IDOC fails as the Service Order is already being processed.
Kindly suggest if there is a way to resolve this issue.
Regards
Pravesh

Hi,
Check below link:
File adapter should pick a single file at a time
can file adapter pick files sequentially
Amol
Edited by: AMOL BHARTI on Apr 14, 2010 11:38 AM

File adapter polling stops after reboot of third party system

Hi,
We noticed that whenever we reboot our third party system, XI File Adapter is losing it's connection to that third party system and polling stops. As a result File Adapter is not processing any files from that particular server.
To fix this problem, we either reboot XI Server or refresh communication channel (Go to change mode and save it).
File adapter is configured to use FTP to transfer the files between Windows Server and Unix Server.
Is there a better way to fix this problem?
Thanks in advance.
Regards
Chandu

Hi,
Make the connect mode as PER FILE TRANSFER in the file adapter.
Connect Mode
Permanently
An existing connection to the FTP server is used permanently.
The connection is reestablished automatically if it is closed by the server.
Per File Transfer
A new connection to the FTP server is established for each file transfer.
http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/content.htm
Regards,
Bhavesh

SOA Suite and File Adapter polling

Hi All.
Whenever I have a BPEL process deployed (didn't test whith ESB yet) that uses a file adapter tha polls for files in a directory, my SOA Suite is not able to shutdown properly, and it stops with error when it's time to stop the container that has the BPEL installed.
This is the error message:
There are some errors while stopping the following components. Refer to the generated error report for more details.
==================================================
ias-component: default_group
process-type: oc4j_soa
process-set: default_group
Error Message:time out while waiting for a managed process to stop
==================================================
Looking at OPMN log, I see that the managed process was forcefully shutdown.
Is this an issue, or a normal behavior, or do I have to implement some code in order to stop the BPEL process before shutdown?
I'm using SOA Suite 10.1.3.1 in a developer environment (Win XP)
Regards.
Denis

I applied patch 5964097 (OPMN PERFORMS ALWAYS A FORCEFUL SHUTDOWN IN 10.1.3.1) and it seems to solve the problem, at least for the BPEL scenario explained.

XI file adapter polling faster than poll interval

Hi,
We are facing a issue with the file adapter/authorization of the FTPUSER.
We FTP a server and pick up a file from a particular folder.
My polling interval is 2 minutes
My retry interval is space.
Processing mode : ARCHIVE
We are archiving it on a Network attached server(NAS) mounted on our XI server.
When XI polls for the first time it picks up the file but the sender file adapter shows following error in RWB.
2006-01-20 11:31:08 GMT: Error: Deleting of file 'ARUCSjnewb80.txt' failed - cannot proceed: FTPEx: ARUCSjnewb80.txt: Access is denied.
The picked up file gets processed but at the same time just within 12-13 seconds of the first poll XI picks up the file second time and then in another 3 seconds for the third time.
After this the file gets archived thrice in the archive directory and then gets deleted from the source directory.
We are unable to understand why XI is polling again after few seconds of the first poll.(As per my understanding it should have polled after 2 minutes).
I am able to delete the file manually from the Ftp server.
Could anyone give a pointer towards what we are missing or what probable reasons could be?
authorization issue?( XIADM /ftpuser have full authorization)
Some adapter setting?
Regards,
Sulakshana

Hi,
Could you let me know how frequent the file gets loaded to the FTP server.
Is your file size too large to get loaded.. If so try to increase the polling interval. Also make sure that you have provided the polling time in sec and not in minutes...i.e for 2 minutes it should have been specified as 120 sec as polling interval
Regards,
Nithiyanandam

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : 5sec/msg) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
 Windows 2003 Server
 Processors: 2x3GHZ
 RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

File Adapter Polling issue(Is there critical value of File size )?

Hi
I use File adapter as the Activation to initialize a BPEL process instance .The source data is a kind of Delimited file format.On my PC, when the file size is less than 4M ,everything works fine ,But when the size increased. The BPEL process will not initialize the instance.When the source data is XML data , the "critical value " is about 12M. The error msg is below.
<2005-08-08 12:48:26,209> <INFO> <default.collaxa.cube.activation> <File Adapter::Inbound> Processing file : D:\Temp\WOSSystemIntegration\InBoundFiles\LOADPLAN_DATA_200508041708.xml
<2005-08-08 12:48:29,455> <INFO> <default.collaxa.cube.activation> <FileAdapter::Inbound> Sending message to Adapter Framework for posting to BPEL engine: { file=D:\Temp\WOSSystemIntegration\InBoundFiles\LOADPLAN_DATA_200508041708.xml
<2005-08-08 12:48:40,197> <ERROR> <default.collaxa.cube> <BaseCubeSessionBean::l
ogError> Error while invoking bean "cube delivery": Delivery callback message se
rialization failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube> <BaseCubeSessionBean::l
ogError> Error while invoking bean "delivery": Delivery callback message seriali
zation failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound> [Read_ptt::Read(loadPlanCollection)] - JCA Activation Agent was
unable to perform delivery of inbound message to BPEL Process 'bpel://localhost/
default/P2E_WOS_LP~1.0/' due to: Delivery callback message serialization failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound>
com.oracle.bpel.client.ServerException: Delivery callback message serialization
failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
at com.collaxa.cube.engine.delivery.DeliveryHandler.initialPostAnyType(D
eliveryHandler.java:328)
at com.collaxa.cube.engine.delivery.DeliveryHandler.initialPost(Delivery
Handler.java:219)
at com.collaxa.cube.engine.delivery.DeliveryHandler.post(DeliveryHandler
.java:83)
at com.collaxa.cube.ejb.impl.DeliveryBean.post(DeliveryBean.java:181)
at IDeliveryBean_StatelessSessionBeanWrapper22.post(IDeliveryBean_Statel
essSessionBeanWrapper22.java:861)
at com.oracle.bpel.client.delivery.DeliveryService.post(DeliveryService.
java:161)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase$DeliveryServiceMon
itor.send(AdapterFrameworkListenerBase.java:2340)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase.executeDeliverySer
viceSend(AdapterFrameworkListenerBase.java:478)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase.deliveryServiceSen
d(AdapterFrameworkListenerBase.java:535)
at oracle.tip.adapter.fw.jca.AdapterFrameworkListenerImpl.performSingleA
ctivation(AdapterFrameworkListenerImpl.java:699)
at oracle.tip.adapter.fw.jca.AdapterFrameworkListenerImpl.onMessage(Adap
terFrameworkListenerImpl.java:567)
at oracle.tip.adapter.fw.jca.messageinflow.MessageEndpointImpl.onMessage
(MessageEndpointImpl.java:121)
at oracle.tip.adapter.file.inbound.ProcessWork.publishMessage(ProcessWor
k.java:651)
at oracle.tip.adapter.file.inbound.ProcessWork.doTranslation(ProcessWork
.java:456)
at oracle.tip.adapter.file.inbound.ProcessWork.processMessages(ProcessWo
rk.java:200)
at oracle.tip.adapter.file.inbound.ProcessWork.run(ProcessWork.java:139)
at oracle.tip.adapter.fw.jca.work.WorkerJob.go(WorkerJob.java:51)
at oracle.tip.adapter.fw.common.ThreadPool.run(ThreadPool.java:267)
at java.lang.Thread.run(Thread.java:534)
<2005-08-08 12:48:40,245> <INFO> <default.collaxa.cube.activation> <File Adapter
::Inbound> Failed to send message {D:\Temp\WOSSystemIntegration\InBoundFiles\LOA
DPLAN_DATA_200508041708.xml} to Adapter Framework.
<2005-08-08 12:48:40,245> <WARN> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> [Read_ptt::Read(loadPlanCollection)] - onReject: Sending invalid
inbound message to Exception Handler: file://D:/Temp/WOSSystemIntegration/Reject
edMessages
<2005-08-08 12:49:44,617> <FATAL> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound> [Read_ptt::Read(loadPlanCollection)] - Resource Adapter requeste
d Process shutdown
<2005-08-08 12:49:48,676> <INFO> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> Adapter Framework instance: OraBPEL - performing endpointDeactiva
tion for portType=Read_ptt, operation=Read
<2005-08-08 12:49:48,676> <INFO> <default.collaxa.cube.activation> <File Adapter
::Inbound> Endpoint De-activation called in adapter for endpoint : D:\Temp\WOSSy
stemIntegration\InBoundFiles
<2005-08-08 12:49:49,042> <INFO> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> JCAActivationAgent::onStateChanged State is changed for process '
bpel://localhost/default/P2E_WOS_LP~1.0/', state=OFF
how can i solve this problem?can i predeploy some parameter? Is there some critical value of File size for the processing of File Adapter ?

Hi,
There is no specific parameters to specify the maximum file size to be read in. It is just limited by the heap size of the JVM running the BPEL engine.
If you have enough RAM on your machine you can change the current heap size from 512Mbyte to 1Go by editing the startorabpel.bat file
and modifying the line :
set MEM_ARGS=-Xms512m -Xmx512m -Xmn300m -XX:MaxPermSize=80m
to
set MEM_ARGS=-Xms512m -Xmx1024m -Xmn300m -XX:MaxPermSize=80m
But only do it if you have at least 1.5 Gb of RAM on your machine, otherwise ot will keep spawing and you will have very bad performance.
Speaking about performance, do you really need to have a BPEL payload of 4 to 12 Mb ?
Will the BPEL process really need to access it ? if so, the best solution would be using batching techniques to cut you file in pieces and process it piece by peice.
FB.

File adapter polling frequency is not consistent in SOA 10g!

Friends,
I have used file adapter for polling files in a service in SOA 10G env. with polling frequency 3600 secs. However, i have noticed file polling is not happening at 60 mins interval, instead some times files getting polled in less than 30 mins but again after sometime its polling correctly in 60 mins interval. I am not sure what could be the reason but i need a solution urgently. Please help!

Could be the managed servers in the cluster are not in sync.
I faced DB JCA adapter sync issues because of Oracle soa suite bug.
You could check whether any sync issues are there with File adapters.

Problem in File Adapter jca.file.FileName

Hello, I have problem in sending variable data to the file adapter property
I have defined Variable FlowData of Type Element from a XSD
When I am trying to assign the variable data to the File adapter it is throwing error
*<bpelx:inputProperty name="jca.file.FileName"*
variable="flowData"
query="ns2:flowData/ns2:fileInfo/ns2:name"/>
Error query "ns2:flowData/ns2:fileInfo/ns2:name" is invalid, because step 'ns2:flowData' is not valid.
Please help me!!

Hi,
Try to add a slash */* at the beginning of the xpath...
*/ns2:flowData/ns2:fileInfo/ns2:name*
Cheers,
Vlad
Give points - it is good etiquette to reward an answerer points (5 - helpful; 10 - correct) for their post if they answer your question
https://forums.oracle.com/forums/ann.jspa?annID=330

Need file adapter polling with read operation to be triggered by a BPEL without using synchronous read

The scenario is:-
Web Service Client -->input-->BPEL-->if input valid-->trigger file adapter with read operation--> receive file
i am not able to stop the polling until it is required to trigger the polling.
As soon as i deploy the composite the file adapter starts polling without waiting for input.
Since i am using two receive activities, the second one which is suppose to receive file from file adapter is always showing pending state. (asynchronous callback)

Hi there,
IMHO the traditional read is used only as inbound operation, that means
that it starts polling the input folder as soon as the composite gets
deployed - which is the same you are experiencing.
In your case you need an outbound operation that needs to be invoked at
a certain moment. I don't know what are the reasons not to use sync
read, but this is the only outbound read operation supported by the
adapter. If you can not use the sync read, then you would have to design
some custom solution where you call a web service or EJB for instance
that reads the desired files.
Another option I can think of, though have not use personally is using
the adapters programatically in Java - take a look at this blog post as
it seems related to this topic -
https://technology.amis.nl/2012/01/22/using-the-oracle-weblogic-technology-adapters-with-custom-java-message-driven-bean-mdb-triggered-by-file-adapter-part-of-the-story/.
Hope this helps,
A.

Performance Problem with File Adapter using FTP Conection

Hi All,
I have a pool of 19 interfaces that send data from R/3 using RFC Adpater, and these interfaces generate 30 TXT files in a target Server. I'm using File Adapters as Receiver Comunication Channel. It's generating a serious perfomance problem. In File Adpater I'm using FTP Conection with Permanently Conection, Somebody knows if PERMANENTLY CONECTION is the cause of performances problem ?
These interfaces will run once a day with total of 600 messages.
We still using a Test Server with few messages.

Hi Regis,
We also faced teh same porblem. Whats happening is that when the FTP session is initiated by the file adapter, then its getting done from teh XI server. Hence the memory of the server is also eaten up. Why dont you give a try by using 'per file transfer'.
If this folder to which you are connecting is within your XI server network then you can mount(or map) that drive to the XI server and use it with a NFS protocol of the file adapter and thereby increasing the performance.
Cheers
JK

Weird problem in File Adapter polling

Similar Messages

Maybe you are looking for