[File-Adapter] Reading not finished files

Hey,
my sender file adapter reading files which are not finished yet.
The files are created by an ABAP programm. The creation could
take some seconds. If the file adapter polls while creation is not
finished, we have a problem.
The flag "Process Read-Only Files" is not set, so the ABAP programm
doesn't seem to set the file to read only.
Is there a way to check (e.g. with an operating system command) if the
file is processed completly?
For example I could check if the date of creation is higher than 10 minutes
or something like this.
Any other ideas?
thanks
chris

What is the file adapter option you are using?
If NFS, you have the option "Milliseconds check before modification" that will prevent the file from being picked up till they are completly written.
If FTP, then when the file is being written to the ftp folder you should have the option to use temporary files option
Regards,
Bhavesh

Similar Messages

File Adapter is not polling File.

Hi All,
I am using file adapter to poll a file. When I am restarting server then it is picking file. After then when I am dropping a file then File Adapter is not picking File.
Can any one guide me what si problem?
I am using SOA SUITE 10.1.3.4
Thanks in Advance.

First clusterGroupId is a unique value. Do not use the same clusterGroupId across different adapters even in different process.
Once clusterGroupId is defined, the multiple activations of the same adapter Activation Agent is to be detected implicitly and automatically by all the instances of the adapter framework active in that cluster. The cluster will allow onlye one node activation to start the reading the files/messages. The adapter framework instances chooses one among multiple nodes, randomly to assume the Primary Activation responsibility. The other activations (instances) in the cluster will initiate to a hot stand-by state, without actually invoking EndpointActivation on the JCA resource adapter.
If a primary activation at some point becomes unresponsive, is deactivated manually or if it crashes/exits, then any one of the remaining adapter framework members of the cluster group will immediately detect this, and reassign the primary activation responsibility to one of activation agents standing by.
This feature uses JGroups underneath for the implementation, hence the clusterGroupId property. These features require cluster and JGroups configuration in collaxa-config.xml and jgroups-protocol.xml. All BPEL instances participating in the cluster must share the same cluster name in collaxa-config.xml,and the same multicast address and port in jgroups-protocol.xml.
As far as for this issue, I too face the same across diff environments and searching for the exact reason. I believe this happens when primary activation agent crashes, the hand-over to the other node is not happening properly through jgroups.
Nirav

File adapter reading while the file is still being written....

Hello BPEL Gurus,
I had a quick question around BPEL or ESB file adapter. Does BPEL file adapter starts reading a huge file that is being written or it waits until the writing process is completed and file is complete?
Any response is highly is appreciated.
Thanks.
SM

It goes like this. At every polling frequency, the adapter looks into the directory for the files with specified pattern (e.g. *.csv, MYCOMPANY*.txt) and specified condition, e.g. minimum file age. This means if there will be 2 files available with matching criteria, the both will be picked up and processed simultaneously in two different BPEL instances. No specific order of execution. However you will find the instances in BPEL console with little delay based on file size.
Perhaps you can elaborate your scenario further. Do we have knowledge of the file name that are to be picked up from the folder. You may use synchronous read option. If you are using 10.1.3.4 version then you can specify the file name before file adapter makes a synchronous read into the give directory.

File Adapter Read not working

Hi All,
I have a file adapter service,which has to read a CSV file.
The configurations i have done is
1)Gave the incming diretory path,delete option is checked
2)Polling frequency - 5 secs
3) gave the xsd.
But the process is not picking up the file,and i dont see any errors in domain.log
Please help.
Regards
Ashwini

Hi Anirudh,
Thanks for the reply.
IS there no solution other than restarting the server ??
below is the xsd i am using.please let me know the modifications that i can do to reject the second invoice if there are any errors in that and proceed further.
<?xml version="1.0" encoding="UTF-8" ?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns:nxsd="http://xmlns.oracle.com/pcbpel/nxsd"
targetNamespace="http://antony.blog.com/ReadStructuredMasterDetailService"
xmlns:tns="http://antony.blog.com/ReadStructuredMasterDetailService"
elementFormDefault="qualified" attributeFormDefault="unqualified"
nxsd:encoding="ASCII" nxsd:stream="chars" nxsd:version="NXSD">
<xsd:element name="Invoice">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="InvoiceHeader" nxsd:startsWith="$H$" maxOccurs="unbounded">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="Supplier_name" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Supplier_Site" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Inv_No" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Invoice_Date" type="xsd:date" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Invoice_Currency" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Invoice_gross_Amount" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Total_Ex_VAT" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," nxsd:quotedBy="""/>
<xsd:element name="Total_VAT_Amount" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Scanned_image_Reference_URL" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="${eol}" />
<xsd:element name="InvoiceDtail" maxOccurs="1">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="InvoiceDTL" nxsd:startsWith="$D$"
maxOccurs="unbounded">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="Business_Unit" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="location" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Store_Name" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Department" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Natural_Account" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy=","/>
<xsd:element name="Inc_VAT" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="Ex_VAT" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="VAT_Amount" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="," />
<xsd:element name="VAT_Rate" type="xsd:int" nxsd:style="terminated" nxsd:terminatedBy="${eol}"/>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema>
Regards
Ashwini

Sender File Adapter does not get files when there is a large number ( 300)

We are on XI 7.0 (SAPKB70015)
We have an issue picking up a large number of files from a particular server. We are trying to pickup the files based on a wildcard e.g. test
- we can retreive up to 200 files from the same server (using the same config) no problem
- we can pull lots of files (>3000) files from other servers (using the same config) no problem
- we can write an mget command (mget test) to reteive the files no problem
So the only issue is retrieving a large number of files from a parfticular server. We see no errors in the RWB.
To get this sorted out we need to find the exact commmands that XI executes to attempt to retrieve the files. Can anyone point me in the right direction on how to find this.
Thanks
Richard

It turned out that this was caused by a limitation on the ftp server.
The file adapter uses the dir command to get a listing of the files matching a specific mask. The dir command does not return any files if there are a large number (the ls command works fine but the file adapter uses dir instead of ls).
sap told me that 'According to this FTP server is no compliant with RFC 959 and that is
why DIR command returns an error.'
We were able to get this resolved by applying a patch on the ftp server.
Thanks
Richard

How to make BPEL File Adapter read only new files?

Hello
we have BPEL processes that define to run from bpel component - file adatper-
when a file come into location that it is path on the linux server . the bpel start run when "File Adapter" bpel component recognize that new file come to the location. its PollingFrequency define to 5. property name="DeleteFile" value="false" so the files remaine there.
we want to migrate the bpel to new SOA version so we did export and deploy to new SOA Domain.
the location of the file adapter is the same.
but when the BPEL processes deployed its start to run for all the files that are in this location- that the file adapter define on .
even the original soa tooks those files and start the BPEL processes for each one of them. also the new SOA that we did deploy to the BPEL processes take those files even if they are very old.
we want the file adatper we take only new files . the start point is the time when we do deploy to the process so if we do deploy in 10:00 am we dont want this bpel will take files from 9:00 or earlier time
Please help , how we can do this?
Thanks

thank you
do you kno hat the value means in the example:
Java mon amour: File Adapter metadata with SOA Suite
<property name="jca.file.LastModifiedTime" value="1293041258635">
what should I rite for read only the files that are only neer then yesterday?

Sender File adapter is not picking up file

Hi,
I am usning the sender file adapter to process a file through FTP. Adapter does not pick up the file, however it recognise the file, as it appears in the error message. Below is the text of the error message:
Could not process file 'filename': com.sap.aii.adapter.file.ftp.FTPEx: 550 toSAP: No such file or directory.
I am not sure yet whether this file is read only. Can read only file not be processed in FTP ?
Thanks

Hi, I have the same problem. In advance, we can see in FTP Server log that CWD command it is called twice, for example :
00:00:59 10.15.64.187 [4669]USER MDM 331 0
00:00:59 10.15.64.187 [4669]PASS - 230 0
00:00:59 10.15.64.187 [4669]CWD MDM_55600_MATERIAL_STD\Outbound\ESN_800\_MATMAS05\Ready 250 0
00:00:59 10.15.64.187 [4669]CWD MDM_55600_MATERIAL_STD\Outbound\ESN_800\_MATMAS05\Ready 550 3
00:01:59 10.15.64.187 [4669]QUIT - 550 0
If we create a directory MDM_55600_MATERIAL_STD\Outbound\ESN_800\_MATMAS05\Ready into the first directory Ready where it is positioned with first cwd , its works !!
First CWD is called for read file an seccond for processing, somebody knows because this behavior ?
Best Regards
Claudio Maino

File Adapter does not process the same file twice

SOA: 11.1.1.4 (non-HA).
I have a file adapter that triggers when a new file gets to a directory; the file is not deleted after the process triggers.
The process is supposed to call other services via a mediator and if any remote fault happens it should rollback automatically and re-trigger with the same file at the next polling interval.
I have literally 3 scenarios:
1). The file gets picked up once, the process fails and the file is never picked up again.
Msg in log: The file : /xx/xx/xx/abc.xml is being ignored as it has already been processed
2). If the mediator only routes to one service after the file gets picked up, it works as expect (that is rollback and restart at the next polling interval). If it has more than one sequential routing rule, I see the same error as above.
3). File does not get picked up EVEN if I "touch" or rename the file.
Msg in Log:
File Adapter ProcessName Poller enqueuing file for processing :/xx/xx/xx/abc.xml
File Adapter ProcessName Ignoring File : abc.xml as it is already enqued for processing.
I have already checked, there is no permission issue.
This is what my .jca file looks like:
<adapter-config name="getFile" adapter="File Adapter" wsdlLocation="getFile.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/FileAdapter" UIincludeWildcard="*"/>
<endpoint-activation portType="Read_ptt" operation="Read">
<activation-spec className="oracle.tip.adapter.file.inbound.ScalableFileActivationSpec">
<property name="DeleteFile" value="false"/>
<property name="MinimumAge" value="5"/>
<property name="SingleThreadModel" value="true"/>
<property name="PhysicalDirectory" value="/xx/xx"/>
<property name="Recursive" value="false"/>
<property name="PollingFrequency" value="20"/>
<property name="IncludeFiles" value=".*"/>
<property name="UseHeaders" value="true"/>
<property name="MaxRaiseSize" value="5"/>
<property name="ListSorter" value="oracle.tip.adapter.file.inbound.listing.TimestampSorterAscending"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
Thanks for looking into it in advance.
Any help with the error messages will be appreciated.

You have to use MOVE operation, if there is any remote exception occured, then move the file to someother folder and again move back to the same folder where the file pickup will start.
In that way you will be use the same file picked up next time when the polling happens.
It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts).
Thanks,
Vijay

Sender file adapter is not polling the file.

Dear all,
Sender file adapter is not polling the file.(But Receiver file adapter is getting the file)
we have installed SP15.
It was worked fine for previous SP14.
I have cheked in Adapter monioring also.
Can you help me out of this problem
Regards
Dhanabal

Hi Dhanabal,
Is the XI system running on a unix machine ?
If yes, from the OS level for the folder you are using in the file comm. channel, execute the command
chmod 777 <folder_name>
The reason for the file to show up in receiver side and not get deleted might be that the xi user mighht be having only read access to the folder...
Thanks,
Renjith.

File Adapter : read XML file with data validation and file rejection ?

Hello,
In order to read a XML file with the file adapter, I have defined a XSD that I have imported to my project.
Now the File Adapter reads the file correctly but it does not give an error when:
- the data types are not valid. Ex: dateTime is expected in a node and a string is provided
- the XML file has invalid attributes.
How can I manage error handling for XML files ?
Should I write my own Java XPath function to validate the file after is processed ? (here is an example for doing this : http://www.experts-exchange.com/Web/Web_Languages/XML/Q_21058568.html)
Thanks.

one option is to specify validateXML on the partnerlink (that describes the file adapter endpoint) such as shown here
<partnerLinkBinding name="StarLoanService">
<property name="wsdlLocation"> http://<hostname>:9700/orabpel/default/StarLoan/StarLoan?wsdl</property>
<property name="validateXML">true</property>
</partnerLinkBinding>
hth clemens

Can file adapter read file link/short cut

All,
I have a requirement for following use case
Can file adapter read a file-link (basically a short-cut to a file in a folder) and check if the file exists at the path referred to in the short-cut.
Thanks,
Praveen

Hi
symbolic link did not work
polling folder - "/tmp/filepoll"
soft link - "/tmp/filepolllink" ponits to above folder
my OS is Sun Solaris
error in opmn.log
<2010-03-24 07:46:55,023> <INFO> <default.collaxa.cube.activation> <AdapterFramework::Inbound> Adapter Framework instance: OraBPEL - successfully completed endpointActivation for portType=Read_ptt, operation=Read
<2010-03-24 07:46:55,025> <INFO> <default.collaxa.cube.activation> <File Adapter::Inbound> Poller raising Alert for exception : ORABPEL-11001
Invalid Input Directory.
The value specified for the input (Physical/Logical)Directory activation parameter has an invalid value "/tmp/filepolllink".
Ensure that the following conditions are satisfied for the input directory :
1) It exists and is a directory (not a file). and
2) It is readable (file read permissions). and
3) If activation parameter "DeleteFile" is set to "true" then the directory should also have granted write permissions. and
4) If using a logical name, then ensure that the mapping from logical name<->physical directory is correctly specified in the deployment descriptor.
Thanks,
Praveen

File Adapter polls all the files from the directory when deployed again

Hi,
File Adapter polls all the files from the inbound directory irrespective of the timestamp when deployed again.
For ex. when the BPEL process with file adapter is deployed, it starts polling the directory based on the timestamp as and when the directory is written with the files. I did not opt for deleting the files after read by the File Adapter.
But, when BPEL process is modified and deployed again, this time, the file adapter picks up all the files in the inbound directory and doesn't consider the timestamp.
My guess is that it should not pick all the files but based on timestamp only.
I guess I can observe the same behavior if I bounce the Application Server also
Do I have an option to achieve this?
Thanks,
Sasi Bhushan.

try this:
1- create a File object for the directory. (look at isDirectory() )
2- create a File[] that represents the files in that directory. (.listFiles())
3- if (file[x].isDirectory()) {recursive method call;}
4- else {
process file;
If you want more help--do some work on it, and come back with specific questions relating to specific lines in your code and specific error messages you've been receiving.

Sender File Adapter stop processing all files

Hello all,
the file adapter pick up all files in the directory by default.
if a large number of files are in the directory then this could slow down the pi processing.
is there any way to process only one file per polling??
regards

>
Ralf Zimmerningkat wrote:
> Hello all,
> the file adapter pick up all files in the directory by default.
> if a large number of files are in the directory then this could slow down the pi processing.
> is there any way to process only one file per polling??
>
> regards
I do not have any proble if you have got the answer. BUT this blog says how to exclude the other files from the same folder.
Your Case: For example, Your Sender CC wants to pick up file ABC.txt from /xyz dir, now suppose there are 10 thousand files of same name in the dir and you want ABC.txt should be picked up one by one, So how this blog is going to help you. Can you Plz explain to me and others too?
@Sachin may be you can throw some light on this... may be I am missing something.

Sender File Adapter picking the same file twice

We are facing a weird issue with File Sender Adapter
We are using PI File Adapter ( NFS ) to read files for a NFS folder and
processing those in PI.Normally it works fine. But for a scenario we
are noticing it sometimes process the same file twice before archiving,
thus duplicating the financial postings.
What we have is :
File Sender Adapter - NFS, Polling interval 60 secs, and Processign
mdoe Archive. File name includes Wildcards - JE_Upload*.txt
what we are noticing is that :
when it picks up a file, it immediately polls again to check for
another file, and sometimes the file is not yet archived so it picks up
and reprocess the same file.
If you see the message below, both belong to the same file, and it
picked up the same file again in 12 secs after processing it the first
time
Successful 02.11.2009 15:01:00 02.11.2009 15:01:01 APMANUAL urn:bl:i2g:003:100
SI_SKF_FIDOC_OB XI Message
Successful 02.11.2009 15:00:49 02.11.2009 15:00:50 APMANUAL urn:bl:i2g:003:100
SI_SKF_FIDOC_OB XI Message
Anyone seen this behavior before?

Hi,
Please check the script which creates file in source NFS Folders. There is possibility that script is making change in file when PI is picking up the file.
When PI picks the file first time it creates one message ID in system. After that if script is making any change in file without file name change (This need not necessary data change), for PI it becomes new file and new message gets generated in PI for same file.
This error normally comes when File adapter is not able to archive file succesfully. For eg. file with same name alredy exists in Archive folder.
File adapter generates the new message id whenfile get modified(eg.change in its length or data change) even though
the file name is same and when file get change ,XI file adapter thinks that its new file and hence generate the new message id for same file.
If file has same name and notmodified then XI adapter will not generate new message id and will keep on throw the error till you remove that file with same name from the
archieve directory.
-Warm Regards,
Gouri

File adapter picking up partial files

Hi All,
We are facing a wierd problem with the File Adapter.
The problem is that, we are getting the xml files from the source system, and PI is supposed to pick them up and process them. Sometimes, the file adapter is picking up the empty files / partial files, i.e., before the file is completely written on to the FTP folder.
We tried increasing the polling interval. But this did not help. Since we are taking the files from the FTP, the option "MSecs" in Additional Parameters also will not work. As we are on PI 7.0 SP13, we tried to search for the "Empty File Handling" option wherein we can make the file adapter skip the 0kb files. But we are not able to find that option anywhere.
Please help us find a solution to this problem.
Thanks,
Hari.

Hari,
In sender communication channel click on Advanced. Then you see the paramter Msecs to Wait Before Modification Check. Add a value 3000. Then you should be good.
Regards,
---Satish

[File-Adapter] Reading not finished files

Similar Messages

Maybe you are looking for