Problem with file adapter polling on Unix

Hi everybody,
I'm trying to run my BPEL process with receive activity of File adapter partner link. Everything is working OK on Windows file system - folder polling is set correctly and when the new file appears and is at least 2 minutes old, the process starts. But when I try to run the process on the UX server with BPEL (folders are changed to the correct values as '/home/myfolder', rights for this folder are set to RWX for everybody and process is deployed successfully to the appropriate domain) nothing is done when the new file appears in the folder.
I really don't know, where is the problem. Any hint from you?
Thanks,
Milan K.

Hi Suraj,
From The Note ``
"lock" option:- This is the option that is almost similar to the above; The key difference being in very rare circumstances, the first option may still allow channels to be run on both server nodes. When this option is set, file adapter acquires a enqueue service lock. Lock is taken on channel object and it is exclusive and non-cumulative such that no second message(even it is from the same channel) can fetch the files from configured FTP/File directories unless and until first message has completed(success/fail) its processing.
This is exactly my requirement.
but when I see the end time of the message its they are withing second only as
14:02:38     14:02:39
14:02:48     14:02:48
14:02:58     14:02:58
14:03:08     14:03:08
14:03:18     14:03:18
14:03:28     14:03:28
14:03:38     14:03:38
14:03:48     14:03:48
14:03:58     14:03:58
14:04:08     14:04:08
14:04:18     14:04:19
14:04:28     14:04:29
14:04:38     14:04:39
14:04:49     14:04:49
14:04:59     14:04:59
14:05:09     14:05:09
14:05:19     14:05:19
14:05:29     14:05:29
14:05:39     14:05:39
14:05:49     14:05:49
14:05:59     14:05:59
14:06:09     14:06:09
14:06:19     14:06:19
14:06:29     14:06:31
14:06:39     14:06:40

Similar Messages

Problem with FIle Adapter

Hi
We r facing typical problem with file adapter.
Lets say there are 30 files to be processed by placing an copy in arichive folder by file adapter based on pooling
parameters.
All the 30 files are picked up and we can see the copies in archive folder.
But when we go to RWB and check the audit log,
there we could see only 25 files , the 5 files are missing.
no trace found therre about the 5 files.
This is happening only some times and not to all the files placed in the FTP. Later when the same file is placed back from the Archive folder to the Source folder, the file is being picked and processed succesfully.
unfortunately this is happening on Production server
Any pointers which could trouble shoot this issue.
Regards
shekar chandra

Hi,
Couple of thing which you can try....
1. Use EOIO QoS and check if you still face the issue.
Is some program or application writing files to the directory? If yes I would recommend the use of a temporary name to write the files and then rename them.
Sometimes when an external application connects via FTP and transfers the files...
The file could be picked up by the adapter poll even before the transfer of data is done.
Which is why you will find that the file is archived but there is no xml message created for the same in the Integration engine.
Try increasing the poll interval. This helps sometimes.
Regards,
Sidharth

Problems with File adapter

Hi All
I am facing some problems with XI system. XI production server was restarted couple of days back. From that time, 1 file is not reaching its destination. When i go to communication channel monitoring, i see this message for all the communication channels with file adapter "No adapter registered for this channel".
But, communication channels with SOAP adapter are working fine, and the corresponding files are reaching its destinations. So, what should i do to rectify this probelm? Do we have to restart XI server onceagain? Is there anything pirticular, to be careful about, while restarting XI system?
Many Thanks in Advance
Chandra Sekhar

Hi Chandra shekar,
Plz try to do the following steps:
1)Try after restarting the Java Stack.
2)Try after SLD cache.
To clear the SLD cache, from the Integration Builder main menu, choose Environment ® Delete Cache for SLD Data.
Once we have deleted the cache for SLD data, accessing objects in the SLD may take longer than usual initially.
This will help you to find SP Level
http://help.sap.com/saphelp_nw2004s/helpdata/en/1f/c45b4211aac353e10000000a1550b0/frameset.htm
http://hostname:5/CPACache/refresh?mode=full
Regards,
Vinod.

Weird problem in File Adapter polling

Hi Guys,
My BPEL process is working fine not until today wherein the File Adapter cannot poll for new files in the target directory. I tried restarting the bpel server and still my bpel process was not able to poll for new files. I tried creating a test bpel process and configure the file adapter (see below):
Operation Type: Read
Archive processed files: Enable
Delete files after successfule: Enable
Include files with pattern: *.csv
Publish messages in batches of: 1000
Polling frequency: 5 seconds
Minimum file age: 0 seconds
Sample File: test.csv
12345,12345,12345
When I tried testing it, the file was deleted but it was not able to archive the file and bpel process did not appear in the instance tab of BPEL console. I have check the domain.log and orabpel.log files and it didn't show any exceptions or error (log level is set to error)
Any idea how to fix this problem?
FYI, I'm using the version 10.1.3.1.
thanks,

What does your process do other than poll files, does it call any other adapter / service. This is more likely the issue although I have seen issues with the file and ftp adapter in 10.1.3.3 and 10.1.3.1. I never sorted the issue it just seemed to affect that process.
10.1.3.1 is really out of date and has a number of issues you should look at upgrading to 10.1.3.4 or 10.1.3.5 but I have seen some posts that have issues with 10.1.3.5.
cheers
James

Problem with File adapter channel

Hi All,
I am using a File Adapter channel to process files from FTP server(which is in UNIX environment). I am polling the files from a unix folder (which has this format as -rw-rr). Now I want to know what are the basic permisions should the file have in order to process the file by anyone.
Hope you got the information..
Regards,
Achari

You would need to understand the permission schema.
-rw-rr
- : tells this is file
rw- : tells the owner permission,
r-- : tells the user group permission
r-- tells any other user permission.
so if you are using mode delete/archive mode then the file shoud have execute permission for that owner.
If you are using the same user(i.e. owner that write the file in FTP) to connect FTP from PI then the permission required is
-rwxrr
If you connecting to FTP from PI with a User that is of the same group of the owner then the file permission should be
-rrwxr
If you are using any other to connect to FTP then the file permission should be
-rrrwx
note : rwx or --x is same read/write is included in execute mode along with delete & modify mode.
~SaNv...
Edited by: Santhosh Kumar V on Mar 18, 2010 4:00 PM

Performance Problem with File Adapter using FTP Conection

Hi All,
I have a pool of 19 interfaces that send data from R/3 using RFC Adpater, and these interfaces generate 30 TXT files in a target Server. I'm using File Adapters as Receiver Comunication Channel. It's generating a serious perfomance problem. In File Adpater I'm using FTP Conection with Permanently Conection, Somebody knows if PERMANENTLY CONECTION is the cause of performances problem ?
These interfaces will run once a day with total of 600 messages.
We still using a Test Server with few messages.

Hi Regis,
We also faced teh same porblem. Whats happening is that when the FTP session is initiated by the file adapter, then its getting done from teh XI server. Hence the memory of the server is also eaten up. Why dont you give a try by using 'per file transfer'.
If this folder to which you are connecting is within your XI server network then you can mount(or map) that drive to the XI server and use it with a NFS protocol of the file adapter and thereby increasing the performance.
Cheers
JK

Problem with file adapter for delimiter

Hi,
I am working in a file-idoc scenario where i need to read a file with comma delimited body.
Content configuration for the body of the file is as follows,
BODY.fieldNames F1,F2,KEY,F3,F4,F5 where KEY is the key field
BODY.keyFieldValus 01
BODY.fieldSeparator ,
BODY.endSeparator 'nl'
For most of the cases it is working fine.
The record for which this is not working is,
AAA,,01,XXX,FFF,GGG
XI file adapter is ignoring this records.
1) I tried with some option like fieldContentFormatting but this is not working.
2) Most surprisingly if i shift the KEY to left(in place of F2), record is getting picked up properly with SPACE in the tag KEY and '01' in F2.
3) I tried using record like 126126,JJJ,01,,,GGG
Record is picked up with value in F3 and F4 fields are SPACE.
The problem is only with blank between two separator before KEY field.
Is there any other parameter which can solve the problem.
In case any body knows the solution please let me know.
With Regards
Amitesh

By making BODY mandatory with 1 record, i am getting the below given error message in Adapter monitoring...
Sender Adapter v2722 for Party '', Service 'BS_MRS':
Configured at 2007-08-29 09:40:17 BST
History:
- 2007-08-29 09:46:26 BST: Retry interval started. Length: 2.000 s
- 2007-08-29 09:46:26 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:26 BST: Processing started
- 2007-08-29 09:46:24 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:24 BST: Processing started
With Regards
Amitesh

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : <b>5sec/msg</b>) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
     Windows 2003 Server
     Processors: 2x3GHZ
     RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

Problem with File Adapter in OSb

Hi All,
I have a scenario where I need to read 2 data files based on a trigger file.Ex: ABC.TRG file should poll ABC1.DATA and ABC.2 DATA files from the same directory.If by any chance,If the second data file is not read, I need to rollback the first one also.I just need to pass only metadata of my .DATA files.I am able to do one .TRG file and one .DATA file in OSB. But I am struck with processing 2 different DATA files and one TRG file.I have tried like this:Using read operation I created a proxy service and in my message flow ,using service callout I tried to get metadata of .DATA files (I used synchread for this JCA) .But when I use service callout, I was not able to get metadata of my .DATA files.
Any help would be appreciated.
Thanks,
PK.

Can you try this :
<getWidgetsResponse>
          <getWidgetsResult>
for $widget in $yourwidgetresponseelement/widgets/widget
return
<widget>
<widgetnumber> { data($widget/widgetnumber) }</widgetnumber>
<widgetclass> { data($widget/widgetclass) }</widgetclass>
</widget>
          </getWidgetsResult>
</getWidgetsResponse>
          or change the
          { data($widget/widgetnumber) }</widgetnumber> }
{ data($widget/widgetclass) }</widgetclass> }
in
          $widget/widgetnumber
               $widget/widgetclass
Good luc.
havent tested it, but should be something like this

Problem with file adapter (FTP) created under business service

Hi
I am using file adapter in my receiver communication channel. I dont know the physical existance of the system so i have created one business service. Under this business system i have created a file adapter with FTP protocol. I have given all the parameters. But when i am trying to execute my scenarion i am getting the following error in SXMB_MONI.
com.sap.aii.utilxi.misc.api.BaseRuntimeException thrown during application mapping com/sap/xi/tf/_SQLMediaCodeToCRMCapaign_: RuntimeException in Message-Mapping transformatio~
In RWB i am getting the following error.
Mapping Error
Execption_During_Execution
In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or sucessful. How to find whether my receiver communication channel FTP parameters configured correctly or not.What is the error. Please help me.
Regards
Sowmya

Somya,
Error clearly indicates that issue is with mapping....so there is no point of checking receiver adapter..
BTW for checking whether the FTP site is working properly or not , you can use any ftp client softwares or command prompt of windows also.
---->In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or successful.
Message has not reached up to that level so no point of looking at receiver communication channel.
Regards,

Problem with File Adapter Communication

Hi,
I have got an tab delimted file as mentioned below
601252539   5000004 5000004 ZURICH CARGO MCO 00000000005
606012525   5000005 5000004 MIKEN INC       00000000003
I have created proper sender and receiver communication channels with content conversions handled properly.
In my adapter monitoring I am able to see that my Sender & Receiver Communication channel is showing green and the messages are polled from the flat file in my sender communication channel.But I am unable to receive my messages in the receiver.I have even checked up with MONI,no messages are displayed as per my interface.
But everything is fine.When I am sending an XML file.
If there are any mistakes with Content conversion with my tab delimeted file than,some error must be shown in my Adapter monitoring showing my communication channel error.
But everything is going fine with Sender communication channel.
There is a major concern here is when I debug the problem, I found out that my content conversion is working fine and the XML document is getting created and When it is going to XI,I have observed that BLANK DOCUMENT is being sent to XI.So,as a thumb rule.SAP XI wont process any BLANK DOCUMENTS.Thats the reason why my receiver is not receing any messages.
I dont know why,when the content conversion with tab delimted file is converted in XML,When conversion is completed while sending the SAP XI is receiving a blank document.
Can any one help me.
Thank You,
KishoreJ.

Hi,
I have just given an example flat file and now even I am giving my content conversion by deleting some,which are not fitting into the page.
Header.fieldFixedLengths 15,25,8,6,1,8,8,8,15,3,31
Header.endSeparator      'nl'
Header.fieldNames        NAME,EXTRD,EXTRT,DBUPD,VOID,UNVD
Header.keyFieldValue      021309379
Detail.fieldFixedLengths 18,13,13,35,15,3,8,2,21
Detail.endSeparator      'nl'
Detail.fieldNames      BANKN,CHECF,CHECT,ZNME1,AMNT,DECM
Detail.keyFieldValue      601252539
Thank You,
KishoreJ.

Problem with file content conversion in receiver file adapter

Hi All
I have a problem with file content conversion in receiver file adapter.
This is my recordset structure: Header_Record,1,Claim_Record,*,Check_Rec,1
These are the content conversion parameters:
Header_Record.fieldSeparator = ,
Header_Record.endSeparator = 'nl'
Claim_Record.fieldSeparator = ,
Claim_Record.endSeparator = 'nl'
Check_Rec.fieldSeparator = ,
Check_Rec.endSeparator = 'nl'
In SXMB_MONI, i can see that the data is correctly extracted from proxy, and correctly mapped to receiver message, and i see a checkered flag (success).
But, Adapter status is RED with the following error message:
Conversion initialization failed: java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found: Parameter '1.fieldFixedLengths' or '1.fieldSeparator' is missing
In communication channel monitoring, i get the following error message:
Message processing failed. Cause: com.sap.aii.af.ra.ms.api.RecoverableException: Channel has not been correctly initialized and cannot process messages
What is going wrong here? Can anyone please tell me?
Thanks
Chandra

Posted in Incorrect forum.
Posted again in Process Integration forum

How to process large input CSV file with File adapter

Hi,
could someone recommend me the right BPEL way to process the large input CSV file (4MB or more with at least 5000 rows) with File Adapter?
My idea is to receive data from file (poll the UX directory for new input file), transform it and then export to one output CSV file (input for other system).
I developed my process that consists of:
- File adapter partnerlink for read data
- Receive activity with checked box to create instance
- Transform activity
- Invoke activity for writing to output CSV.
I tried this with small input file and everything was OK, but now when I try to use the complete input file, the process doesn't start and automatically goes to OFF state in BPEL console.
Could I use the MaxTransactionSize parameter as in DB adapter, should I batch the input file or other way could help me?
Any hint from you? I've to solve this problem till this thursday.
Thanks,
Milan K.

This is a known issue. Martin Kleinman has posted several issues on the forum here, with a similar scenario using ESB. This can only be solved by completely tuning the BPEL application itself, and throwing in big hardware.
Also switching to the latest 10.1.3.3 version of the SOA Suite (assuming you didn't already) will show some improvements.
HTH,
Bas

Problem with FTP Adapter in creating a new Folder

Hi all,
I have a requirement in which a BPEL process shud create a folder named as sysdate dynamically and write a
CSV file into that.(ex: PO/2010-03-09/PO_1.csv).I created a header variable for Oubound FTP adapter and
passing the file directory as concat('PO/',xp20:current-date(),'/') to outbound header directory variable.Problem is FTP
adapter is not creating the sysdate folder its says:1.check u have privileges 2.file name is too long....Blah....Blah.
But i have all the privileges for that user.If i manually create the sysdate folder the FTP adapter is placing the CSV
file.The same works fine with file adapter...but i need to use FTP since the FTP server can change in future.Seems to
be a problem with FTP adapter....can some one help.
Iam using SOA 10.1.3.4
Regards,
Edited by: 0racler on Mar 9, 2010 4:46 AM
Edited by: 0racler on Mar 9, 2010 5:49 AM

any thoughts????

File Adapter polls all the files from the directory when deployed again

Hi,
File Adapter polls all the files from the inbound directory irrespective of the timestamp when deployed again.
For ex. when the BPEL process with file adapter is deployed, it starts polling the directory based on the timestamp as and when the directory is written with the files. I did not opt for deleting the files after read by the File Adapter.
But, when BPEL process is modified and deployed again, this time, the file adapter picks up all the files in the inbound directory and doesn't consider the timestamp.
My guess is that it should not pick all the files but based on timestamp only.
I guess I can observe the same behavior if I bounce the Application Server also
Do I have an option to achieve this?
Thanks,
Sasi Bhushan.

try this:
1- create a File object for the directory. (look at isDirectory() )
2- create a File[] that represents the files in that directory. (.listFiles())
3- if (file[x].isDirectory()) {recursive method call;}
4- else {
process file;
If you want more help--do some work on it, and come back with specific questions relating to specific lines in your code and specific error messages you've been receiving.

Problem with file adapter polling on Unix

Similar Messages

Maybe you are looking for