Performance Problem with File Adapter using FTP Conection

Hi All,
I have a pool of 19 interfaces that send data from R/3 using RFC Adpater, and these interfaces generate 30 TXT files in a target Server. I'm using File Adapters as Receiver Comunication Channel. It's generating a serious perfomance problem. In File Adpater I'm using FTP Conection with Permanently Conection, Somebody knows if PERMANENTLY CONECTION is the cause of performances problem ?
These interfaces will run once a day with total of 600 messages.
We still using a Test Server with few messages.

Hi Regis,
We also faced teh same porblem. Whats happening is that when the FTP session is initiated by the file adapter, then its getting done from teh XI server. Hence the memory of the server is also eaten up. Why dont you give a try by using 'per file transfer'.
If this folder to which you are connecting is within your XI server network then you can mount(or map) that drive to the XI server and use it with a NFS protocol of the file adapter and thereby increasing the performance.
Cheers
JK

Similar Messages

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : <b>5sec/msg</b>) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
     Windows 2003 Server
     Processors: 2x3GHZ
     RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

Problem with FIle Adapter

Hi
We r facing typical problem with file adapter.
Lets say there are 30 files to be processed by placing an copy in arichive folder by file adapter based on pooling
parameters.
All the 30 files are picked up and we can see the copies in archive folder.
But when we go to RWB and check the audit log,
there we could see only 25 files , the 5 files are missing.
no trace found therre about the 5 files.
This is happening only some times and not to all the files placed in the FTP. Later when the same file is placed back from the Archive folder to the Source folder, the file is being picked and processed succesfully.
unfortunately this is happening on Production server
Any pointers which could trouble shoot this issue.
Regards
shekar chandra

Hi,
Couple of thing which you can try....
1. Use EOIO QoS and check if you still face the issue.
Is some program or application writing files to the directory? If yes I would recommend the use of a temporary name to write the files and then rename them.
Sometimes when an external application connects via FTP and transfers the files...
The file could be picked up by the adapter poll even before the transfer of data is done.
Which is why you will find that the file is archived but there is no xml message created for the same in the Integration engine.
Try increasing the poll interval. This helps sometimes.
Regards,
Sidharth

Error in Rcvr File Adapter using FTP ?

Hi @,
I am getting the follwoing error while trying to put file in the folder thru Rcvr File Adapter using FTP and it is giving me following error :
java.io.FileNotFoundException :(Permission Denied )
I have verified the permissions on the folder and it is having write permissions.
Please suggest Its urgent.
REgards

hi amit,
can you
1. check whether the access to FTP is Authenticated, if so provide the username and password
2. try giving different file name at the receiver end
3. try normal ftp commands to access the folder
regards
Ramesh P

Problem with file permissions using Snow Lepord

I'm having problems with file Sharing & Permissions using Snow Lepord.
When I save any new file it only has 'Read & Write' privileges for the user, everyone else is 'read only' or 'no access'.
We have a Netgear NAS Server which is accessed by other users over the local network and if I change the Privilege to 'read & write' via Get Info and then copy the file from my desktop to ther server it changes the Privilege of the server version to 'no access' we then have to change it again for it to work.
I also created a new folder on the server and now it says 'no access' and has a no entry icon!
Any ideas???

We have issues like this. Have tried running AFP and SMB, now connecting using CIFS. All have the same problem. I can work on one or two files fine, then suddenly, one of the files I just worked on says I don't have permissions. I log off the server and log back on, and then I have permissions to the file. It will work fine for one or two operations, then fails. We just updated to OSX Mavericks and a Windows 2012 server, but have been having this issue for years. My permissions look fine. I can even change permissions, but it won't let me work on the file or move or delete the file or rename the file. Once I log out and log back in, I can do anything I want.

Sapevt and file adapter using ftp

Hi;
Using the file adapter, I ftp a file to our SAP R/3 system called T01 (=SID).
Target directory
//T01/010/OCS/TC/IN
File name scheme:
wka.dat
I specify in "Run Operating System Command After Message Processing"
sapevt WKA -t name=T01 nr=01
WKA is the event I defined (SM62) into our T01 R/3 system.
It seems not to work. Any help? Did I miss something?
Where do I need to search for logging (ABAP or J2EE stack)?
Wilbert

Hi Wilbert,
Please check these...
http://help.sap.com/saphelp_nw04/helpdata/en/bc/bb79d6061007419a081e58cbeaaf28/content.htm
FTP ReceiverChannel and OS commands help
Hope these help!
cheers,
Prashanth
P.S Please mark helpful answers

Problems with File adapter

Hi All
I am facing some problems with XI system. XI production server was restarted couple of days back. From that time, 1 file is not reaching its destination. When i go to communication channel monitoring, i see this message for all the communication channels with file adapter "No adapter registered for this channel".
But, communication channels with SOAP adapter are working fine, and the corresponding files are reaching its destinations. So, what should i do to rectify this probelm? Do we have to restart XI server onceagain? Is there anything pirticular, to be careful about, while restarting XI system?
Many Thanks in Advance
Chandra Sekhar

Hi Chandra shekar,
Plz try to do the following steps:
1)Try after restarting the Java Stack.
2)Try after SLD cache.
To clear the SLD cache, from the Integration Builder main menu, choose Environment ® Delete Cache for SLD Data.
Once we have deleted the cache for SLD data, accessing objects in the SLD may take longer than usual initially.
This will help you to find SP Level
http://help.sap.com/saphelp_nw2004s/helpdata/en/1f/c45b4211aac353e10000000a1550b0/frameset.htm
http://hostname:5/CPACache/refresh?mode=full
Regards,
Vinod.

Problem with file adapter (FTP) created under business service

Hi
I am using file adapter in my receiver communication channel. I dont know the physical existance of the system so i have created one business service. Under this business system i have created a file adapter with FTP protocol. I have given all the parameters. But when i am trying to execute my scenarion i am getting the following error in SXMB_MONI.
com.sap.aii.utilxi.misc.api.BaseRuntimeException thrown during application mapping com/sap/xi/tf/_SQLMediaCodeToCRMCapaign_: RuntimeException in Message-Mapping transformatio~
In RWB i am getting the following error.
Mapping Error
Execption_During_Execution
In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or sucessful. How to find whether my receiver communication channel FTP parameters configured correctly or not.What is the error. Please help me.
Regards
Sowmya

Somya,
Error clearly indicates that issue is with mapping....so there is no point of checking receiver adapter..
BTW for checking whether the FTP site is working properly or not , you can use any ftp client softwares or command prompt of windows also.
---->In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or successful.
Message has not reached up to that level so no point of looking at receiver communication channel.
Regards,

Problem in Receiver side File Adapter using FTPS mode

Hello,
Here I am facing some problem in receiver side while using FTPS mode in the channel configuration.
The error message which i could see in the audit log is,
Message processing failed. Cause: com.sap.aii.af.ra.ms.api.RecoverableException: Error when getting an FTP connection from connection pool: com.sap.aii.af.service.util.concurrent.ResourcePoolException: Unable to create new pooled resource: java.lang.NullPointerException
Can anyone help me out in solving this issue ASAP?
I am using Per file transfer mode ni the reciever channel.
Thanks in advance,
Yours
Soorya

HI Surya,
First check wether server started or not and then check you are connecting to FTP server by
go to run -> cmd and write ping and ipaddress which is used and see whether u r getting reponse from teh FTP server.
Try to login to the ftp server which you have mentioned in CC using the user name and pwd, to chk whether you have the permissions to login to the server.
Also the check whether the folder you are trying to access is having permission for delete/read/write.
Restart the FTP server and try it again.
Regards
Sridhar Goli

Problem with file adapter polling on Unix

Hi everybody,
I'm trying to run my BPEL process with receive activity of File adapter partner link. Everything is working OK on Windows file system - folder polling is set correctly and when the new file appears and is at least 2 minutes old, the process starts. But when I try to run the process on the UX server with BPEL (folders are changed to the correct values as '/home/myfolder', rights for this folder are set to RWX for everybody and process is deployed successfully to the appropriate domain) nothing is done when the new file appears in the folder.
I really don't know, where is the problem. Any hint from you?
Thanks,
Milan K.

Hi Suraj,
From The Note ``
"lock" option:- This is the option that is almost similar to the above; The key difference being in very rare circumstances, the first option may still allow channels to be run on both server nodes. When this option is set, file adapter acquires a enqueue service lock. Lock is taken on channel object and it is exclusive and non-cumulative such that no second message(even it is from the same channel) can fetch the files from configured FTP/File directories unless and until first message has completed(success/fail) its processing.
This is exactly my requirement.
but when I see the end time of the message its they are withing second only as
14:02:38     14:02:39
14:02:48     14:02:48
14:02:58     14:02:58
14:03:08     14:03:08
14:03:18     14:03:18
14:03:28     14:03:28
14:03:38     14:03:38
14:03:48     14:03:48
14:03:58     14:03:58
14:04:08     14:04:08
14:04:18     14:04:19
14:04:28     14:04:29
14:04:38     14:04:39
14:04:49     14:04:49
14:04:59     14:04:59
14:05:09     14:05:09
14:05:19     14:05:19
14:05:29     14:05:29
14:05:39     14:05:39
14:05:49     14:05:49
14:05:59     14:05:59
14:06:09     14:06:09
14:06:19     14:06:19
14:06:29     14:06:31
14:06:39     14:06:40

Problem with file adapter for delimiter

Hi,
I am working in a file-idoc scenario where i need to read a file with comma delimited body.
Content configuration for the body of the file is as follows,
BODY.fieldNames F1,F2,KEY,F3,F4,F5 where KEY is the key field
BODY.keyFieldValus 01
BODY.fieldSeparator ,
BODY.endSeparator 'nl'
For most of the cases it is working fine.
The record for which this is not working is,
AAA,,01,XXX,FFF,GGG
XI file adapter is ignoring this records.
1) I tried with some option like fieldContentFormatting but this is not working.
2) Most surprisingly if i shift the KEY to left(in place of F2), record is getting picked up properly with SPACE in the tag KEY and '01' in F2.
3) I tried using record like 126126,JJJ,01,,,GGG
Record is picked up with value in F3 and F4 fields are SPACE.
The problem is only with blank between two separator before KEY field.
Is there any other parameter which can solve the problem.
In case any body knows the solution please let me know.
With Regards
Amitesh

By making BODY mandatory with 1 record, i am getting the below given error message in Adapter monitoring...
Sender Adapter v2722 for Party '', Service 'BS_MRS':
Configured at 2007-08-29 09:40:17 BST
History:
- 2007-08-29 09:46:26 BST: Retry interval started. Length: 2.000 s
- 2007-08-29 09:46:26 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:26 BST: Processing started
- 2007-08-29 09:46:24 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:24 BST: Processing started
With Regards
Amitesh

Problem with File adapter channel

Hi All,
I am using a File Adapter channel to process files from FTP server(which is in UNIX environment). I am polling the files from a unix folder (which has this format as -rw-rr). Now I want to know what are the basic permisions should the file have in order to process the file by anyone.
Hope you got the information..
Regards,
Achari

You would need to understand the permission schema.
-rw-rr
- : tells this is file
rw- : tells the owner permission,
r-- : tells the user group permission
r-- tells any other user permission.
so if you are using mode delete/archive mode then the file shoud have execute permission for that owner.
If you are using the same user(i.e. owner that write the file in FTP) to connect FTP from PI then the permission required is
-rwxrr
If you connecting to FTP from PI with a User that is of the same group of the owner then the file permission should be
-rrwxr
If you are using any other to connect to FTP then the file permission should be
-rrrwx
note : rwx or --x is same read/write is included in execute mode along with delete & modify mode.
~SaNv...
Edited by: Santhosh Kumar V on Mar 18, 2010 4:00 PM

Problems with file upload using AMF or SOAP

We use your AMF to connect Flex with Ruby on Rails.
Everything is OK, except file upload.
We did not find how to upload file using AMF or SOAP RPC from
Flex. Only to use FileReference.upload().
The problem is that Flex uses different User-Agent in HTTP
header for this upload and for SOAP/AMF calls.
This means that sessions are different. And even if you
authenticated via SOAP/AMF you can not use it to upload file.
Could you, please, advice is there any other way to upload
files from Flex via SOAP or AMF?

Please, help me on this issue, i am still waiting for someone replying me!

Problem with File Adapter in OSb

Hi All,
I have a scenario where I need to read 2 data files based on a trigger file.Ex: ABC.TRG file should poll ABC1.DATA and ABC.2 DATA files from the same directory.If by any chance,If the second data file is not read, I need to rollback the first one also.I just need to pass only metadata of my .DATA files.I am able to do one .TRG file and one .DATA file in OSB. But I am struck with processing 2 different DATA files and one TRG file.I have tried like this:Using read operation I created a proxy service and in my message flow ,using service callout I tried to get metadata of .DATA files (I used synchread for this JCA) .But when I use service callout, I was not able to get metadata of my .DATA files.
Any help would be appreciated.
Thanks,
PK.

Can you try this :
<getWidgetsResponse>
          <getWidgetsResult>
for $widget in $yourwidgetresponseelement/widgets/widget
return
<widget>
<widgetnumber> { data($widget/widgetnumber) }</widgetnumber>
<widgetclass> { data($widget/widgetclass) }</widgetclass>
</widget>
          </getWidgetsResult>
</getWidgetsResponse>
          or change the
          { data($widget/widgetnumber) }</widgetnumber> }
{ data($widget/widgetclass) }</widgetclass> }
in
          $widget/widgetnumber
               $widget/widgetclass
Good luc.
havent tested it, but should be something like this

Urgent: Performance problem with where clause using IN and an OR condition

Select statement is:
select fl.feed_line_id
from ap_expense_feed_lines_all fl
where ((:1 is not null and
fl.feed_line_id in (select distinct r2.object_id
from xxdl_pcard_wf_routing_lists r2,
     per_people_f hr2
where upper(hr2.full_name) like upper(:1||'%')
          and hr2.person_id = r2.person_id
and r2.fyi_list is null
          and r2.sequence_number <> 0))
or
(:1 is null))
If I modify the statement to remove the "or (:1 is null))" part at the bottom of the where clause, it returns in .16 seconds. If I modify the statement to only contain the "(:1 is null))" part of the where clause, it returns in .02 seconds. With the whole statement above, it returns in 477 seconds. Anyone have any suggestions?
Explain plan for the whole statement is:
(1) SELECT STATEMENT CHOOSE
Est. Rows: 10,960 Cost: 212
FILTER
(2) TABLE ACCESS FULL AP.AP_EXPENSE_FEED_LINES_ALL [Analyzed]
(2) Blocks: 8,610 Est. Rows: 10,960 of 209,260 Cost: 212
Tablespace: APD
(6) TABLE ACCESS BY INDEX ROWID HR.PER_ALL_PEOPLE_F [Analyzed]
(6) Blocks: 4,580 Est. Rows: 1 of 85,500 Cost: 2
Tablespace: HRD
(5) NESTED LOOPS
Est. Rows: 1 Cost: 4
(3) TABLE ACCESS FULL XXDL.XXDL_PCARD_WF_ROUTING_LISTS [Analyzed]
(3) Blocks: 19 Est. Rows: 1 of 1,303 Cost: 2
Tablespace: XXDLD
(4) UNIQUE INDEX RANGE SCAN HR.PER_PEOPLE_F_PK [Analyzed]
Est. Rows: 1 Cost: 1
Thanks in advance,
Peter

Thanks for the reply, but I have already checked what you are suggesting and I am pretty sure those are not causing the problem. The hr2.full_name column has an upper index and the (4) line of the explain plan shows that index being used. In addition, that part of the query executes on its own quickly.
Because the sql is not displayed in an indented format on this page it is a little hard to understand the structure so I am going to restate what is happening.
My sql is:
select a_column
from a_table
where ((:1 is not null) and a_column in (sub-select statement)
or
(:1 is null))
The :1 bind variable is set to a varchar2 entered on the screen of an application.
If I execute either part of the sql without the OR condition, performance is good.
If the :1 bind variable is null with the whole sql statement (so all rows or a_table are returned), performance is still good.
If the :1 bind variable is a not-null value with the whole sql statement, performance stinks.
As an example:
where (('wa' is not null) and a_column in (sub-select statement)) -- fast
where (('wa' is null)) -- fast
where (('' is not null) and a_column in (sub-select statement) -- fast
or
('' is null))
where (('wa' is not null) and a_column in (sub-select statement) -- slow
or
('wa' is null))

Performance Problem with File Adapter using FTP Conection

Similar Messages

Maybe you are looking for