SFTP Adapter Stops picking files intermittently
We are having issues with sftp. In the BPEL process we are polling for files from a sftp location. When we deploy this process, it picks the files
perfectly but after some time(couple of hours to few days) it stops polling.
We have seen in the logs that the sftp adapter stops gettling list of files after some time.
Any clues why's this happening.
Is there someway to tell FTP Adapter to create a new connection every time it goes to poll the files AND some way to keep the activation agent keep working instead of dying out when something bad happens.(e.g. timeout or ftp server unavailability etc).
We are going to production in 2 weeks and have just discovered this issue. Pls help.
thanks
Hi ,
i think currently your FTP Connection factory will have the following connection pool
<connection-pooling use="none">
</connection-pooling>
replace the above with the following properteis
<connection-pooling use="private">
<property name="waitTimeout" value="300" />
<property name="scheme" value="dynamic" />
<property name="maxConnections" value="10" />
<property name="minConnections" value="0" />
</connection-pooling>
Krishna
Similar Messages
-
File adapter stops pulling files from ftp
hi,
i defined a communication channel in this way:
adapter type: File
Sender
transport protocol: FTP
message protocol: file content conversion
data connction: passive
connect mode: permanently
Quality of service: exacly once.
somtimes the channel stops working - no indication in message monitioring or communication channel monitoring of any error.
the only way to get it to again and start pulling files again from ftp is to set it to inactive, save, activate, set it to active, save,
activate. somtimes this operation needs to be repeated more than once until it starts working again.
the only relevant note i found is: 999791
https://websmp130.sap-ag.de/sap(bD1oZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=999791
but this note was already implemented on my system.
Does anyone know what could be the problem?
Thanks,
TomerHi,
In communication channel monitoring, is it so happening that channel is working but it is not fetching any data?
If this is the case, that means, your channel must be getting locked.
For this the solution we have implemented is, in advanced tab, we have mentioned the parameter as 'taskTimeout' and
have assigned the value of 300sec to it.
That means, aftr 300 sec, channel will be unlocked (if at all it is locked) and try to fetch the data again.
If this is not the case with you, then pls explain the issue in detail.
Regards,
Supriya. -
JMS Adapter not picking file in PI7.0
Hello,
I am working jms to jms scenario on PI7.0 Service Pack13. file is not able to pick up sendar JMS Channel. I am using WebSphereMQ Transport Protocol. JMS drivers are installed. ports and protocals are correct.
I checked all parameters of JMS Adapter. no mistake in parameters. What is the problem. Please suggest as soon as possible.
Thanks
venkatHi San ,
Please checke the status of JMS communication channel. In Runtime work bench , U will get the adapter monitoring there if any activity happens it shows the event details .
I hope picking the file is initial event so you can get some idea with those event log for Communication channel .
Cheers,
Reddy -
Hi
I trying to get files from a remote FTP server
but the FTP adapter configured is not able to pick up files from the remote folder
using
soa 11.1.1.3
filezilla as FTP server
+<Sep 5, 2011 5:32:56 PM GMT+05:30> <Error> <oracle.soa.b2b.transport> <BEA-00000+
+0> <[IPT_FileRecMonitorError] Error in ftp or file receiver monitor.>+
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using mcf
for credentials
FINE: Ftp Adapter Managed Connection Created
FINE: Ftp Adapter Adding Event Listener
FINE: Ftp Adapter Connection Created
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Wed Aug 31 1+
+9:40:00 GMT+05:30 2011] for [Aug 31 19:40], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Fri Sep 02 1+
+8:23:00 GMT+05:30 2011] for [Sep 02 18:23], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Fri Sep 02 1+
+8:33:00 GMT+05:30 2011] for [Sep 02 18:33], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Mon Sep 05 1+
+3:13:00 GMT+05:30 2011] for [Sep 05 13:13], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Mon Sep 05 1+
+3:45:00 GMT+05:30 2011] for [Sep 05 13:45], time offset=[0]+
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@8
+68852+
can someone help me on this
-Regards
adiKsystimeHey Naresh
thanks for your earlier reply
but I have no luck yet
soa_server logs show
FINE: Ftp Adapter Clearing Event Listeners
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Managed Connection Created
FINE: Ftp Adapter Adding Event Listener
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
+47dc09+
FINE: Ftp Adapter The candidate set size in matchManagedConnection [1]
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
d469b0
FINE: Ftp Adapter The candidate set size in matchManagedConnection [1]
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
+040f85+
FINE: Ftp Adapter FTPManagedConnection::destroy called, closing physical socket
and No luck yet in picking up the remote files
regards
adiKsystime -
HTTPs sender adapter to pick file from a external HTTP file location
HI gurus
Please see the problem here. I need know hoe to configure the Sender HTTP adapter.
My Scenario-
A Flat file (non-xml but structured) sitting on an external https enabled web server. I need XI to go out and get this file on a regular basis (which will then be processed laterby the business person)
Thanks
VLHi,
The FTP Adapter will do the job for you. Just create a File Communication Channel and change Transport Protocol to FTP. Since you mentioned that the file is non-xml, in the Message Protocol, choose, File Content Conversion.
Here are some blogs that will help you:
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
FYI.. HTTP Sender adapter is not required to be configured because a HTTP request will directly come to the ABAP Engine
Regards,
Balaji.M -
Aedaptive SFTP adapter - alerting problem
Hello experts,
Has anyone experience with the Aedaptive SFTP adapter?
We use it at the client side, but unfortunately alerting is not supported. I expected this of a certified SAP PI adapter, but it isn't the case.
Is there an alternative?
Thanks a lot!
DimitriHi Iñaki,
We configured our channel as it show the note 1988592 - SFTP Adapter not picking files with *
But we have the same error:
Exception received while check for additional files: String index out of range: -1
I attached the screenshot
Thanks and best regards -
Hi,
Last year we made the upgrade in our PI server to enable SFTP adapter. Our version is SAP 7.1 ehp 1
When trying to use this adapter (We attached configuration in the message), this gives us an error.
This is the error log:
Exception received while check for additional files: String index out
of range: -1
On the other hand, the communication channel fails when it try to process any of the file list but doesn't gives us any log error.
Is it a problem of configuration required for SFTP adapters? If so how should indicate our filters to properly process messages?
Thanks and best regards.
MónicaHi Iñaki,
We configured our channel as it show the note 1988592 - SFTP Adapter not picking files with *
But we have the same error:
Exception received while check for additional files: String index out of range: -1
I attached the screenshot
Thanks and best regards -
File adapter to pick a single file
The scenario is PI File adapter would pick files from a 3rd party FTP location. The 3rd party is placing files with file names using date time stamp.
The requirement is to process one file at a a time - I have mentioned the Processing Sequence as 'By Date' which means the adpater would pick the files sequentially. But I want the adapter to pick only one file at a time rather than picking all the available files in the system.
Is that possible to do?
Thanks.
Anuradha.Hi Anuradha,
Could you please kindly provide answers to the queries below so that forum members can have a clear picture of your requirement
1. What is the operating system of your PI server?
2. What is the version of PI you are working on?
3. What exactly do you mean by statement " I want the adapter to pick only one file at a time rather than picking all the available files in the system." since adapter will actually pick up files one by one only in each polling interval. This goes in PI pipeline
one after another in quick succession.
4. Do you mean that you want to insert delays between successive file pick up then Baskar has already answered your question.
5. Do you want the channel to pick up only one file in a day out of all possible file?
6. Could you please kindly provide any sample file name you are receiving in PI ?
regards
Anupam -
Flat file to XML in SAP SFTP adapter
Hello All
I am trying to convert flat file to xml using SAP SFTP adapter.
Flat File is like below:
AABEN;20141106;20141106;45;0.00
AABOL;20141106;20141106;45;0.00
ABGRI;20141106;20141106;45;0.00
ADDEA;20141106;20141106;45;0.00
ALADA;20141106;20141106;45;58.43
AMSCH;20141106;20141106;45;0.00
ANOLV;20141106;20141106;45;0.00
ANROY;20141106;20141106;45;0.00
AVMCD;20141106;20141106;45;0.00
Message Type structure I created like below
In Server SFTP adapter in Module tab I am using "AF_Modules/MessageTransformBean" and conversion type ="StructPlain2XML"
I am getting error = "Error: com.sap.aii.af.sdk.xi.adapter.trans.TransformException: Transformer Conversion3.0.5226 Error initializing Class: java.lang.Exception: java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found (4408) Parameter 'xml.keyFieldName' is missing (4403) Parameter 'xml.keyFieldType' is missing (4403) ; nested exception caused by: java.lang.Exception: java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found (4408) Parameter 'xml.keyFieldName' is missing (4403) Parameter 'xml.keyFieldType' is missing (4403) "
I am not using any key field then please let me know how to overcome this issue.
I searched on SDN but did not get any perfect answer.
Thanks
Dheeraj KumarHello Dheeraj,
Thanks for your reply. I created a new discussion,
Flatfile to XML
Thanks well in advance for your help!
-Satish. -
Advantco SFTP for retaining source file name
We are using Advantco SFTP adapter in a File to File scenario on both sender and receiver side. We have 2 files to be picked from Source (both with different name) and need to place them on receiver directory with the name that we picked from source directory without conversion. Can anyone suggest how we can do this using Advantco SFTP adapter without using JAVA mapping ?
Thanks,
Pankaj Kumar SinghHi Pankaj,
use the ASMA parameter "File Name" in sender channel and ASMA parameter "File Name" in receiver channel.
this is worked for my scenario.
Regards,
Harish -
Hi
I want to transfer the file from one location to another locatoin through Seeburger SFTP adapter, is it possible?, If yes could you please suggest how to do and provide any documents/links.
By using File adapter we can send the data
/people/william.li/blog/2006/09/08/how-to-send-any-data-even-binary-through-xi-without-using-the-integration-repository
Like this i want to send the data through SFTP.
Thanks
RameshI had a same question long time back.
The way to do this is - Exchange the server keys ( Your admin can generate it)
Install the keys ( server keys ) from the target system in your source server ( where you have SFTP adapter installed). If you have user id and password you can choose in the drop down of the SFTP adapter.
Yes, FIle adapter is configured to pick the file and virual receiver.
Another pointer was - there are some fields which are mandatory like mapping where you can use DUMMY.
To send to the target - configure the receiver adapter.
Make sure your fire wall is open for the port needed for SFTP.
-Sanju -
Hello,
I am only a few weeks old into BizTalk so I am new to this application.
The pieces I have for my development environment consists of the following:
FTP Server ---[SFTP Adapter]---> BizTalk 2013 ---[FILE Adapter]---> Internal Network Share Drive
I currently configured a simple PassThru, One way Receive/Send in BizTalk where the Receive Port receives a file via SFTP
Adapter from our FTP server and the Send Port sends the file via the FILE Adapter to our Internal Network share drive.
The setup works great with small files. However, when I receive a large file on the FTP server, the Send Port sends multiple instances of the file on the FTP server because the Receive Adapter sees that the file is there, but not yet
fully uploaded.
Can someone please guide me as to how I can determine when a file is fully uploaded to the FTP server before the Receive Adapter fires?
Thanks,
MitchYap BizTalk does not have control over locking the file during read/write Operation and its the third party which need to take care of this (by rename the file after upload ) .
If the file size is too large I would suggest to bypass the message box as it has performance bottleneck during peak hours
Apart from being repetitive, this is not good advice. There is no indication that the file is too large or will cause any "performance" issues.
The concurrency problem can happen with a file of any size. -
Picking file in sequence/Queuing in sender SFTP adapter.
Hi Experts,
I am using SFTP adapter in sender side, it has no option of quality of service ( EOIO) and queue name as we have in FTP adapter configuration .Is there any predefined module provided by Sap which i use in the modules Tab in communication channel configuration to get the functionality of queuing ? just like we use strictXMlto plain bean etc.
I have 3 files which needs to proccess in a sequence one after another in order.I CANT USE BPM or Even FTP because of Security reasons.
please share you ideas.
Regards,
AnikaHi all,
I have tried using AF_Modules/DynamicConfigurationBean in module tab present is the sender SFTP adapter with the attribute qualityOfService.
parameter name Parameter value
key.0 insert http://sap.com/xi/XI/System/Messaging qualityOfService
value.0 ExactlyOnceInOrder
But in Moni i dont see the 3 messages didnt go in the same queue.But when i double click and open the dynamic configuration present in the soap header section i can see the values which i given in the module parameter.
Is there any way i can change the quality of service to EOIO at runtime ? how to change the default EO to EOIO.
Regards,
Anika -
Sender SFTP Adapter channel is not polling for files
Hello All,
Couple of SFTP sender adapter channel was failing in Developent system with u201Cdirectory listingu201D error.All SFTP sender channels stopped polling for the files in Developent system . We were unable to find the reason for adapter failure, Hence we restarted the j2ee server and adapter started polling files. Later we are facing the same issue in Quality system. THe adapter cahnnel is not polling files in Quality system even.
All lean tool adapters were showing the u201CHost key was not accepted erroru201D on 27th of Feb . As per the other channel trace, the time stamp of last successful polling and error time stamp of lean tool sender channels are exactly same
Eventhough two communication channels access the same SFTP adapter, one communicationchannel is getting 'Host key was not accepted error' but in other communication channel, files are getting picked.
Please let me know the solution if you have come accross this issue previously
Regards,
DilipKumarHi Mike,
Thanks for your reply.
Its not a standard SFTP adapter rather its a C-BURGER SFTP adapter.
Sorry I did not mention this in my previous post
Regards,
DilipKumar -
Need to read source file without deleting it - Sender SFTP adapter
Dear friends,
The data from the source file needs to be read by PI on a daily basis. The file should not be deleted.
Vendor updates the file on a daily basis with file name DataFeed.xml
How to acheive this in Sender SFTP adapter ?
Kindly guide me
RenuHi Renu,
Unfortunately as of latest release of SFTP adapter. Arching is not possible :(. really dont know why :).
as a work around what you can do is create a scenario as 1 sender and 2 reicever.
here: 1 sender: will be the sender fileadapter which will pick the file from souce.
1st receiver: will be a receiver file channel which will palce back the file in the source Archive folder.
2ed Receiver: this will be the actual receiver to which the data has to be given.
Or write a Module in Sender adapter which will archive the files in new location.
Note: Here i am assuming that each time the source creates a new file with same name which contains new data in it everytime.
Regards,
Senthilprakash.
Maybe you are looking for
-
I have few JSP pages with input fields. I want to do vaildation for these input fields. (check if empty and popup message) Approach to do the same are:1.Define javascript and include the .js in all the JSPOR 2. Define custom tag for form and use it i
-
TSV_TNEW_BLOCKS_NO_ROLL_MEMORY or TSV_TNEW_PAGE_ALLOC_FAILED
Hi; Our SAP servers run on Windows Server 2003 Enterprise x64 Edition and Mssql 2005 64 bit. They have 16 Gb Ram and 42 Gb virtual memory. I have to make system measurement by using tcode USMM. Although there is no problem when i run USMM on our test
-
Mail refuses to use current SMTP
Mail Version 2.0.7 Problem: With SOME but NOT all messages Mail refuses to use currently active SMTP server. When the problem occurs, on some occasions, Mail provides a choice of available SMTP servers, ( I have to manually change servers for each me
-
Crystal reports 8.5 runtime directories search order
Hi, We are deploying an application based on run-time crystal reports 8.5 SP3. We connect to SqlServer via ODBC, using C++ API CRPE.H. The runtime includes CRPE32. DLL + P2SODBC.DLL + Microsoft MDAC last version Everything works fine, but we isolated
-
Need formula help - how do i fin duplicates in a list
I have a list of text data and want to remove duplicates. I think I know how to do it... but I've done a fair bit of searching here and elsewhere and just don't understand how to set it up. I assume I should use the Countif function... and then compa