Adapter Queue - Parallel Processing (File, JDBC, SFTP)

Dear experts,
we have a scenario where the bandwhich of the connection to an SFTP-Server is very low. So the transmississions need a lot of time. During this time, no other messages for the same adapter (but different communication channles) get processed, as they all are stuck in the queue.
Is it possible to configure XI to process messages for one adapter in difference Queues, so that big transmissions don't block other transmissions?
Our XI System:
make.rel NW04S_20_REL
SP-Number 20
jdk.version 1.3
We use Itelligence SFTP adapter.
Best regards,
David

Dear all,
thank you for your answers. We solved this problem (or let's say minimized the risk) by implementing SAP note 1084161.
1. Go to Visual Admin
2. Go to Service SAP XI AF Core
3. Modify property messaging.connectionDefinition for the corresponding adapter
Also take a look here
http://help.sap.com/saphelp_nw70/helpdata/de/5c/22ee41c334c717e10000000a155106/frameset.htm
Best regards,
David

Similar Messages

File adapter issue - files not processed (file name mask is *)

Hi guys!
I have a problem I never faced before. My file adapter doesn't process files in the source directory. When I put there exact file's name, it is processed. But when I use * , nothing happen. This is very strange. I was wondering, if problem can't be in that my PI box is UNIX and it's accessing Win filesystem.
Any ideas, what to try?
Thank you!
Olian

Yes, but I meant the one directory we're working in. We can write, delete there, so we should be able also use wildcards, don't we?
However, I tried it on a directory with 777 attributes. There is a file named clooo.ttt. When I run del .ttt I get Requested action not taken, file unavailable. The same for clooo. , clooo*,... But when I type del clooo.ttt, the file is deleted...
Any suggestions?
Olian

Unable to clone File Adapter receiver channel for parallel processing

Hi Experts,
I am using variable substitution for File - RFC - File with out BPM scenario(using request response, oneway bean).
While i placed the file in the sender FTP folder, the file didnt get picked up, but in communication channel monitoring, i am getting error ' Unable to clone File Adapter receiver channel for parallel processing'.
Can anybody provide me suggestions to solve this error.
Note : without variable substitution , the interface is working good.
Is it due to, i am trying the source structure field in response file adapter?

Hi,
In your CC, do you use some additional paramaters ?
like these one of point 47/48 of [Oss note 821267 - FAQ: XI 3.0 / PI 7.0/ PI 7.1 File Adapter|https://service.sap.com/sap/support/notes/821267]
Maybe there is conflict with a parallel connexion and the bean used to do asynch-synch bridge...
Mickael

Parallel process with a queue and file?

Hello, first of all sorry for my bad english^^:
I am working for days on my project where I have to show the parallel process while transfering information by different ways and their problems (like timing and so on).
I chose the transmission of information to a parallel process by (1) a queue, and by (2) a file (.txt). (other ways are welcome, do you have 1-2 other ideas?)
To solve this problem I made three while loops, the first one is the original one, where the original information (as a signal) is created and send by queue and file to the other two while loops, where this information is getting evaluted to create the same signal.
so in the end you can compare all signals, if they are the same - so that you can answer the question with the parallelity of process.
but in my vi file i have some problems:
the version with the queue works pretty fine - it's almost parallel
but the version with file doesn't work parallel, and i have no idea how i can solve it - -
i'm a newbie^^
can someone correct my file, so both (file and queue version) run parallel with the original one, or tell me what i can or must do?
Attachments:
Queue_Data_Parallel_FORUM.vi ‏23 KB

LapLapLap wrote:
Hello, first of all sorry for my bad english^^:
I am working for days on my project where I have to show the parallel process while transfering information by different ways and their problems (like timing and so on).
I chose the transmission of information to a parallel process by (1) a queue, and by (2) a file (.txt). (other ways are welcome, do you have 1-2 other ideas?)
To solve this problem I made three while loops, the first one is the original one, where the original information (as a signal) is created and send by queue and file to the other two while loops, where this information is getting evaluted to create the same signal.
so in the end you can compare all signals, if they are the same - so that you can answer the question with the parallelity of process.
but in my vi file i have some problems:
the version with the queue works pretty fine - it's almost parallel
but the version with file doesn't work parallel, and i have no idea how i can solve it - -
i'm a newbie^^
can someone correct my file, so both (file and queue version) run parallel with the original one, or tell me what i can or must do?
A queue is technically never parallell, though you can have several if you really need parallellism. Other methods include Events, Action Engines, Notifiers (and why not webservices) for information transfer between processes.
Due to limitations in the disk system you can only read/write one file at a time from one process, so i wouldn't recommend that. If you use a ramdisk it might work.
/Y
LabVIEW 8.2 - 2014
"Only dead fish swim downstream" - "My life for Kudos!" - "Dumb people repeat old mistakes - smart ones create new ones."
G# - Free award winning reference based OOP for LV

Issue while archiving the processed file in sender communication channel using SFTP adapter

Hi All,
In one of my scenario (File to IDOC), we are using SFTP sender communicationchannel.
we are facing an issue while archiving the processed file. Some times PI processed the file successfully but unable to archive it and in the next poll PI process & archives the same file successfully which will creates duplicate orders in ECC.
Please let us know how to resolve this issue.

Hi Anil,
Refer Archiving concepts in below links.
http://help.sap.com/saphelp_nw73/helpdata/en/44/682bcd7f2a6d12e10000000a1553f6/content.htm?frameset=/en/44/6830e67f2a6d12e10000000a1553f6/frameset.htm
http://scn.sap.com/docs/DOC-35572
Warm Regards,
DNK Siddhardha.

How to process files one by one using sender file adapter

Hi,
I have to process file one by one using my file adapter (sender), because while doing the G/R materials get locked, if the same materal exist in other files.
I have maintained QOS as "Exactly Once in Order" & processing Sequence as "by date".
Processing sequence come in which tab? What will be the Queue name?
Thanks,
krishna

It will come under Processing tab
Here you need to select the first parameter QOS as EOIO
Then QUEUE name and processing sequence will be enabled.
NOTE: This will work only for NFS protocol not for FTP.

Is XI Mapping dependent on the Adapter Type ??? JDBC versus File Adapter

Gretings,
I am setting a scenario JDBC (Access) -> XI -> Idoc ->R3.
First I set up the scenarion File ->XI ->IDOC. Everything worked fine, and the I tried to use JDBC adapter instead of the File Adapter. The JDBC adapter is able to retrieve the data from the Access Database but I got a mapping problem only the Idoc control record was filled, the data segment are empty.
This mapping was working fine in the case of a File adapter !!!
Here is the XML File in a case of File Adapter :
<?xml version="1.0" encoding="UTF-8" ?>
- <ns:POS_TRANSACTION xmlns:ns="http://aramco.com/XI/POS_OIL">
<DATE>11/17/2004</DATE>
<TIME>08:25:03</TIME>
<TRANS_CODE>01</TRANS_CODE>
<CUSTOMER>1235</CUSTOMER>
<AMOUNT>105</AMOUNT>
<POS_ID>1000</POS_ID>
</ns:POS_TRANSACTION>
And then The XML file in a case of JDBC adapter :
<?xml version="1.0" encoding="utf-8" ?>
- <ns:POS_TRANSACTION xmlns:ns="http://aramco.com/XI/POS_OIL">
- <row>
<DATE>11/17/2004</DATE>
<TIME>00:00:07</TIME>
<TRANS_CODE>01</TRANS_CODE>
<CUSTOMER>23456</CUSTOMER>
<AMOUNT>1456</AMOUNT>
<POS_ID>1000</POS_ID>
</row>
</ns:POS_TRANSACTION>
what is really strange is SAP XI mapping process should be adapter independent ! why am I having this problem ?
Any help is more than welcome.
Regards,
Mustapha

Hallo Mustapha,
as far as i know, it is currently not possible to omit the row tag. Looking at the technique behind it, it makes sense: the JDBC Adapter polls a database with an SQL Statement and what gets back from the database is a resultset with zero, one or more rows (compare JDBC Classes, where you have java.sql.ResultSet). I guess, that maybe in later versions, it could be possible to customize the row tag to any name you want, but it will never be possible to completely omit it, as SQL statements can retrieve several rows and then you need to be able to differentiate between the rows.
best regards
Christine

Processing files in Sequence using FTP Adapter

Hi Experts,
I have searched several forums but i am not clear on how to process the files using FTP Adapter based on Timestamp.
To process the files in sequence i.e, FIFO using FTP Adapter
i have the files with file name customer and timestamp : customer<yyyyMMddHHmmss>
there are around 50 files in the FTP server llike this.
I need to process these files acording to the timestamp and place the files in same processing sequence in the receiver end using the file adapter.
If i specify the parametes in sender FTP Adapter as
Qos= EOIO
Queue name = ACCOUNT
Whether these parameters would do the processing in sequence according to the Timestamp?
Suppose if the queue ID for Inbound(SMQ2) is XBTI0_ACCOUNT then whether it will be the same for Outbound(SMQ1)?
Kindly suggest me how to process the files in sequence according to the Timestamp using FTP Adapter
Please reply..
Thanks
Sai

Hi Shabarish,
But this would require one more additional channel to process
So i think it will take more time to process.
Let me clarify my question once again.
I need to Pick the files from FTP server based on their TimeStamp and in sequence.
the file names are like this Customer<YYYYMMDDHHmmSS>.
suppose i have 3 files as
Customer20050413044534
Customer20050414053430
Customer20050315034533
So i need to pick these files in this order and place the files in the same order to the receiver end(File Adapter)
Customer20050315034533
Customer20050413044534
Customer20050414053430.
As i am using FTP sender adapter i cannot use processing sequence "By Date".
please suggest me on this.
Thanks
Sai.

PGP Encryption Exception in File and SFTP receiver adapter.

Scenario: We have got the PGP (Private and Public key pair) and stored the same in PI server path.
We have sample partner Public key which is store at temporary shared location for testing purpose.
Issue: While doing the encryption we are getting below exception in case of File Adapter and SFTP adapter.
Case 1: File Receiver Adapter
Case 1: SFTP Receiver Adapter
Can anyone please suggest on below exception?
How to proceed to resolve the above issue or what should be the cause of the issue?
Thanks,
Vertika

Hi everyone,
Thanks for reply Sarah
I have downloaded and added the JCE unlimited strengthh juristiction policay files are updated as directed in above blogs.
Now I am able to encrypt the File using plane File Adapter (NFS). But still it is throwing exception for SFTP adapter. Below is the error detail:
MP: exception caught with cause javax.ejb.TransactionRolledbackLocalException: ASJ.ejb.005043 (Failed in component: sap.com/com.sap.aii.adapter.pgp.app, BC-XI-CON-B2B) Exception raised from invocation of public com.sap.aii.af.lib.mp.module.ModuleData com.sap.aii.adapter.pgp.ejb.api.PGPEncryptionBean.process(com.sap.aii.af.lib.mp.module.ModuleContext,com.sap.aii.af.lib.mp.module.ModuleData) throws com.sap.aii.af.lib.mp.module.ModuleException method on bean instance com.sap.aii.adapter.pgp.ejb.api.PGPEncryptionBean@2648d238 for bean sap.com/com.sap.aii.adapter.pgp.app*xml|com.sap.aii.adapter.pgp.ejb.jar*xml|PGPEncryption in application sap.com/com.sap.aii.adapter.pgp.app.; nested exception is: java.lang.NullPointerException: while trying to invoke the method com.sap.engine.interfaces.messaging.api.Message.getMessageKey() of a null object loaded from local variable 'message'; nested exception is: javax.ejb.EJBException: ASJ.ejb.005043 (Failed in component: sap.com/com.sap.aii.adapter.pgp.app, BC-XI-CON-B2B) Exception raised from invocation of public com.sap.aii.af.lib.mp.module.ModuleData com.sap.aii.adapter.pgp.ejb.api.PGPEncryptionBean.process(com.sap.aii.af.lib.mp.module.ModuleContext,com.sap.aii.af.lib.mp.module.ModuleData) throws com.sap.aii.af.lib.mp.module.ModuleException method on bean instance com.sap.aii.adapter.pgp.ejb.api.PGPEncryptionBean@2648d238 for bean sap.com/com.sap.aii.adapter.pgp.app*xml|com.sap.aii.adapter.pgp.ejb.jar*xml|PGPEncryption in application sap.com/com.sap.aii.adapter.pgp.app.; nested exception is: java.lang.NullPointerException: while trying to invoke the method
What could be the reason of above exception in SFTP adapter? Please suggest.
Thanks,
Vertika

XI Sender file adapter - How to process data and control files.

Hello all,
I have the following requirement to fulfill: I am using an FTP client (XI Sender file adapter) to retrieve data from an FTP site. To make sure I am not picking up a data file that is currently being written to, 2 files are actually present on the FTP site (for each data file):
1. abc.ctrl (control file with no data in it. Indicates that the data file has been completely written).
2. abc.dat (actual data file).
I want the file/ftp connector in XI to retrieve the data file (abc.dat) only if the control file (abc.ctrl) is present. After the processing of the data file is finished, both files (.dat and .ctrl) should be deleted.
Is there an elegant and robust way to accomplish this?
Thanks for your help.

Hi Yves,
in my opinion there's no problem with files currently being written in combination with a polling file adapter because the final file name should be available only when the file is transferred completely. I'm using different file sender adapters very often and never had any problems. After picking up the files I move them to the corresponding archive folders mentioned in the adapters so that a second processing cannot occur.
Regards
Ralph

File Adapter does not process the same file twice

SOA: 11.1.1.4 (non-HA).
I have a file adapter that triggers when a new file gets to a directory; the file is not deleted after the process triggers.
The process is supposed to call other services via a mediator and if any remote fault happens it should rollback automatically and re-trigger with the same file at the next polling interval.
I have literally 3 scenarios:
1). The file gets picked up once, the process fails and the file is never picked up again.
Msg in log: The file : /xx/xx/xx/abc.xml is being ignored as it has already been processed
2). If the mediator only routes to one service after the file gets picked up, it works as expect (that is rollback and restart at the next polling interval). If it has more than one sequential routing rule, I see the same error as above.
3). File does not get picked up EVEN if I "touch" or rename the file.
Msg in Log:
File Adapter ProcessName Poller enqueuing file for processing :/xx/xx/xx/abc.xml
File Adapter ProcessName Ignoring File : abc.xml as it is already enqued for processing.
I have already checked, there is no permission issue.
This is what my .jca file looks like:
<adapter-config name="getFile" adapter="File Adapter" wsdlLocation="getFile.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/FileAdapter" UIincludeWildcard="*"/>
<endpoint-activation portType="Read_ptt" operation="Read">
<activation-spec className="oracle.tip.adapter.file.inbound.ScalableFileActivationSpec">
<property name="DeleteFile" value="false"/>
<property name="MinimumAge" value="5"/>
<property name="SingleThreadModel" value="true"/>
<property name="PhysicalDirectory" value="/xx/xx"/>
<property name="Recursive" value="false"/>
<property name="PollingFrequency" value="20"/>
<property name="IncludeFiles" value=".*"/>
<property name="UseHeaders" value="true"/>
<property name="MaxRaiseSize" value="5"/>
<property name="ListSorter" value="oracle.tip.adapter.file.inbound.listing.TimestampSorterAscending"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
Thanks for looking into it in advance.
Any help with the error messages will be appreciated.

You have to use MOVE operation, if there is any remote exception occured, then move the file to someother folder and again move back to the same folder where the file pickup will start.
In that way you will be use the same file picked up next time when the polling happens.
It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts).
Thanks,
Vijay

How to map expdp parallele process to output file

How to map expdp parallel process to its output file while running...
say i use expdp dumpfile=test_%U.dmp parallel=5 ..
Each parallele process writing to its related output file.. i want to know the mapping in run time...

I'm not sure if this information is reported in the status command but it's worth a shot. You can get to the status command 2 ways:
if you are running a datapump job from a terminal window, then while it is running, type ctl-c and you will get the datapump prompt. Either IMPORT> or EXPORT>
IMPORT> status
If you type status, it will tell you a bunch of information about the job and then each process. It may have dumpfile information in there.
If you run it interactively, then you need to attach to the job. To do this, you need to know the job name. If you don't know, you can look at sys.dba_datapump_jobs if prived, or sys.user_datapump_jobs if not prived. You will see a job name and a schema name. Once you have that, you can:
expdp user/password attach=schema.job_name
This will bring you to the EXPORT>/iMPORT> prompt. Type status there.
Like I said, I'm not sure if file name information is specified, but it might be. If it is not there, then I don't know of any other way to get it.
Dean

Can we process files with attachments using File Adapter

Hi All,
I want to process files which have attachments using File Adapter.
Is it possible to process such files?
May be using standard modules?
Regards,
CBKLP

Assuming you are talking about sender FILE channel....you can make use of PayloadSwapbean provided by SAP (standard module)...to read data from attachment.
Regards,
Abhishek.

Sending empty files using SFTP Adapter

I am trying to send empty files using SFTP adapter. The interface has to send the file whether its empty file or containing data using SFTP adapter. I am using BizTalk Server 2013 R2. Is it a bug or the hotfix is already there for this issue.

The issue here is not your SFTP not able to send 0KB files, but the file receive adapter that is receiving the file. The file adapter deletes 0 KB files and doest not transmit it further.
If u have a ftp receive for example you should be able to send 0KB files.
If u have a custom file receive adapter , is it handling 0KB files ?
Regards <br/> When you see answers and helpful posts,<br/> please click Vote As Helpful, Propose As Answer, and/or Mark As Answer

Could not process file 'Input 110110b.txt': com.sap.aii.adapter.file.

I have a FILE Adapter using FTP as a transport that is generating a very odd error.
The FTP sender channel is giving the following error is set up to retreive all files (*) from a specific directory. If you look at the error, it indicates an error processing the file 'Input 110110b.txt' as a file -- the only way this filename woudl be visible is if the adapater interrogated the directory, or the filename was hard-coded in the file mask. But the error indicates it can't change to the directory. The only way it would have come up with the file is if it had already CD'd t that directory.
1/7/11 8:12:01 AM   Retry interval started. Length: 60.0 seconds
1/7/11 8:12:01 AM   Could not process file 'Input 110110b.txt': com.sap.aii.adapter.file.ftp.FTPEx: 550 Failed to change directory.
1/7/11 8:12:00 AM   Processing started
My first thought was a simple permission issue, so I opened a connection to server with FileZilla (an FTP client) and was able to retrieve the file without a problem. I was also able to drop a file in the directory. There is no permissions problem.

Hi
Please check the below points before processing any file
a) check the File placing by a Local Plant FTP owner is using the same authentification credentials It means both PI and source team needs to use same FTP User ID and login credentials otherwise if suppose if source team is placing with one User and PI cannot able to pick that file as this User cannot have permissions in this case also u will get 550 error
b) I know what ur telling is u manualy palced one file and able retrive...but do one thing u can login with same PI FTP login server credentials and then place the file with different name also I suggest lets test the channel by simply keeping
. not simply * if you keep simply * then u cna use in receiver chanel while using dynamic connfiguration.
Else give *.txt and then activate the channel and also please check the CACHE as well
Regards
Amar Srinivas Eli

Adapter Queue - Parallel Processing (File, JDBC, SFTP)

Similar Messages

Maybe you are looking for