Limiting the number of files being picked up by the sender file adapter

We are running a file adapter to collect xml files from a legacy system in a shared network location. The files are picked up, information is sorted and mapped, and then sent to a proxy on our CRM system to store the data. Very simple and not-complex.
Our initial data load will consist of somewhere in the neighborhood of 900k records, which is killing CRM.
A co-worker with a bit more experience was telling me that he believes there is a way to limit the number of files that will be pulled per iteration of the file communication channel. If this is the case, can someone share with me the parameters that need to be set?
My apologies if this is a duplicate post - I have tried to look for a good answer in the forums and have come up empty.
We are running PI 7.1, and I believe it is SP 6.
Thanks in advance for the help,
Ben

Hi Ben,
There is no standard way to limit the number of files to be processed by the communication channel.
On the Sender File CC, there is a parameter " Maximum File Size" which restricts the files bigger than the specific size, but this is just a prevention not a solution.
If you have a single big size file, then somehow you have to create small sized files out of it.
Thanks,
Pooja Pandey

Similar Messages

How to process a text file (mail attachment) using the sender mail adapter?

Hi guys,
Is it possible to process mail attachments using the sender mail adapter? Let's say I have a structured text file (attachment) which needs to be mapped and sent to target system.
Post please any thoughts or experience.
Thanks,
Olian

Hi Olian,
Have a look at these helpful links -
1. http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/9e6c7911-0d01-0010-1aa3-8e1bb1551f05&overridelayout=true
2. http://www.riyaz.net/blog/xipi-configuring-the-sender-mail-adapter/
3. http://help.sap.com/saphelp_nw70/helpdata/en/23/c093409c663228e10000000a1550b0/content.htm
Regards,
Sunil Chandra

Can we enhance the Sender SOAP Adapter with our own modules?

Hi All,
Can we enhance the Sender SOAP Adapter with our own modules on the Module Tab Page in the Module Processor?
I believe the answer is no. However, whatever may be the answer, I would like to know that is there any specific reason for that.
Please help me in this regard.
Thanks,
Yogi.

Hi,
I think, we are mentioning the URL of the adapter channel directly in the configuration. SO there is no place we can customize this flow..just a thought
Because in the file adapter etc, After Adapter Engine picks up the data and before it goes into integration engine module is processed..
http://help.sap.com/saphelp_nw2004s/helpdata/en/fc/5ad93f130f9215e10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/f013e82c-e56e-2910-c3ae-c602a67b918e
Rgds,
Moorthy

Does the sender SOAP adapter support multiple operations per interface

Hi guys,
does the sender SOAP adapter support multiple operations per interface? (interface type of 7.1)?
Thanks,
Andrzej

theoretically Yes.
Do have a look into this when you get time
/people/shabarish.vijayakumar/blog/2010/09/08/service-interface-and-multiple-operations--is-it-just-an-hype

How to catch the sender SOAP adapter http response?

Hi eXperts,
I've a sender soap adapter opened to customer as webservice. When customers call this webservice, data is coming into XI and works fine. But the customer is complaining that the expected HTTP 200 response is not sent back to the calling SOAP client.
So my question is: Is there a way to catch the http 200 response from sender adapter, or at least get to know if the sender adapter has sent the response?
Thanks in advance.
Regards
Luis

Hi,
If I understood it correcly... Sender is a Async SOAP call and the sender system is expcting a status back of HTTP 200. Are you sure you had set the quality of effort to Exactly Once? If not please try setting it.
You can also go to Adapter monitoring or Communication channel monitoring in the Runtime workbench and see if the Sender SOAP adapter is fine.
http://help.sap.com/saphelp_nw04/helpdata/en/5e/164442c1a1c353e10000000a1550b0/content.htm
Thanks,
Prakash

Rename the attachment of the Sender mail adapter

Hello Everyone,
i have Mail to file scenario. There is an attachment in mail and this file needs to be renamed and dropped in FTP server.
is it possible to read the attachment and then rename it .
How to achieve this solution because i could not find ASMA in sender mail adapter . so could not use Dynamic configuration.
Regards,
Ravi
Edited by: Ravi Maheshwari on Feb 16, 2012 1:50 PM

This blog could help you
http://www.sdn.sap.com/irj/scn/weblogs?blog=/pub/wlg/6107

Passing the queue name to the sender JMS adapter at run time..

Hello Experts,
I have a scenario where PI is to pick data from MQ queues. The message type coming from queues is same and the procession needs to be done with PI is also the same.That's the reason why we want to have only one interface processing the data for all the queues.
My question here is that is there any way where I do not put the queue name in the sender adapter at design time and based on the data availability in the queue let the sender adapter know the queue name to be processed at run time.
Any suggestions will be greatly appreciated.
- Rajan

> My question here is that is there any way where I do not put the queue name in the sender adapter at design time and based on the data availability in the queue let the sender adapter know the queue name to be processed at run time.
Unfortunately for JMS Sender CC it is not possible, but other way around is possible. I.e. you can dynamically choose the receving queue names by using ASMA "JMSReplyTo" in JMS Sender CC.
Regards,
Sarvesh

Contract number is not being picked during MRP run

Hi,
I have a contract with vendor as V1.
This contract is MRP revelant with source list maintained with MRP revelant.
Source list maintained with vendor V1, contract and with fixed indicator and with MRP relevant indicator set.
Step 1
Now I am executing MRP, system is creating PR with contract vendor V1 as source of supply is V1 in source list.
This step is OK.
Step 2
After this I am maintaining sub contracting vendor V2 in contract.
Again I am executing MRP run, system is creating PR, but the PR is not picking the contract details.
I am expecting this PR, which supposed to be created in this Step 2 should have vendor V2 as source of supply.
Am I correct?
Note: Source list is still having vendor as V1, same contract number, with fixed indicator and MRP relevent option set.
Any input if process is OK or if some thing wrong is apprecited,
Thanks
Dipak

Hi,
Ok.
I am following this way -
In ME32K, there is a delivery address button available is transaction tool bar, there I am maintaining the subtracting vendor number and enabling the SC vendor check option so that this vendor flows to PR which gets created during MRP run and comes to PR delivery address tab i.e., in vendor field as subcontracting vendor with SC vendor check option selected.
Am I correct ?
Thanks
Dipak

Excise Invoice number range not being picked by crystal reports

Hi all,
We have a Crystal Report that generates the Invoice document based on the invoice number which is an input a parameter. The report is built on 'SAP Table,Cluster or Function' type connection. The Invoice numbers are updated into the source system. Current invoice series is *****0001,.....****0052,****0053,****0054.............****0100......****0111,****0112,*****0113.
The problem is that the Crystal Report is working fine till ******0111 but it is returning a blank values for Invoice numbers ******0112 and others following. We checked the data in the SAP system and the details for Invoice Numbers ******0112 and others are available in the SAP system.
While i select the Excise Invoice number field of the corresponding table and clicking on browse data it is showing invoices upto ******0052.
Please help.
Thanks and Regards,
Raja.N

Hi
is this data coming from a single table or are joins involved ?
did you try a report simple on a single table to see if the data would be returned ?
ingo

How to use a atore procedure in the sender Jdbc adapter

Hi Experts!
I am having a requirement to read multiple data from multiple tables from Oracle database at a time.
In sender side i am using JDBC Adapter. Here i want to know how can we use a store procedure to do this and can any one pls give a blog which guide me in design.
Thanks in advance,
Preethi.

Pleasae see this thread
Stored procedure in Sender JDBC Adapter
In space of select statement put
EXEC nameofstoredprocedure
and update statement
Put <TEST>

How to know if file is being picked up by XI through sender file adapter -

Hi
How can I check if the file is being picked up XI through sender file adapter? Can you please help.
Thanks in advance

Hi Rajiv,
Select teh File processing mode as
1. Read only -> After reading the file it will change the read only property of the file. Just right click on the file, select properties.If the file has been read then ReadOnly check box will be enabled. If u are testing several times then it will be more useful.
2. Archive -> Then u need to give some other folder name where u want to archive it.
3.Delete -> It will delete if the file has been successfully read.
regards,
Gowtham K.
http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm

Limit on the number of file names retrieved using FM 'RZL_READ_DIR_LOCAL'

Hi All,
I am using FM 'RZL_READ_DIR_LOCAL' , to retrieve file names from a specified directory.
When executed, i am getting 10,000 records(file names) only against lakhs of files present in the directory.
I would like to know if there is any limitation on the number of file names retrieved using that FM and how to over come it.
Also please let me know if the FM 'EPS2_GET_DIRECTORY_LISTING' also has any such limitations.
Thanks in advance,
Sreeni Vallem

I did not know about this limitation of number of files returned. You can give a try to the external command way of doing it in your development system. Well, creating 10001 files in development is a boring job . You can write a sample program as Rob has mentioned in this thread and copy files to a specific directory ABAP: Copy files from one R3 directory to another. This doesn't disturb the existing program written.
Mean while let's wait for expert's reply.
Kesav

Maximum number of files in a folder ?

Hello, what is the maximum number of files in a folder OS X can handle ?
I used a file recovery software called FileSalvage to save some files of an external 300GB with a corrupted disk directory (unable to repair with the usual repair/recovery programs).
FileSalvage recovered about 435,000 files and sorted them by extension in individual folders, unfortunately it does not recognize the file names and just sequentially names the files per extension.
The .jpeg, .gif and .html folders had up to 75,000 files. After recovery the external FW drives started to behave very strange, unresponsive, just hanging, time-out. I tried on a Mac Mini, iMac G5, an iBook and PowerBook, OS X 10.3.9 and 10.4.3, FW400/800 and USB 2.0 interface, they all had pretty much the same failure mode after a while.
Running Disk Utility on the drives with the recovered FileSalvage folders showed a corrupted directory (invalid file count) and unable to repair, although I could copy most of the folders of the disk (deleted the folders with more than 10,000 files per folder).
I suspect that File Salvage copies more files in a folder than OS X allows, causing unpredicable problems.
Any ideas ?

From "Mac OS X: Mac OS Extended Format volume and file limits"
"Maximum number of files (or files and folders) in a folder … up to 2.1 billion"
According to a note in the document, the above is subject to the drive's size (maximum 16 terabytes in "Tiger") and block size, ie. the number of available blocks.
So it would appear that the number of files you mentioned would be well within theoretical limits, although I suppose there could be a bug in some other part of OS X. Otherwise, maybe there is a problem with the drive...

Maximum number of files and sizes to be Backup

Hi all,
I read somewhere saying that Windows Server Backup 2012 is limited to 2TB (MBR partitions), but can be more for GPT partitions.
What i want to know is, is there limitation on number of files/folder?
Thanks.

Hi,
I assume you are a little confused by partition limitation and backup size limitation.
Here MBR and GPT are for "partition limitation", which means with MBR the largest partition size is 2TB. In GPT, with larger sector size, it supports larger in partition size.
The limitation of Windows Server Backup (WSB) is caused by single file size limitation - WSB creates a VHD(x) file for saving backups. Currently a single file size is limited in 2TB which causes the WSB limitation. See:
Backup Version and Space Management in Windows Server Backup
http://blogs.technet.com/b/filecab/archive/2009/06/22/backup-version-and-space-management-in-windows-server-backup.aspx

Need to get the Mail attachment name as it is to the receiver file adapter

I am doing a Mail to File scenario. I need to get the attachment from the mail and store it on the file server. I am using the PayloadSwap bean in the sender mail adapter. My requirement is to carry forward the attachement name as it is to the receiver file adapter side and store the file with the same name.
Did any one try doing this? I was looking at developing an adapter module but got struck as I could not find whether the attachement name is stored in the XI payload after it has got swapped using the swap bean.
Any help would be appreciated.
VJ

Oops pressed the send key. Take two.
This is becoming a damn nightmare. When I run the adapter I am getting ModuleExceptions. Can you pass your eyes over these Java config settings to see what I am doing wrong. Using NWDS CE 7.1 with PI 7.1 both at SP07. All the imports were taken from PI 7.1 after SP07 was applied. The build id of NWDS is
SAP NetWeaver Developer Studio
SAP NetWeaver 7.1 Composition Environment SP07 PAT0001
Build id: 200901152336
APPLICATION.XML
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE application PUBLIC "-//Sun Microsystems, Inc.//DTD J2EE Application 1.3//EN"
"http://java.sun.com/dtd/application_1_3.dtd">
<application>
<display-name>MailPOP_EAR</display-name>
<description>EAR description</description>
<module>
<ejb>MailPOP_EJB.jar</ejb>
</module>
</application>
APPLICATION-J2EE-ENGINE.xml
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE application-j2ee-engine SYSTEM "application-j2ee-engine.dtd">
<application-j2ee-engine>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="service">engine.security.facade</reference-target>
</reference>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="library">engine.j2ee14.facade</reference-target>
</reference>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="service">com.sap.aii.af.svc.facade</reference-target>
</reference>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="interface">com.sap.aii.af.ifc.facade</reference-target>
</reference>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="library">com.sap.aii.af.lib.facade</reference-target>
</reference>
<reference reference-type="hard">
<reference-target provider-name="sap.com" target-type="library">com.sap.base.technology.facade</reference-target>
</reference>
<fail-over-enable mode="disable" />
</application-j2ee-engine>
EJB-J2EE-ENGINE.XML
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ejb-j2ee-engine SYSTEM "ejb-j2ee-engine.dtd">
<ejb-j2ee-engine>
<enterprise-beans>
<enterprise-bean>
<ejb-name>GetMailAttachment</ejb-name>
<jndi-name>GetMailAttachment</jndi-name>
<session-props/>
</enterprise-bean>
</enterprise-beans>
</ejb-j2ee-engine>
EJB-JAR.XML
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ejb-jar PUBLIC "-//Sun Microsystems, Inc.//DTD Enterprise JavaBeans
2.0//EN"
"http://java.sun.com/dtd/ejb-jar_2_0.dtd">
<ejb-jar>
<description>EJB JAR description</description>
<display-name>EJB JAR</display-name>
<enterprise-beans>
<session>
<ejb-name>GetMailAttachment</ejb-name>
<home>com.sap.aii.af.lib.mp.module.ModuleHome</home>
<remote>com.sap.aii.af.lib.mp.module.ModuleRemote</remote>
<local-home>com.sap.aii.af.lib.mp.module.ModuleLocalHome</local-home>
<local>com.sap.aii.af.lib.mp.module.ModuleLocal</local>
<ejb-class>sample.GetMailAttachment</ejb-class>
<session-type>Stateless</session-type>
<transaction-type>Container</transaction-type>
</session>
</enterprise-beans>
</ejb-jar>
SENDER MAIL ADAPTER modules
1 AF_Modules/PayloadSwapBean Local EB 1
2 GetMailAttachment Local EB 2
3 sap.com/com.sap.aii.adapter.mail.app/XIMailAdapterBean Local EB 3
1     swap.keyName          payload-name
1     swap.keyValue          MailAttachment-1
RECEIVER FILE MODULES
1     localejbs/AF_Modules/DynamicConfigurationBean     Local Enterprise Bean     1
2     localejbs/CallSapAdapter                    Local Enterprise Bean     2
1     key.0          write http://sap.com/xi/XI/System/File FileName
1     value.0          message.interface
VARIABLE FILENAME SUBST WITH ASMA TURNED ON
fName     message:interface_name
JAVA SOURCE
package sample;
import javax.ejb.CreateException;
import javax.ejb.SessionBean;
import javax.ejb.SessionContext;
import com.sap.aii.af.lib.mp.module.Module;
import com.sap.aii.af.lib.mp.module.ModuleContext;
import com.sap.aii.af.lib.mp.module.ModuleData;
import com.sap.aii.af.lib.mp.module.ModuleException;
import com.sap.engine.interfaces.messaging.api.Message;
import com.sap.engine.interfaces.messaging.api.MessagePropertyKey;
import com.sap.engine.interfaces.messaging.api.TextPayload;
import com.sap.engine.interfaces.messaging.api.XMLPayload;
import com.sap.aii.af.service.cpa.Channel;
@ejbHome <{com.sap.aii.af.lib.mp.module.ModuleHome}>
@ejbLocal <{com.sap.aii.af.lib.mp.module.ModuleLocal}>
@ejbLocalHome <{com.sap.aii.af.lib.mp.module.ModuleLocalHome}>
@ejbRemote <{com.sap.aii.af.lib.mp.module.ModuleRemote}>
@stateless
<code>GetMailAttachment</code>
@SuppressWarnings("unused")
public class GetMailAttachment implements SessionBean, Module {
     private static final long serialVersionUID = 7612238514043673502L;
     private SessionContext myContext;
     private MessagePropertyKey myFileName;
     public void ejbRemove() {
     public void ejbActivate() {
     public void ejbPassivate() {
     public void setSessionContext(SessionContext context) {
          myContext = context;
@throws CreateException
     public void ejbCreate() throws CreateException {
     public void getMessageProperty(MessagePropertyKey FileName) {
          myFileName = FileName;
@param moduleContext
           Contains data of the module processor that might be important
           for the module implementation such as current channel ID
@param inputModuleData
           Contains the input XI message as principal data plus eventual
           set supplemental data
@return ModuleData Contains the (changed) output XI message. Might be the
        response message if the module is the last in the chain.
@exception ModuleException
               Describes the cause of the exception and indicates whether
               an retry is sensible or not.
     @SuppressWarnings("deprecation")
     public ModuleData process(ModuleContext moduleContext,
               ModuleData inputModuleData) throws ModuleException {
          try {
               Message msg = (Message) inputModuleData.getPrincipalData();
               TextPayload payload = msg.getDocument();
               String contentType = payload.getContentType();
               // Content Type could be something like
               // text/plain;charset="UTF-8";name="file.txt"
               contentType = contentType.replaceAll("\"", "");
               int i = contentType.lastIndexOf("=") + 1;
               String fileName = contentType.substring(i);
               msg.setMessageProperty(myFileName, fileName);
               inputModuleData.setPrincipalData(msg);
          } catch (Exception e) {
          return inputModuleData;
JAVA ERRORS
2009-02-04 11:41:14     Information     Mail: calling the module processor for channel LMK_Common_Mail_Sender
2009-02-04 11:41:14     Information     Swap: swapping by payload-name ? MailAttachment-1
2009-02-04 11:41:14     Information     Swap: successfully swapped
2009-02-04 11:41:14     Information     Mail: message leaving the adapter (call)
2009-02-04 11:41:14     Information     The application tries to send an XI message asynchronously using connection AFW.
2009-02-04 11:41:14     Information     Backward validation is enabled
2009-02-04 11:41:14     Error     Unable to validate the message with message ID 8702df71-f254-11dd-9b9b-001a64a73518
2009-02-04 11:41:14     Error     Returning to application. Exception: com.sap.engine.interfaces.messaging.api.exception.MessagingException: Content is not allowed in prolog.
2009-02-04 11:41:14     Error     Mail: error occured: com.sap.engine.interfaces.messaging.api.exception.MessagingException: Content is not allowed in prolog.
2009-02-04 11:41:14     Error     Mail: error occured: com.sap.aii.af.lib.mp.module.ModuleException

Picking file in sequence/Queuing   in sender SFTP adapter.

Hi Experts,
I am using SFTP adapter in sender side, it has no option of quality of service ( EOIO) and queue name as we have in FTP adapter configuration .Is there any predefined module provided by Sap which i use in the modules Tab in communication channel configuration to get the functionality of queuing ? just like we use strictXMlto plain bean etc.
I have 3 files which needs to proccess in a sequence one after another in order.I CANT USE BPM or Even FTP because of Security reasons.
please share you ideas.
Regards,
Anika

Hi all,
I have tried using AF_Modules/DynamicConfigurationBean in module tab present is the sender SFTP adapter with the attribute qualityOfService.
parameter name                  Parameter value
     key.0                         insert http://sap.com/xi/XI/System/Messaging qualityOfService
    value.0                        ExactlyOnceInOrder
But in Moni i dont see the 3 messages didnt go in the same queue.But when i double click and open the dynamic configuration present in the soap header section i can see the values which i given in the module parameter.
Is there any way i can change the quality of service to EOIO at runtime ? how to change the default EO to EOIO.
Regards,
Anika

Limiting the number of files being picked up by the sender file adapter

Similar Messages

Maybe you are looking for