Limitation of sender file adapter

Hi Gurus,
I am working on a file to proxy scenario.Data is coming from MDM and goes to BW through PI. The question is approx. 1,70000 records will be passing from MDM through PI to BW. Is my File adapter is well versed to handle the said quantity of records at one shot? If,not what is the other alternative. If file adpater is not able to handle then i need to tell my clients with a valid proof.
Can anyone help me out.I have points for every valid answer.
Thanks
Veeru

>
viru srivastava wrote:
> Hi Gurus,
> I am working on a file to proxy scenario.Data is coming from MDM and goes to BW through PI. The question is approx. 1,70000 records will be passing from MDM through PI to BW. Is my File adapter is well versed to handle the said quantity of records at one shot? If,not what is the other alternative. If file adpater is not able to handle then i need to tell my clients with a valid proof.
>
> Can anyone help me out.I have points for every valid answer.
>
> Thanks
> Veeru
for the maximum file size that can be handled by XI ref File Adapter: SAP Note 821267
in case you have no content conversion happening, more file/record size can be easily handled by XI

Similar Messages

Restricting polling in sender file adapter

Hi friends,
I have a requirement where I need to poll a file from an FTP server. But, if the file is being edited (some other application is writing to it) I need to avoid picking that file. Plz tell me how i can achieve this...waiting for ur replies.
Regards,
Shilpa

Shilpa,
Check out this sap note :
[https://websmp230.sap-ag.de/sap(bD1kZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=821267|https://websmp230.sap-ag.de/sap(bD1kZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=821267]
File Locking / Incomplete Processing
Q: I sometimes observe that files are processed only partially, i.e., only a fragment from the file's start is converted into an XI message. Nevertheless, the file is usually archived completely. Does the File Sender Adapter honor if another process has locked a file for exclusive use?
A: Unfortunately, the J2EE 1.3 technology the File Adapter is built upon does not support file locking. This limitation affects the File Adapter's operation. Depending on whether the JRE implementation for the operating system under which the adapter runs uses mandatory file locking or advisory file locking, opening a file that is currently being written to by another process will fail or not.
If opening the file fails, no problem exists and the adapter will try to open the file each poll interval until it succeeds.
However, if opening the file is not prevented by the operating system, the adapter starts to process the file although it is still being modified. Since XI 3.0 SP11 / PI 7.0 there is a parameter named "Msecs to Wait Before Modification Check" in the advanced settings of the File Sender channel configuration to work around this issue. This setting causes the File Adapter to wait a certain time after reading, but before sending a file to the Adapter Engine. If the file has been modified (which is basically determined by comparing the size of the read data with the current file size of the input file) after the configured interval has elapsed, the adapter aborts the processing of the file and tries to process the file again after the retry interval has elapsed.
If this option is not available for the settings you would like to use, the following algorithm (to be implemented in your application) may be used to ensure that the File Adapter only processes completely written files:
Create the file using an extension, which does not get processed by the File Adapter, e.g., ".tmp"
Write the file content
Rename the file to its final name, so the File Adapter will notice its existence and pick it up
Hope this will help.
Thanks,
Nilesh

Sender File Adapter Problem when text document is a single line.

Hi All,
I have posted this question earlier too. But did not get a proper answer.
I am using File adapter to fetch data from a file system.
My input data is: AA123BB45678AA345BB78564.
It is just reading the first segment i.e.AA123 and not reading the remaining.
How can I configure my Sender File adapter to pick this pattern of data? It works fine if I have line break after each record that is if the input is as below.
AA123
BB45678
AA345
BB78564
In the above there is a Line break after each segment. So File adapter picks it fine.
I have also tried using xml.A.endSeparator equals to blank in the module configuration. But it does not work either.
Can anyone throw some light to this?

Abhi
I tried a different approach to send your file data In..
You can get each line in the source structure in separate row as
<?xml version="1.0" encoding="utf-8" ?>
- <ns:SingleRowDT xmlns:ns="http://xxxxx.com/xi/pocs/sriram">
- <Recordset>
- <row>
<rowElt>AA123BB45678AA345BB78564</rowElt>
</row>
- <row>
<rowElt>AA123BB45678AA345BB78564AA123BB45678AA345BB78564</rowElt>
</row>
- <row>
<rowElt>AA123BB45678AA345BB78564AA123BB45678AA345BB78564AA123BB45678AA345BB78564</rowElt>
</row>
</Recordset>
Now you can use a suitable mapping logic to split the individual records into the 2 field structure as expected in the target..
Trying your way would be a limitation on file adapter I think..Let me know if this helps..I can give you the content conversion config for this model..
its simply
RecordSet - Leave it empty
RecordSet Seq - Row, *
Recordsets/msg - *
row.fieldSeparator - 'nl'
row.endSeparator - 'nl'
row.fieldNames - 'rowElt
..So each line will be pulled into a single Row in the source structure and then u can apply a specific mapping to split into 2 fields for your target
Regards
Sriram V.
Regards
Sriram V.

Sender File Adapter - FCC - No incoming field separator - How to do FCC?

Hi,
I have a sender File adapter and I need to do the File Content Conversion but there apparently no incoming field separator and the file ocntains just running text - no data records but just information.
For example the incoming file is something like:
                                The Hongkong and Shanghai Banking Corporation Limited                      27JAN2009       PAGE 1
                                Incorporated in Hong Kong with limited liability
ABC IAL LIMITED                                                               ABU DHABI, UAE
ABC MIDDLE EAST                                                               Account No.     001-8888888
ABU DHABI                                                                       Payment Set     AAA
BBB MAIL BOX NO.99                                                             Contact Person ABC LIMITED
                                               7777777777                      Telephone
                                                 AUTOPAY LIST - PROCESSED
                                                 (AUTOPAY-OUT SALARY)
Payment Date           27JAN2009
First Party Narrative .                             66666666
Second Party Narrative .
The Message type that I am mapping to contains:
MT_XXXX
     WA
          Item
          Item2
          Item3
This is so that the information can be mapped to different field areas and send across to the Receiver Mail Adapter. In the mail i receive, i get the running text. I tried giving the field separator as '0x09' but it is not working.
I have also tried WA..fieldContentFormatting to nothing but again no luck.
I have tried with Recordset Sequence with Ascending and variable and have also tried Recordsets per Message with * and blank - but it did not help.
Please advice.
Regards,
Archana

Hi,
I assumed that it was tab but when I made the change in FCC, it did not work.
I would still like to have a output where it looks like below if more than 2 types of information in 1 line as below:
ABC IAL LIMITED                     ABU DHABI, UAE
ABC MIDDLE EAST                  Account No. 001-9999999999999
and not something like:
ABC IAL LIMITED ABU DHABI, UAE
ABC MIDDLE EAST Account No. 001-999999999999
I am not sure what to do here.
Help please.
Regards,
Archana

Sender File adapter Pooling

Hi ALL,
1)while creating the file in the FTP server i want the sender file adater to wait or lock from polling the file getting created and start picking the file once its completely crated.
i am told that we need to write OS commends to handle this ..if any one has done this can you pls help..with the command.?
2)is there any way to handle this issue with having a trigger file which intimates the adapter to pick the actual data file .. ?
thanks
Souz

2)is there any way to handle this issue with having a trigger file which intimates the adapter to pick the actual data file .. ?
You can use use "Specifying Additional Files" to achieve ur secnario.
Trigger fileName: PickupFile.trg (Specify this file name in Sender File adapter)
ActualFileName: Pickupfile.txt (Specify these details in Specifying Additional Files)
Use the payload swap bean to swap between Trigger file & actual file. The Actual file can be used in further processing like msg mapping...
Limitations:
All additional files must be in the source directory.
The name of the additional file is determined from the file name that was assigned for the XI message under File Name
No file content conversion is possible
http://help.sap.com/saphelp_nw04/helpdata/EN/3c/b4a6490a08cd41a8c91759c3d2f401/content.htm
Regards,
Siva Maranani

Can we control the triggering of sender file adapter

Hi,
Can we control the tiggering of Sender file adapter with option of Run OS command before message processing
This option is available in Sender communication channel, what are the limitations of this option?
My actual requirement is to see the target folder whether it is empty or not, if empty then I can trigger the interface.
For this I want to write shell script whihc execute at OS level to check whether the target is empty or not, But the constraint is will this can control the triggering of sender adapter.

Hi Sekhar,
I guess this can help you control the file pick up.
If your shell script works well then using the same you can modify the filename or its extension if the target folder is empty.
Say in the sender file adapter you set the source-filename as "inbound_*.ready". Now when originally the source file is dropped into the source folder (by any other process) let it be named as "inbound_001.pending" and your script will change the file name to "inbound_001.ready" if the target directory is empty. I dont think you need to use the pre processing OS command for this.
Does it make any sense?
Regards,
Suddha

FileName in Sender File Adapter Module

Hi Folks,
In my sender file adapter have written a module to read the picked file name. The protocol used is NFS.
Notice that the file name read in the module has the absolute path, including the directory path. E.g The file name xyz has to be picked from source directory
XIServer\Outbound. In the module when I retrieve the file name, it comes up as
XIServer\Outbound\xyz. Is this expected behaviour?
I was expecting just the file name<xyz> to be retrieved.
Thanks,
Anand

HI,
Create an UDF and write this code.
DynamicConfiguration conf = (DynamicConfiguration) container.getTransformationParameters().get(StreamTransformationConstants.DYNAMIC_CONFIGURATION);
DynamicConfigurationKey key =
DynamicConfigurationKey.create("http://sap.com/xi/XI/System/File","FileName");
String ourSourceFileName = conf.get(key);
return ourSourceFileName;
in Adapter u will have Adapter specific parameters check the file name check box.
Using this UDF u will get the file name at target side.
Regards,
Phani.

Advance select for source file in Sender File Adapter

Hi
I am trying to utilise the parameter 'Advance Selection for source file' on a sender file adapter to pick the file from multiple folders
My problem is that this parameter that is listed on the SAP help is not getting in File accessing Parameters.
I am running PI 7.02 (NW702_07_Rel)
Service pack 07
Has anyone come across this before?
any suggestions on how to do this?

Hi,
In PI7.0 the property exists. I have used it previously. I think SP was 13.
Regards,
Nutan
Edited by: nutan champia on Nov 24, 2011 10:42 AM

Mapping problem due to FCC in sender file adapter

Hi All
I am doing File( Flat File ) to RFC Scenario.it is working fine..
the problem comes in mapping with multiple records.
FCC at sender file adapter is used
my Data Type are :
Source DT Target RFC import parameter(table).
E2ED20* ITEM*
 KEY VBELN
 VBELN POSNR
E2E24* CHARG
 KEY
 POSNR
 CHARG
*->>multiple occurence
E2ED20 and E2E24 are 2 segment ,KEY is used in FCC to identify E2EDL20 & E2EDL24
My source text file is like this :
E2EDL20 0200
E2EDL24 xyz
E2EDL20 0201
E2EDL24 abc
E2EDL24 efg
E2EDL24 mln
E2EDL20 0202
E2EDL24 gty
so the payload should be :
0200 xyz
0201 abc
0201 efg
0201 mln
0202 gty
in FCC ignoer record set= true
otherwise is not called...
i try to use split by value & use oneasmany , not helpfull.
in message mapping when i checked th field VBELN -> display queue
i am getting an array 0200
 0201
 0202 in white fields
thanks & regards
Ashutosh Rawat

Source payload
<?xml version="1.0" encoding="utf-8" ?>
- <ns:MT_MATNO_FILE xmlns:ns="urn:abc:xxx">
- <E2ED20>
<KZ>E2EDL20</KZ>
<FIELD1>020</FIELD1>
<VBELN>0083662685</VBELN>
</E2ED20>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900001</POSNR>
<CHARG>1078629</CHARG>
<LFIMG>3200</LFIMG>
<MEINS>PCE</MEINS>
</E2E24>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900002</POSNR>
<CHARG>1078630</CHARG>
<LFIMG>1895</LFIMG>
<MEINS>PCE</MEINS>
</E2E24>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900003</POSNR>
<CHARG>1079145</CHARG>
<LFIMG>1883</LFIMG>
<MEINS>PCE</MEINS>
</E2E24>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900004</POSNR>
<CHARG>1079146</CHARG>
<LFIMG>3195</LFIMG>
<MEINS>PCE</MEINS>
</E2E24>
- <E2ED20>
<KZ>E2EDL20</KZ>
<FIELD1>020</FIELD1>
 <VBELN>0083662648</VBELN>
</E2ED20>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900011</POSNR>
<CHARG>1001450</CHARG>
<LFIMG>2946</LFIMG>
<MEINS>8PC</MEINS>
</E2E24>
- <E2ED20>
<KZ>E2EDL20</KZ>
<FIELD1>020</FIELD1>
 <VBELN>0083673936</VBELN> </E2ED20>
- <E2E24>
<KZ>E2EDL24</KZ>
<FIELD2>020</FIELD2>
<POSNR>900012</POSNR>
<CHARG>1073953</CHARG>
<LFIMG>2458</LFIMG>
<MEINS>PCE</MEINS>
</E2E24>
</ns:MT_MATNO_FILE>
at target what required is
<item>
<VBELN>0083662685</VBELN>
<POSNR>900001</POSNR>
</item>
<item>
<VBELN>0083662685</VBELN>
<POSNR>900002</POSNR>
</item>
<item>
<VBELN>0083662685</VBELN>
<POSNR>900003</POSNR>
</item>
<item>
<VBELN>0083662685</VBELN>
<POSNR>900004</POSNR>
</item>
<item>
<VBELN>0083662648</VBELN>
<POSNR>900011</POSNR>
</item>
<item>
<VBELN>0083673936</VBELN>
<POSNR>900012</POSNR>
</item>
in Sender FCC
E2ED20.fieldFixedLengths 7,76
E2ED20.fieldNames KZ,VBELN
E2ED20.keyFieldValue E1EDL20
E2ED20.endSeparator 'nl'
E2E24.fieldFixedLengths 7,24,13,7,3
E2E24.keyFieldValue E1EDL24
E2E24.fieldNames KZ,POSNR,CHARG,LFIMG,MEINS
E2E24.endSeparator 'nl'
ignoreRecordsetName true
source file is already there...
Message was edited by:
 ashutosh rawat

Multiple Exclusion Criteria[Exclusion Mask] in Sender File Adapter

Hello All,
I have a requirement to specify multiple exclusion criteria in the 'Exclusion Mask' property of a Sender File Adapter, i.e. I need to pick up files that correspond to 111*.txt from a specified source directory, but I would also want to exclude specific individual files that go by the following names:-111ACC.txt, 111INV.txt & 111PUR.txt.
I have tried the following - Specified 111*.txt in the 'File Name' field and in the 'Exclusion Mask' field specified ACC, INV & PUR - the exclusion criteria separated by commas. But this does not seem to work. All the 111* files are getting picked up.
Have gone through a couple of weblogs that deal with exclusion masks, but they do not talk about multiple exclusion criteria.
Is there any other way I could accomplish this?
Thanks,
Anand

Hi,
Try this config.
Give *.txt in filename. and Directory as <YourDir>
In exclusion mask give 111ACC.txt
Below this there will be a table. Add two Entries
Dont add anything to FilenameMask.
Directory ->FileNameMask--->ExclusionMask
<yourDir>->--->111INV.txt
<YourDir>->--->111PUR.txt
Try this and get back.
Regards,
Sudharshan
Message was edited by:
Sudharshan Aravamudan

Errro when referring a Bean in Sender file adapter

Hi
I have created a sample code and deployed in the server and when i refer that in the sender file adapter module processor using the naming format
localejbs/sap.com/com.vas.mod/GetFileNameBean
where
com.vas.mod is the EAR Project name
GetFileNameBean is the Bean name
I am getting the erro in the XI Adaptor monitor as follows
- 2006-07-31 13:06:51 UTC: Error: NameNotFoundException: Path to object does not exist at com.vas.mod, the whole lookup name is localejbs/sap.com/com.vas.mod/GetFileName.
I checked theJNDI name in the server it is exactly the same.
can some one help me on this please?
vasagam R K

Hi Vasagam,
Please check these threads..
They deal with ur question...
NameNotFoundException during JNDI lookup for Deployable WebService Proxy
Strange Lookup Error (SAP Resource Adapter)
cheers,
Prashanth
P.S Please mark helpful answers

Archive file with errors in sender file adapter not working! please help!

Hi Experts,
I have a file to RFC scenario. the input is a XML file. I have setup the flag in sender file adapter channel for archiving the input files with errors. But it is not working.
For testing I have used an invalid xML file for example without the main XML tag. I have also tested with a MSWORD file saved with.xml extension. But in both the cases the files are not getting archived.
My archive location permissions are fine and in fact normal archive operation is happening. That is, if I select the processing mode as "Archive" and gave the Archive directory then files are getting archived. The problem is only with the "Archive faulty source files" option.
What am I missing? DO I need to do some more configurations?
What are the prerequisites if any for this option?
How to test this?
Please help me! I will be greatfull to you all!
Thanks & Regards
Gopal

and go thru this links
Creating a Single Archive of the Version Files
http://help.sap.com/saphelp_nw04/helpdata/en/79/1e7aecc315004fb4966d1548447675/frameset.htm
http://help.sap.com/saphelp_nw04/helpdata/en/31/8aed3ea86d3d67e10000000a114084/frameset.htm
Note: reward points if solution found helpfull
Regards
Chandrakanth.k

Unzip file using PayloadZipBean in Sender FILE adapter

I am trying to unzip a flat file in Sender FILE adapter using PayloadZipBean.
I am getting mapping error. The problem is File adapter is reading data without unzipping. I am getting weird characters/data, so mapping error.
I searched all the blogs/ forum threads and help.sap.com, everywhere the focus is on zipping, not unzipping.
the file I have is with .gz extension, but I tried with .zip extension also.
Please help in resolving this issue.
Edited by: Gopal Janagama on May 2, 2008 11:42 PM

Gopal,
GZIP and ZIP format are slightly different, as stated here :
"GZIP compresses only one file and does not have a header. ZIP contains header information about what files are contained in the file."
So I'm not sure the PayloadZipBean supports GZIP format ... Try to ungzip and then zip its content and see if the bean works for it
Rgds
Chris

Recordset per message in Sender File Adapter

Hi Friends
I have configured a sender file adapter to pick up *.txt files from a specific path, Since the file is having thousands of records it is failing to process the file at PI level . In order to avoid the problem I have kept Recordset Set Per Message as 10 , but still PI is processing all the records into a single message. Please help me in troubleshooting it.
Regards
Suman.

Hi Suman,
Go thru these threads for troubleshooting...
Massive file
Processing huge file loads through XI
Processing of huge no of Inbound xml files
Bottleneck in Large file processing
How to process large data files in XI ? 100 MB files ?
Regds,
Pinangshuk.

Archiving TXT files in Sender File Adapter--Unformatted Way

Hello,
I am Archiving TXT files thru Sender file adapter, files are getting archived to specified directory.No issues in that.,
When i open the archived files, those are not in the correct format way that i placed before file pickup.
Header & lines got messed up side by side.
Regards

Hi,
If the file that it being archived is not transformed, it should exactly be the same as the original file.
Please make sure that you are not transforming the archive file by any means(unix script, mapping logics etc).
As suggested above, it is advisable to open the file in the editors like textpad, ultraedit etc. The difference in the alignment could be because of the notepad editor.
Try to open the original and archived files in any of those(textpad,ultraedit etc) editors and check.
Please let us know if you are still able to find the difference in the alignment.
Regards,
Subbu

Limitation of sender file adapter

Similar Messages

Maybe you are looking for