How To split large message using File Adapter
Hello everyone,
Here is my scenario FTP > XI > BI.
I got 2 questions:
(1) I am getting large message around 70 MB file.
How we can split the message into multiple files 10 MB each before processing the file into XI?
(2) Is there is any way we can find out size of file which is on FTP without contacting FTP admin?
through XI before processing the file?
Thanks
Vick
hi vick,
check the blog
Zip or Unzip your Payload with the new PayloadZipBean module of the XI Adapter Framework
Working with the PayloadZipBean module of the XI Adapter Framework
SAP XI acting as a (huge) file mover
The specified item was not found.
Managing bulky flat messages with SAP XI (tunneling once again) - UPDATED
The specified item was not found.
regards
kummari
Similar Messages
-
How to post multiple message using file adapter in XI2.0
We have to post multiple IDOCS.We have scenario as below.
We will have file structure like as shown below.
VKORG,VTWEG,SPART,BSART,PARVW,PARTNER,BSTDK,MATNR,MENGE,VSART,BSTZD,POLINE,BSARK
BE10;10;10;OR;SP;1000033;;M184-ISS01;2;G;131;0002;
BE10;10;10;OR;SP;1000033;;M184-ISS01;2;G;131;0002;
BE30;10;10;OR;SP;1000033;;M184-ISS01;2;G;131;0002;
For this we want that 2
messages should be created.In first message there will be first 2 records
with VKORG BE10 and in second message there will be last record with VKORG BE30.
We can do it through FILE2XMBWITHSTRUCTURECONVERSION and using some options.
I am sending the configuration that I have done for my adapter.
classname=com.sap.aii.messaging.adapter.ModuleFile2XMB
mode=FILE2XMBWITHSTRUCTURECONVERSION
#mode=FILE2XMB
XMB.TargetURL=http://20.60.53.36:8000/sap/xi/engine?type=entry
XMB.ReceiverBusinessSystem=sapdev210
#XMB.ContentKind=B
XMB.ContentKind=T
#XMB.ContentType=application/xml
XMB.ContentType=text/xml
#XMB.ContentType=text/plain
XMB.QualityOfService=EO
##xml conversion properties if mode FILE2XMBWITHROWCONVERSION specified (example, see docu)
xml.recordsetStructure=IDOC,*
xml.recordsetName=SALESDATA
xml.recordsetsPerMessage=1
xml.documentName=SALESDATA
#xml.fieldFixedLengths=
xml.IDOC.processFieldNames=fromConfiguration
xml.IDOC.fieldNames=VKORG,VTWEG,SPART,BSART,PARVW,PARTNER,BSTDK,MATNR,MENGE,VSART,BSTZD,POLINE,BSARK
xml.keyFieldName=VKORG
xml.keyFieldType=CaseSensitiveString
xml.IDOC.keyFieldValue=BE10.
xml.IDOC.fieldSeparator= ;
What I have tried is hardcoding 2 in xml.recordsetStructure=IDOC,2.It works fine
Since I already knew this.
Butin real scenario we wont be knowing this that is why I have given * in configuration , and
given
xml.keyFieldName=VKORG
xml.keyFieldType=CaseSensitiveString
xml.IDOC.keyFieldValue=BE10.
With this it should identify on key field and its value and put first 2 records in one message
and last record in second message.
It is not giving any error when we start adapter but no XML message is created.Can u plz help me
for the above problem.
My datatype in repository is like
SALESDATA
IDOC
VKORG
VTWEG
and allother remaining fields.
Is this scenario possible in XI 2.0.If yes then will it be done through above approach or something else.
Thanx.
Rekha.Hi,
I think you can not handle this problem with keyFieldName/keyFieldValue.
In my opinion with keyFieldName/keyFieldValue you can create different substructures of the same XML, but you can not seperate messages with the same substructure.
But I don't know how to handle your problem ;-(
Another point is that I see a dot after xml.IDOC.keyFieldValue=BE10.
My be this is a problem too.
Christoph -
How to handle large data in file adapter
We have a scenario Proxy -> PI -> File Sever using File adapter.
File adapter is using FCC for conversion.
recently we had wave 2 products live and suddenly for this interface we have increase in volume of messages, due to which File adapter is not performing well, PI goes slow or frequent disconnect from file server problem. Due to which either we will have duplicate records in file or file format created is wrong.
File size is somewhere around 4.07 GB which I also think quite high for PI to handle.
Can anybody suggest how we can handle such large data.
Regards,
VikrantCheck this Blog for Huge File Processing:
Night Mare-Processing huge files in SAP XI
However, you can take a look also to this Blog, about High Volume Messages:
Step-by-Step Guide in Processing High-Volume Messages Using PI 7.1's Message Packaging
PI Performance Tuning Best Practice:
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/2016a0b1-1780-2b10-97bd-be3ac62214c7?QuickLink=index&overridelayout=true&45896020746271 -
How to Write a PDF using File Adapter
Hi All,
Can anyone please let me know how to create a PDF file at the receiving end using a File Receiver Adapter. The source is an XML file. The scenario is as follows.
XML-File ---> XI --->PDF-File.
Any help would be highly appreciated.
Thanks in Advance
Anil.hi ,
if u r using pi7.1 you can use agents concept.
please find the links.
http://help.sap.com/saphelp_nwpi71/helpdata/en/43/fc39c16bfb025ee10000000a1553f7/frameset.htm
How to get started using Conversion Agent from Itemfield
More on the SAP Conversion Agent by Itemfield
Integrate SAP Conversion Agent by Itemfield with SAP XI
Conversion Agent a Free Lunch?
How to get started using Conversion Agent from Itemfield
https://websmp102.sap-ag.de/~sapdownload/011000358700001090982006E/ConvAgentDocSP16.zip
https://websmp102.sap-ag.de/~sapdownload/011000358700004921152005E/ConversionAgent.pdf
XI: Generate PDF file out of file adapter
XI: Read data from PDF file in Sender Adapter
The specified item was not found.
regards,
navneet -
How to handle rejected messages in file adapter
Hi....! every one.........
in file adapter read operation it will pick the files even the file contains unstructure message but that file wont be processed.
where the rejected message goes.
i have requirement like that rejected message i have to store in another file
please provide me answer..........Hi,
You can add the parameter 'PhysicalErrorArchiveDirectory' in the JCA file (of the File Adapter).
Put there the required directory where you want the rejected file to be sent.
You can add this property in 2 ways:
1. In your JDeveloper open the JCA file and add: <property name="PhysicalErrorArchiveDirectory" value="/../.."/>
2. In EM, right click the composite->Service/Reference Properties->Choose your file->On the Properties tab press Add-> Choose 'PhysicalErrorArchiveDirectory' and put the directory-> press Apply.
Arik -
Regarding hierarchy of message using file adapter
Hi all.
I have following source-structure
<name of MT>
<Header>
<h1></h1>
<Subheader>
<sh1></sh1>
<LineItem>
<l1></l1>
<LineItem>
</Subheader>
</Header>
</name of MT>
Input is coming like a flat file.
can file adapter can read the above structure? may be it doesn't because, <l1> item is in 4th level of message. so adapter can't read more than 3rd levels.. is it right? Please give u r inputs.
ThanksHi,
To my Knowledge
>>so adapter can't read more than 3rd levels.. is it right? Please give u r inputs
It is not like that.
Regards
Agasthuri Doss -
Multiple message through FIle Adapter using XI 2.0
I have scenario to create multiple message using File adapter .My file structure will be like
EMPID NAME SKILLS
001 A ABAP
001 A XI
002 B JAVA
Now I want to post first 2 records in one message and last record in other message.
Can we do it in XI 2.0.Any help appreciatedHi Suraj.
Thank you very mutch for your reply.
Excuse me...my mapping is done for message type and idoc.
My problem is that when the interface start, on the sxmb_moni I see an error like this:
Creating Java mapping com.sap.xi.tf._MM_XmlOrderToIdocMapping_ --- Using MappingResolver with context URL //srvsapdev/sapmnt/CX1/SYS/global/xi/mapping/gestione_magazzini/7fa9c9e15a7811dab710f3e3ac10826e/ --- Load of com/sap/xi/tf/_MM_XmlOrderToIdocMapping_.class from //srvsapdev/sapmnt/CX1/SYS/global/xi/mapping/gestione_magazzini/7fa9c9e15a7811dab710f3e3ac10826e failed. --- Class not found: com.sap.xi.tf._MM_XmlOrderToIdocMapping_ --- java.lang.ClassNotFoundException at RUMappingJava.load(): Could not load class: com.sap.xi.tf._MM_XmlOrderToIdocMapping_ Class not found: com.sap.xi.tf._MM_XmlOrderToIdocMapping_ --- com.sap.aii.ibrun.server.map.MappingRuntimeException: at com.sap.aii.ibrun.server.map.MappingRuntimeException.code_STYLESHEET_OR_CLASS_NOT_FOUND
..where 'gestione_magazzini' is my namespace and 'MM_XmlOrderToIdocMapping' is my message mapping.
Can you help me to undestand the problem?
Thanks,
Gianluca -
Two Files merging using File adapter in Bpel 2.0
Hi All,
I have two different files (File 1 and 2) of same format(Two columns each) , now i want to merge these two files using their data and form a consolidated file (File 3 with four columns).
Please advise on how to make it possible using file adapter.
Example:
File 1 Format: A1 and A2 - are two columns of number and sring type
File 2 Format : B1 and B2 - are two columns of number and string type
Consolidated File 3 Format : A1 B1 A2 B2 - forming a single row if A1=B1 and also populating A2 and B2.
Thanks
Karthick.Hi Karthick,
I would say read both files completely. Then create a transform and select both messages as an input creating one output. With XSLT it should not be too hard to combine the two inputs. You could loop on one file and then select each row from the other file. That output can be written to file.
I don't know what triggers the process, but you could either let bpel be triggered by the polling on one file and read the other synchronously. Or read both files synchronously.
Regards,
Martien -
How to get the read input file name in bpel process using File Adapter.
Hi,
I am reading a .txt file from configured directory using File Adapter.
I had configured file adapter to read file with naming pattern “SalesOrder.*\.txt”.
Now I had requirement to access the actual file name in bpel process eg: “SalesOrder123.txt”
How can I get the file name in bpel process.
Any help is appreciated.
Vidya.1) create a variable of message type. Click on Browse Message type. Here you select Message Type-->Project WSDL Files -->fileAdapterInboundHeader-->Message Types-->Inboundheader_msg. Then click OK
2)Next dbl Click on teh receive Activity which is receing your File from teh File Adapter. Go to the Adapter Tab. Click on Browse variable and select the variable that you had just created above.
This would get the File name in the variable declared -
How to read MS-Excel file by using file Adapter
hi friends,
I have an issue on read Operation by using file Adapter.
It is necessary to read excel file by using file adapter. But in the native format of file adapter there is no option to read excel type of files.
So friends, please help me how to solve this problem?
Thanks in Advance..See also this post:
Read Excel File Using FileAdapter in SOA 11g
It might help you -
How to use File Adapter with hierarchial Structure?
Hi,
How to use File Adapter with hierarchial Structure like..
Data:
--Header Details:
Line Item Details:
Data
Bcoz I am getting a Flatfile in a hierarchial way as shown below.
Header Details :1
Line Item a
Line Item b
Header Details :2
Line Item c
Line Item d
KishoreHey Kishore,
In order to create a structure you need to use the file with convertion mode on the sending communication channel of the file adapter.
check the link for the needed configuration paramters.
If the structure is more complexed you can use the Contetnt master(CM) from itemfield which allows to ceate XML file from complex flat files and more.
<a href="http://help.sap.com/saphelp_erp2005/helpdata/en/0d/5ab43b274a960de10000000a114084/frameset.htm">File sender adapter</a>
If you have any question i'll be more than happy to assist.
Nimrod Gisis -
How to read pdf file using file adapter
Hi..
How to read pdf file using file adapter?
regards
ArunHi
This may help you
/people/sap.user72/blog/2005/07/27/xi-generate-pdf-file-out-of-file-adapter
/people/alessandro.guarneri/blog/2007/02/21/sap-xi-acting-as-a-huge-file-mover
---Ram -
How to get file name using File adapter Sync read
Hi All,
I am using SOA 10.1.3.3 and JDEV 10.1.3.3.
I have an async bpel process.
I have to read file name in this process... so i have used file adapter sync read operation.
How can we get the file name with out payload using sync read.
For normal read (Inbound Spec)we have UseHeaders="true" property.
Is there any property for sync read to read the file name.
Please help me
Regards
PavanKumar.M
Edited by: [email protected] on Oct 27, 2009 11:23 PMHi Eric,
The info in the link provided by you is for a normal read.
I need to read he file name using Sync read operation.
Regards
PavanKumar.M -
How to use File Adapter in BPEL
Hi,
How to use File Adapter in BPEL. I am using Oracle SOA 10g. Any sample or best example in blog or elsewhere ?Hi,
Please check the below links for samples on how to use file adapter in BPEL (in 10g/11g usage is same) and let me know any further queries.
11g - http://blogs.oracle.com/theshortenspot/entry/soa_suite_integration_part_3_l
10g - http://erpschools.com/articles/bpel-file-adapter-tutorial -
How to use File Adapter to transport files
Hi,
Can i use File Adapter Additional Files settings to Transfer files from one system to other without conversion?
File Adapter's Additional Files documentation says "additional attachments require a receiver that can process them". In my case receiver is also
File Adapter.
Please let me know if there is any other way to achive this.
Thanks in Advance
JayantHi Jayant -
Here is the link to the documentation related to this:
http://help.sap.com/saphelp_nw04/helpdata/en/3c/b4a6490a08cd41a8c91759c3d2f401/content.htm
Notice in "Rules for Additional Files":
"Messages with additional attachments require a receiver that can process them."
Currently, the receiver file adapter does not support the processing of attachments.
Regards,
Jin
Maybe you are looking for
-
BI Publisher 10.1.3.4.1 works fine in IE 6 & 8 but not 7
When performing operations such as test database connections or install schema on scheduler configuration, the customer gets an error occurs on the page in IE 7.0.5730.11, but it works fine in 7.0.6001.18000. My customer is pushing on reproducing thi
-
AVCHD in Ae CS5 is a sad joke.
Ok! AVCHD footage is playing perfectly in Premiere cs5 due to Mercury. But no Mercury in AE C5 makes scrubbing the CTI such a difficult task! And don't think my 8 core workstation is to blame. The strange thing is that RAM preview is reeealy fast!
-
Where is the photo bin in photoshop CC
Where is the photo bin in photoshop CC
-
SPA50X transfer with one-touch button
Hi to All! Sorry for my English first! :-) I'm using SPA504G phones with IP-PBX ZyXEL X8004. One-touch buttons is configured as described in manuals: fnc=sd+cp+blf; sub=UserID@$PROXY Here is my problem: when I want to transfer incoming call to other
-
Hi, currently we only have Item level ODS existing inside our system, but now we want to have the three header level ODS created or activated, which will link to the three header level infosource 2LIS_11_VAHDR, 2LIS_12_VCHDR and 2LIS_13_VDHDR(these