Process Integration File adapter

file adaptor in PI was able to accumulate several messages into one file?
In other words, every 30 minutes or so, we will connect to any system to collect the documents. If I get there and find a list with 50 document, can I change the adaptor between ECC and PI to send the information as file instead of iDOC? Can this file have all 50 documents together instead of one file per PO, as the iDOC interface was going to do?

Let me clarify the question first. Please, correct me if anything doesn't make sense.
Every 30 minutes or so, our PI system will receive a burst of SOAP messages (xCBL format) from the provider transfering data to out ERP. The adapter between our PI and our ERP is an iDoc adapter. It means that, if in the 30 minutes interval I have 50 individual messages to receive, ( not one message with 50 documents ), PI will then create 50 iDocs in ERP (calling the iDoc import 50 times). This would be very resource consuming in our system (of course I am not talking only 50 and not for only one type of document).
The question is if we can change the iDoc adapter to ERP to a FILE adapter (custom format), and have this file adapter collect all messages into ONE unique file, describing 50 documents. This way, we can run a customized import program to process all 50 documens (or more) at once.
So, I don't want to convert the iDocs but to exchange it to batch file.
Clear as mud?

Similar Messages

107 MB File - was not able to process thru File Adapter

Hi All,
I tried to send one 107 MB file using file adapter.
But was getting error as "not able to write on the integration server".It seemed like XI was not able to process file with that much size...as when we did split up the file into smaller ones ..those were processed....
I want to know what is the file size limit of File adapter......is there any way to send files with that much size from file adapter?
Can we do any file sizing exercise on XI servers?
Thanks.

Hi Henrique
Even the Zip Module doesnt help.
We had a similar case, when Xi was acting as a FTP. We thought we would use the Zip Module, etc but what we realise was even if you plan to use the Zip Module, the Entire File first needs to be loaded into the memory before the module can be called and the chances are that the j2EE stack goes down even before the module can be called.
We also explored the option of using the Jar command in the command line processing before message processing, even this has the same issue that , the Data is loaded into the memory of the j2ee stack and only then the command is executed and so even though the content was zipped, the actual content used by the file adapter was not the zipped content.
Regards
Bhavesh

File processing in FIle adapter

Hi,
i have configured Sender File Adapter (FTP) in my scenario which picks the file from FTP folder and sends to JDBC.
now i have 2 flat files in my FTP (yesterdays and todays). file names are test_07062010 and test_08062010.
now my requirement is while processing the files, my file adapter has to process first file as test_07062010 and then test_08062010. but now it is processing first test_08062010 and then test_07062010. due to this yesterdays data is overwriting on todays data in Database.
i know we have some option in file sender adapter (NFS)...but i need to do with FTP file sender...please let me know how to proceed further.
Thanks in Advance.

Hi Praveen...thanks for reply
my communication channel is active all the days. but sometimes due to PI server down or some maintance we will stop channels.
that time file will not pick by file sender and it will be in FTP.then next day one more file will generate in FTP.
So my proble is while processing these files my sender file adapetr is processing todays file first and then yesterdays.due to this yesterdays data is overwriting on todays data.
can you tell me how to handle that in file adapter.

Alert if no file process :Same file adapter with same communication Channel

Hi XI Guru,
I have encountered 1 requirement from my client where, sender will send different data file with different file name. And there want XI to alert the user if no file to process for the schedule date. Please take note that the communication channel is common to all the sender.
Example:
Communication Channel : CC_FILE_SND
FILE_10.TXT ---> Every month on the 10, user have to send FILE_10.TXT to process
FILE_20.TXT ---> Every month on the 20, user have to send FILE_20.TXT to process
If user fail or forget to send the FILE_10.TXT and FILE_20.TXT on special schedule date to process, XI should alert user.
Many thanks

Hi Lord
<<< there want XI to alert the user if no file to process for the schedule date.
Can you tell me how you are planning to configure this schedule date in your sender file adapter. I mean this date will be fixed or it is going to be change according to the requirement.
Now for the second part in order to alert the user if file is not there, one solution is to use BPM with wait step ( specify the time in this step ), but then again it takes me back to my previous question, the time seems to be different everytime according to the requirement.

How to get the read input file name in bpel process using File Adapter.

Hi,
I am reading a .txt file from configured directory using File Adapter.
I had configured file adapter to read file with naming pattern “SalesOrder.*\.txt”.
Now I had requirement to access the actual file name in bpel process eg: “SalesOrder123.txt”
How can I get the file name in bpel process.
Any help is appreciated.
Vidya.

1) create a variable of message type. Click on Browse Message type. Here you select Message Type-->Project WSDL Files -->fileAdapterInboundHeader-->Message Types-->Inboundheader_msg. Then click OK
2)Next dbl Click on teh receive Activity which is receing your File from teh File Adapter. Go to the Adapter Tab. Click on Browse variable and select the variable that you had just created above.
This would get the File name in the variable declared

Row By Row File Processing using File Adapter

Hi,
Can any one explain that how can a read a file row by row using File adapter in BPEL?
Like ...When One row is executed completely only then second row starts........
Regards,
En
Edited by: Enceladus on Apr 16, 2013 11:55 AM

For This ...you need to make you service Synchronus by adding a reply in interface WSDL of BPEL process.
Regards,
En

Large file processing in file adapter

Hi,
We are trying to process a large file of ~280 MB file size and we are getting timeout errors. I followed all the required tunings for memory and heap sizes and still the problem exists. I want to know if installation of decentral adapter engine just for this large file processing might solve the problem which I doubt.
Based on my personal experience there might be a limitation of file size processing in XI may upto 100 MB with minimul mapping and no BPM.
Any comments on this would be appreciated.
Thanks
Steve

Dear Steve,
This might help you,
Topic #3.42
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/70ada5ef-0201-0010-1f8b-c935e444b0ad#search=%22XI%20sizing%20guide%22
/people/sap.user72/blog/2004/11/28/how-robust-is-sap-exchange-infrastructure-xi
This sizing guide & the memory calculations it will be usefull for you to deal further on this issue.
http://help.sap.com/bp_bpmv130/Documentation/Planning/XISizingGuide.pdf#search=%22Message%20size%20in%20SAP%20XI%22
File Adpater: Size of your processed messages
Regards
Agasthuri Doss

Empty File has to write after Message Processing in File Adapter..!!

Hi,
File to File Scenario.
Once the file is processed and placed in the receiver folder, I need to generate one empty file with the original file name but with different extension (DON). This is used to indicate that the full file is written in the folder.
Example:
Original file has to write like "Output_Final.CSV"
Empty file has to be placed like "Output_Final.DON"
Is there any way I can achieve this requirement.?
Thanks
Deepthi.

I have no clue of removing the same using Graphical mapping ..
I hope you have set the option of Write Empty File if not try this and still doesnot work
then need to look for java or ABAP mapping
chekc the below thread may help
Re: How to create empty Payload
Rajesh

Files fail to reach IS after being processed by File adapter

Hi,
Till a few minutes back, our XI server was working fine. But all of a sudden the messages could not be sent to IS for processing. I found the following message in RWB--> Message monitoring.
8000 is the ABAP port that we have mentioned in SMICM.
<b>Transmitting the message to endpoint http://intersrv:8000/sap/xi/engine?type=entry using connection AFW failed, due to: com.sap.aii.af.ra.ms.api.RecoverableException: java.net.ProtocolException: Server redirected too many times (20).</b>
In adapter monitor i found that the message has been successfully been picked up(processed).
Also 1 strange thing that i observed is, when i tried posting the same payload using HTTP adapter(i mean the sample HTML page used to post HTTP requests to IS) is failing. I could not see any messages in sxmb_moni when i tried in an EO or EOIO processing mode.
Kindly help me on this.
Regards,
Siva Maranani

siva,
can you check the url in SLD for the related business system. It should be 8000 also and not 50000(i had a similar error and it was resolved by changing the URL in SLD.
is your DB up?
thanks
tony

Decryption of Message after processing by File adapter

Hi,
Encrypted File> XI> Encrypted File
I have to pick up an encrypted file, decrypt it and do the message transformations & business process associated wiht it and place it in another folder by encrypting the file again.
How can i acheive this.?
Regards,
Siva Maranani.

Hi siva,
You can use Java Mapping or user-Modules to do this.
Go thru this link:
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/unkown/webinars/how to handle unstructured source content for adapters/the pdf presentation of how to handle unstructured source content for adapters.pdf
Regards,
Sridhar

Read from a config file in File Adapter in SOA Suite 11g

I want to read from a config file in order to determine whether to archive or delete the file after processing using file adapter in SOA Suite 11g. How do i do that.

only part i replied on was the part of how to read a file
but i think in your case you could do the next
use the sync file adapter to read in the file during your process
based on this content you set a variable "myOutputDirectory"
then create a file adapter (write) which will store the file on file system
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#CIACICFD
4.3.2.2.5 Specifying a Dynamic Outbound File Name
and use that (jca.file.Directory) property to store the file either on the archive location or the delete location

To much files in archive of file adapter

Dear all,
on a day in november the RWB and the sxmb_moni show about 150 messages that
have been processed by a sender file adapter.
On the file system we have two files (all in all 152) more in our archive for this day. Neither the day
before nor the day after have a different amount of messages so that the two message
could not be a problem of late processing (for example over midnight).
I also check that no empty files where in archive.
My question: What kind of problem could appear that a message get processed through file adapter and save
to archive folder but not getting processed by adapter engine or integration engine?
Thanks
Chris

Hi,
My question: What kind of problem could appear that a message get processed through file adapter and save
to archive folder but not getting processed by adapter engine or integration engine?
There can be few situations when this can happen.
For example - say you are sending out a proxy from PI to R3 / BW system. Your sender file channel will read and archive the file, but when the PI tries to generate the proxy, it encounters an error - "User is not authorized to process messages" ... Means, the id that PI is using to send and process the proxy in R3 is not having proper authorization.
But once you have fixed this problem, you can re-start the message from MONI in PI.
Similarly, there can be other cases when this situation can arise.
So, for those 2 extra archive files, you might be interested in checking the logs in MONI / RWB if any message went into error.
Regards,
Neetesh

ESB File Adapter data validation issue

I have a really simple ESB process.
File Adapter Read
(XML format with XSD) --> Routing Service --> SOAP Call to BPEL Process
Quite simply, the ESB uses the File Adapter to read an XML file which has an associated XSD. The contents are then routed to a BPEL Process.
If the XML file is valid in syntax but contains an element which is not in the XSD, the file contents are pushed to the BPEL process which has validateXML set to true - thus the error is caught and handled by the BPEL process.
This is what I want to happen.
If the XML file is invalid in syntax - for example -
<TAG>hello</WRONGTAG>
The ESB process rejects the file and stops dead.
I would rather the invalid file is pushed to the BPEL so that the BPEL can handle the error.
Why?
Because my error handling in the BPEL picks up the invalid XML format and emails the users to inform them there is a problem.
Can someone help? Is this possible? Thanks.
Message was edited by:
IanBaird

Hello again! You are now aware of the problem as there has been a lot of conversation between myself and Dave Berry [and you!] regarding this issue.
For the rest of the readers - here is a brief summary of progress so far. Sorry but there has been so much communication that I think the best way is to direct you to various links.
If an adapter fails in ESB, then it is possible to trap these failures and handle them as documented here:
Dave Berry said:
you need to look into the adapter rejection handlers which are documented on OTN ESB page in the exception handling lesson and the adapters OTN dev resources page http://www.oracle.com/technology/products/integration/adapters/dev_support.html
I had also devised my own solution in the meantime, which involves reading the input file as opaque schema and passing this to a BPEL process which converts it to an XML document! This can then be validated and use standard BPEL error handling to find any problems in the file format etc.
See my blog for a tutorial on doing this:
http://soastuff.wordpress.com/2007/06/06/handling-opaque-datatypes-in-bpelesb/
The only problem with this at the moment is that the BPEL function ora:parseEscapedXML has a bug in it - so it fails if the XML does not comply with the XSD it tries to convert to.
This in turn causes an ORABPEL-09500 error which does not seem to get handled by the BPEL process so the process fails.
As things stand, this bug remains - though Dave Berry has been very helpful in identifying it and bringing it to Muruga's attention. Hopefully we can get a fix (?) and a workaround whilst the fix is being implemented (?)
Cheers.

Got compilation error about 'create instance activity' using file adapter

Hi,
I am creating a very simple bpel process using file adapter. in my 'Receive' activity, I selected 'create instance' , as the tutorial says.
I got this compilation error during deploying.
'Error(31): [Error ORABPEL-10051]: multiple create instance activity [Description]: in line 31 of "D:\OraBPELPM_1\integration\jdev\jdev\mywork\BPELPractices\FileAdapterTest2\FileAdapterTest2.bpel", Conflicting createInstacne="yes". Instance is already created by another activity. [Potential fix]: Remove createInstance="yes" attribute from this activity. '
Several people had the same problem in my team. I wonder if this is a common issue. how to fix it?
Thanks,
Kate

You must be having another receive/pick activity within the same process that has "createInstance" set to yes.
Thats why its complaining.

File Adapter Polling issue(Is there critical value of File size )?

Hi
I use File adapter as the Activation to initialize a BPEL process instance .The source data is a kind of Delimited file format.On my PC, when the file size is less than 4M ,everything works fine ,But when the size increased. The BPEL process will not initialize the instance.When the source data is XML data , the "critical value " is about 12M. The error msg is below.
<2005-08-08 12:48:26,209> <INFO> <default.collaxa.cube.activation> <File Adapter::Inbound> Processing file : D:\Temp\WOSSystemIntegration\InBoundFiles\LOADPLAN_DATA_200508041708.xml
<2005-08-08 12:48:29,455> <INFO> <default.collaxa.cube.activation> <FileAdapter::Inbound> Sending message to Adapter Framework for posting to BPEL engine: { file=D:\Temp\WOSSystemIntegration\InBoundFiles\LOADPLAN_DATA_200508041708.xml
<2005-08-08 12:48:40,197> <ERROR> <default.collaxa.cube> <BaseCubeSessionBean::l
ogError> Error while invoking bean "cube delivery": Delivery callback message se
rialization failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube> <BaseCubeSessionBean::l
ogError> Error while invoking bean "delivery": Delivery callback message seriali
zation failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound> [Read_ptt::Read(loadPlanCollection)] - JCA Activation Agent was
unable to perform delivery of inbound message to BPEL Process 'bpel://localhost/
default/P2E_WOS_LP~1.0/' due to: Delivery callback message serialization failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
<2005-08-08 12:48:40,245> <ERROR> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound>
com.oracle.bpel.client.ServerException: Delivery callback message serialization
failed.
An attempt to serialize the delivery callback messages for conversation "LocalGU
ID:d0b7ccf8e4242850:134b07e:10594606738:-7ffc", message "d0b7ccf8e4242850:134b07
e:10594606738:-7ffb" to binary format has failed. The exception reported is:
at com.collaxa.cube.engine.delivery.DeliveryHandler.initialPostAnyType(D
eliveryHandler.java:328)
at com.collaxa.cube.engine.delivery.DeliveryHandler.initialPost(Delivery
Handler.java:219)
at com.collaxa.cube.engine.delivery.DeliveryHandler.post(DeliveryHandler
.java:83)
at com.collaxa.cube.ejb.impl.DeliveryBean.post(DeliveryBean.java:181)
at IDeliveryBean_StatelessSessionBeanWrapper22.post(IDeliveryBean_Statel
essSessionBeanWrapper22.java:861)
at com.oracle.bpel.client.delivery.DeliveryService.post(DeliveryService.
java:161)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase$DeliveryServiceMon
itor.send(AdapterFrameworkListenerBase.java:2340)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase.executeDeliverySer
viceSend(AdapterFrameworkListenerBase.java:478)
at oracle.tip.adapter.fw.AdapterFrameworkListenerBase.deliveryServiceSen
d(AdapterFrameworkListenerBase.java:535)
at oracle.tip.adapter.fw.jca.AdapterFrameworkListenerImpl.performSingleA
ctivation(AdapterFrameworkListenerImpl.java:699)
at oracle.tip.adapter.fw.jca.AdapterFrameworkListenerImpl.onMessage(Adap
terFrameworkListenerImpl.java:567)
at oracle.tip.adapter.fw.jca.messageinflow.MessageEndpointImpl.onMessage
(MessageEndpointImpl.java:121)
at oracle.tip.adapter.file.inbound.ProcessWork.publishMessage(ProcessWor
k.java:651)
at oracle.tip.adapter.file.inbound.ProcessWork.doTranslation(ProcessWork
.java:456)
at oracle.tip.adapter.file.inbound.ProcessWork.processMessages(ProcessWo
rk.java:200)
at oracle.tip.adapter.file.inbound.ProcessWork.run(ProcessWork.java:139)
at oracle.tip.adapter.fw.jca.work.WorkerJob.go(WorkerJob.java:51)
at oracle.tip.adapter.fw.common.ThreadPool.run(ThreadPool.java:267)
at java.lang.Thread.run(Thread.java:534)
<2005-08-08 12:48:40,245> <INFO> <default.collaxa.cube.activation> <File Adapter
::Inbound> Failed to send message {D:\Temp\WOSSystemIntegration\InBoundFiles\LOA
DPLAN_DATA_200508041708.xml} to Adapter Framework.
<2005-08-08 12:48:40,245> <WARN> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> [Read_ptt::Read(loadPlanCollection)] - onReject: Sending invalid
inbound message to Exception Handler: file://D:/Temp/WOSSystemIntegration/Reject
edMessages
<2005-08-08 12:49:44,617> <FATAL> <default.collaxa.cube.activation> <AdapterFram
ework::Inbound> [Read_ptt::Read(loadPlanCollection)] - Resource Adapter requeste
d Process shutdown
<2005-08-08 12:49:48,676> <INFO> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> Adapter Framework instance: OraBPEL - performing endpointDeactiva
tion for portType=Read_ptt, operation=Read
<2005-08-08 12:49:48,676> <INFO> <default.collaxa.cube.activation> <File Adapter
::Inbound> Endpoint De-activation called in adapter for endpoint : D:\Temp\WOSSy
stemIntegration\InBoundFiles
<2005-08-08 12:49:49,042> <INFO> <default.collaxa.cube.activation> <AdapterFrame
work::Inbound> JCAActivationAgent::onStateChanged State is changed for process '
bpel://localhost/default/P2E_WOS_LP~1.0/', state=OFF
how can i solve this problem?can i predeploy some parameter? Is there some critical value of File size for the processing of File Adapter ?

Hi,
There is no specific parameters to specify the maximum file size to be read in. It is just limited by the heap size of the JVM running the BPEL engine.
If you have enough RAM on your machine you can change the current heap size from 512Mbyte to 1Go by editing the startorabpel.bat file
and modifying the line :
set MEM_ARGS=-Xms512m -Xmx512m -Xmn300m -XX:MaxPermSize=80m
to
set MEM_ARGS=-Xms512m -Xmx1024m -Xmn300m -XX:MaxPermSize=80m
But only do it if you have at least 1.5 Gb of RAM on your machine, otherwise ot will keep spawing and you will have very bad performance.
Speaking about performance, do you really need to have a BPEL payload of 4 to 12 Mb ?
Will the BPEL process really need to access it ? if so, the best solution would be using batching techniques to cut you file in pieces and process it piece by peice.
FB.

Process Integration File adapter

Similar Messages

Maybe you are looking for