Reading huge flat file through SOAP adapter

Hi Everybody,
In one of our interface we need to read big flat file using soap adapter at sender side into xi and we are using java map to convert into xml. but before that i need to split this flat file into multiple files in the first message mapping. and in the second map we have to write a java map to do the flat file conversion to XMLBut i got struck up in reading this big flat file into XI as i need to declare some datatype to read this entire file. Can anybody tell me how i can do this. is it a possible to do first of all with SOAP adapter .
Thanks
raj

hi vijay,
Thanks for your prompt reply. Due to some reasons i am not allowed to use file adapter . i can use only JMS adapter or SOAP adapter. we tried few scenarios with JMS content conversion but what ever scenario i am asking here is complex at multilevel i can't even use JMS in this case. so we are thinking to read whole file using SOAP adapter and then we are planning to split the file into multiple files, as file can be huge size ,using java mapping and in next level we want to use another mapping to do content conversion. SO I have to do experiements whether this is a feasible solution or not. because when u declare at sender side
<ffdata_MT>
<Recordset>
<ROW> String type
when u declare like this and when u sent the flat file using SOAP adapter at sender side we are getting whole file which we sent at part of "ROW" as string. but inside java mapping i need to see whenther i can split this in XI ,so that i can use these split files in next mapping for content conversion. Hope i am clear now. I want to know whether it is a feasible solution or not.
I really appreciate if sombody give some idea on this
Thanks
raj

Similar Messages

Reading huge flat file in OSB 11gR1

Hi,
I want to read a flat file in OSB.The size of the flat file may be larger, upto 1 MB.
As per my knowledge, OSB provides following approaches to read a flat file-
1.JCA(creating a file adapter in jdev and importing artifacts in OSB)
2.MFL transformation
3.Java callout
Please let me know which is the best way to read the flat file.Also , is there any other way to do the same.
Thanks in advance.
Regards,
Seemant
Edited by: Seemant Srivastava on Feb 18, 2011 1:47 PM

Which option is best one to convert a flat file to XML - is it via File Adapter or MFL ? Well, it's a topic of debate and it usually depends on your choice. Manoj has explained it clearly above that why one may prefer File Adapter over MFL. It also depends on your familiarity with the product. If you are a Oracle developer dealing with BPEL/Mediator mostly then you will prefer going for File adapter in this situation, even with OSB, but if you are a OSB developer (since the time it was known as ALSB) you will prefer MFL over adapter.
It's just matter of choice & your comfort. Remember, in different-different cases, both solutions may result in different performance, so better test them from performance perspective and then choose.
Such flexibility of optional tags can only be handled by mfl.I don't think so. File adapter should also be able to handle this use case. Have you checked this -
http://download.oracle.com/docs/cd/E17904_01/integration.1111/e10231/nfb.htm#CHDDHEAI
Also, upto what size of input file is supported by mfl.It's a unanswerable question. It totally depends upon your system structure. I personally don't prefer huge files translation at OSB because it hurts the performance of OSB.
but I think such feature will not be supported when the file adapter artifacts are imported and used in OSB 11.1.1.3/11.1.1.4Correct. From OSB Dev guide -
25.2.1.1 Oracle JCA Adapter Limitations
Following are limitations when using some JCA adapters with Oracle Service Bus:
•Oracle JCA Adapter for AQ – Streamed payload is not supported with Oracle Service Bus.
•Oracle JCA Adapter for FTP and Files – Attachments (large payload support), pre- and post-processing of files, using a re-entrant valve for processing ZIP files, content streaming, and file chunked read are not supported with Oracle Service Bus.
http://download.oracle.com/docs/cd/E17904_01/doc.1111/e15866/jca.htm#BABBICIA
Regards,
Anuj

Flat file with soap adapter

Hi,
Can anybody tell me is it possible to send flat file as an atttachment via soap adapter.
Regards,
Dhill

Hi Doss,
Thank you, my user have given details as
URL Name : https:
xxxxx
and
Headers details as :
Ent-sender: XXXX
Ent-receiver: YYYY
Ent-APRF: ZZZZZ
Ent-filename: client_file_name
Please let me know how we need to specify this in receiver soap communication channel.
Regards,
Dhill

Can we read a ZIP file through ESB file adapter?

Hi,
Is it possible to read a ZIP file from a specified locaiton either through a FTP adapter or file adapter as a opaque element and place it in another specified locaiton?
So far the available options are to read a txt, csv, fixed length or cobol file.
I tried to create a ESB reading ZIP file and place it in another locaiton. but it was not reading the ZIP file.
Is it first possible for the ESB to read the ZIP file? if so then is there any specific configuratuion that we have to do for it to work?

how can we read a MSWORD file through java?You can read it like any other file using FileInputStream
and similar.
Howvere, if you want do do something with it, like display
it, you have a problem. AFAIK Microsoft do not release
information about their document formats, and i have not
seen a .doc viewer for java.

Read an xml file through file adapter?

How do i read an xml file through file adapter?

Hi,
This is pretty straight forward.
Just configure the sender file adapter without any file content conversions.
Read this for more information:
http://help.sap.com/saphelp_nw04/helpdata/EN/e3/94007075cae04f930cc4c034e411e1/content.htm
Regards,
Ravi

Connection issue between Data service(DQ) to PI through SOAP adapter.

Hi Guys,
We are trying to connect the data services(DQ) with SAP PI through SOAP adapter. I provided the wsdl file to data services team and they are trying to send messages to PI. Looks like the messages are showing successful in there system, but not showing up in PI system.
I tried the same file using xmlspy and PI receiving the messages from XMLSPY. We are wondering whats going wrong?
Any idea about this data services system? Is there any other better way to receive messages to PI apart from webservices?
PS: Connection is working fine from PI to DQ thorugh SOAP adapter.
Thanks
Deepthi.

>>>> We are trying to connect the data services(DQ) with SAP PI through SOAP adapter. I provided the wsdl file to data services team and they are trying to send messages to PI. Looks like the messages are showing successful in there system, but not showing up in PI system.
You are using soap sender adapter ... Hosting webservices and DQ team is able to access your webservice. Also using XMLSPY you are able to see pi messages.
If you are using advance adapter engine, Please check only in the RWB -> adapter engine.
If you are not using AAE, check in both SXMB_MONI and RWB for the wide range... Something problem with filter query in your checking...
Note since XMLSPY testing goes through Pi and able to monitor means you dont need another webservice client tool.
Solution:
use tcp monitor to monitor the soap message ... It is better option
/people/stefan.grube/blog/2007/03/29/troubleshooting-soap-http-and-mail-adapter-scenarios-with-tcpgateway

How to write won WSDL file for SOAP adapter ?

Hi experts
Can any one expalin me how to write WSDL file for SOAP adapter ?
What and all things i need to know ? i have no idea on this....
I got the business but to WSDL ...i am very new to this
Adv...thanks
Rakesh

HI,
Please see the below links,
Consuming XI Web Services using Web Dynpro Part II-/people/riyaz.sayyad/blog/2006/05/08/consuming-xi-web-services-using-web-dynpro-150-part-ii
Consuming XI Web Services using Web Dynpro Part I -/people/riyaz.sayyad/blog/2006/05/07/consuming-xi-web-services-using-web-dynpro-150-part-i
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/0d7349b6-0901-0010-ddbe-ec43178a61ff
/people/sap.user72/blog/2006/01/16/xi-propagation-of-meaningful-error-information-to-soap-client
/people/kevin.liu/blog/2006/04/12/wsdl-11-binding-extension-for-soap-12
Regards
Chilla..

Extracting data from Essbase & loading into flat file through ODI

Hi,
I want to extract data from Essbase and load it into a flat file through ODI(for extraction from essbase I'm using a report script) and I’m using these KM’s:- LKM Hyperion Essbase data to SQL,IKM SQL to FILE Append & for reversing I’m using RKM Hyperion Essbase.All the mappings have been done and the interface has been made. But when I’m executing the interface it is throwing the error below:-
ODI-1217: Session ESS_FILEI (114001) fails with return code 7000.
ODI-1226: Step ESS_FILEI fails after 1 attempt(s).
ODI-1240: Flow ESS_FILEI fails while performing a Loading operation. This flow loads target table ESS_FILE.
ODI-1228: Task SrcSet0 (Loading) fails on the target FILE connection FILE_PS_ODI.
Caused By: java.sql.SQLException: ODI-40417: An IOException was caught while creating the file saying The system cannot find the path specified
at com.sunopsis.jdbc.driver.file.impl.commands.CommandCreateTable.execute(CommandCreateTable.java:62)
at com.sunopsis.jdbc.driver.file.CommandExecutor.executeCommand(CommandExecutor.java:33)
at com.sunopsis.jdbc.driver.file.FilePreparedStatement.execute(FilePreparedStatement.java:178)
at oracle.odi.runtime.agent.execution.sql.SQLCommand.execute(SQLCommand.java:163)
at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:102)
at oracle.odi.runtime.agent.execution.sql.SQLExecutor.execute(SQLExecutor.java:1)
at oracle.odi.runtime.agent.execution.TaskExecutionHandler.handleTask(TaskExecutionHandler.java:50)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.processTask(SnpSessTaskSql.java:2906)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java:2609)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatAttachedTasks(SnpSessStep.java:537)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java:453)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:1740)
at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$2.doAction(StartSessRequestProcessor.java:338)
at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:214)
at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.doProcessStartSessTask(StartSessRequestProcessor.java:272)
at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor.access$0(StartSessRequestProcessor.java:263)
at oracle.odi.runtime.agent.processor.impl.StartSessRequestProcessor$StartSessTask.doExecute(StartSessRequestProcessor.java:822)
at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:123)
at oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$2.run(DefaultAgentTaskExecutor.java:82)
at java.lang.Thread.run(Thread.java:619)
Please let me know what I'm missing and how I can resolve this error.
Thanks

It seems that you are trying to use the file as your staging areas. Hyperion LKM extracts essbase data into a DB staging area which can then be used by your file IKM to load it into file.
You need to use a RDBMS for your staging area.

How to transfer an Image file through SOAP

can i transfer image(.bmp, .jpg etc), MS word (.doc) or any other files through SOAP
if yes then how come
please let me know the steps of it

Hi,
You can transfer files such as the types you mention as SOAP attachments.
Try reading the JWSDP (v1.1) tutorial for a starter ( http://java.sun.com/webservices/docs/1.1/tutorial/doc/ ). Also, the SAAJ (SOAP with Attachments API for Java) chapter of the new book "Java Web services In a Nutshell" by O'Reilly is available free from their web site ( http://www.oreilly.com/catalog/javawsian/ )- this discusses attachments in some detail.
Simon

Send and Receive an xml file over SOAP adapter

hi,
I want to send an xml file as an attachment over SOAP adapter and Response also should be file.
Can anybody tell the exact solution.
Useful responses will be appreciated
Thanks
Jaideep Jain

Hi Jaideep,
Yes you can send the any file throgh SOAP adapter by selecting the Keep Attachments option.
For your requirement you can go throgh the following link
Re: Attachments in SOAP adapter
http://www.w3.org/TR/SOAP-attachments
http://www.theserverside.com/tt/articles/article.tss?l=SendingAttachmentsWithSOAP
Regards
Sridhar Goli

How to read a text file through pl/sql

How to read a text file through pl/sql

pl/sql runs inside the database. so your file also should be on the database server file system for you to be able to read.
check out UTL_FILE package. This is the database package to read/write files on the database server.

How to read a flat file from the batch

Hi,
We have a requirement to read a flat file in the custom java batch in ETM2.2. We have the file at a specific location.
can some one let me know what are the various options, we have to read a flat file.
Thanks,
Sharath Kumar G.

Is it referring to some "Process X" batch?
And why MPL/XAI with or without Configuration Tools should not be used to do this and a custom Java batch is required?

Send a file usring SOAP adapter

Can I send a file using SOAP adapter on the sender side.
reg,

Henrique Pinto,
I am trying something out. The scenario I am trying would be a very small but imp part of a bigger business requirement.
I am trying out different options to show the clinet.
<b>1.Started XMLSPY and selected, SOAP>Create new SOAP request>
Now u r asked to browse for the wsdl....DONE. Clicked on OK
Now the request created as an xml file.
2.Go to SOAP> Send SOAP request > there is a new xml file which is the response.
I did not get any errors. I see a file in the target directory.
My problem is where it would really be picking up the data.
WSDL has only referrence to the definition of the message type
(in the definition of O/B interface )</b>
As you have already mentioned that in XI, message type should be refering to file message. If this is the case, how would I incorporate the data in that message.
I hope I am clear.
reg,
Message was edited by:
Naveen Chitluri

Reading a flat file into Oracle

Can someone tell me the best way to read a flat file into Oracle8i?

You can use SQL*Loader
or programmatically with UTL_FILE package.
(Please see documentation of SQL*Loader
and using predefine package UTL_FILE)

Problem while reading multiple files through FTP Adapter

Hi,
We have a requirement to read the excel files placed in an FTP Location and as there is no Adapter to read Excel file
we are using FTP Adapter and reading the Header values of the file(name of the
file) and we are paasing as input to the Java code which will read the data nd insert into the Database.
If we place above 20 files it was reading only some files and some were left and if we delete the files and place the unread files again some files are read and if we do the same procedure then all the files were read.
Any help regaring this appreciated.
Thanks and Regards,
Nagaraju .D

Are you doing anything complex for your polling, e.g. Files that must be n time old.
Can you post the WSDL so I can see the polling configuration. I only need to see the adapter configuration, not the whole file.
cheers
James

Reading huge flat file through SOAP adapter

Similar Messages

Maybe you are looking for