FILE Adapter over HTTP

Hi,
Does anybody know if File Adapter woks with files over http?
For example:
I have a CSV file at http://xxx.com/file1.csv, I want to process this file and send to RFC Adapter.
Can I put "http://xxx.com/" in "Source Directory" of file sender communication channel?
Any sugestions? (FTP is not a choice)
regards,
Luiz Alberto

Hi Luiz,
I don't think this will work with File Adapter.
Thanks and Regardds,
Chandu.

Similar Messages

File upload over HTTP into IFS

The webui classes provide functionality to upload a file over HTTP as multipart/form-data. It takes care of splitting out the boundaries, and other form data, leaving just the file to store in IFS. My question is this:
1. Since the webui classes are not a part of the API, are they supported for development purposes? (i.e, can I mimic the behavior of the webui in my application?) I suspect not.
2. Why doesn't the IFS API provide the ability to handle multipart/form data over http? Even the webcommandapp example application assumes the file is already local to the webserver computer, which leads me to believe it's my responsibility to get it there over HTTP or FTP.

I think the best way out for now is to use the Oreilly classes that are available at : http://www.servlets.com/resources/com.oreilly.servlet/
to handle the multipart-form data;until Oracle provides this feature in a later release of the ADK

Mangled file downloads over http problem in 10g

I have a web app running in an OC4J stand alone 10.1.3.3 and am having a problem with downloading files over http. Its a struts2 app whose file downloading impl is easy to use and standard code for writing to an http servlet response output stream.
Using the firefox plugin for Live Headers I can see that the headers are correctly added to the servlet response and I do get the file I want. However the file has been mangled with binary output around the text. This is the case for txt, word, or any other file.
This problem does not occur in Jetty or Tomcat. I've also ruled out file corruption while going in/out of the database since I can upload a file when running oc4j, turn off oc4j, start up my app in Jetty and retrieve the same file just fine.
The mime types are all accounted for and the problem exists regardless if I use a specific content type or just application/download. My browsers (firefox and ie) also recognize all files from the content disposition value "attachment; filename=myfilename.ext". Its just the file content that some how has been wrecked on the way out of the container.
Has anyone experienced this? I only found one or two unanswered posts elsewhere.
How can this be mitigated?
Thanks in advance.
Andrew

Figured it out when I realized it was in fact the data coming from the database that was corrupt. There were some older posts on the hibernate website that pointed to a single property that needs to go in the hibernate.properties file: hibernate.jdbc.use_streams_for_binary=true. Without it, Oracle returns the Blob locator consistently 86 bytes in length and therefore bad binary.

Help........ How to download an XML file (URL) over HTTP within ESB?

Hi,
There is a requirement to download an XML file from the Web using Fusion middleware. The XML file is available as a URL, and is updated daily.
http://www.ecb.europa.eu/stats/eurofxref/eurofxref-daily.xml
We need to check if this is download is possible from within ESB.
One Oracle consultant reported this to be slightly tricky, but possible through HTTP Binding. We never could get in touch with him again.
So open to the forum.
So please suggest your opinions, and icing on the cake if you can also point to some tutorial or sample code.
Thanks,
Amit

just run a wget on the file and then you can pick it up with a file adapter, I note there is no XSD association with it.

Error using Sender SOAP adapter over HTTPS

Hi experts,
Few weeks ago, i developed an interface as follows: SOAP <-> XI <-> RFC.
I tested the functionality using Altova and everything went well, with HTTP.
However, when i use HTTPS it fails throwing these error messages (pop ups):
<i>"HTTP error: could not post file"......
"Error sending the soap data"</i>
I have reviewed the SSL certificates installation and everything seems to be ok, but currently i am stuck and do not know how to fix this.
I have also change the ID comm channel from HTTP to HTTPS with client aut.
Is there any special service i have to activate? (XI services and SPIGATE are already done)
Could you please assist?
Thanks in advance and best regards,
David

David,
have a look @ these threads...u may get some help!!!
Sender Soap with HTTPS
https Soap Adapter
Regards
Biplab

Problem with parsing large XML files chunked over HTTP

I'm trying to isolate a bug that was introduced when upgrading the JRE in use from Java 7u51 to 7u71 without changing any code. The problem appears to be very similar to: Bug ID: JDK-8027359 XML parser returns incorrect parsing results.
Further investigation showed that it was also introduced in the same versions (7u71) where that fix was applied. Unlike that bug though, my XML is marked as version 1.0. It also appears to be with only large XML files, on the order of 10MB or so.
The closest I've been able to narrow it down to is the code is using JAXB to unmarshall a stream that the debugger tells me is a org.apache.http.com.EofSensorInputStream / org.apache.http.impl.io.ChunkedInputStream. The exception I get is not consistent, but typically appears to be from chunks being overwritten or shuffled, resulting in letters appearing in attributes that are actually numbers, or like the following where an attribute "testAttribute" gets partially overwritten by the end of a timestamp that was in a different section of the XML.
javax.xml.bind.UnmarshalException
- with linked exception:
[javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1,98748]
Message: Attribute name "testAttribu00Z" associated with an element type "testElement" must be followed by the ' = ' character.]
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.handleStreamException(UnmarshallerImpl.java:421)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:357)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:334)
Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1,98748]
Message: Attribute name "testAttribu00Z" associated with an element type "testElement" must be followed by the ' = ' character.
at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:598)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.StAXStreamConnector.bridge(StAXStreamConnector.java:181)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:355)
... 6 more
Here's some code that seems to reproduce it if you can connect to an XML server that returns a large chunked XML file:
SchemeRegistry registry = new SchemeRegistry();
registry.register(
new Scheme("http", 80, PlainSocketFactory.getSocketFactory()));
HttpClient client = new DefaultHttpClient(new BasicClientConnectionManager(registry));
String url = "http://someUrlReturningAlargeChunkedXML";
HttpGet method = new HttpGet(url);
HttpResponse response = client.execute(method);
InputStream inputStream = response.getEntity().getContent();
XMLStreamReader responseReader = factory.createXMLStreamReader(inputStream);
JAXBElement<JaxBObjectOfResponse> wot = unmarshaller.unmarshal(responseReader, JaxBObjectOfResponse.class);
If you connect using URL.openStream() to the same service there is no error. If I read bytes directly and write to a file, there is no error. The error only happens when I try to unmarshal it, and it's large, and I'm using Java 7u71 (or later). It can be consistently repeated with the jsp webapp that I'm using, but didn't show the error when I used the same code with a Wikipedia dump XML file.
How can I unmarshal in a different way to avoid this problem? Or, how can I better isolate the bug so it can be posted to the appropriate bug system?

Apparently, adding the Woodstox XML libraries avoids the bug. Is there anyone who can reproduce this on another system? Was there any changes to the Stax implementation between u67 and u71 that may have introduced a bug like this?
Edit: When setting the logging level to DEBUG, I once saw the overwritten buffer being logged as if that was what was received (as in the testAttribu00Z example above). I can't repeat that anymore though, and very rarely it does parses with no exception (though it may have still been corrupted). Now the error seems to be consistently on one of the buffer boundaries, as in:
17:08:09,705 DEBUG wire:63 - << "2000[\r][\n]"
17:08:09,705 DEBUG wire:77 - << "trend>....OTHER XML...<trend hours=""
17:08:09,705 DEBUG wire:77 - << "634.0972777777778" datetime="2013-05-21T00:43:48.350Z" t"
17:08:09,705 DEBUG wire:63 - << "[\r][\n]"
17:08:09,705 DEBUG wire:63 - << "2000[\r][\n]"
17:08:09,705 DEBUG wire:77 - << "rend-mode="0">
Exception in thread "main" java.lang.NumberFormatException: t34.0972777777778
at com.sun.xml.internal.bind.DatatypeConverterImpl._parseDouble(DatatypeConverterImpl.java:213)
at mypackage.Trend_JaxbXducedAccessor_hours.parse(TransducedAccessor_field_Double.java:48)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.StructureLoader.startElement(StructureLoader.java:194)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallingContext._startElement(UnmarshallingContext.java:486)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallingContext.startElement(UnmarshallingContext.java:465)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.InterningXmlVisitor.startElement(InterningXmlVisitor.java:60)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.StAXStreamConnector.handleStartElement(StAXStreamConnector.java:231)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.StAXStreamConnector.bridge(StAXStreamConnector.java:165)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:355)
at com.sun.xml.internal.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:334)
Or:
17:19:12,563 DEBUG wire:63 - << "2000[\r][\n]"
17:19:12,563 DEBUG wire:77 - << ...OTHER XML...<trend index="5"
17:19:12,563 DEBUG wire:77 - << "" label="N"
17:19:12,563 DEBUG wire:63 - << "[\r][\n]"
Exception in thread "main" java.lang.NumberFormatException: Not a number: N
at com.sun.xml.internal.bind.DatatypeConverterImpl._parseInt(DatatypeConverterImpl.java:106)
at com.sun.xml.internal.bind.DatatypeConverterImpl._parseShort(DatatypeConverterImpl.java:118)

File Adapter: Dynamic file name

Hello,
I would like to use a filename like this:
Name.<DOCNUM>.Direction.<Timestamp>
For DOCNUM I use variable substitution. Works fine.
For <Timestamp> I need a different format as the timestamp function
in file adapter create. So I try to set up my timestamp in mapping like
dynamic file name:
DynamicConfigurationKey key1 = DynamicConfigurationKey.create("http://sap.com/xi/XI/System/File", "Timestamp");
conf.put(key1, a);
Input a is date function which creates my desired timestamp format. In file adapter I try this:
Name.%DOCNUM%.Direction.%Timestamp%
or
Name.%DOCNUM%.Direction.Timestamp
or
Timestamp
all doesn't work for Timestamp.
So is there a possibility to configure a dynamic filename like this???
Is there a possibility to access dynamic configuration variables in dynamic filename except
the known for filename and directory??
thanks
chris
Edited by: Christian Riekenberg on Mar 10, 2009 4:02 PM
Edited by: Christian Riekenberg on Mar 10, 2009 4:05 PM

your file name needs to be
Name.<DOCNUM>.Direction.<Timestamp>
dont use variable substitution. use only dynamic configuration and set the file name
introduce a logic that will create the string
Name.<DOCNUM>.Direction.<Timestamp>
eg. String filename = "Name" + var_docnum + "Direction" + var_timestamp;
then use the dynamic conf code to set the file name and use adapter specific properties in you adapter to retrieve it.
Ref:
/people/michal.krawczyk2/blog/2005/11/10/xi-the-same-filename-from-a-sender-to-a-receiver-file-adapter--sp14
http://help.sap.com/saphelp_nw04/helpdata/en/43/03612cdecc6e76e10000000a422035/frameset.htm

Reading severl files in file adapter sender

Hi all,
I need to read several files and perform checks on there attributes,
like name and date of creation.
and only if the checks are o.k i need to transfer them to, otherwise i need to send an email reporting the error.
I saw in the sender file adapter an option of reading several files, how does it work, how can i perform the checks.
I thing that i can also perform this task using BPM, but from whet I understand it can be problematic when reading big files.
Thanks,
Naama

>>NFS
You are going to pick the files of same types or different types?
If it is of same type: Use below informtion.
file.sourceFileName=<filename>
Specify the name of the file that you want to process.
The name can contain a placeholder (*) at any point, so as to be able to select a list of files for processing.
The following are valid examples for filename:
myFile.txt
my*.txt
*.txt
[Read Multiple Files from File Adapter.|http://help.sap.com/saphelp_nw04/helpdata/en/0d/00453c91f37151e10000000a11402f/frameset.htm]
Names that comprise more than two parts are also permitted.
If the files are of different types the use this approach:
Thanks
Farooq.

Add time Stamp format in File Adapter

Is it possible to change Add Time Stamp format ??
If so please let me know the procedure to chnage it..
It is scenario with no mapping so i cant go either Dynamic configuration or Variable substitotion.
Thanks & Regards,
Polas

Hi,
I think you need to assign it dynamically as you cannot change the format for Add TimeStamp
See the below links:
File Adapter: Dynamic file name
/people/michal.krawczyk2/blog/2005/11/10/xi-the-same-filename-from-a-sender-to-a-receiver-file-adapter--sp14
http://help.sap.com/saphelp_nw04/helpdata/en/43/03612cdecc6e76e10000000a422035/frameset.htm
http://help.sap.com/saphelp_nw70/helpdata/EN/e3/94007075cae04f930cc4c034e411e1/content.htm
Thanks,
Tiny

File Adapter :- Handling Large documents

Hi
I am currently working on File Adapter. Reading large documents and writing the same in to some other file location.
I came across the following techniques:
1. Scalable DOM
2. File Chunk Read.
Can any one help me the exact use cases of the above mentioned techniques in File Adapter.
Thanks

1. Scalable DOM - is used to move/copy large files intact.
2. File Chunk Read - is used to process large documents (it uses a while loop).
When you're using File ChunkRead, you can take a large document with many elements and for each of those elements, perform some operations.
-----------Documentation-----------
**Oracle File Adapter Scalable DOM
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#BABCHCEI
This use case demonstrates how a scalable DOM process uses the streaming feature to copy/move huge files from one directory to another.
The streaming option is not supported with DB2 hydration store.
You can obtain the Adapters-103FileAdapterScalableDOM sample by accessing the Oracle SOA Sample Code site.
**Oracle File Adapter ChunkedRead
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#BABJFCBH
This is an Oracle File Adapter feature that uses an invoke activity within a while loop to process the target file. This feature enables you to process arbitrarily large files.
You can obtain the Adapters-106FileAdapterChunkedRead sample by accessing the Oracle SOA Sample Code site.
An additional reference that may be helpful is, Handling Binary Content and Large Documents in Oracle SOA Suite 11g
http://www.oracle.com/technetwork/middleware/soasuite/learnmore/binarycontentlargepayloadhandling-1705355.pdf

Uses of file adapter

hi all.
iam new to xi.
sorry i want to be sure in one thing i.e
in real time if we r dealing with file to bapi r file to idoc r file to file.
under sender file adapter in what way we will configure .
lets assume like a file to be processed daily when ever a file is placed in sender directty xi should pickup the file and process it to bapir idoc.
so how we can do it.
waitin for reply.
cheers.
seeta ram.

hi;
You need file content conversion if you are not getting in file in xml format .
if you get it as flat file then you will have to use FCC.
refer these for details on FCC.
help link for Receiver file adapter (FCC) - http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
These are a collection of blogs on content conversion (both receiver and sender)
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
Mudit

File Adapter Best Effort...how come?

Hi !
While reading the File Adapter online documentation, it says that it supports Best Effort as QoS...?? I though that QoS = BE is for synchronous interfaces...in what case the File Adapter could work in sync mode?
Tnx,
Matias

Matias,
A classical use case of when you can use a QOS of BE in the file adapter is,
https://forums.sdn.sap.com/click.jspa?searchID=3084724&messageID=3075228
If you look into my response in this thread, the RequestResponseBean is used to change the QOS of file adapter from EO to BE . If you select the QOS as BE in the File Adapter you need not use this module.
Have not given this a shot though!
Regards
Bhavesh

Internet Explorer cannot download over HTTPS if Pragma: no-cache is set

APEX Ver. - 3.2
DB Ver. - 11.1.0.7
Problem : The apex application generates an XML file and saves it to a table. Users navigate to a report where they have a DOWNLOAD link to download the file. Over HTTPS, when the download link is clicked Internet Explorer (IE7) generates an Error Message saying Internet Explorer cannot download apex_util.get_blob from ...
The same functionality works in Firefox and Chrome.
A blog post on MSDN (http://blogs.msdn.com/b/ieinternals/archive/2009/10/03/internet-explorer-cannot-download-over-https-when-no-cache.aspx) describes this problem and one of the reasons contributing to this problem is a pragma declaration of no-cache , is there a way to remove the pragma declaration in the request header?
Thanks,
Ramesh
Edited by: Ramesh on Dec 10, 2010 11:27 AM
Edited by: Ramesh on Dec 10, 2010 11:28 AM
Edited by: Ramesh on Dec 10, 2010 11:29 AM

Dear Markus
Could you please tell me indetail...
Im able to download if im in internal network, bz it is directly pinging from server in IE 6.0 and 7.0. Problem is only with External facing, that too with IE 6.0, 7.0. In firefox im able to downlad the file even using reverse proxy , and internal network.
What i guess is problem within reverse proxy setup & configurations or IE broweser.?
Please suggest
Thanks
PRadeep

Flat file over HTTP or SOAP

Hey Guys,
I need to post a Flat file over HTTP (or SOAP), is this possible without developing my own Adapter module?
I just need to get a Flat file from a FTP server and post to another server via HTTP,since there is no message mapping involved, i developed the scenario without any Integration Repository objects, it is just a pass-through scenario.
Now i am stuck on the receiver side since i am unable to post Flat file over HTTP.
Secondly i have Login URL, Logout URL and upload URL from the receiver system, i don't see any place in receiver HTTP adapter to put all these 3 URL's, can i use SOAP adapter to put all these URL anywhere?
Any help would be appreciated.
Thanks
Saif
Edited by: Saif Manzar on Jan 19, 2010 2:51 AM

Hey Guys,
I need to post a Flat file over HTTP (or SOAP), is this possible without developing my own Adapter module?
I just need to get a Flat file from a FTP server and post to another server via HTTP,since there is no message mapping involved, i developed the scenario without any Integration Repository objects, it is just a pass-through scenario.
Now i am stuck on the receiver side since i am unable to post Flat file over HTTP.
Secondly i have Login URL, Logout URL and upload URL from the receiver system, i don't see any place in receiver HTTP adapter to put all these 3 URL's, can i use SOAP adapter to put all these URL anywhere?
Any help would be appreciated.
Thanks
Saif
Edited by: Saif Manzar on Jan 19, 2010 2:51 AM

File fetch from external souce... http adapter, file adapter, or...

Hi - Hopefully this is a straight-forward question. I need to fetch a file from an external source (vendor) using a url that they provided us. Secondly, the url and file change each run. Here is the scenario:
#1.
- our side (PI 7.11) calls their webservice A to tell them to generate a report, and a report handle id is passed back to us (this part works)
- our side (PI 7.11) calls their webservice B with that report id to get a https url string (this part works). E.g. return url is https://pvab70barp.companyb.com/reports/ODbsPPSBIQxPs/u1/u1_1307128013471215.csv
- our side (PI 7.11) then needs to go fetch the contents of that file... again, the file is over at their site
#2.
The next time we run this we would get an entirely different url string
So to solve #1, it seems to me that the HTTP adapter can be used (can it be used though given the url is https?). I don't think FILE adapter can be used as I believe it needs the file to reside on the local file system.
To solve #2, it appears some dynamic configuration of the url is needed. Is their an easy way?
If anyone has thoughts on these then I would appreciate hearing back from you with your comments. I have not worked with either of these adapters yet.
Thanks,
Keith

1) You can use http or https connection to connect remote server. HTTPS is not an issue. You create RFC destination of type H and there provide login credentials such as client certificates. Use that destination name in the http receiver adapter to use https. Looks like to read the file that is on the http server, you might want to use Java proxy to achieve this. Simple HTTPS communication would not read the file. Or request the client to share it in the network shared drive. so that we can use File adapter to pulll the file.
2) Yes you can use dynamic configuration in the mapping for the dynamic HTTPS URL.

FILE Adapter over HTTP

Similar Messages

Maybe you are looking for