Retreiving files over http or ftp.

I was wondering what program I should use to retreive files over http or ftp. Previously I had used wget per my hosting provider's recommendation. It worked when I was ssh logged in to his server (via Mac Terminal). However, when I try using wget on my local Mac it says "command not found".

Thanks. So if I specify a file name (-o /path/to/file), does the incoming file get renamed to that (and put in that location) or does this specify the directory (-o /path/to/directory) that the incoming file will go to? I wasn't quite clear on that.
Also, I keep hearing about stdout. What is it exactly? I assumed it was just the Terminal window itself, the alternative being things like | more or | nano or something like that... Or am I totally up the wrong tree?

Similar Messages

Flat file over HTTP or SOAP

Hey Guys,
I need to post a Flat file over HTTP (or SOAP), is this possible without developing my own Adapter module?
I just need to get a Flat file from a FTP server and post to another server via HTTP,since there is no message mapping involved, i developed the scenario without any Integration Repository objects, it is just a pass-through scenario.
Now i am stuck on the receiver side since i am unable to post Flat file over HTTP.
Secondly i have Login URL, Logout URL and upload URL from the receiver system, i don't see any place in receiver HTTP adapter to put all these 3 URL's, can i use SOAP adapter to put all these URL anywhere?
Any help would be appreciated.
Thanks
Saif
Edited by: Saif Manzar on Jan 19, 2010 2:51 AM

Hey Guys,
I need to post a Flat file over HTTP (or SOAP), is this possible without developing my own Adapter module?
I just need to get a Flat file from a FTP server and post to another server via HTTP,since there is no message mapping involved, i developed the scenario without any Integration Repository objects, it is just a pass-through scenario.
Now i am stuck on the receiver side since i am unable to post Flat file over HTTP.
Secondly i have Login URL, Logout URL and upload URL from the receiver system, i don't see any place in receiver HTTP adapter to put all these 3 URL's, can i use SOAP adapter to put all these URL anywhere?
Any help would be appreciated.
Thanks
Saif
Edited by: Saif Manzar on Jan 19, 2010 2:51 AM

Hi, I am using HP11 and iPlanet web server. When trying to upload files over HTTP using FORM ENCTYPE="multipart/form-data" that are bigger than a few Kilobytes i get a 408 error. (client timeout).

Hi, I am using HP11 and iPlanet web server. When trying to upload files over HTTP using FORM ENCTYPE="multipart/form-data" that are bigger than a few Kilobytes i get a 408 error. (client timeout). It is as if the server has decided that the client has timed out during the file upload. The default setting is 30 seconds for AcceptTimeout in the magnus.conf file. This should be ample to get the file across, even increasing this to 2 minutes just produces the same error after 2 minutes. Any help appreciated. Apologies if this is not the correct forum for this, I couldn't see one for iPlanet and Web, many thanks, Kieran.

Hi,
You didnt mention which version of IWS. follow these steps.
(1)Goto Web Server Administration Server, select the server you want to manage.
(2)Select Preference >> Perfomance Tuning.
(3)set HTTP Persistent Connection Timeout to your choice (eg 180 sec for three minutes)
(4) Apply changes and restart the server.
*Setting the timeout to a lower value, however, may prevent the transfer of large files as timeout does not refer to the time that the connection has been idle. For example, if you are using a 2400 baud modem, and the request timeout is set to 180 seconds, then the maximum file size that can be transferred before the connection is closed is 432000 bits (2400 multiplied by 180)
Regards
T.Raghulan
[email protected]

Play an audio file over HTTP

Hello everybody,
I'm trying to play an audio file over HTTP protocol. The code is the following:
public class HTTPClientJMF {
     static String url = "http://localhost/audio/Reklam1.wav";
     static String urlFile = "file:///C://tmp/audio/Reklam1.wav";
      * @param args
     public static void main(String[] args) {
          // TODO Auto-generated method stub
          try {
               DataSource dataS = new URLDataSource(new URL(url));
               dataS.connect();
               Player player = Manager.createPlayer(dataS);
               player.start();
          } catch (MalformedURLException e) {
               // TODO Auto-generated catch block
               e.printStackTrace();
          } catch (IOException e) {
               // TODO Auto-generated catch block
               e.printStackTrace();
          } catch (NoPlayerException e) {
               // TODO Auto-generated catch block
               e.printStackTrace();
}Now, if I'm trying to play the file from the local disk (+urlFile+ - using file protocol), everything goes well, but if I'm trying to play the same file from the network (using http protocol) I get the following exception:
javax.media.NoPlayerException: Cannot find a Player for: javax.media.protocol.URLDataSource@fa9cf
Can somebody tell me what I'm doing wrong?
Thank you!

Ah',..okay. I constructed the DataSource like follows:
Buffer mediaBuffer = new Buffer();;
          String mediaURL = "http://ares.inescn.pt/video/Reklam1.wav";
          URL url;
          try {
               url = new URL(mediaURL );
               InputStream in = url.openStream();
               BufferedInputStream bufIn = new BufferedInputStream(in);
               for (;;) {
                    int data = bufIn.read();
                    // Check for EOF
                    if (data == -1)
                         break;
                    else
                         mediaBuffer.setData(data);
               System.out.println(mediaBuffer.getLength());
               if (mediaBuffer.getLength() != 0) {
                    DataSource ds = new DataSource();
                    HttpStream[] httpStream = ds.getStreams();
                    System.out.println(httpStream.length);
                    httpStream[0].read(mediaBuffer);
                    ds.connect();
                    ds.start();
                    Player player = Manager.createPlayer(ds);
                    player.start();But I still cannot play an audio file (wav format) over the HTTP. Application starts but nothing happened.
I make the modification like you suggested. (into the DataSource, more exactly for method getStreams()).
I renamed as well the HttpDatasource into HttpStream.
Did you actually tried the code? I've been reading the instruction how to test the code but I did not be able to run the example.

Downloading Text file over http

Hi,
I am trying to display some plain text files over http to the client using a web browser. Everything works fine till the time the file size is small, but for the files of over 1MB the frontend just dies. Probably the display happens only after the complete transfer of the file.
Does any one have the solution by which the text files can also be downloaded similar to the html files i.e. incrementaly. I have the code of transferring the html file over http as it happens in the explorer. But the same does not seem to work on the plain text files.
Please help
Sachin

I do not have any Remote server written for this. What i am doing is, the directory in which the files are stored is exposed as a virtual directory through a web server(Apache) and then from client i am just placing a http request to open this file.
So what i can do under this situations to handle the large files.

Downloading files over HTTPS

how can i upload files over https
can you give me some links to web sites that explain this
thank u

Hi..
Have you got the information yet ?
I need more information for uploading file in https.
Thanks in advance

Cannot download file over https behind firewall ?

I have a program to download files :
public class TestServlet
     public static void main(String args[]){
    Authenticator.setDefault(new AuthImpl());
     if (args.length!=2){
      System.out.println("Proper Usage: java -Dhttp.proxyHost=172.21.32.166 -Dhttp.proxyPort=80 TestServlet RemoteFileURL LocalFileName");
       System.out.println("Usage Example:java -Dhttp.proxyHost=199.67.138.83 -Dhttp.proxyPort=8080 TestServlet https://url.com/csv/file.zip file.zip");
      System.exit(0);
     DataOutputStream out=null;
     FileOutputStream fOut=null;
     try
      trustAllHttpsCertificates();
      String urlStr = args[0];
          HostnameVerifier hv = new HostnameVerifier() {
               public boolean verify(String urlHostName, SSLSession session) {
                    System.out.println("Warning: URL Host: "+urlHostName+" vs. "+session.getPeerHost());
                    return true;
         HttpsURLConnection.setDefaultHostnameVerifier(hv);
          System.out.println("\nConnecting to Website . . . "+urlStr);
          URL url = new URL(urlStr == null ? "https://url/Downloads/WC.csv" : urlStr);
          System.out.println("\nConnecting . . . . ");
          BufferedReader in = new BufferedReader(new InputStreamReader(url.openStream()));
          System.out.println(". . . Connected");
          System.out.print("\nDownloading the file . . . ");
          int buff;
          fOut=new FileOutputStream(args[1]);
          System.out.print(" . .");
          out=new DataOutputStream(fOut);
          System.out.print(" . .");
          while ((buff = in.read()) != -1) {
            fOut.write(buff);
          in.close();
        System.out.println(" . . . Done \n");
      catch (Exception e) {
            e.printStackTrace();
       finally {
          try{
               fOut.flush();
               fOut.close();
               System.exit(0);
           catch(Exception e){
               e.printStackTrace();
    HostnameVerifier hv = new HostnameVerifier()
        public boolean verify(String urlHostName, SSLSession session) {
            //System.out.println("Warning: URL Host: " + urlHostName + " vs. " + session.getPeerHost());
            return true;
    private static void trustAllHttpsCertificates() throws Exception
         // Create a trust manager that does not validate certificate chains:
        javax.net.ssl.TrustManager[] trustAllCerts = new javax.net.ssl.TrustManager[1];
        javax.net.ssl.TrustManager tm = new miTM();
        trustAllCerts[0] = tm;
          javax.net.ssl.SSLContext sc = javax.net.ssl.SSLContext.getInstance("SSL");
        sc.init(null, trustAllCerts, null);
        javax.net.ssl.HttpsURLConnection.setDefaultSSLSocketFactory(sc.getSocketFactory());
    public static class miTM implements javax.net.ssl.TrustManager, javax.net.ssl.X509TrustManager {
        public java.security.cert.X509Certificate[] getAcceptedIssuers() {
            return null;
        public boolean isServerTrusted(java.security.cert.X509Certificate[] certs) {
            return true;
        public boolean isClientTrusted(java.security.cert.X509Certificate[] certs) {
            return true;
        public void checkServerTrusted(java.security.cert.X509Certificate[] certs, String authType)
                throws java.security.cert.CertificateException {
            return;
        public void checkClientTrusted(java.security.cert.X509Certificate[] certs, String authType)
                throws java.security.cert.CertificateException {
            return;
   public static class AuthImpl extends Authenticator {
   protected PasswordAuthentication getPasswordAuthentication() {
      String username = new String("guest");
String password = new String ("guest");
       return new PasswordAuthentication(username, password.toCharArray());
}This program works fine for downloading files, over both http and https from my home. When I run this on my desktop in the office it can download files over http, but cannot download https files.
When I try to download files over https, I get the foll. exception:
java.net.UnknownHostException: www.site.com
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:153)
at java.net.Socket.connect(Socket.java:452)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(DashoA12275)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.<init>(DashoA12275)
at com.sun.net.ssl.internal.ssl.SSLSocketFactoryImpl.createSocket(DashoA12275)
at sun.net.www.protocol.https.HttpsClient.doConnect(DashoA12275)
There are 2 differences here, one being that my office desktop sits behind a firewall and there is a proxy in between.
In the office I run the program as :
java -Dhttp.proxyHost -Dhttp.proxyPort TestServlet URL [filename]
eg.:
java -Dhttp.proxyHost=235.67.138.84 -Dhttp.proxyPort=8080 TestServlet https://site.com/portal/Downloads/file.csv file.csv
This url requires authentication, the userid and pwd are hardcoded in the code.
Now, my problem is I cannot understand why this error would come. Is it because of the firewall or because of the proxy ?
Why is it that I can download over http successfully from my office desktop? If the problem is with the firewall or proxy, then even http protocol urls should give the same problem.
Please help.
Vinay
Message was edited by:
vinay_dsouza
Message was edited by:
vinay_dsouza

If you are using HTTPS you should be setting
https.proxyHost
https.proxyPortnot the http.* ones.

Post file over Http

Hi All,
I am working on EDI scenario in which EDI partner has given one HTTP site address with user name and password. I will have to put EDI file at that site using http/soap adaptors at receiver end.
One thing I know for sure that I can not use File channel at reveiver side as there is no FTP available. Now Can anybody please let me know how to generate file using http connection?
I have absolutely no idea how to use http and soap adaptors so if any links to the blogs will also be helpful.
Thanks in advance,
Atul

Hi Aamir,
Thanks for your reply.
I just want to generate a file at given location. I am confused what is the difference in data sent as a payload or as attachment?
As you said in case of attachement we need to use some modules(Looks bit difficult ) I would perhaps like to generate file by using Payload .
Can you suggest some blog for the same?
Thanks and Regards,
Atul

INDD files on Http or FTP

We have a NAS storage device that hosts files using http protocol.
When we upload .indd files to the server, and try to download them using http or ftp protocols, the browser freaks out and doesnt know what to do with them.
Is this a known issue? Should we be zipping them up and uploading them?
Any help is appreciated.

Nevermind, Http is the problem, not FTP.

Wiki CSS files over HTTPS use only RC4

I finally found the answer to my problem of why the wiki CSS files wouldn't load.
It turns out that the wiki forces an HTTPS connection and it retrieves the CSS files from https://d11xdyzr0div58.cloudfront.net. The encryption used for those CSS files uses 128-bit RC4 with MD5. In Firefox, the about:config parameter name is
security.ssl3.rsa_rc4_128_md5
I had turned off all RC4-based encryption for SSL3 in about:config because RC4 is old and not appropriate for secure use in the modern day. Since SSL works by the server offering to the client all of the encryption algorithms it's willing to use, and then the client selects the ones it likes, my assumption was that if the encryption parameters for a connection include RC4 Firefox would just not ever pick one of the RC4 options. However, I had no idea that there would be a website that ONLY offered RC4. My guess is that this is the case for the wiki's CSS file server, because only by turning on the about:config parameter mentioned above can I get the CSS files to load.
Is there a way to address this issue? Preferably, either the CSS file server needs to support alternative algorithms (it looks like a cloud host, is that under our control at all?), or the wiki needs a way to be viewed in non-HTTPS mode. I don't care about the security of the wiki CSS files, I care about having RC4 turned on in Firefox -- I shouldn't have to enable it.
I considered filing a feature request, but I wanted feedback first.

A couple of years ago, I wrote an extension for Firefox called CipherFox (see my sig below). One of its features is disabling RC4 in about:config. I've had RC4 disabled all this time, and the Arch Wiki is the first time I've ran into trouble with it being disabled.
I too don't care much about the CSS files being encrypted. Here's what I did a couple of months ago as a crappy, hacked-up workaround:
(1) A Greasemonkey script to change link and script href's to point to http instead of https:
// ==UserScript==
// @name Archwiki Cloudfront SSL
// @description Removes SSL from Cloudfront href's
// @version 1.0.0
// @author MkFly
// @include http://wiki.archlinux.org/*
// @include https://wiki.archlinux.org/*
// ==/UserScript==
var head = document.getElementsByTagName('head')[0];
var link = head.getElementsByTagName('link');
var script = head.getElementsByTagName('script');
var cloudfront = "d11xdyzr0div58.cloudfront.net";
for (var i in link) {
link[i].href = link[i].href.replace("https://" + cloudfront, "http://" + cloudfront);
for (var i in script) {
script[i].src = script[i].src.replace("https://" + cloudfront, "http://" + cloudfront);
(2) With that installed, loading the Wiki pages was still delayed while it tried to connect via SSL and waited to time out. I worked around that by blocking them with Adblock Plus:
|https://d11xdyzr0div58.cloudfront.net/*
I know this is a hacky way to do it, but it works for now. Hopefully Cloudfront will let us use something better than RC4 in the future.
Last edited by MkFly (2011-01-26 05:29:22)

Header variable: Content Disposition for downloading file over HTTP?

Hi All,
I have a general content server question...Is there anyway to pass a parameter or set a setting on the content server to send the file with the header variable content-disposition set so that when a user selects a file within a browser, it doesn't open in place but asks the user whether they want to open or save the document?
Note - I'm actually using this with ArchiveLink and displaying the link in the Portal but this forum seems the closest I can get to asking this question.
Regards,
Matt

Thanks Athol.
Although there's quite a bit of configuration options there for displaying files, there doesn't appear to be anything that let's you manipulate the HTTP header variables to set content-disposition.
Any other ideas?
Cheers,
Matt
ps. If you want to artificially see the behaviour I'm after, within IIS, you can predefine this header variable for the contentserver.dll but this makes every HTTP request act like a file that wants to be downloaded, and it calls every file contentserver.<suffix>. From a user perspective, there's nothing worse than a document opening in place in your window (losing the underlying application), or within another IE window, hence why I'd like it to act like a file download.

Unable to serve .APK file over HTTPS

I have created an .APK mime type and put up a test APK on the default IIS site. Everything downloads fine on an Android handset.
Mime-type : application/vnd.android.package-archive
I've then created a NEW site to host this file and added the same mime-type etc. When I download the file on an Andoird handset it sees the site, link and file, and when selected it begins a download but immediately fails.
The filename is and the error message is "Download Unsuccessful".
Even changing to a default mime-type - application/octet-Stream same problem occurs.
I'm sure its a configuration or permissions issue for IIS but I cant figure out what. I've replicated the NTFS permissions from the default wwwroot folder to this new site.
The only difference is the new site is HTTPS while the default site is HTTP. If I allow HTTP on the new site it works fine.
EDIT: Forgot to add that a desktop browser (Chrome and IE) both download the file fine from the default and new site.

Hi,
I notice the issue is more related to IIS. Since IIS has its specific forum to provide professional support, I suggest you report the question there. Thanks for your understanding.
http://forums.iis.net/
Niki Han
TechNet Community Support

NetStream doesn't play mp4 packaged with app - but plays same file over http

I'm using StageVideo to play an h264 encoded mp4 file in an iPhone app.
When I package the mp4 file with the app (in the root), the app doesn't play the video at all. When I simply change the video's location to a http location where the exact same file is located, it plays fine.
In other words, the only change I'm making is:
Packaging mp4 in root of app:
var _videoURL:String = "video_h264.mp4" ;
_nc = new NetConnection ( ) ;
_nc.connect ( null ) ;
_ns = new NetStream ( _nc ) ;
_ns.client = this ;
_ns.play ( _videoURL ) ;
_stageVideo.attachNetStream ( _ns ) ;
to
Hosting video remotely:
var _videoURL:String = "http://www.myDomain.dk/video_h264.mp4" ;
_nc = new NetConnection ( ) ;
_nc.connect ( null ) ;
_ns = new NetStream ( _nc ) ;
_ns.client = this ;
_ns.play ( _videoURL ) ;
_stageVideo.attachNetStream ( _ns ) ;
Does anyone know if there's some restriction when using NetStream that could explain this?

You can get away with just the relative path. But, do make sure you added the folder with the videos in the General tab.
Another thing to know, you may not get a StageVideoAvailabilityEvent.STAGE_VIDEO_AVAILABILITY, that may have already happened before you start looking for it. In case like that you can get remote videos to work, and local videos will sometimes work. Seems to be amateur of timing.
The way I worked around that issue was to check the stagevideos before listening for the event. Like this:
if ( stage.stageVideos.length >= 1 ) {
enableStageVideo();
}else{
stage.addEventListener(StageVideoAvailabilityEvent.STAGE_VIDEO_AVAILABILITY, _onStageVideoAvailability);
That seems reliable. enableStageVideo is just a function to set up the stageVideo variable, and its viewPort.

Send xml file over https - urgent

Helo everybody.
I need to solve next problem:
1. Build/Use a client program that can operate with the HTTPS protocol. There are no restrictions on the type of client program used, providing it can use this protocol and deal with transactions synchronously.
2. Build/Use a program that can build a valid request XML document and attach it via a POST parameter to a HTTPS request.
POST /<URL_TO_SUBMISSION_SITE> HTTP/1.0
Example
User-Agent: HTTPTool/1.0
Content-Type: application/x-www-form-urlencoded
Content-Length: 9999999
<XML_DOCUMENT> 􀃅Post Payload
or
POST /<URL_TO_SUBMISSION_SITE> HTTP/1.0
User-Agent: HTTPTool/1.0
Content-Type: application/x-www-form-urlencoded
Content-Length: 9999999
xml=<XML_DOCUMENT>
3. Ensure the program can retrieve the HTTPS response and parse the returned XML payload.
4. Ensure the program can correctly interpret the inquiry response information within the XML return.
Please help me in point 2. I don't know how to attach xml document to https request.
I'm trying something like this :
System.setProperty("java.protocol.handler.pkgs",
"com.sun.net.ssl.internal.www.protocol");
try {
url = new URL("https://" + path);
} catch (MalformedURLException e) {
// TODO Auto-generated catch block
e.printStackTrace();
URLConnection con = null;
try {
con = url.openConnection();
con.setDoInput(true);
con.setDoOutput(true);
con.setAllowUserInteraction(true);
con.setRequestProperty("Content-type", "application/x-www-form-urlencoded;charset=Cp1250");
con.setRequestProperty("Content-Length","9999999");
} catch (IOException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
but without success. Please help

Just saw a link, may be this will help you : http://resellers.tucows.com/documentation/xmlhttpspost.pdf

FILE Adapter over HTTP

Hi,
Does anybody know if File Adapter woks with files over http?
For example:
I have a CSV file at http://xxx.com/file1.csv, I want to process this file and send to RFC Adapter.
Can I put "http://xxx.com/" in "Source Directory" of file sender communication channel?
Any sugestions? (FTP is not a choice)
regards,
Luiz Alberto

Hi Luiz,
I don't think this will work with File Adapter.
Thanks and Regardds,
Chandu.

Retreiving files over http or ftp.

Similar Messages

Maybe you are looking for