File Data over FTP

Hello everyone,
I have a project in which I need to generate stats about a directory that is only accessible over FTP. The FTP folder could sometimes have 6,000 files in it (maybe more). I've tried several different FTP libraries, but none of which have really had what I need.
I do not need to manipulate the files at all, I just need to grab data on them... such as the filename and date modified.
I'm really stumped on this, could anyone give me some direction as to what approach I should take on this project? Am I crazy for trying this is Java?
Thanks in advance,
-mc88

I've decided FTP is probably the wrong approach for this, so I'm putting a script on the server to run ls, output the list to a text file. and then download it to java.
But if anyone has any better ideas. Let me know! :-)

Similar Messages

PSD files sent over FTP given 1kb file size, archived, and have .bin appended to extension

I'm trying to deliver PSD files to someone over our server's FTP. If the FTP shared folder is accessed via a browser (like safari which is the main thing I've been testing on), the files in are listed as being only 1kb in size when each is approximately 60MB and all have had .bin appended to the .psd file extension. When the file is downloaded it's still 1kb and when opened it is associated with the archive utility which attempts to unarchive it and produces and identically named and extensioned file of 4kb size which cannot be opened by preview or text edit or photoshop.
Changing the extension does not help as suggested here http://forums.appleinsider.com/archive/index.php/t-25119.html . Also if the file is downloaded via 3rd party FTP software like cyber duck, though the file size is listed as 1kb, the correct size file is downloaded though still has the .bin extension. When this full sized .bin file is opened, archive utility instead of unarchiving attempts to archive it and produces a file roughly half the size which too cannot be opened. Speaking with apple care resulted in the suggestion that I use terminal command line to force the client to use binary mode when downloading the file which also downloads a file of correct size but with the .bin extension and that can not be opened.
Is this a known issue with PSD files? I've not come accross this before, the server is configured correctly and different file types are successfully downloading with no changes to size or extension and then opening as they should upon receipt at the client side.

Hi and thanks,
that was my next port of call but I stumbled across a more permanent fix. Mac OSX server automatically converts files sent over FTP to something called MacBinary on the fly and it seems this process doesn't agree with PSD files. Someone else encountered this problem back in 2003 and found this solution
http://forums.appleinsider.com/archive/index.php/t-25119.html
speaking to apple care they also sent a link for the official mac instructions for achieving the same thing here
http://support.apple.com/kb/TA20996
and here
http://support.apple.com/kb/TA20645?viewlocale=en_US
in the second explanation it's important to note for anyone attempting to follow this that if you're fixing the problem on MacOsX server rather than just MacOSX it isn't necessary to enable the root account as it is automatically enabled by default. Simply log out and log back in as root and use the same password as the first administrator account you set up when the server was first configured.

How secure is USB disk file data over the Internet?

I have an Airport Extreme with an external USB drive attached. I can successfully connect to the drive both from the internal network (LAN) and from the Internet. I have secured my drive using user accounts granting either read-only or read-write access. When connecting from the Internet, how secure is the data when it is being transferred over the Internet between the USB drive and my remote device (Mac, iPhone, iPad, etc.)?

Thank you, Kappy. I sincerely appreciate your input.
It appears that the Airport Express "Share On WAN Port" is not really a secure connection. File data is not secure as it is transferred over the Internet, which is what I suspected. So, in order to secure the data one would need to establish a VPN (or equivalent) connection to the local network and then access the Airport Extreme disk data via the VPN connection. I should note that in this scenario the "Share On WAN Port" would not be needed and should probably be disabled. For me, a VPN connection is necessary unless I only want to store and share files and data that I don't mind others obtaining while in transmission.
This is what I expected, but was hoping for something along the lines of what Apple's Messages does, which encrypts data from end-to-end between two (or more) users in a conversation to ensure the data/content is secure.
Thanks again.

NW6.5 FTP-file-mismatch with FTP over TotalCommander

Hello *
We use the FTP-Service within the TotalCommander-Program (TC from
www.ghisler.com) to access a NetWare-NSS-Volume.
Some filenames contains periods and space characters also
(e.g. "1.2 Chapter x.pdf".)
After a couple of weeks (~80 days) the displayed file-name changes: This
happens within the TC-FTP-access only. All other access-methods (MS-FTP;
Novell-NetStorage; NCP - Windows-Explorer) are showing the name correctly.
e.g.
access over NCP, MS-FTP, NetStorage | access over FTP within TC
displayed filename |(after ~80 days) displayed filename
------------------------------------|----------------------------
"2.1 Chapter ONE.pdf" |"Chapter ONE.pdf"
This happens from every PC at the same time, so there have to be some
changement on the NetWare-Server.
Volume compression is disabled (nssmu.nlm)
We have to copy or open and save the file again to get rid of this for
the next ~80 days ...
Any idea?
oskar

Thank you - Andrew,
yes, SOPHOS-Anti-Virus is installed, and there is a regularly Backup-Job
also. But both are running weekly ...
Anyway, we have to move the data to a new OS ... (could be a solution
for this ...)
By the way, Symantec-Backup-Exec-Support told me, that restoring the
trustee-rights (from a NetWare-NSS-Volume-Backup) to a OES-NSS-Volume is
not supported ("reason: ... it is another OS!").
Can you recommend a smooth method to move the data from NW to OES?
Kind regards
Oskar
Am 01.02.2012 22:56, schrieb ataubman:
>
> OK, well that's fine. I have no idea what your problem is, there is no
> automatic process on NW that runs every 80 days. The closest I can think
> of would be the NSS background check; Normally it runs 5 days after the
> server comes up and every two weeks thereafter.
>
> Do you have perhaps an anti-virus or backup that runs a scan regularly
> over the volumes at that interval?
>
> That aside all I can suggest is a rebuild:
>
> nss /poolrebuild /purge
>
>

Internet toolkit get file date without year using ftp!!!

Hi!
I'm using "FTP Directory Listing.vi" to get the modification date of files on a ftp server (PXI-RT): I only get the time, day and month of the last modification but I do not get the year (For example: Aug 3 04:52)!?!
Have anybody an idea how to get the complete date information (For example: 2005 Aug 3 04:52)?
Thanks in advance for your help!

I agree with Corey that you may have issues with the host computer blocking your VI, but the error 15425 seems to fix itself if you change the ftp mode from active to passive. The default is true, but wiring-in a false constant should take care of the error and enable successful file transferring.
The reasons for this are explained here.
National Instruments
RIO Embedded Hardware PSE
CompactRIO Developers Guide

File upload over HTTP into IFS

The webui classes provide functionality to upload a file over HTTP as multipart/form-data. It takes care of splitting out the boundaries, and other form data, leaving just the file to store in IFS. My question is this:
1. Since the webui classes are not a part of the API, are they supported for development purposes? (i.e, can I mimic the behavior of the webui in my application?) I suspect not.
2. Why doesn't the IFS API provide the ability to handle multipart/form data over http? Even the webcommandapp example application assumes the file is already local to the webserver computer, which leads me to believe it's my responsibility to get it there over HTTP or FTP.

I think the best way out for now is to use the Oreilly classes that are available at : http://www.servlets.com/resources/com.oreilly.servlet/
to handle the multipart-form data;until Oracle provides this feature in a later release of the ADK

File sender adapter (FTP) - processing mode "Archive"

Hello all
We're polling files from an external FTP server. For this I created a scenario on XI according to this thread:
When setting processing mode to "Archive" in the file sender adapter (ftp) it polls the file, stores it to the archive directory I specified and then tries to delete the file on the FTP server side. This returns me an error because we're not allowed to delete the retrieved files on the FTP server!
Because of this error the file adapter stops further processing and does not poll all the other files.
How can I disable this deletion mechanism while keeping processing mode to "Archive"?!?!?
We do not want to use processing mode "Delete" or "Test" and we don't see other options to influence this behaviour.
Thanks for any guideance on this one in advance!
Kind regards,
Renaud

Hi Bhavesh
Sorry for the late answer. Unfortunately I can't ask the application system to provide file names containing a timestamp within. The files are provided by an external partner and are retrieved by several others as well.
In the meantime I managed to achieve this:
In repository I created dummy data types, message types and message interfaces. No mapping programs and interface mappings!
In configuration I created the necessary communication channels (1 ftp sender, 1 file receiver) and the required receiver and interface determinations as well as the sender and receiver agreements.
The result of this is:
I'm able to poll some specific files via ftp from remote host. The file names are file1.arj, file2.arj, file3.arj and file4.arj. All 4 files have the same SourceFileTimestamp (e.g. "20060727T053900Z").
I'm able to store those 4 files 1:1 in a target directory with the same file names. Until here I did NOT need to follow this blog: <a href="/people/michal.krawczyk2/blog/2005/11/10/xi-the-same-filename-from-a-sender-to-a-receiver-file-adapter--sp14: The same filename from a sender to a receiver file adapter - SP14</a>.
As of this blog it is possible to access adapter specific attributes and make them available in message mapping using user defined functions. This way I'm able to get the SourceFileTimestamp from the polled files and use it in a message mapping. This way I'm also able to use it in variable substitution on file receiver adapter (syntax = "payload:root,1,fileTS,1") in order to dynamically create a directory with this syntax: YYYYMMDD.
So far so good... but the only remaining BIG problem now is, that as soon as the mapping is activated and assigned in the interface determination, the created files contain the XML payload instead of the original binary content. Where has it gone? How should the target message type look like so that it can carry over the original binary file content?
BTW: isn't it possible to post screenshots? Would be much more easier to explain things... so sorry to anyone if I wasn't clear enough!
TIA and best regards,
Renaud

Retriving live data frm FTP.

We are doing some data anaylis for solar power outputs.
Omron Data Logger will log the datas into webbrowser .
Is there a way that we could read the datas value directly fromFTPconnection.
I dont think you all can acces to my FTP link as it has location restriction.
i will upload the picture of how our values are looks like and the values will be updating every 5-10s.
can someone give suggestions onthis?thanks
Attachments:
url.png ‏60 KB

What do you mean by "data processor as buffer"?
You need to understand the difference between FTP and HTTP (web). These are different protocols.
Can you connect to the data logger over FTP, or only from a web browser? The datasheet to which I linked earlier does not indicate that there is an FTP server on your logger, but that datasheet may not be complete. Where are you getting a GBD file? Do you have the format of that file? If you do have an FTP server available, the Internet Toolkit includes FTP VIs which will make it easy to retrieve the file.
I still do not understand why you are insistent on using the browser. If the data logger supports real-time data gathering over ethernet - and it appears that it does - then that is probably easier than trying to parse a web page. You have access to the logger over the web, so you should be able to access it using another protocol as well - for example whatever protocol is required for the real-time data gathering.

Help Fetching files from an FTP server into a DBase or local folder

Hello Gurus!
I need help to automate or design/write an app capable of (replace a manual process) reading log files in an ftp server folder, this log files are called CDR (Call Detail Record) and named as follow cdr.txt.20020221010000 meaning that this log file was created on 2002/02/21 at 01:00:00.
This CDR log files are generated every hour by a Lucent telephone switch using a software/program called EXS ExchangePlus in ASCII format (fixed length delaminated, Char data type). EXS ExchangePlus writes a record in this CDR/log files after the call is completed, i.e. Calling_Number, Called_Number, Date_connect (yyyymmdd), Time_connect (hhmmss), Charged_time (hhmmss, duration of the call), and so on.
The manual process I am using now is:
1. Log in the ftp server into the folder where the CDRs log files are, located the latest generated CDRs log files and downloaded them into a local folder/directory. Normally I download the CDR for full day or 24 CDRs log files.
1a. Optionally sometimes I used a program called VEdit compiled/gather all 24 CDRs into a single file.
2. Once I have downloaded the CDRs I want to process (normally I process a full day 24 CDRs) I imported then into a Data Base temp table, where then I do the conversion of data types (i.e. Dates and times fields from char type -> to ->Date type) and calculations for billing purposes.
So if somebody can help with this, I would really appreciated ideas or any kind of information on how to automated this process.
I�m familiar with Java2 platform (using JDeveloper ) so if somebody has done something like this before using java, this would very helpful. Or Maybe using Visual Basic 6.0 would help too.
Thanks Gurus, and I look forward to hear from you soon!
Alf Pathros!

Thanks for the idea, even though an example would help me more.
I already found the FTPClient class.
I also would like to knwo if there is a away Ican append/merged various files CDRs into a single/one to then dump/import it into the database

Extracting .xls file from an FTP site

Hi there,
I'm trying to run a DI solution that is extracting a file from a FTP site. DI can see the file but it gives me an error saying that:
FTP could not transfer file <FTP site/myfile.xls> from host <IP Address>: <>. Please ensure that the FTP relative path for the SAP R/3 working directory is set correctly such that the data file is accessible to the FTP
Can someone please help with this.
Thank you.
Gsecure

Hi,
thats SP1 for DS XI 3.2
I think there is no delta from XI 3.2 to XO 3.2 SP1 what means you have to do a fresh install and upgrade repo.
But you better doublecheck before but i think there is no delta.
Regards
-Seb.

Extract .xls file from an FTP site

Hi everyone,
Can anyone assist with this, I'm trying to extract an .xls file from a FTP site. The system I'm currently working on has no SAP application installed, we are using Microsoft SQL server as the target database and there is an FTP site which contains the .xls/.csv files and Data services as a ETL tool. The error I'm getting is 'FTP could not transfer file </DI_TEST/DATA_TO_IMPORT_1.xls> from host <www.servername.com>: <T>. Please ensure that the FTP relative path for the SAP server working directory is set correctly such that the data file is accessible to the FTP program. Also, ensure that the target path, where the transferred file is written to, is correct.'
Do I need to have SAP installed to use this functionality?
Currently to make this work, I wrote a .CMD file to do the GET ftp code and I then call this with a DI script and it works perfectly. Isn't there a way I can do this independant of the .CMD?
I'm sorry for bring this up again, I know I had a similar thread before. The reason why I closed it is that I did it using .CMD, I would prefer if I can do it with DI without using .CMD.
Thank all for your help.
Kind regards,
Edited by: gsecure on Apr 19, 2010 10:26 AM
Edited by: gsecure on Apr 21, 2010 11:08 AM

Hi There,
I've a similar issue. Can anyone assist with this, I'm trying to extract an .xml file from a FTP site. The system I'm currently working on has no SAP application installed, we are using Microsoft SQL server as the target database and there is an FTP site which contains the .xml files and SAP Data services as a ETL tool.
Thank you
Mohan

320N Freezes when trying to transfer data over wifi

I have the 320N and I am very frusterated. I would just take it back, but I bought it brand new on Amazon.com, meaning I will have to pay shipping because I threw out the box and the return shipping form for RMA's! I don't even know if Amazon will take it back without that paperwork, but anyway here's the issue...
I don't have any N cards yet, but I upgraded to this router because my home internet service is faster than what my older WRT-54g could route. This new router does route and I can now achieve the rated speeds of my ISP (50/10 mbps).
I can transfer large files 6+ GB WIRED between any of the LAN ports on this device. However if I try to transfer much data over wifi, the router will simply stop working. The lights on the front work fine, they blink like there is activity, and the power LED is solid, but it won't pass traffic and the wifi SSID dissapears. I run a constant ping to the router (ping -t 192.168.1.1) and I get <1ms replies. On my laptop I initiate a download of a 1GB file which is shared in my windows 7 homegroup. Within a minute or two the constant ping to the router starts timing out. Internet access to anything (wired or wireless) instantly ceases. New introduced devices will not grab a DHCP address. Existing PC's whom already have their DHCP address can talk to each other only if wired. The wireless transmitter stops broadcasting the network and devices no longer see it on the airwaves. The only way to fix it is to power cycle it.
It doesn't even have to be a large file over wifi to transfer. Just now as I'm typing this post I noticed the constant ping on my other monitor started timing out. I power cycled the router in time for me to submit this post. In fact I had to do it three times in the time it took me to write this post. This is the most frustrating experience I've had with any wifi ap/router, and I play with Cisco gear at work that run real IOS.
Here's what I tried so far.
Reset factory defaults by holding in the rear reset button for over 30 seconds.
I can confirm this resets the defaults as the password and all other settings are back to default.
I tried WPA2 Personal. I tried WPA. Router still freezes.
I tried it with just the default settings. Router still freezes.
I've reset the router numerous times. Still freezes.
Power cycle it for more than a minute. Still freezes.
Reflash it with Linksys's latest firmware. Still freezes.
What do I do next? I have a feeling it's the same problem as in a lot of the HP Printer firmware boards. That problem is poor solder joints on the BGA processor connection. To fix that you put the formatter board in an oven at 400 degrees for 5 to 8 minutes. After that time you just let it cool to room temperature. The oven heats the poor solder joints enough so that it reseats and gets a better connection. There are hundreds of posts of success on this. I also hear that the solder connection problem exists for many of the older revision Xbox 360 game consoles causing the infamous "Red Ring of Death".
So do I try to fight with Amazon to take this back and eat the shipping?
Do I void my warranty, open the device up and put the board in the oven?
Do I buy another router from a closer store, but then put this one in the box and take it back?
Do I just cut my losses?
Do I just use this as a wired router (disable Wifi) and hook up my WRT-54g and make that act as just an access point?
Thanks for the advice.
Solved!
Go to Solution.

Ok I've had my replacement 320N for almost 1 full week now, and while at first it was fine, come Sunday it appears to freeze during heavy transfers. I was streaming an HD movie to the laptop connected to the TV. 3/4ths of the way through the movie it started skipping. What do you know, the whole network was down. No internet or anything. Power cycle the router and everything was back up. Needless to say, I finished the movie through the wired connection. The next day I tried copying 8GB of data wirelessly. The SSID vanished 1/3rd of the way in during the transfer.
What is wrong with this stuff? Linksys doesn't make things like they used to. This 320N is so cheaply made I don't think I could recommend it to anyone. I might see if I can send this back to Amazon and get a Netgear.

Polling of the current file from multiple files in the FTP Server

Hello Experts
I am working on a file to file scenario.We have to poll the file from the FTP server which may contain multiple files with different creation dates.The requirement is to poll only the file created in the current date.Could anyone throw some light on this.
Thanks & Regards
Sabyasachi

Hi Sabyasachi,
You can archive the files that you do not need into another folder manually for the first time.
Later you can schedule the file adapter to poll the folder only once in a day (Poll INterval = 86400 secs)
Do not forget to set the option to archive/delete the file that are already processed.
Regards,
Ravi Kanth Talagana

Sending XML file from SAP to Windows Based file server with FTP function

Hi Gurus,
We are using SAP BW 3.0B version.
I need to convert data in ODS to XML format and send this XML file to remote server which is not a SAP application server, it is just a Window Based file server with FTP function..
By writing some ABAP code I have converted ODS data into XML format (which gets saved in my local system)
(Is that I need to put this file in Application Server to send it to the other servers? )
Now the thing is how I can send this file to that Windows Based file server.
plz suggest me.... what can be done......
Thanks in Advance
Madhusudhan
Edited by: Madhusudhan Raju on Dec 3, 2009 4:25 AM

I dont think the above code support windows OS. Because I always execute this script via UNIX.
I think you can try this option, go to command prompt, goto the destination path where you have an XML file using cd....
ftp (destination servername), specify the username and password.
afterthat, use the command put and filename.
check whether the file had reached destination successfully or not.
For automation purpose, you can use the following script like
ftp: -s: test.txt (servername)
In test.txt,
UserName
Password
bin
cd /files
put file.xml
bye
Also, you can check in SM69, there will be some SAP external commands to automate the file transfer.
Thanks
Sat
http://support.microsoft.com/?kbid=96269

Help : windows xp to mac os x file transfer over network

hi folks! ... (sorry for the double post ... in the macbook discussion thread)
i've recently bought a macbook pro and am in the process of switching predominantly to the mac from my windows pc. I'ld really appreciate a guide/tutorial on how to transfer the files of my pc to my mac over a home network
okay .. here's wht iv got ..
1. macbook pro with hardly any data
2. laptop with windows xp home (which has a lot of my data) (ntfs formatted)
3. external hard drive with a lot of data (hard drive formatted with ntfs)
4. Router and wireless connection
what i want to do ...
transfer my data from external hard drive & my pc to my mac without using macdrive/macfuse. I want to enable file sharing over the network between the laptop (preferably the external hard disk attached to the laptop) and the macbook pro.
I haven't done network file sharing before... and it would be really nice if anyone could guide me through it ..
thanks!
zambie

Hi zambie,
Here is article that might help you out:
http://www.apple.com/getamac/movetomac/network.html
basically it is the same between macbookpro and macbook to get file sharing from pc.
Good Luck.

File Data over FTP

Similar Messages

Maybe you are looking for