Help Fetching files from an FTP server into a DBase or local folder

Hello Gurus!
I need help to automate or design/write an app capable of (replace a manual process) reading log files in an ftp server folder, this log files are called CDR (Call Detail Record) and named as follow cdr.txt.20020221010000 meaning that this log file was created on 2002/02/21 at 01:00:00.
This CDR log files are generated every hour by a Lucent telephone switch using a software/program called EXS ExchangePlus in ASCII format (fixed length delaminated, Char data type). EXS ExchangePlus writes a record in this CDR/log files after the call is completed, i.e. Calling_Number, Called_Number, Date_connect (yyyymmdd), Time_connect (hhmmss), Charged_time (hhmmss, duration of the call), and so on.
The manual process I am using now is:
1. Log in the ftp server into the folder where the CDRs log files are, located the latest generated CDRs log files and downloaded them into a local folder/directory. Normally I download the CDR for full day or 24 CDRs log files.
1a. Optionally sometimes I used a program called VEdit compiled/gather all 24 CDRs into a single file.
2. Once I have downloaded the CDRs I want to process (normally I process a full day 24 CDRs) I imported then into a Data Base temp table, where then I do the conversion of data types (i.e. Dates and times fields from char type -> to ->Date type) and calculations for billing purposes.
So if somebody can help with this, I would really appreciated ideas or any kind of information on how to automated this process.
I�m familiar with Java2 platform (using JDeveloper ) so if somebody has done something like this before using java, this would very helpful. Or Maybe using Visual Basic 6.0 would help too.
Thanks Gurus, and I look forward to hear from you soon!
Alf Pathros!

Thanks for the idea, even though an example would help me more.
I already found the FTPClient class.
I also would like to knwo if there is a away Ican append/merged various files CDRs into a single/one to then dump/import it into the database

Similar Messages

Getting the file from IIS FTP Server using ALSB

Hi,
I want to extract a file from FTP server in ALSB.I am using ALSB2.5 and Microsoft IIS FTP Server.
Now i want to know that
1.Do i need to configure a Proxy service or Business Service to poll a file from FTP server?
2.How to read the contents of the file once the File comes in?
Regards,
Indu Garg

You need to configure a Proxy service for the polling.
The contents of the file will be inside the context variable $body.

ALSB 3.0: Unable to retrieve files from Novell FTP Server

I have written several ALSB proxy services that retrieve data from Unix FTP servers. This works great and I haven't experienced any major issues. However, I now have to write a service that monitors a directory on a Novell FTP server. The same exact code works great pointed against a unix ftp server, but when pointed against the Novell FTP server, the proxy service never finds any files to process even though I have manually connected to that ftp server using the same id/password and have been able to see the files.
All the proxy is supposed to do is poll for files and copy them to the ALSB server for processing. Very very simplistic and works great against a Unix ftp server.
I turned on the transport debug option and this is all that shows:
<Ftp Client created and connected successfully for '+my_server+:21 for user:+myuserid+>
<+FileWorkPartitioningAgent.execute()>
<Returning 0 tasks.>
<-FileWorkPartitioningAgent.execute()>
We ran a packet trace on the server and we see the following commands being executed:
User myuserid
mypassword
SYST
TYPE i
PASV
list .
TYPE i
PASV
list .
quit
The files are in the "landing" directory for the user, so I am certain that it isn't a pathing issue. I'm just running out of ideas.
Some questions I have are:
1. has anyone experienced/resolved this issue before?
2. is there any way to do custom configuration of the ftp client (disable the PASV aka passive mode, enable debugging, etc) used by the FTP transport?
3. Could the FTP Transport not like the format of the list results from the Novell FTP server?
If anyone has any thoughts, I'd love to hear them.
Thanks!

Hi Iccarus
I realise its been quite a while since you wrote this thread but, in my desperation, I hoped you might have made some progress on this. I too am having almost identical issues:
1. Can get/put files via ALSB ftp from/to unix or microsoft ftp server
2. Can put files via ALSB ftp to the problem ftp server (not sure of its flavour atm)
3. Can get/put files from the command line from/to the problem ftp server
4. Cant get files via ALSB ftp from the problem server
The commands which were executed at the problem server are very similar to those you found:
successful login
ls
ls
quit
Any insights would be greatly appreciated

Can ODI delete a file from an FTP server

Hi
I'm downloading a file via FTP - but I want that file removed after it's downloaded.
So I want to 'move' the file down, rather than copy it... or delete it after it has downloaded
Is this possible with ODI?
Many thanks
Z.

Have a read of :-
Re: Is this possible?
Re: Delete multiple files from FTP Folder
Ok?
Cheers
John
http://john-goodwin.blogspot.com/

File transfer from a FTP server to another External FTP server

Hi,
I have one FTP server , I need to transfer a file from this FTP server to aother external FTP server. Could any one please help me how to write a batch file on FTP server so that my file is transfered to another FTP server by executing the Batch file. I don't want to use SAP server for this.
best regards
bobby

CREATE CONTROLFILE
Caution:
Oracle recommends that you perform a full backup of all files in the database before using this statement. For more information, see Oracle9i User-Managed Backup and Recovery Guide.
Purpose
Use the CREATE CONTROLFILE statement to re-create a control file in one of the following cases:
All copies of your existing control files have been lost through media failure.
You want to change the name of the database.
You want to change the maximum number of redo log file groups, redo log file members, archived redo log files, datafiles, or instances that can concurrently have the database mounted and open.
Note:
If it is necessary to use the CREATE CONTROLFILE statement, do not include in the DATAFILE clause any datafiles in temporary or read-only tablespaces. You can add these types of files to the database later.
An alternative to the CREATE CONTROLFILE statement is ALTER DATABASE BACKUP CONTROLFILE TO TRACE, which generates a SQL script in the trace file to re-create the controlfile. If your database contains any read-only or temporary tablespaces, that SQL script will also contain all the necessary SQL statements to add those files back into the database.
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96540/statements_54a.htm#SQLRF01203

Is it possible to import the website I completed in Muse from the ftp server back into Muse?

I have lost the Muse files for my site (due to a stolen laptop). Is it possible to download the site files from my ftp server and import the files back into Muse (without having to rebuild the entire site)? My site is hosted by GoDaddy cPanel, and I am running Windows 7 on my (new) laptop. Bumming out here and could use some help. Thanks!

Yes, go to your GoDaddy control panel and somewhere there will be a download your HTML button.

Polling of the current file from multiple files in the FTP Server

Hello Experts
I am working on a file to file scenario.We have to poll the file from the FTP server which may contain multiple files with different creation dates.The requirement is to poll only the file created in the current date.Could anyone throw some light on this.
Thanks & Regards
Sabyasachi

Hi Sabyasachi,
You can archive the files that you do not need into another folder manually for the first time.
Later you can schedule the file adapter to poll the folder only once in a day (Poll INterval = 86400 secs)
Do not forget to set the option to archive/delete the file that are already processed.
Regards,
Ravi Kanth Talagana

File Archive in FTP Server

I'm using odiscpget to extract file from remote FTP server and i have a requirement to archive the file after successful extraction into archive directory in the same server.
Do i have an utility to perform a file move in remote server from ODI?
Thanks in Advance

odiscpput will look for a file in local directory to move to remote server isn't it?Yes .. it is.
If you want to do file operation on the remote server only then you need to write your own code for it.

Reading file from the presentation server in the background

Hi,
I am trying to read a .csv file from the presentation server into an internal table in the background. what should I do for it? In the foreground it works fine.
I have declared a selection parameter 'p_file' that has the path of the file. It wokrs fine in the foreground and how to set it up in the background?
Any thoughts would be helpful. Thanks in advance,
VG

hii
did you achieved the required functionality , i,e, accessing presentation server file i nbackground .
I too got the same requirement, can you explain the process.
There is no way you can do it... The best method is to put the file on Appln server and then call it in the background mode.
Regards,
Vishwa.

Error -36 when attempting to copy files from an FTP

I recently got a new macbook pro, but am having trouble retrieving files from an FTP server I used to use with my old iMac with no problems. Whenever I try to copy the files from the FTP to my computer, I get Error Code -36 about being unable to write the files. I know it's not a problem with the FTP server because I was able to retrieve the files with a computer running Windows. Any idea how to fix this problem? I have it when using CuteFTP as well as the standard Mac FTP access through Finder.

Try the Unix forum under OS X Technologies. Additionally, use the built in ftp command.

How to transfer excel files(on ftp server) into internal table?

hello,everyone
pls tell me how to transfer excel files those on a ftp server into internal table?
ps.i know the function 'ftp_server_to_r3',it can help to transfer flat file.

Hi,
I believe you want to get the data from the FTP Server to R3.
I am also sending the code. Have a look and it would help you.
First get the Password and user name and the FTP Server Path where file is stored and FTP Server Host name
FUNCTION zfi_ftp_get.
*"*"Local Interface:
*" IMPORTING
*"     VALUE(I_FILENAME) TYPE C
*" TABLES
*"      T_BLOB STRUCTURE ZFI_TLM_LENGTH OPTIONAL " is a table type with a field called line of length 992
*"      RETURN STRUCTURE BAPIRET2 OPTIONAL
DATA : i_password(30)     TYPE c,
         i_user(30)         TYPE c,
         i_host(30)         TYPE c,
         i_rfc_destination TYPE rfcdes-rfcdest,
         i_length           TYPE i,
         i_folder_path(100) TYPE c.
DATA:   lv_blob_length   TYPE i.
DATA:   lv_length        TYPE i, "Password length
          lv_key           TYPE i VALUE 26101957,
          lv_password(30) TYPE c,
          lv_ftp_handle    TYPE i,
          lv_cmd(80)       TYPE c.
DATA: BEGIN OF result OCCURS 0,
        line(100) TYPE c,
        END OF result.
TYPES: BEGIN OF ty_dummy,
         line(392) TYPE c,
       END   OF ty_dummy.
DATA: lt_dummy TYPE TABLE OF ty_dummy,
        ls_dummy LIKE LINE OF lt_dummy.
i_password        = 'vnhdh'.
i_user            = 'sdkgd'.
i_host            = 'sbnksbg'.
i_rfc_destination = 'SAPFTP'.
i_length          = '992'.
i_folder_path     = '/hioj/hohjk/hh'.
lv_length = STRLEN( i_password ).
CALL FUNCTION 'HTTP_SCRAMBLE'
    EXPORTING
      SOURCE      = i_password
      sourcelen   = lv_length
      key         = lv_key
    IMPORTING
      destination = lv_password.
CALL FUNCTION 'FTP_CONNECT'
    EXPORTING
      user            = i_user
      password        = lv_password
      host            = i_host
      rfc_destination = i_rfc_destination
    IMPORTING
      handle          = lv_ftp_handle
    EXCEPTIONS
      not_connected   = 1
      OTHERS          = 2.
IF sy-subrc = 1.
    return-type = 'E' .
    return-message = 'FTP Connection not Successful'.
    APPEND return.
ELSEIF sy-subrc = 2.
    return-type = 'E' .
    return-message = 'FTP Connection not Successful'.
    APPEND return.
ELSEIF sy-subrc EQ 0.
    return-type = 'S' .
    return-message = 'FTP Connection Successful'.
    APPEND return.
    CONCATENATE 'cd' i_folder_path INTO lv_cmd SEPARATED BY space.
    CALL FUNCTION 'FTP_COMMAND'
      EXPORTING
        handle        = lv_ftp_handle
        command       = lv_cmd
      TABLES
        data          = result
      EXCEPTIONS
        command_error = 1
        tcpip_error   = 2.
    IF sy-subrc = 1.
      return-type = 'E' .
      return-message = 'Command Error Occured during open of FTP Folder'.
      APPEND return.
    ELSEIF sy-subrc = 2.
      return-type = 'E' .
      return-message = 'TCIP Error Occured during open of FTP Folder'.
      APPEND return.
    ELSE.
      REFRESH t_blob.
      lv_blob_length = 992.
      TRANSLATE i_filename TO LOWER CASE.
      CALL FUNCTION 'FTP_SERVER_TO_R3'
        EXPORTING
          handle      = lv_ftp_handle
          fname       = i_filename
        IMPORTING
          blob_length = lv_blob_length
        TABLES
          blob        = lt_dummy.
      t_blob[] = lt_dummy[].
    ENDIF.
ENDIF.
ENDFUNCTION.
Regards
Sajid
Edited by: shaik sajid on Nov 16, 2010 7:25 AM

File name structure for picking up X12/EDIFACT documents from an FTP Server

According to some documents, and posts in this forum, the file name for a document retreived from an FTP server by B2B has to be in the following format: %TPName%_%X12 Doc Type%_%X12 Version_1_12345.dat
Why is this format required? Is it possible to obtain all this information for the Header Envelopes of each X12 or even EDIFACT EDI Document?

Thanks Ramesh.
I did specify the propery oracle.tip.adapter.b2b.edi.identifyFromTP=Group, but I was still not getting the expected results. Now I played around for a while and now I identified the problem . When I specify the property oracle.tip.adapter.b2b.edi.identifyFromTP=Group, I should use the Group ID when I create the agreement so that the agreement would be identified by using group id. I think I got that working now.
I have one question on the trading partner end point URL in FILE/FTP. When I specify the endpoint URL for a trading partner would that be used to pull the document from the trading partner or push the documents to trading partner?
In my testing even though I specified the end point URL for the trading partner using FILE protocol, when I put the message in that URL ( folder), it did not pull the message from that URL ( this trading partner is the initiator for that EDI 204 message). But when I put the messages into the host partner's end point URL, it got pulled and processed successfully. I am little confused on the usage of trading partner end point URL for the FILE/FTP protocols . Could you explain me little bit or point me to a documnet where it is expalined in detail?
Bala

Load data from FTP server into Oracle

I have a zipped file in a FTP server. I need to unzip the file and sql load it into an Oracle table.
Does Oracle has any utilities with which I can direct do "get" from the FTP server?
Does Oracle has any zip/unzip features?
I am using 10g.

user6794035 wrote:
I have a zipped file in a FTP server. I need to unzip the file and sql load it into an Oracle table.
Does Oracle has any utilities with which I can direct do "get" from the FTP server?
Does Oracle has any zip/unzip features?
I am using 10g.Oracle does not support thes features directly. You'll have to write an OS script to performthe tasks and insert the data.
Dependending on your output format you can use UTL_FILE, SQL*LOADER, or external tables to load the data.

I need help! when I am importing my NEF files from my D3300 camera into lightroom 5 and try to use the "copy as DNG" button I always get an error message saying that "saying the file is not recognized by the raw format support"

I need help! when I am importing my NEF Raw files from my D3300 camera into lightroom 5 and try to use the "copy as DNG" button I always get an error message saying that "saying the file is not recognized by the raw format support". The whole purpose of that button is so that the file can be recognized... How can I make the "copy as DNG" button work as it is supposed too?? Thank you

Thank you for responding. So I essentially will never be able to use that button in lightroom 5? do I need to get LR 6? Will there ever be an update for LR 5 that will enable me to use it?
Does DNG Converter work within LR or do I have to upload pictures to my computer and then make a second copy in DNG format. and then go into LR and use them?
Thank you @dj_paige

I have copied my music library from two different files from extewrnal hard drive into the Itunes folder. I tunes only recognizes some of the songs. I have reloaded 5 times and can't get intunes to recognize all my songs? HELP!

I have copied my music library from two different files from extewrnal hard drive into the Itunes folder. I tunes only recognizes some of the songs. I have reloaded 5 times and can't get intunes to recognize all my songs? HELP!

" When I did this, my library showed all the music I have "purchased" from itunes but did not have the music that I downloaded a long time ago through itunes from my old CDs."
Correct.
" How can I get that music to show up in my library now on my new computer? "
Copy it from your old computer or your backup copy of your old computer.
The sync is one way - computer to ipod.

Help Fetching files from an FTP server into a DBase or local folder

Similar Messages

Maybe you are looking for