How to dump a flat file into database?

hi guys,
I am new to jdbc. I am trying to transfer some data from flat file to database. What I can think of now is to create an array that is big enough to hold the entire file, dump the content of file in it and then store the array of data into database using insert statement. But this seems to be memory consuming especially when the file is very large. So could anyone tell me a more efficient way of doing that? thanks a lot.

Similar Messages

How to upload a Flat file into sap database if the file is in Appl'n Server

Hello Sap Experts , Can you tel me
" How to upload a Flat file into sap database if the file is in Application Server.
what is Path for that ?
Plz Tel Me its Urgent
Thanks for all

Hi,
ABAP code for uploading a TAB delimited file into an internal table. See code below for structures.
*& Report ZUPLOADTAB                                                  *
*& Example of Uploading tab delimited file                             *
REPORT zuploadtab                    .
PARAMETERS: p_infile LIKE rlgrap-filename
                        OBLIGATORY DEFAULT '/usr/sap/'..
DATA: ld_file LIKE rlgrap-filename.
*Internal tabe to store upload data
TYPES: BEGIN OF t_record,
    name1 like pa0002-VORNA,
    name2 like pa0002-name2,
    age   type i,
    END OF t_record.
DATA: it_record TYPE STANDARD TABLE OF t_record INITIAL SIZE 0,
      wa_record TYPE t_record.
*Text version of data table
TYPES: begin of t_uploadtxt,
name1(10) type c,
name2(15) type c,
age(5) type c,
end of t_uploadtxt.
DATA: wa_uploadtxt TYPE t_uploadtxt.
*String value to data in initially.
DATA: wa_string(255) type c.
constants: con_tab TYPE x VALUE '09'.
*If you have Unicode check active in program attributes then you will
*need to declare constants as follows:
*class cl_abap_char_utilities definition load.
*constants:
*    con_tab type c value cl_abap_char_utilities=>HORIZONTAL_TAB.
*START-OF-SELECTION
START-OF-SELECTION.
ld_file = p_infile.
OPEN DATASET ld_file FOR INPUT IN TEXT MODE ENCODING DEFAULT.
IF sy-subrc NE 0.
ELSE.
DO.
    CLEAR: wa_string, wa_uploadtxt.
    READ DATASET ld_file INTO wa_string.
    IF sy-subrc NE 0.
      EXIT.
    ELSE.
      SPLIT wa_string AT con_tab INTO wa_uploadtxt-name1
                                      wa_uploadtxt-name2
                                      wa_uploadtxt-age.
      MOVE-CORRESPONDING wa_uploadtxt TO wa_upload.
      APPEND wa_upload TO it_record.
    ENDIF.
ENDDO.
CLOSE DATASET ld_file.
ENDIF.
*END-OF-SELECTION
END-OF-SELECTION.
*!! Text data is now contained within the internal table IT_RECORD
* Display report data for illustration purposes
loop at it_record into wa_record.
    write:/     sy-vline,
           (10) wa_record-name1, sy-vline,
           (10) wa_record-name2, sy-vline,
           (10) wa_record-age, sy-vline.
endloop.

How to import a excel file into database?

hi all,
How can I import a excel file into database?
What I need to do first?
Thanks,
Amy

1. Create a conrtol file in your disc(with notepad) ex
test_loader.ctl
LOAD DATA
INFILE='C:\Testcsv.csv'
into table test_table
FIELDS TERMINATED BY ','
TRAILING NULL COLS
(ID,COL1,COL2,COL3)
The table descrption is
scott@ORCL> desc test_table;
Name Null? Type
ID NUMBER
COL1 VARCHAR2(10)
COL2 VARCHAR2(10)
COL3 VARCHAR2(10)
scott@ORCL>
2 .Create a file testcsv.csv from your excel file you want to load with " save as" csv comma seperated value
in your hard disc c:\
3. in dos command mode write
C:\>sqlldr scott/tiger control=c:\testcsv.ctl log=c:\testcsv.log
Thats it!

How to upload a flat file into a Z DB table

Hi All,
For a planning application I would like to permit our users to upload a flat file to a internal table to be persisted on to any given database Z Table. From here we would use it in a planning application.
Please kindly share the code and approach to implement this in BSP.
Thanks
Karen

Hi Karen,
Check the links mentioned below.
[Excel to internal table|Excel to Internal table in BSP;
[upload excel into BSP|upload excel sheet into BSP application;
The two links show how to convert an excel file data to internal table in BSP application.Similarly you can convert the flat file data to internal table and then modify the Z DB table to store the data from internal table.
Regards,
Anubhav

How to load a flat file into BW-BPS using Web Browser

Hello, i have a problem with the "How to do Paper". I want to upload a Excel CSV file , but the paper only describes a txt file Uplaod. Does anybody can help me ?Thanks !

You need to parse the line coming in from the flat file...
You can do this with generic types in your flat file structure (string).
Then you loop through the table of strings that is your flat file and parse the string so that it breaks up the line for each comma. There is an ABAP command called: SPLIT - syntax is as follows:
SPLIT dobj AT sep INTO
{ {result1 result2 ...} | {TABLE result_tab} }
[IN {BYTE|CHARACTER} MODE].
Regards,
Zane

How to batch upload PDF files into database BLOB

Hello.
I have a requirement to batch upload PDF files into BLOB column of an Oracle 8.1.7 table from Forms 6i Web. The content of the blob column (ie. the PDF content) MUST be displayable from all client software (eg. Oracle Web forms, HTML forms, etc.)
Our environment is
Middle-tier is 9iAS on Windows/2000
Database is Oracle 8.1.7.0.0 on VMS
Oracle Web Forms 6i Patch 10
Basically my Oracle web form program will display a list of PDF files to upload and then the user can click on the <Upload> button to do the batch upload. I have experimented the following approaches but with no luck.
1. READ_IMAGE_FILE forms built-in = does NOT work because it cannot read PDF file. I got error FRM-47100: Cannot read image file
2. OCX and OLE form item = cannot use this because it does NOT work on the Web. I got error FRM-41344 OLE object not defined
3. I cannot use DBMS_LOB to do the load because the PDF files are not in the database machine.
4. Metalink Note 1682771.1 (How to upload binary documents back to database blob column from forms). When I used this, I got ORA-6502 during the hextoraw conversion. In using this solution, I have downloaded a bin2hex.exe from the Google site. I've noticed that when I looked at the converted HEX file, each line has the character : (colon) at the beginning of each line. I know the PDF file has been converted correctly to HEX format because when I convert the HEX file back to BIN format using hex2bin.exe, I'm able to display the converted bin file in Acrobat Reader. When I removed the : (colon) in the HEX file, I did NOT get the ORA-6502 error but I CANNOT display the file in Acrobat Reader. It gives an error "corrupted file".
5. upload facility in PL/SQL Web toolkit - I tried to automatically submit the html form (with htp.p) but it does NOT load the contents of the file. I called the URL from Oracle forms using web.show_document. There seems to be issues with Oracle Web forms (JInitiator) and HTML (+ htp.p).
The other options I can think of at this point are:
1. Use SQL*Loader to do the batch upload via SQL*Net connection and use HOST() built-in from Oracle Webforms to execute SQL*Loader from the 9iAS.
2. Write a Visual Basic program that reads a binary file and output the contents of the file into a byte array. Then build a DLL that can be called from Oracle webforms 6i via ORA_FFI. I don't prefer this because it means the solution will only work for Windows.
3. Write a JSP program that streams the PDF file and insert the contents of the PDF file into blob column via JDBC. Call JSP from forms using web.show_document. With this I have to do another connection to the database when I load the file.
4. Maybe I can use dbms_lob by using network file system (NFS) between the application server and VMS. But this will be network resource hungry as far as I know because the network connection has to be kept open.
Please advise. Thank you.
Regards,
Armando

I have downloaded a bin2hex.exe from the Google site.
... each line has the character : (colon) at the
beginning of each line. I'm afraid it isn't a correct utility. I hope you'll find the source code of a correct one at metalink forum:
Doc ID: 368771.996
Type: Forum
Subject: Uploading Binary Files: bin2hex and hex2bin do not reproduce the same file
There is some links to metalink notes and some example about working with BLOB at http://www.tigralen.spb.ru/oracle/blob/index.htm. Maybe it helps. Sorry for my English. If there is any problem with code provided there, let me know by e-mail.

How to Load a Flat File into BW-BPS Using a Web Browser

Hello,
I'm using the upload functionality described in the how to guide.
When we want to have this functionality available for 12 different Planning levels. Do I have to create the Web Interface (as described in the how to guide) for each Planning Level separately, or can i pass a parameter in the URL (wenn calling the File Upload functionality) to determine which Planning level and Function it is.
This pice of coding i want to have a bit more flexible
*Execute planning function
CALL FUNCTION 'API_SEMBPS_FUNCTION_EXECUTE'
        EXPORTING
          i_area     = 'ZIPM0001' " <<<< ADJUST
          i_plevel   = 'ZCAPB006' " <<<< ADJUST
          i_package = '0-ADHOC' " <<<< ADJUST
          i_function = 'ZEX00001' " <<<< ADJUST
          i_param    = 'Z0000001' " <<<< ADJUST
        IMPORTING
          e_subrc    = l_subrc
        TABLES
          etk_return = lt_bapiret.
Does someone have an idea ?
Thank you
Dieter

Hi Dieter,
you should be able to grab the variable value by the following statement (e.g. in this case 'area' is being passed along, works for whatever you want to send) is:
data: l_area type upc_y_area.
l_area = request->get_form_field( 'area' ).
in this case the calling URL looks like:
<normal URL>?area=example_area
example_area will then contain your value.
Then depending on the value execute your different SEM functions
Note that if you want to load different flatfile formats, more has to change in the functions as indicated in the white paper,
Hope it helps,
Regards,
MArc
I got it from the following document I found on SAPNet or SDN (forgot..) some time back:
How To Call a BPS Web Interface with Predefined Selections

How to read a flat file into a report?

The file format is like below:
Company Code : BUKRS(header)
Posting Period :3(header)
Then The items data is started as a table format.
Line items in table format.
If anybody knows the answer please share with me.

Use the GUI_UPLOAD Program to upload the file from Presentation server to SAP.
Sample code:
*& Report Z_UPLOAD_MUNCPCODE                                          *
REPORT z_upload_muncpcode.
PARAMETERS : p_fname   LIKE rlgrap-filename.
TYPES: BEGIN OF ty_munc,
        land1     TYPE tzone-land1,
        zone1     TYPE tzone-zone1,
        vtext TYPE tzont-vtext,
       END OF ty_munc.
DATA: i_munc   TYPE STANDARD TABLE OF ty_munc,
      i_tzone TYPE STANDARD TABLE OF tzone,
      i_tzont TYPE STANDARD TABLE OF tzont,
      wa_munc TYPE ty_munc,
      wa_tzone TYPE tzone,
      wa_tzont TYPE tzont.
CONSTANTS: c_path     TYPE char20 VALUE 'C:\',
           c_mask     TYPE char9 VALUE ',*.*,*.*.',
           c_mode     TYPE char1 VALUE 'O',
           c_filetype TYPE char10 VALUE 'ASC',
           c_x        TYPE char01 VALUE 'X'.
AT SELECTION-SCREEN ON VALUE-REQUEST FOR p_fname.
*-- Browse Presentation Server
PERFORM f4_presentation_file.
START-OF-SELECTION..
*-- Read presentation server file
PERFORM f1003_pre_file.
LOOP AT i_munc INTO wa_munc.
    wa_tzone-mandt = wa_tzont-mandt = sy-mandt.
    wa_tzone-land1 = wa_tzont-land1 = wa_munc-land1.
    wa_tzone-zone1 = wa_tzont-zone1 = wa_munc-zone1.
    wa_tzont-spras = sy-langu.
    wa_tzont-vtext = wa_munc-vtext.
    APPEND wa_tzont TO i_tzont.
    APPEND wa_tzone TO i_tzone.
    CLEAR: wa_munc, wa_tzont, wa_tzone.
ENDLOOP.
END-OF-SELECTION.
Modify Table TZONT
PERFORM enqueue_table USING text-001.
MODIFY tzont FROM TABLE i_tzont.
PERFORM dequeue_table USING text-001.
Modify Table TZONE
PERFORM enqueue_table USING text-002.
MODIFY tzone FROM TABLE i_tzone.
PERFORM dequeue_table USING text-002.
WRITE: 'Tables TZONE & TZONT are updated'.
*&                  Form f4_presentation_file
*&                F4 Help for presentation server
FORM f4_presentation_file .
CALL FUNCTION 'WS_FILENAME_GET'
    EXPORTING
      def_path         = c_path
      mask             = c_mask
      mode             = c_mode
      title            = text-001
    IMPORTING
      filename         = p_fname
    EXCEPTIONS
      inv_winsys       = 1
      no_batch         = 2
      selection_cancel = 3
      selection_error = 4
      OTHERS           = 5.
IF sy-subrc <> 0.
   MESSAGE ID sy-msgid TYPE sy-msgty NUMBER sy-msgno
           WITH sy-msgv1 sy-msgv2 sy-msgv3 sy-msgv4.
ENDIF.
ENDFORM.                    " f4_presentation_file
*&                      Form f1003_pre_file
*&                         Upload File
FORM f1003_pre_file .
DATA: lcl_filename TYPE string.
lcl_filename = p_fname.
CALL FUNCTION 'GUI_UPLOAD'
    EXPORTING
      filename                = lcl_filename
      filetype                = c_filetype
      has_field_separator     = c_x
    TABLES
      data_tab                = i_munc
    EXCEPTIONS
      file_open_error         = 1
      file_read_error         = 2
      no_batch                = 3
      gui_refuse_filetransfer = 4
      invalid_type            = 5
      no_authority            = 6
      unknown_error           = 7
      bad_data_format         = 8
      header_not_allowed      = 9
      separator_not_allowed   = 10
      header_too_long         = 11
      unknown_dp_error        = 12
      access_denied           = 13
      dp_out_of_memory        = 14
      disk_full               = 15
      dp_timeout              = 16
      OTHERS                  = 17.
IF sy-subrc <> 0.
    MESSAGE ID sy-msgid TYPE sy-msgty NUMBER sy-msgno
            WITH sy-msgv1 sy-msgv2 sy-msgv3 sy-msgv4.
    EXIT.
ENDIF.
ENDFORM.                    " f1003_pre_file
*&                         Form enqueue_table
*&                           Enqueue Table
FORM enqueue_table USING p_tabname.
CALL FUNCTION 'ENQUEUE_E_TABLE'
    EXPORTING
      tabname        = p_tabname
    EXCEPTIONS
      foreign_lock   = 1
      system_failure = 2
      OTHERS         = 3.
IF sy-subrc <> 0.
    MESSAGE ID sy-msgid TYPE sy-msgty NUMBER sy-msgno
            WITH sy-msgv1 sy-msgv2 sy-msgv3 sy-msgv4.
ENDIF.
ENDFORM.                    " enqueue_table
*&                        Form dequeue_table
*&                           Dequeue Table
FORM dequeue_table USING p_tabname.
CALL FUNCTION 'DEQUEUE_E_TABLE'
    EXPORTING
      tabname = p_tabname.
ENDFORM.                    " dequeue_table
Prakash.

How to read the CSV Files into Database Table

Hi
Friends i have a Table called tblstudent this has the following fields Student ID, StudentName ,Class,Father_Name, Mother_Name.
Now i have a CSV File with 1500 records with all These Fields. Now in my Program there is a need for me to read all these Records into this Table tblstudent.
Note: I have got already 2000 records in the Table tblstudent now i would like to read all these CSV File records into the Table tblstudent.
Please give me some examples to do this
Thank your for your service
Cheers
Jofin

1) Read the CSV file line by line using BufferedReader.
2) Convert each line (record) to a List and add it to a parent List. If you know the columns before, you might use a List of DTO's.
3) Finally save the two-dimensional List or the List of DTO's into the datatable using plain JDBC or any kind of ORM (Hibernate and so on).
This article contains some useful code snippets to parse a CSV: http://balusc.xs4all.nl/srv/dev-jep-csv.html

Load a flat file into BW-BPS using SAP GUI

Hi,
We are using BW BPS 3.5 version, i implemented how to guide " How to load a flat file into BW-BPS using SAP GUI" successfully without any errors.
I inlcuded three infoobjects in the text file   costelemt, Posting period and amount. the same three infoobjects i inlcuded the file structure in the global data as specified in the how to document
The flat file format is like this
Costelmnt      Postingperiod         Amount
XXXXX             #
XXXXX             1                          100
XXXXX             2                           800
XXXXX             3                           700
XXXXX             4                           500
XXXXX             5                           300
XXXXX             6                           200
XXXXX             7                           270
XXXXX             8                           120
XXXXX             9                           145
XXXXX            10                           340
XXXXX            11                           147
XXXXX            12                           900
I successfully loaded above flat file in to BPS cube and it dispalyed in the layout also.
But users are requesting to load flatfile in the below format
Costelmnt        Annual(PP=#)   Jan(PP=1)   Feb(PP=2) ........................................Dec(PP=12)
XXXXX              Blank                       100           800                                                   900
Is it possible to load a flat file like this
They wants load a single row instead of 13 rows for each costelement
How to do this. Please suggest me if anybody accorss this requirment.
In the infocube we have got only one Info object 0FISCPER3(Posting period) and one 0AMOUNT(Amount)
do we need 13 Infobjects for each posting period and amount.
Is there any possiblity we can implement any user exit which we use in BEX Quer's
Please share your ideas on this.
Thanks in advance
Best regards
SS

Hi,
There are 2 ways to do this.
One is to change the structure of the cube to have 12 key figures for the 12 posting periods.
Another way is to write an ABAP Function Module to fetch the values from each record based on the posting period and store it in the cube for the corresponding characteristic. This way, you dont have to change the structure of the cube.
If this particular cube is not used anywhere else, I would suggest to change the structure itself.
Hope this helps.

To upload a flat file into BW using a variable entry in web application

hi guys,
how to upload a flat file into the web browser using a
a variable entry in the wad application.
Thanks,
your help will be duly appreciated
Message was edited by:
Vj.R T

thanks arun
but is it not possible to load the flat file at bex level which
might be the same at wad level
and also what do you mean the load package
triggered from the backend and how do i
manipulate the data is it at bex level or wad level
please elaborate.
thanks
your help will be rightly acknowledged.

How to Upload a PDF file into BLOB column in a table using Forms 9i

Can anyone tell me how to upload a PDF file from client system using File dialog window and store its content in BLOB column in a table. The file to be uploaded will be in client side.

Hi,
please, search a bit on the forum before do a question:
Just searching by "upload blob pdf" ...
How to batch upload PDF files into database BLOB
Regards,
Jose.

Save file into database

I need information on how I can save a file into database (Oracle 9i), preferably from Oracle Forms

Hello,
You did not provide your Forms version, but, if you are using version greatest than 6i you can use the Webutil file transfert function to put local or server side files into the database.
Francois

How to insert a image file into oracle database

hi all
can anyone guide me how to insert a image file into oracle database now
i have created table using
create table imagestore(image blob);
but when inserting i totally lost don't know what to do how to write query to insert image file

Hi I don't have time to explain really, I did have to do this a while ago though so I will post a code snippet. This is using the commons file upload framework.
Firstly you need a multi part form data (if you are using a web page). If you are not using a web page ignore this bit.
out.println("<form name=\"imgFrm\" method=\"post\" enctype=\"multipart/form-data\" action=\"FileUploadServlet?thisPageAction=reloaded\" onSubmit=\"return submitForm();\"><input type=\"FILE\" name=\"imgSource\" size='60' class='smalltext' onKeyPress='return stopUserInput();' onKeyUp='stopUserInput();' onKeyDown='stopUserInput();' onMouseDown='noMouseDown(event);'>");
out.println("   <input type='submit' name='submit' value='Submit' class='smalltext'>");
out.println("</form>"); Import this once you have the jar file:
import org.apache.commons.fileupload.*;Now a method I wrote to upload the file. I am not saying that this is correct, or its the best way to do this. I am just saying it works for me.
private boolean uploadFile(HttpServletRequest request, HttpSession session) throws Exception {
        boolean result = true;
        String fileName = null;
        byte fileData[] = null;
        String fileUploadError = null;
        String imageType = "";
        String error = "";
        DiskFileUpload fb = new DiskFileUpload();
        List fileItems = fb.parseRequest(request);
        Iterator it = fileItems.iterator();
        while(it.hasNext()){
            FileItem fileItem = (FileItem)it.next();
            if (!fileItem.isFormField()) {
                fileName = fileItem.getName();
                fileData = fileItem.get();
                // Get the imageType from the filename extension
                if (fileName != null) {
                    int dotPos = fileName.indexOf('.');
                    if (dotPos >= 0 && dotPos != fileName.length()-1) {
                        imageType = fileName.substring(dotPos+1).toLowerCase();
                        if (imageType.equals("jpg")) {
                            imageType = "jpeg";
        String filePath = request.getParameter("FILE_PATH");
        session.setAttribute("filePath", filePath);
        session.setAttribute("fileData", fileData);
        session.setAttribute("fileName", fileName);
        session.setAttribute("imageType", imageType);
        return result;
     } And now finally the method to actually write the file to the database:
private int writeImageFile(byte[] fileData, String fileName, String imageType, String mode, Integer signatureIDIn, HttpServletRequest request) throws Exception {
        //If the previous code found a file that can be uploaded then
        //save it into the database via a pstmt
        String sql = "";
        UtilDBquery udbq = getUser(request).connectToDatabase();
        Connection con = null;
        int signatureID = 0;
        PreparedStatement pstmt = null;
        try {
            udbq.setUsePreparedStatements(true);
            con = udbq.getPooledConnection();
            con.setAutoCommit(false);
            if((!mode.equals("U")) || (mode.equals("U") && signatureIDIn == 0)) {
                sql = "SELECT SEQ_SIGNATURE_ID.nextval FROM DUAL";
                pstmt = con.prepareStatement(sql);
                ResultSet rs = pstmt.executeQuery();
                while(rs.next()) {
                   signatureID = rs.getInt(1);
                if (fileName != null && imageType != null) {
                    sql = "INSERT INTO T_SIGNATURE (SIGNATURE_ID, SIGNATURE) values (?,?)";
                    InputStream is2 = new ByteArrayInputStream(fileData);
                    pstmt = con.prepareStatement(sql);
                    pstmt.setInt(1, signatureID);
                    pstmt.setBinaryStream(2, is2, (int)(fileData.length));
                    pstmt.executeUpdate();
                    pstmt.close();
                    con.commit();
                    con = null;
            if(mode.equals("U") && signatureIDIn != 0) {
                signatureID = signatureIDIn.intValue();
                if (fileName != null && imageType != null) {
                    sql = "UPDATE T_SIGNATURE SET SIGNATURE = ? WHERE SIGNATURE_ID = ?";
                    InputStream is2 = new ByteArrayInputStream(fileData);
                    pstmt = con.prepareStatement(sql);
                    pstmt.setBinaryStream(1, is2, (int)(fileData.length));
                    pstmt.setInt(2, signatureID);
                    pstmt.executeUpdate();
                    pstmt.close();
                    con.commit();
                    con = null;
        } catch (Exception e) {
            con = null;
            throw new Exception(e.toString());
        return signatureID;
   }

How to store the flat file data into custom table?

Hi,
Iam working on inbound interface.Can any one tell me how to store the flat file data into custom table?what is the procedure?
Regards,
Sujan

Hie
u can use function
F4_FILENAME
to pick the file from front-end or location.
then use function
WS_UPLOAD
to upload into
AT SELECTION-SCREEN ON VALUE-REQUEST FOR p_file.
CALL FUNCTION 'F4_FILENAME'   "Function to pick file
    EXPORTING
      field_name = 'p_file'     "file
    IMPORTING
      file_name = p_file.     "file
CALL FUNCTION 'WS_UPLOAD'
   EXPORTING
     filename                       = p_file1
    TABLES
      data_tab                      = it_line
*then loop at it_line splitting it into the fields of your custom table.
loop at it_line.
          split itline at ',' into
          itab-name
          itab-surname.
endloop.
then u can insert the values into yo table from the itab work area.
regards
Isaac Prince

How to dump a flat file into database?

Similar Messages

Maybe you are looking for