Loading Data From a Text File Through an Application into Oracle

Question

Hi There,
I have a web application that allows the user to upload a text file. This file is then processed by my application. Each line in the file is a new row I need to insert into my table.
Currently, I batch 200 updates together and insert them into the DB.
For about 3 million records this is taking much longer than I would like it to.
Any suggestions for optimization?
thanks.

Answer 1

I put here a simplest demo (file has whitespace)
I think it may help to start.
--Structure of your file test1.dat (put in your directory)
a1 b1
a2 b2
a3 b3
a4 b4
CREATE OR REPLACE DIRECTORY
test_dir AS
'C:\oraclexe\DIR' --or anywhere
--GRANT READ, WRITE ON DIRECTORY  test_dir TO your_user
--external table:
DROP TABLE test_ext
CREATE     TABLE test_ext
   (col1      CHAR(5),
    col2      CHAR(5)
ORGANIZATION EXTERNAL
   (TYPE oracle_loader
    DEFAULT DIRECTORY test_dir
    ACCESS PARAMETERS
      (RECORDS DELIMITED BY NEWLINE
       FIELDS TERMINATED BY WHITESPACE)
       LOCATION ('test1.dat')
SELECT * FROM test_ext
COL1  COL2 
a1    b1   
a2    b2   
a3    b3   
a4    b4   
Insert into another_table(another_col1, another_col2) (select col1, col2 from test_ext) if needed