Bulk Data - Insert / Update from text file - Urgent

Question

hi,
Consider there is a Table A. There are around 1.7 Million
Records.
i have a situation that i will be getting the Data,
Every two Weeks, around 100 - 200 thousand Records.
I have to do some calculations.
If any Old Data Exists, then update the Data
for the Non - Primary Key Fields.
Else
I have to Insert the New Data.
Most of the time, i will be getting update information.
very few hundreds, insert records.
Please, help me, by providing the techniques or tools.
Is it posssible to automate the whole process.
Sreedhar V
null

Answer 1

Sreedhar V (guest) wrote:
: hi,
: Consider there is a Table A. There are around 1.7 Million
: Records.
: i have a situation that i will be getting the Data,
: Every two Weeks, around 100 - 200 thousand Records.
: I have to do some calculations.
: If any Old Data Exists, then update the Data
: for the Non - Primary Key Fields.
: Else
: I have to Insert the New Data.
: Most of the time, i will be getting update information.
: very few hundreds, insert records.
: Please, help me, by providing the techniques or tools.
: Is it posssible to automate the whole process.
: Sreedhar V
Here's a process that might help:
create a temporary table the same format as the flat file.
create a sqlldr control file to load the data from the file into
the temp table
create a pl\sql or JAVA script to cursor through the records
from the temp table and for each row see if there is a match on
TABLE A. If so this is an update, if not it is an insert.
If you are in a Unix environment you can write a shell script to
automate the whole process and schedule it in kron.
null