Using muliple delimiters when importing files.

Question

I have some sql*loader control files that I created manually, but I would like to set those up in OWB so that I can keep the entire ETL process in one tool.
My files are Tab delimited, but the last field has trailing spaces so in my Control file I have TERMINATED BY WHITESPACE on the last field. How do I do this with OWB?
Thanks,
Scott

Answer 1

Hi
I personally have not found that much difference between sqlload and external tables in mappings without complex joins
What I think you are doing
sqlload --> Staging Table --> Validated staging table --> Fact Table
What I normally do for loads under 1m rows (rule of thumb based on current hardware that I don't stick to)
External Table --> Validated staging table --> Fact Table
which includes all the lookups in the first step
What I normally do for loads over 1m rows
External Table --> Staging Table --> Validated staging table --> Fact Table
where the lookups are done in the second step and the staging table can be indexed or not. The staging table is nologging and the first step a truncate/insert.
What I was suggesting is that you might consider switching from
sqlload --> Staging Table --> Validated staging table --> Fact Table
to using
External Table --> Staging Table --> Validated staging table --> Fact Table
where the first step is a straight truncate/insert with no joins.
Cheers
Ian