OWB Mapping involving Oracle External Table to Oracle Target Table.
Hi All,
I created a mapping which involves External Table as source & oracle table as target.
Following were steps followed.
1> Created Directory & External Table on oracle server
2> Attached Text file with ',' delimiter to the External Table.
3> Imported the External Table in source module.
4> Created mapping which involves External Table as Source & Oracle Table as Target.
5> Validated & Generated Mapping in OWB.
6> Deployed the mapping in Deployment Manager.
7> Executed the mapping in Deployment Manager.
Execution Results: Completed with errors.
No error message is displayed, I am wondering where can I get more information about the error message?
Thanks in Advance.
Regards,
Vidyanand
Hi,
Look in the logfile <your runtime owner>.log.* under the directory <owb home>/owb/log
thanks
Similar Messages
-
Executing external table mapping
Got this type of error message on executing a mapping of an external table to a another table. I have checked all the file sources, locations, etc.
ORA-29913: error in executing ODCIEXTTABLEOPEN callout ORA-29400: data cartridge error KUP-04040: blah_blah.csv in XXX_XXX_XXX_LOC not found.Hi.
This means the file is not in the directory it should be or maybe you don't have proper OS permissions to access the file.
The following query will show you where Oracle is looking for the file.
select a.type_owner, a.table_name, b.directory_name, b.directory_path
from dba_external_tables a,
dba_directories b
where a.default_directory_name = b.directory_name
and a.table_name like '&1'Regards,
Marcos -
External Table Performance and Sizing
Hi,
Can anyone tell me anything about best practices for external tables?
I have an application that writes structured log data to flat files. The size of these files can be configured and when the size limit is reached, they are rolled over. The data itself is queriable via an external table in oracle. Every so often the data is migrated (materialized) to a normal database table so it can be indexed, etc. and to keep the external file size down.
My questions are:
<ol><li> is there an optimum file size for an external table (overall size / number of rows) - by that, I suppose I mean, is there a limit where performance degrades significantly rather than constantly?
</li>
<li>is it better to have one large file mapped to the external table or multiple smaller ones mapped to the same table? e.g. does oracle do some parallel work on multiple smaller files at the same time which might improve things?
</li>
</ol>
If there are any resources discussing these issues, that would be great - or if there is any performance data for external tables in this respect, I would love to see it.
Many thanks,
DaveHi Dave
is there an optimum file size for an external table (overall size / number of rows) - by
that, I suppose I mean, is there a limit where performance degrades significantly rather
than constantly?AFAIK there is no such limit. In other words, access time is proportional to the size (number of rows).
is it better to have one large file mapped to the external table or multiple smaller ones
mapped to the same table? e.g. does oracle do some parallel work on multiple smaller
files at the same time which might improve things?The DOP of a parallel query on an external table is limited by the number of files. Therefore, to use parallel processing, more than one file is needed.
HTH
Chris Antognini
Troubleshooting Oracle Performance, Apress 2008
http://top.antognini.ch -
Error while running OWB mapping package from sql prompt
hi all,
i have deployed my owb mapping in oracle. Now i want to execute this from the sql prompt. the foolowing error is giving when i try to run.
SQL> DECLARE
2 RetVal NUMBER;
3 P_ENV WB_RT_MAPAUDIT.WB_RT_NAME_VALUES;
4 BEGIN
5 RetVal := TEST1.TEST_MAP.MAIN ( P_ENV );
6 END;
7 /
RetVal := TEST1.TEST_MAP.MAIN ( P_ENV );
ERROR at line 5:
ORA-06550: line 5, column 19:
PLS-00302: component 'TEST_MAP' must be declared
ORA-06550: line 5, column 3:
PL/SQL: Statement ignored
pls help me for finding the solution.
-Regards
Raj KumarYou need to split your data and create (at least 5) worksheet targets.
For example if you have a ROW_NUMBER column you can use for instance a
Conditional Split for something like:
ROW_NUMBER % 5 == 0 for Case 1 (excel 1)
ROW_NUMBER % 5 == 1 for Case 2 (excel 2)
ROW_NUMBER % 5 == 2 for Case 3 (excel 3)
ROW_NUMBER % 5 == 3 for Case 4 (excel 4)
ROW_NUMBER % 5 == 4 for Case 5 (excel 5) -
OMBPLUS Looking for External Table in Mappings
Hello,
Can I resolve this problem with OMBPLUS?
I would like looking for all the mappings (stage) that have a source as an External Table.
Maybe anyone have a example?
Thanks
christian
Edited by: user11126676 on 14.09.2009 07:19Something like this should get you on your way
(code assumes that you have logged in and CCd to the project and then the module already)
set maps [OMBLIST MAPPINGS]
foreach map $maps {
set tabs [ OMBRETRIEVE MAPPING '$map' GET EXTERNAL_TABLE OPERATORS]
if {[llength $tabs] == 0} {
puts "Mapping $map does not depend on external tables"
} else {
puts "Mapping $map depends on external tables: "
foreach tab $tabs {
puts $tab
}Cheers,
Mike -
How to create Oracle Table in DWB from Oracle external table
Dear all,
I have create Oracle External Table by using DWB. Kindly tell me steps that how could i able to import this external oracle table into internal oracle table now.
When I deploye this External table message arise "Name is using by an existing object.
any help would be ppreciated.
ThanksIn your database is there a table already existing with the same name as your external table? If there is then you can try and rename your external table in OWB and then deploy it again.
Then you can create a mapping with your source as the External Table Operator and the target as a Table Operator. When you run the mapping the data from the external table will be imported into the oracle table.
I hope this helps.
Regards
GB -
Error when i fetch the external table in oracle 9i ?
External table is created.
But, when i select the external table , it is thrwing the following error.
I have given READ and WRITE permission to the oracle directory.
And, i having the flat file with comma delimited data.
SQL> create table mohan_ext (
2 EMPNO NUMBER(5) ,
3 JOB VARCHAR2(15),
4 SALARY NUMBER(8,2),
5 MGR NUMBER(5) ,
6 HIREDATE DATE,
7 DEPTNO NUMBER(5)
8 )
9 organization external
10 (type oracle_loader
11 default directory ext_dir
12 access parameters (records delimited by newline
13 fields terminated by ','
14 missing field values are null
15 (
16 EMPNO NUMBER(5:5) ,
17 JOB VARCHAR2(15:15),
18 SALARY NUMBER(8,2:8,2),
19 MGR NUMBER(5:5) ,
20 HIREDATE DATE,
21 DEPTNO NUMBER(5:5)
22 )
23 )
24 LOCATION('flat.txt'));
Table created.
SQL> select * from mohan_ext;
select * from mohan_ext
ERROR at line 1:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-00554: error encountered while parsing access parameters
KUP-01005: syntax error: found "identifier": expecting one of: "comma, char, date, defaultif,
decimal, double, float, integer, (, nullif, oracle_date, oracle_number, position, raw, recnum, ),
unsigned, varrawc, varchar, varraw, varcharc, zoned"
KUP-01008: the bad identifier was: NUMBER
KUP-01007: at line 5 column 11
ORA-06512: at "SYS.ORACLE_LOADER", line 14
ORA-06512: at line 1
SQL>You may need to scrub some of the data prior to using it as an external table. For instance, ensure that you do not have any extra commas lingering around somewhere within the data as this could cause mapping issues with the data. I've used this process hundreds of times, and more often than not there is an extra comma somewhere that is causing the issue.
-
External table in Oracle 10g and Windows server 2003 problem
I'm having a problem accessing an external table in an Oracle 10g and Windows 2003 server environment. The disk is remote (mapped) to the server. It's the usual access errors, kup-04001 or kup-04063.
I have the [seemingly] exact same setup in an Oracle 9i and Windows 2000 server environment which works perfectly. Services run as local SYSTEM and SYSTEM has full permissions on the disk. Directories exist and so do the permissions to the directories.
In the Oracle 10g and Windows 2003 environment, services run as local SYSTEM and SYSTEM has full permissions on the mapped disk. Directories exist and so do the permissions to the directories.
This obviously effects mappings, deployments, etc.
Does anyone know if something changed in either the db or the os?
Thank you,
MichaelThank you for your reply.
Your proposal is the standard solution. As a matter of fact, that's how it is on my "old" system. Server "A" Oracle services are started by SYSTEM. Server "B" Oracle services are started by SYSTEM and is where the flat files reside. SYSTEM has full permissions on a disk local to Server "B". Database directoriies defined on Server "A" point to Server "B" remote disk. External Tables on Server "A" are defined with directories that point to Server "B" remote (mapped) disk. I have no problems with this configuration.
I'm having a problem acheiving the same configuration with Oracle 10g and Windows 2003. I guess I'm baffled over the fact it isn't working the same way as my "old" environment. Why shouldn't it? Oracle (and you) want me to start services as a specific user. It shouldn't have to be that way unless something changed in the way the database makes calls to the os or if Microsoft slipped something in with one of it's numerous security patches. -
External table in Oracle 10g and Windows server 2003
I'm having a problem accessing an external table in an Oracle 10g and Windows 2003 server environment. The disk is remote (mapped) to the server. It's the usual access errors, kup-04001 or kup-04063.
I have the [seemingly] exact same setup in an Oracle 9i and Windows 2000 server environment which works perfectly. Services run as local SYSTEM and SYSTEM has full permissions on the disk. Directories exist and so do the permissions to the directories.
In the Oracle 10g and Windows 2003 environment, services run as local SYSTEM and SYSTEM has full permissions on the mapped disk. Directories exist and so do the permissions to the directories.
Does anyone know if something changed in either the db or the os?
Thank you,
MichaelVersion 9.2.04.
Server "A" Oracle services are started by SYSTEM. Server "B" Oracle services are started by SYSTEM and is where the flat files reside. SYSTEM has full permissions on a disk local to Server "B". Database directoriies defined on Server "A" point to Server "B" remote disk. External Tables on Server "A" are defined with directories that point to Server "B" remote (mapped) disk. I have no problems with this configuration.
I'm having a problem acheiving the same configuration with Oracle 10g and Windows 2003. I guess I'm baffled over the fact it isn't working the same way as my "old" environment. Why shouldn't it? Oracle (and you) want me to start services as a specific user. It shouldn't have to be that way unless something changed in the way the database makes calls to the os or if Microsoft slipped something in with one of it's numerous security patches. -
Oracle BI Groups, Roles and permission through external Table
Hi,
We are using SSo integration with Oracle BI 10g. We need to fetch the roles , permission and groups through an external table to our Oracle BI Dashboard. Please let me know if this is possible.
Thanks,
Aditya AryaThanks a lot shru.
I have achieved this User authentication through external table but the roles, groups and permissions are assigned inside Oracle BI only. I need to get the roles from an external database table and map the users in that database only. I do not want to use the administration screen in Oracle BI to achieve this.
Also, I need to know what is the OBIEE variable i can use to override roles, as we use USER for adding a new user and the values that can be used to map the permissions.
Thanks,
Aditya Arya -
Error while creating oracle external table
I am trying to create an external table with the following syntax. WhenI have executed this statement in my server which running in my machine, it is working fine. Whine I try to run the same statement on different server, it is giving the below error. I have verified the grants on both the schemas, they are simillar.
create table ext_ORGBASIC_CLIENT1(
Serial_Number varchar2(1000),
Add_Edit_Organization varchar2(1000),
Parent_Organization varchar2(1000),
Organization_Code varchar2(1000),
Organization_Name varchar2(1000),
Legal_Entity varchar2(1000),
Active varchar2(1000),
Require_Entity_Use__as_Matchin varchar2(1000),
Pass_On_Tax_On_Tax_To_Customer varchar2(1000),
Allow_Exemption_Without_Receiv varchar2(1000),
Entiy_Use_Code_Association varchar2(1000),
Tax_Calculation_Type_Code varchar2(1000),
Transaction_Type_Code varchar2(1000),
Transaction_Source_Code varchar2(1000),
Taxware_Delivery_Terms_Code varchar2(1000),
Taxware_Mode_of_Transport_Code varchar2(1000),
Debit_Credit_Indicator varchar2(1000),
Discount_Type_Code varchar2(1000),
Place_of_Principal_Negotiation varchar2(1000),
Quantity_Unit_of_Measure_Code varchar2(1000),
Good_Service_Category_Code varchar2(1000),
Tax_Rate_Of_Geo_Code_To_Be_Aut varchar2(1000))
organization external
( type oracle_loader default directory EXT_TAB_DIR
access parameters ( records delimited by newline characterset US7ASCII load
when (serial_number != 'Number' and serial_number != '#')
badfile 'EXT_TAB_DIR':'CLIENT1.bad'
logfile 'EXT_TAB_DIR':'CLIENT1.log'
fields terminated by ',' optionally enclosed by '"' lrtrim missing field values are null
reject rows with all null fields )
location ('C_CLIENT1_TXWR_FS1_TWEBULK_ORGBASIC_1_1_20091126102230_001_CSV.csv') )
parallel reject limit unlimited
while querieng from the table I am getting the below error
select * from ext_orgbasic_client1;
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-04001: error opening file CLIENT1.log
ORA-06512: at "SYS.ORACLE_LOADER", line 19I try to run the same statement on different server, it is giving the below errorSame OS name & version?
Same Oracle version to 4 decimal places?
Same OS file permissions?
Same OS pathnames? -
Hi,
I am trying to insert a csv file as a single record as a CLOB (one row for entire csv file) and trying to do that via external table. But unalbe to do so. Following is the syntax I tried with:
create table testext_tab2
( file_data clob
organization external
TYPE ORACLE_LOADER
DEFAULT DIRECTORY dir_n1
access parameters
RECORDS DELIMITED BY NEWLINE
BADFILE DIR_N1:'lob_tab_%a_%p.bad'
LOGFILE DIR_N1:'lob_tab_%a_%p.log'
FIELDS TERMINATED BY ','
MISSING FIELD VALUES ARE NULL
clob_filename CHAR(100)
COLUMN TRANSFORMS (file_data FROM LOBFILE (clob_filename) FROM (DIR_N1) CLOB)
LOCATION ('emp.txt')
REJECT LIMIT UNLIMITED
--it gives the output that the table is created but the table does not have any rows (select count(*) from testext_tab2 gives 0 rows)
-- and the logfile has entries like follows:
Fields in Data Source:
CLOB_FILENAME CHAR (100)
Terminated by ","
Trim whitespace same as SQL Loader
Column Transformations
FILE_DATA
is set from a LOBFILE
directory is from constant DIR_N1
directory object list is ignored
file is from field CLOB_FILENAME
file contains character data
in character set WE8ISO8859P1
KUP-04001: error opening file /oracle/dba/dir_n1/7369
KUP-04017: OS message: No such file or directory
KUP-04065: error processing LOBFILE for field FILE_DATA
KUP-04101: record 1 rejected in file /oracle/dba/dir_n1/emp.txt
KUP-04001: error opening file /oracle/dba/dir_n1/7499
KUP-04017: OS message: No such file or directory
KUP-04065: error processing LOBFILE for field FILE_DATA
KUP-04101: record 2 rejected in file /oracle/dba/dir_n1/emp.txt
KUP-04001: error opening file /oracle/dba/dir_n1/7521
KUP-04017: OS message: No such file or directory
KUP-04065: error processing LOBFILE for field FILE_DATA
KUP-04101: record 3 rejected in file /oracle/dba/dir_n1/emp.txt
and also the file to be loaded (emp.txt) has data like this:
7369,SMITH,CLERK,7902,12/17/1980,800,null,20
7499,ALLEN,SALESMAN,7698,2/20/1981,1600,300,30
7521,WARD,SALESMAN,7698,2/22/1981,1250,500,30
7566,JONES,MANAGER,7839,4/2/1981,2975,null,20
7654,MARTIN,SALESMAN,7698,9/28/1981,1250,1400,30
7698,BLAKE,MANAGER,7839,5/1/1981,2850,null,30
7782,CLARK,MANAGER,7839,6/9/1981,2450,null,10
7788,SCOTT,ANALYST,7566,12/9/1982,3000,null,20
7839,KING,PRESIDENT,null,11/17/1981,5000,null,10
7844,TURNER,SALESMAN,7698,9/8/1981,1500,0,30
7876,ADAMS,CLERK,7788,1/12/1983,1100,null,20
7900,JAMES,CLERK,7698,12/3/1981,950,null,30
7902,FORD,ANALYST,7566,12/3/1981,3000,null,20
7934,MILLER,CLERK,7782,1/23/1982,1300,null,10I will be thankful for help on this. Also I read on asktom site (http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:1669379500346411993)
that LOB are not supported for external tables but there are other sites with examples of CLOB being loaded by external tables.
With regards,
OrausernCMcM wrote:
Hi all
We have an application that runs fine on 10.2.0.4 on most platforms, but a customer has reported an error when running 10.2.0.3 on HP. We have since reproduced the error on 10.2.0.3 on XP but have failed to reproduce it on Solaris or Linux.
The exact error is within a set of procedures, but the simplest reproducible form of the error is pasted in below.Except that you haven't pasted output to show us what the actual error is. Are we supposed to guess?
SQL> select * from v$version;
BANNER
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Prod
PL/SQL Release 10.2.0.1.0 - Production
CORE 10.2.0.1.0 Production
TNS for 32-bit Windows: Version 10.2.0.1.0 - Production
NLSRTL Version 10.2.0.1.0 - Production
SQL> ed
Wrote file afiedt.buf
1 declare
2 vstrg clob:= 'A';
3 Thisstrg varchar2(32000);
4 begin
5 for i in 1..31999 loop
6 vstrg := vstrg||'A';
7 end loop;
8 ThisStrg := vStrg;
9* end;
SQL> /
PL/SQL procedure successfully completed.
SQL>Works ok for me on 10.2.0.1 (Windows 2003 server) -
Hi,
I am working in Oracle 8i. I need to use Oracle 8i External Table to load data in the database. But I am getting the following error
ORA-00922: Missing or Invalid Option
The snippet which I used is as follows:
create table ext_table_csv (
a NUMBER,
n NUMBER,
m NUMBER
organization external
type oracle_loader
default directory swami
access parameters (
records delimited by newline
fields terminated by ';'
missing field values are null
location ('sample.txt')
PARALLEL
reject limit 0
The input file data is
018307;20080421;123457
018307;20080421;123457
Please let me know how this can be done in Oracle 8i and I have to use Oracle Loader only.Its a new feature introduced in Oracle 9i.
http://download.oracle.com/docs/cd/A91202_01/901_doc/server.901/a90120/ch2_feat.htm#58871
For 8i, SQL*Loader is the only option. -
External tables in Oracle 11g database is not loading null value records
We have upgraded our DB from Oracle 9i to 11g...
It was noticed that data load to external tables in 9i is rejecting the records with null columns..However upgrading it to 11g,it allows the records with null values.
Is there are way to restrict loading the records that has few coulmns that are null..
Can you please share if this is the expected behaviour in Oracle 11g...
Thanks.Data isn't really loaded to an External Table. Rather, the external table lets you query an external data source as if it were a regular database table. To not see the rows with the NULL value, simply filter those rows out with your SQL statement:
SELECT * FROM my_external_table WHERE colX IS NOT NULL;
HTH,
Brian -
Unix permission problem for external table in oracle 10g, sun solaris
Hello All,
I'm facing a problem in accessing external table which has stumped me a bit.
What I'm looking for is to use a external table with restricted permission to Others(770) on unix.
Would appreciate if someone helps me out here.
Here are the steps:
1.create directory ext_tab_dir1 as '/home/ravi/test'
2.grant read,write on directory ext_tab_dir1 to scott
3.CREATE TABLE scott.emp_load1(employee_number CHAR(5))
ORGANIZATION EXTERNAL (
type oracle_loader
default directory ext_tab_dir1
access parameters (
records delimited by newline
fields terminated by ' '
optionally enclosed by '"'
missing field values are null
location ('info.dat')
Now I have added unix user oracle to unix group myDbGroup and provided myDbGroup read/write/exec permission on directory /home/ravi/test.
info.dat has been placed in /home/ravi/test.
#pwd
/home/ravi
#ls -l
drwxrwx--- 2 ravi myDbGroup 512 Mar 7 17:35 test
I have manually logged in as user oracle and successfully created a sample file in /home/ravi/test.
-rwxrwx--- 1 ravi myDbGroup 13 Mar 7 17:33 info.dat
-rw-r--r-- 1 oracle oinstall 0 Mar 7 18:05 sampleFile
I then connect to the db using sqlplus as ravi and do a
#select * from scott.emp_load1
I get the following error
ERROR at line 1:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-04063: unable to open log file emp_load1_18567.log
OS error Permission denied
ORA-06512: at "SYS.ORACLE_LOADER", line 19
After this, I gave full permission to /home/ravi/test
drwxrwxrwx 2 ravi myDbGroup 512 Mar 7 17:35 test
#select * from scott.emp_load1
And this was successful.
It created a log file in /home/ravi/test
-rwxrwx--- 1 ravi myDbGroup 13 Mar 7 17:33 info.dat
-rw-r--r-- 1 oracle oinstall 0 Mar 7 18:05 sampleFile
-rw-r--r-- 1 oracle oinstall 0 Mar 7 18:05 emp_load1_18567.log
Now what stumped me is the owner and group owner of the file emp_load1_18567.log.
It is same as the sampleFile which I created manually!!
From this it can be deducted oracle is not using user id oracle while reading/writing to the unix directory but somehow assigning user id oracle as owner to the log file at the end.
If someone has encountered this problem earlier or has some info about this...pls share.
Regards,
RavinandanThanks for the reply.
I have earlier checked this with NOLOGFILE option.
But no luck.
I would like to add one more detail(which I missed earlier) about the problem.
If I give 750 access to /home/ravi(That is read/exec to Group and none perm to Others),
I will get the same error(KUP-04063: unable to open log file emp_load1_18567.log).
This obviously means oracle is not even able to access the directory(Although unix user oracle has access via the group perms).
Maybe you are looking for
-
How to call a function of registered DLL in Diadem8.10?
Please make the entire procedure after registering DLL in Diadem8.1. Notably, i can't use LAbview. I need it in VBS file. Can you put a sample code example, as i already exhausted in searching the help.
-
dear all, we have a requirement ... the requirement is about financial department. we have received post dated cheque from client , let say '10-apr-10'. and we want to inform to particular client before 7 days that their cheque date is coming please
-
Hello Everyone, I have one requirement for mass upload/Download documents in DMS. I read certain discussions which held earlier & decided to go for Sap Easy DMS. Is this right decision ? I have integrated this with ECC & it is working fine as of now.
-
Downloading firefox program will not complete instal
== Issue == I have another kind of problem with Firefox == Description == when i download firefox program from the website, after downloading when i save it i open it and the program starts to install but does not complete installation, stops in the
-
Sync delegated calendars to iPhone
Hello, is there any way to sync calendars that are delegated to me via a Mac Server to my iPhone? In iTunes they do not appear in the list of calendars being able to sync (only my own delegated calendars). Please help! Otherwise this would be complet