External table and XML

Hi.
I have this XML-structure:
<order>
<orderhead>
<orderno>123</orderno>
<orderline>
<name>name_of_what_i_order</name>
</orderline>
<orderline>
<name>name_of_what_i_order</name>
</orderline>
</orderhead>
</order>
How can I get the <orderhead><orderno> when I'm making an external table for the <ordeline> elements? I use 'records delimited by "</orderline>"' to get all the orderlines in one tablerow each. But how can I insert the orderno in each of these rows?

Hi,
You need to practice or test by youself. Fortunately, I have a posting at http://www.oraclepoint.com/topic.php?filename=98&extra=page%3D1, which is a similar case I've done couple of years ago.
What I did are:
1. formating XML
2. Load to oracle table by using SQL*Loader
3. Parse elements one by one from entire xml large object from within oracle table
4. insert the parsed elements to oracle table
Hope it helps. By the way, please register and then log in at oraclepoint.com to get the solution package becuase it's only available for members.
R.Wang
http://www.oraclepoint.com

Similar Messages

Request: PL/SQL, External Table and SQL Loader

I see lately Questions asked in SQL and PL/SQL forum regarding SQL Loader and External Table are being moved to {forum:id=732}.
Being an PL/SQL developer for some time now i feel External Table (and if i may, SQL Loader and DBMS_DATAPUMP) are very much an integral part of a PL/SQL development and the question related to these topics are well suited in SQL and PL/SQL forum. Even in SQL and PL/SQL FAQ we have exclusive content that discuss on these topics {message:id=9360007}
So i would like to request the moderators to consider not moving such questions out of the SQL and PL/SQL forum.
Thanks,
Karthick.

Karthick_Arp wrote:
I see lately Questions asked in SQL and PL/SQL forum regarding SQL Loader and External Table are being moved to {forum:id=732}.
Being an PL/SQL developer for some time now i feel External Table (and if i may, SQL Loader and DBMS_DATAPUMP) are very much an integral part of a PL/SQL development and the question related to these topics are well suited in SQL and PL/SQL forum. Even in SQL and PL/SQL FAQ we have exclusive content that discuss on these topics {message:id=9360007}
So i would like to request the moderators to consider not moving such questions out of the SQL and PL/SQL forum.
Thanks,
Karthick.Not sure which moderators are moving them... cos it ain't me. I'm quite happy to leave those there.

SQL LOADER , EXTERNAL TABLE and ODBS DATA SOURCE

hello
Can any body help loading data from dbase file .dbt to an oracle 10g table.
I tried last day with SQL LOADER, EXTERNAL table , and ODBC data source.
Why all of these utilities still failing to solve my problem ?
Is there an efficient way to reach this goal ?
Thanks in advance

export the dbase data file to text file,
then you have choice of using either sql loader or external table option to use.
regards

Spry Tables and Xml Data Sets viewed in IE7

Has anyone ever run into a problem with Spry Tables and Xml
Data Sets viewed in IE7? Work fine in IE6 and Firefox, but get the
error "exception caught while loading feed.xml: [object Error]" in
IE 7. Any ideas?
Attached is the xml I'm using.
Thanks

I came looking for the answer to this question. I could not
find an answer. Eventually I found it the answer that worked for
me, a graphic designer with not much experience in xml.
The following url provided an errata file in PDF format:
www.peachpit.com/dwcs3cib
which includes the following addendum to the incomplete
instructions in the book i was using to learn about spry:
"If Internet Explorer 7 is your primary browser, you'll nee
to take some extra steps to view spry dynamic content locally.
First, your site must be within the local server webroot; be sure
your Lessons folder is stored within the Inetpub>wwwroot folder.
Next, double-click the site name in the files panel to open the
Site Definition dialogue. Click the Testing Server category; from
the Access List choose Local/Network. Click Okay to close the Site
Definition dialogue. Now, when you preview your page with Internet
Explorer, your local Web server (localhost) serves the page as
designed."
Horray for me! Now i can move on from here and actually get
some work done!

External table and newline character

I have an external table which is just a csv file, records delimited by newline and fields terminated by ','. However, the last column has a newline character appended to it. Is there an option in the external table syntax which will trim this?

Try setting 'REJECT ROWS WITH ALL NULL FIELDS'
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96652/ch12.htm#1011062

External Table and Direct path load

Hi,
I was just playing with Oracle sql loader and external table features. few things which i ovserved are that data loading through direct path method of sqlloader is much faster and takes much less hard disk space than what external table method takes. here are my stats which i found while data loading:
For Direct Path: -
# OF RECORDS.............TIME...................SOURCE FILE SIZE...................DATAFILE SIZE(.dbf)
478849..........................00:00:43.53...................108,638 KB...................142,088 KB
957697..........................00:01:08.81...................217,365 KB...................258,568 KB
1915393..........................00:02:54.43...................434,729 KB...................509,448 KB
For External Table: -
# OF RECORDS..........TIME...................SOURCE FILE SIZE...................DATAFILE SIZE(.dbf)
478849..........................00:02:51.03...................108,638 KB...................966,408 KB
957697..........................00:08:05.32...................217,365 KB...................1,930,248 KB
1915393..........................00:17:16.31...................434,729 KB...................3,860,488 KB
1915393..........................00:23:17.05...................434,729 KB...................3,927,048 KB
(With PARALLEL)
i used same files for testing and all other conditions are similar also. In my case datafile is autoextendable, hence, as par requirement its size is automatically increased and hard disk space is reduced thus.The issue is that, is this an expected behaviour? and why in case of external tables such a large hard disk space is used when compared to direct path method? Performance of external table load is also very bad when compared to direct path load.
one more thing is that while using external table load with PARALLEL option, ideally, it should take less time. But what i actually get is more than what the time was without PARALLEL option.
In both the cases i am loading data from the same file to the same table (once using direct path and once using external table). before every fresh loading i truncate my internal table into which data was loaded.
any views??
Deep
Message was edited by:
Deep

Thanx to all for your suggestions.
John, my scripts are as follows:
for external table:
CREATE TABLE LOG_TBL_LOAD
(COL1 CHAR(20),     COL2 CHAR(2),     COL3 CHAR(20),     COL4 CHAR(400),
     COL5 CHAR(20),     COL6 CHAR(400),     COL7 CHAR(20),     COL8 CHAR(20),
     COL9 CHAR(400),     COL10 CHAR(400))
ORGANIZATION EXTERNAL
(TYPE ORACLE_LOADER
DEFAULT DIRECTORY EXT_TAB_DIR
ACCESS PARAMETERS
(RECORDS DELIMITED BY NEWLINE
FIELDS TERMINATED BY WHITESPACE OPTIONALLY ENCLOSED BY '"' MISSING FIELD VALUES ARE NULL
LOCATION ('LOGZ3.DAT')
REJECT LIMIT 10;
for loading i did:
INSERT INTO LOG_TBL (COL1, COL2, COL3, COL4,COL5, COL6,
COL7, COL8, COL9, COL10)
(SELECT COL1, COL2, COL3, COL4, COL5, COL6, COL7, COL8,
COL9, COL10 FROM LOG_TBL_load_1);
for direct path my control file is like this:
OPTIONS (
DIRECT = TRUE
LOAD DATA
INFILE 'F:\DATAFILES\LOGZ3.DAT' "str '\n'"
INTO TABLE LOG_TBL
APPEND
FIELDS TERMINATED BY WHITESPACE OPTIONALLY ENCLOSED BY '"'
(COL1 CHAR(20),
COL2 CHAR(2),
COL3 CHAR(20),
COL4 CHAR(400),
COL5 CHAR(20),
COL6 CHAR(400),
COL7 CHAR(20),
COL8 CHAR(20),
COL9 CHAR(400),
COL10 CHAR(400))
and ya, i have used same table in both the situations. after loading once i used to truncate my table, LOG_TBL. i used the same source file, LOGZ3.DAT.
my tablespace USERS is loaclly managed.
thanks

External table and discarded rows

I need to load a table mapping an external table.
Sometimes some rows are discarded due to constraints violation or bad values in the file.
How is it possible to identify the discarded rows?
Is it possible to automatically create a file containing the
discarded records?
Thanks, Gio.

Before specify a location, you have to create/define directories in the database and set permissions on them.
Add the location(s) to OWB and register them.
Right click on the external table, choose CONFGURE.
Navigate to ACCESS SPECIFICATION. set the locations here.

External Table and HTTP

All,
Is it possible to specify a URL as the location of a file for an external table? (e.g. http://www.somesite.com/somedir/somefile.csv)
For some organizations, getting files onto the actual Oracle server is a difficult process because they tend to be managed externally, often by an entirely different group from the ones doing the DBA work. NFS, FTP drop-zones, etc. all seem to be considered security risks. Being able to pull directly across a protocol would be a very nice feature.

You need to specify a directory object from where the file is being read by external table. May be you can try creating a directory object which maps to the directory in the network. It may work if the directory is accessible from the server.

External table and error: ORA-01036: illegal variable name/number

using the following script I get the referenced error:
create table dol_sch_c_part2
(DLN NUMBER(14) ,
PAGE_ID VARCHAR2(20),
PAGE_SEQ VARCHAR2(20),
PAGE_ROW_NUM VARCHAR2(20),
ROW_NUM VARCHAR2(20),
IMAGE_FORM_ID VARCHAR2(20),
PROVIDER_TERM_01_NAME VARCHAR2(35),
PROVIDER_TERM_01_EIN VARCHAR2(9) ,
PROVIDER_TERM_01_POSITION VARCHAR2(25),
PROVIDER_TERM_01_STR_ADDRESS VARCHAR2(35),
PROVIDER_TERM_01_CITY VARCHAR2(20),
PROVIDER_TERM_01_STATE VARCHAR2(2),
PROVIDER_TERM_01_ZIP_CODE VARCHAR2(9),
PROVIDER_TERM_01_PHONE_NUM VARCHAR2(10),
PROVIDER_TERM_01_TEXT VARCHAR2(250)
ORGANIZATION EXTERNAL
( type oracle_loader
default directory data_dir
access parameters
RECORDS FIXED 510
FIELDS
DLN(1:14) char(14),
PAGE_ID(15:34) char(20) NULLIF PAGE_ID=BLANKS,
PAGE_SEQ(35:54) char(20) NULLIF PAGE_SEQ=BLANKS,
PAGE_ROW_NUM(55:74) char(20) NULLIF PAGE_ROW_NUM=BLANKS,
ROW_NUM(75:94) char(20) NULLIF ROW_NUM=BLANKS,
IMAGE_FORM_ID(95:114) char(20) NULLIF IMAGE_FORM_ID=BLANKS,
PROVIDER_TERM_01_NAME(115:149) char(35) NULLIF PROVIDER_TERM_01_NAME=BLANKS,
PROVIDER_TERM_01_EIN(150:158) char(9) NULLIF PROVIDER_TERM_01_EIN=BLANKS,
PROVIDER_TERM_01_POSITION(159:183) char(25) NULLIF PROVIDER_TERM_01_POSITION=BLANKS,
PROVIDER_TERM_01_STR_ADDRESS(184:218) char(35) NULLIF PROVIDER_TERM_01_STR_ADDRESS=BLANKS,
PROVIDER_TERM_01_CITY(219:238) char(20) NULLIF PROVIDER_TERM_01_CITY=BLANKS,
PROVIDER_TERM_01_STATE(239:240) char(2) NULLIF PROVIDER_TERM_01_STATE=BLANKS,
PROVIDER_TERM_01_ZIP_CODE(241:249) char(9) NULLIF PROVIDER_TERM_01_ZIP_CODE=BLANKS,
PROVIDER_TERM_01_PHONE_NUM(250:259) char(10) NULLIF PROVIDER_TERM_01_PHONE_NUM=BLANKS,
PROVIDER_TERM_01_TEXT(260:509) char(250) NULLIF PROVIDER_TERM_01_TEXT=BLANKS
location ('f_dol_sch_c_part2.txt')
I've tried it with and without the char(*) in the fields section - no change
thanks

*** SCRIPT START : Session:GLEN_SELF@RAMBO(8) 8/31/2006 12:16:48 PM ***
Processing ...
create or replace directory data_dir as 'c:\dol\'
create table dol_sch_c_part2
(DLN NUMBER(14) ,
PAGE_ID VARCHAR2(20),
PAGE_SEQ VARCHAR2(20),
PAGE_ROW_NUM VARCHAR2(20),
ROW_NUM VARCHAR2(20),
IMAGE_FORM_ID VARCHAR2(20),
PROVIDER_TERM_01_NAME VARCHAR2(35),
PROVIDER_TERM_01_EIN VARCHAR2(9),
PROVIDER_TERM_01_POSITION VARCHAR2(25),
PROVIDER_TERM_01_STR_ADDRESS VARCHAR2(35),
PROVIDER_TERM_01_CITY VARCHAR2(20),
PROVIDER_TERM_01_STATE VARCHAR2(2),
PROVIDER_TERM_01_ZIP_CODE VARCHAR2(9),
PROVIDER_TERM_01_PHONE_NUM VARCHAR2(10),
PROVIDER_TERM_01_TEXT VARCHAR2(250)
ORGANIZATION EXTERNAL
( type oracle_loader
default directory data_dir
logfile 'ext_tab.log'
access parameters
RECORDS FIXED 510
FIELDS
DLN(1:14),
PAGE_ID(15:34),
PAGE_SEQ(35:54),
PAGE_ROW_NUM(55:74),
ROW_NUM(75:94),
IMAGE_FORM_ID(95:114),
PROVIDER_TERM_01_NAME(115:149),
PROVIDER_TERM_01_EIN(150:158),
PROVIDER_TERM_01_POSITION(159:183),
PROVIDER_TERM_01_STR_ADDRESS(184:218),
PROVIDER_TERM_01_CITY(219:238),
PROVIDER_TERM_01_STATE(239:240),
PROVIDER_TERM_01_ZIP_CODE(241:249),
PROVIDER_TERM_01_PHONE_NUM(250:259),
PROVIDER_TERM_01_TEXT(260:509)
location ('f_dol_sch_c_part2.txt')
create or replace directory data_dir as 'c:\dol\'
ORA-01036: illegal variable name/number
*** Script stopped due to error ***
*** SCRIPT END : Session:GLEN_SELF@RAMBO(8) 8/31/2006 12:16:49 PM ***

External table and data load order

I'm unsing Oracle 10g exterbal table feature to load a text file to the database
1- What is the default order of loading the text file into the Oracle table
2- How to ensure or to change the this default behavior

1- What is the default order of loading the text file into the Oracle tableTop (row#1) to bottom
2- How to ensure or to change the this default behavioruse ORDER BY clause

XML File in External Table - OS error permission denied.

Hi.
10g R2, Red Hat Linux
I'm using the article (see below, taken from http://www.dbazine.com/olc/olc-articles/scardina1 by Mark Scardina) to create an external table where I'd store my XML file.
So, I
1. Created a directory xmlfile_dir
2. Granted access to needed db user
3. Created the table
CREATE TABLE relayxml_xt (doc CLOB)
ORGANIZATION EXTERNAL
TYPE ORACLE_LOADER
DEFAULT DIRECTORY xmlfile_dir
ACCESS PARAMETERS
FIELDS (lobfn CHAR TERMINATED BY ',')
COLUMN TRANSFORMS (doc FROM lobfile (lobfn))
LOCATION ('xml.dat')
REJECT LIMIT UNLIMITED;
4. mv relay.xml /xmlfile_dir/xml.dat
When I run SELECT * FROM relayxml_xt I get this:
Error starting at line 1 in command:
select * from relayxml_xt
Error report:
SQL Error: ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-04063: unable to open log file RELAYXML_XT_28773.log
OS error Permission denied
ORA-06512: at "SYS.ORACLE_LOADER", line 19
29913. 00000 - "error in executing %s callout"
*Cause:    The execution of the specified callout caused an error.
*Action:   Examine the error messages take appropriate action.
What am I doing wrong?
Thanks,
Using External Tables
Introduced in Oracle9i, Oracle’s external table feature offers a solution to define a table in the database while leaving the data stored outside of the database. Prior to Oracle Database 10g, external tables can be used only as read-only tables. In other words, if you create an external table for XML files, these files can be queries and the table can be joined with other tables. However, no DML operations, such as INSERT, UPDATE, and DELETE, are allowed on the external tables.
Note: In Oracle Database 10g , by using the ORACLE_DATAPUMP driver instead of the default ORACLE_DRIVER, you can write to external tables. In Oracle Database 10g, you can define VARCHAR2 and CLOB columns in external tables to store XML documents. The following example shows how you can create an external table with a CLOB column to store the XML documents. First, you need to create a DIRECTORY to read the data files:
CREATE DIRECTORY data_file_dir AS 'D:\xmlbook\Examples\Chapter9\src\xml';
GRANT READ, WRITE ON DIRECTORY data_file_dir TO demo;
Then, you can use this DIRECTORY to define an external table:
CREATE TABLE customer_xt (doc CLOB)
ORGANIZATION EXTERNAL
TYPE ORACLE_LOADER
DEFAULT DIRECTORY data_file_dir
ACCESS PARAMETERS
FIELDS (lobfn CHAR TERMINATED BY ',')
COLUMN TRANSFORMS (doc FROM lobfile (lobfn))
LOCATION ('xml.dat')
REJECT LIMIT UNLIMITED;
The xml.dat file follows:
customer1.xml
customer2.xml
If you describe the table, you can see the following definition:
SQL> DESC customer_xt;
Name Null? Type
DOC CLOB
Then, you can query the XML document as follows:
SELECT XMLType(doc).extract('/Customer/EMAIL')
FROM customer_xt;
Though the query requires run-time XMLType creation and XPath evaluation, this approach is useful when applications just need a few queries on the XML data and don’t want to upload the XML data into database. In Oracle Database 10g, you cannot create external tables that contain pre-defined XMLType column types.
Message was edited by:
vi2167

Your don't have the proper operating system privileges. Be sure that you (=oracle OS user / the OS Linux user that is starting the database) are allowed have read privs on the path and/or file.
for example...
chown -Rf /xxxxxxx/xxxx/etc
ls -l file.xml
file.xml    oracle:oinstall    rw-rw-rw

External table log and bad files

Hi, i have defined the following access parameters for my external table and set REJECT LIMIT to 0:
ACCESS PARAMETERS
RECORDS DELIMITED by NEWLINE
BADFILE BAD_DIR:'CARDS.bad'
LOGFILE LOG_DIR:'CARDS.log'
NODISCARDFILE
FIELDS TERMINATED BY ","
OPTIONALLY ENCLOSED BY '"'
READSIZE 1048576
LRTRIM
MISSING FIELD VALUES ARE NULL
REJECT ROWS WITH ALL NULL FIELDS
I want to know everytime i query the external table, my log file and bad file will be overwritten or appended? i want them to be overwritten.

Hi,
Yeah, well, be in for a surprise here:
"The external tables feature is a complement to existing SQL*Loader functionality."
http://download.oracle.com/docs/cd/B19306_01/server.102/b14220/utility.htm#sthref1800
http://www.oracle.com/pls/db102/search?remark=quick_search&word=external+table&tab_id=&format=ranked
Have you actually read/tried anything?
You can download an XE DB for free and play with that.

Subject area security validating users and groups from external table

Hi all.
I don't have practice to put question here, but there is one problem, that seems don't work correctly in OBIEE.
I'm trying to put users in groups within external table and this works fine.
I put security on the subject area level like this:
SA1 -> GroupA allow, Everyone not allow
SA2 -> GroupB allow, Everyone not allow
External table:
User----------Group
A---------GroupA;GroupB
B---------GroupB
Users A, B and GroupA, GroupB exists in the RPD, but I didn't put users inside them, I want this from table.
From the init block, external table I'm taking users and join them in the group. Same name users and groups are also in the presentation service.
When i connect with user A i don't see any subject area, when go to My Account i see in Group Membership/GroupA and GroupB, so it's readed from the external table.
Why in this case the subject area permission is not working?
It works if I explicitly put users in groups, in the RPD.
I have read this blog entry http://kpipartners.blogspot.com/2009/07/groups-webgroups-and-delivers.html and it is said that this works, but I'm interested how.
What should we have in the presentation part, administration, Manage Privileges -> Access within Oracle BI Answers option for those two subject area?
This doesn't work or something is missing:
Re: Security on Subject Areas
Regards
Goran
http://108obiee.blogspot.com

What should we have in the presentation part, administration, Manage Privileges -> Access within Oracle BI Answers option for those two subject area?Yes, you should remove Everyone and add the relevant groups to each Subject Area. You don't need to set privileges in the RPD, in fact that's probably why it doesn't work for you. Leave your RPD Presentation Catalog as "Everyone" = Read as you will controlling access from the Presentation Services and it should work.

External Table Security with OBIEE 11G is not working properly.

Hello Everyone,
we just upgraded for OBIEE from 10G to 11G.
not what we had in 10G for object level and data level security is that we were using "External table" and LDAP Authentication.
Now for User we are capturing Groups in that table, so basically we have Group-level security.
so in that case we are creating Groups in External Table, RPD & Catalog.
Now we upgraded OBIEE to 11G, there we have totally different concept for security.
So here in what we have to do to implement the same concept. because we have created the Application Roles in Admin Console and Groups in Enterprise Manager with same name, and assigned same Groups to same Application Role.
now while applying security in frontend we can catalog groups options too!!! so do we have to create the same groups in catalog too?? and while applying the security to catalog which one do we need to use? "Application Role" OR "Catalog Groups"???
Thanking You..

Hi,
which version r u using? until obiee11.1.1.5 its bug but solve it by workaround method . also the bug fixed in obiee.11.1.1.6
11700314 REPORT NOT EXPORTED FULLY INTO EXCEL WHEN DOWNLOADING FROM PAGES OTHER THAN 1
1) stop it all u r bi serivices then take a back of u original instanconfig.xml file then do the below changes
D:\Oracle\Middleware\instances\instance1\config\OracleBIPresentationServicesComponent\coreapplication_obips1
instanceconfig.xml
just add below content then
<Views>
<Pivot>
<MaxCells>6500000</MaxCells>
<MaxVisibleColumns>100</MaxVisibleColumns>
<MaxVisiblePages>1000</MaxVisiblePages>
<MaxVisibleRows>65000</MaxVisibleRows>
<MaxVisibleSections>25</MaxVisibleSections>
<DefaultRowsDisplayed>500</DefaultRowsDisplayed>
<DefaultRowsDisplayedInDelivery>75</DefaultRowsDisplayedInDelivery>
<DefaultRowsDisplayedInDownload>64000</DefaultRowsDisplayedInDownload>
<DisableAutoPreview>false</DisableAutoPreview>
</Pivot>
<Table>
<MaxCells>6500000</MaxCells>
<MaxVisiblePages>1000</MaxVisiblePages>
<MaxVisibleRows>65000</MaxVisibleRows>
<MaxVisibleSections>25</MaxVisibleSections>
<DefaultRowsDisplayed>500</DefaultRowsDisplayed>
<DefaultRowsDisplayedInDelivery>75</DefaultRowsDisplayedInDelivery>
<DefaultRowsDisplayedInDownload>64000</DefaultRowsDisplayedInDownload>
</Table>
</Views>
Restart all u r bi services..
then test it out.
Thanks
Deva

Report query not returning the field value from external table

hi
I have an issue regarding reports. I have a query having 4 fields from external table and remaining from db tables. the report query returns all the fields from the db tables and only 2 fields from external table. but the same query if I tried in plsql developer it returns all the fields values.
Can anyone please help me in this issue.
Thanks and Regards
kk

Duplicate post?
value not displaying in report whereas it returns in plsql developer
value not displaying in report whereas it returns in plsql developer
Please log a SR if you do not get any reply to your thread instead of creating new one.
Thanks,
Hussein

External table and XML

Similar Messages

Maybe you are looking for