How to fix "ORA-31038:Invalid value ..." in a XML schema

Question

Hello,
We are in 11gR2 :
select * from v$version;
BANNER
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
PL/SQL Release 11.2.0.2.0 - Production
CORE    11.2.0.2.0      Production
TNS for Linux: Version 11.2.0.2.0 - Production
NLSRTL Version 11.2.0.2.0 - ProductionWe load XML files based on a registered XML schema.
Here is the top of our XML schema:
<?xml version="1.0" encoding="UTF-8"?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
         xmlns:xdb="http://xmlns.oracle.com/xdb"
         xmlns="http://www.capgemini.com/xsd/projet.xsd"
         targetNamespace="http://www.capgemini.com/xsd/projet.xsd"
         elementFormDefault="unqualified"
         blockDefault="#all">
  <xsd:element name="WORKBENCH_PROJECT" xdb:defaultTable="WORKBENCH_PROJECT_TABLE">
    <xsd:complexType xdb:maintainDOM="false">
      <xsd:sequence>
        <xsd:element ref="BaseCalendars"/>
        <xsd:element ref="PoolResources"/>
        <xsd:element ref="Projects"/>
      </xsd:sequence>
...We experience error ORA-31038: Invalid number value ... at the load of the XML, when the focus goes to a string type attribute :
Here it is :
        <Task
          UID="AJ\&apos;UF`2=_```)O0H;&quot;P!```?P```0" earlyStart="2010-04-20T08:00:00" category="Run"
          baseTime="2010-03-26T09:22:00" lateStart="2010-04-20T08:00:00" start="2010-04-20T08:00:00"
          proxy="false" earlyFinish="2010-05-12T17:00:00" lateFinish="2010-05-12T17:00:00"
          critical="true" status="2" shortName="OASIS 3.2" outlineLevel="4" baseFinish="2010-06-11T17:00:00"
          finish="2010-05-12T17:00:00" summary="false" baseStart="2010-05-17T08:00:00" baselineDuration="20.0"
          milestone="false" name="OASI 3.2.1 : Association d&apos;un plan à un PFO" fixed="true"
          locked="false" key="false" percComp="1.0" totalSlack="0.0" unplanned="false">
          <Assignments>
            <Assignment
              status="2" actualWork="24.0" resourceID="SMOUFLIH" start="2010-04-20T08:00:00" baselineWork="0.0"
Here is the XML schema part where the load fails ( at the attribute *<xsd:attribute name="name" type="xsd:string"/>* ) :
  <xsd:element name="Task" xdb:defaultTable="">
    <xsd:complexType xdb:maintainDOM="false">
      <xsd:sequence>
        <xsd:element ref="Assignments" minOccurs="0"/>
        <xsd:element ref="BaselineDetails" minOccurs="0"/>
        <xsd:element ref="Constraints" minOccurs="0"/>
        <xsd:element ref="Notes" minOccurs="0"/>
      </xsd:sequence>
      <xsd:attribute name="UID"/>
      <xsd:attribute name="taskID" type="xsd:string"/>
      <xsd:attribute name="baseFinish" type="xsd:NMTOKEN"/>
      <xsd:attribute name="baseStart" type="xsd:NMTOKEN"/>
      <xsd:attribute name="baseTime" type="xsd:NMTOKEN"/>
      <xsd:attribute name="baselineDuration" type="xsd:decimal"/>
      <xsd:attribute name="category" type="xsd:string"/>
      <xsd:attribute name="critical" type="xsd:string"/>
      <xsd:attribute name="earlyFinish" type="xsd:NMTOKEN"/>
      <xsd:attribute name="earlyStart" type="xsd:NMTOKEN"/>
      <xsd:attribute name="finish" type="xsd:NMTOKEN"/>
      <xsd:attribute name="fixed" type="xsd:string"/>
      <xsd:attribute name="guidelines" type="xsd:string"/>
      <xsd:attribute name="key" type="xsd:string"/>
      <xsd:attribute name="lastUpdatedBy" type="xsd:string"/>
      <xsd:attribute name="lastUpdatedDate" type="xsd:NMTOKEN"/>
      <xsd:attribute name="lateFinish" type="xsd:NMTOKEN"/>
      <xsd:attribute name="lateStart" type="xsd:NMTOKEN"/>
      <xsd:attribute name="locked" type="xsd:string"/>
      <xsd:attribute name="methodID" type="xsd:string"/>
      <xsd:attribute name="milestone" type="xsd:string"/>
      <xsd:attribute name="name" type="xsd:string"/>
      <xsd:attribute name="outlineLevel" type="xsd:integer"/>
      <xsd:attribute name="percComp" type="xsd:decimal"/>
      <xsd:attribute name="priority" type="xsd:string"/>
      <xsd:attribute name="proxy" type="xsd:string"/>
      <xsd:attribute name="shortName" type="xsd:string"/>
      <xsd:attribute name="start" type="xsd:NMTOKEN"/>
      <xsd:attribute name="status" type="xsd:integer"/>
      <xsd:attribute name="summary" type="xsd:string"/>
      <xsd:attribute name="totalSlack" type="xsd:double"/>
      <xsd:attribute name="unplanned" type="xsd:string"/>
      <xsd:attribute name="userText1" type="xsd:string"/>
      <xsd:attribute name="userText2" type="xsd:string"/>
      <xsd:attribute name="userText3" type="xsd:string"/>
      <xsd:attribute name="userText4" type="xsd:string"/>
      <xsd:attribute name="userText5" type="xsd:string"/>
  We know how to fix it manually :
The workaround is to :
remove all "&apos;" in each attribute called "name" But we suppose we need to amend the XML schema with a proper change. And we don't know how to do this.
The weird is that we've never noticed this error earlier on a 11gR1 DB... This error only occurs on our brand new 11.2.0.2
I hope it's clear enough for your understanding.
Do you have any advice ?
Thanks in advance,
Olivier

Answer 1

What are your NLS Settings
SQL> select *
  2  from nls_database_parameters
  3  where parameter in ('NLS_LANGUAGE', 'NLS_TERRITORY', 'NLS_CHARACTERSET');
PARAMETER                                SQL> select *
  2  from nls_database_parameters
  3  where parameter in ('NLS_LANGUAGE', 'NLS_TERRITORY', 'NLS_CHARACTERSET');
PARAMETER                    VALUE
NLS_LANGUAGE              AMERICAN
NLS_TERRITORY             AMERICA
NLS_CHARACTERSET       AL32UTF8
SQL>With my settings I do not see a problem with a cut-down test...
SQL> spool testcase.log
SQL> --
SQL> connect sys/oracle as sysdba
Connected.
SQL> --
SQL> set define on
SQL> set timing on
SQL> --
SQL> def USERNAME = CG
SQL> --
SQL> def PASSWORD = &USERNAME
SQL> --
SQL> -- def XMLDIR = &1
SQL> --
SQL> def USER_TABLESPACE = USERS
SQL> --
SQL> def TEMP_TABLESPACE = TEMP
SQL> --
SQL> drop user &USERNAME cascade
  2  /
old   1: drop user &USERNAME cascade
new   1: drop user CG cascade
User dropped.
Elapsed: 00:00:01.72
SQL> grant create any directory, drop any directory, connect, resource, alter session, create view to &USERNAME identified by &PASSWORD
  2  /
old   1: grant create any directory, drop any directory, connect, resource, alter session, create view to &USERNAME identified by &PASSWORD
new   1: grant create any directory, drop any directory, connect, resource, alter session, create view to CG identified by CG
Grant succeeded.
Elapsed: 00:00:00.01
SQL> alter user &USERNAME default tablespace &USER_TABLESPACE temporary tablespace &TEMP_TABLESPACE
  2  /
old   1: alter user &USERNAME default tablespace &USER_TABLESPACE temporary tablespace &TEMP_TABLESPACE
new   1: alter user CG default tablespace USERS temporary tablespace TEMP
User altered.
Elapsed: 00:00:00.01
SQL> connect &USERNAME/&PASSWORD
Connected.
SQL> --
SQL> -- create or replace directory XMLDIR as '&XMLDIR'
SQL> -- /
SQL> var SCHEMAURL1    varchar2(256)
SQL> VAR XMLSCHEMA1    CLOB;
SQL> VAR INSTANCE1     CLOB;
SQL> --
SQL> set define off
SQL> --
SQL> alter session set events='31098 trace name context forever'
  2  /
Session altered.
Elapsed: 00:00:00.00
SQL> begin
  2    :SCHEMAURL1:= 'http://xmlns.example.com/testcase.xsd';
  3    :XMLSCHEMA1 :=
  4  '<?xml version="1.0" encoding="UTF-8"?>
  5  <xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xdb="http://xmlns.oracle.com/xdb" elementFormDefault="qualified" attributeFormDefault="unqualified">
  6     <xsd:element name="Task" xdb:defaultTable="TASK_TABLE">
  7      <xsd:complexType xdb:maintainDOM="false">
  8        <xsd:sequence>
  9          <xsd:element name="Notes" type="xsd:string" minOccurs="0"/>
10        </xsd:sequence>
11        <xsd:attribute name="UID"/>
12        <xsd:attribute name="taskID" type="xsd:string"/>
13        <xsd:attribute name="baseFinish" type="xsd:NMTOKEN"/>
14        <xsd:attribute name="baseStart" type="xsd:NMTOKEN"/>
15        <xsd:attribute name="baseTime" type="xsd:NMTOKEN"/>
16        <xsd:attribute name="baselineDuration" type="xsd:decimal"/>
17        <xsd:attribute name="category" type="xsd:string"/>
18        <xsd:attribute name="critical" type="xsd:string"/>
19        <xsd:attribute name="earlyFinish" type="xsd:NMTOKEN"/>
20        <xsd:attribute name="earlyStart" type="xsd:NMTOKEN"/>
21        <xsd:attribute name="finish" type="xsd:NMTOKEN"/>
22        <xsd:attribute name="fixed" type="xsd:string"/>
23        <xsd:attribute name="guidelines" type="xsd:string"/>
24        <xsd:attribute name="key" type="xsd:string"/>
25        <xsd:attribute name="lastUpdatedBy" type="xsd:string"/>
26        <xsd:attribute name="lastUpdatedDate" type="xsd:NMTOKEN"/>
27        <xsd:attribute name="lateFinish" type="xsd:NMTOKEN"/>
28        <xsd:attribute name="lateStart" type="xsd:NMTOKEN"/>
29        <xsd:attribute name="locked" type="xsd:string"/>
30        <xsd:attribute name="methodID" type="xsd:string"/>
31        <xsd:attribute name="milestone" type="xsd:string"/>
32        <xsd:attribute name="name" type="xsd:string"/>
33        <xsd:attribute name="outlineLevel" type="xsd:integer"/>
34        <xsd:attribute name="percComp" type="xsd:decimal"/>
35        <xsd:attribute name="priority" type="xsd:string"/>
36        <xsd:attribute name="proxy" type="xsd:string"/>
37        <xsd:attribute name="shortName" type="xsd:string"/>
38        <xsd:attribute name="start" type="xsd:NMTOKEN"/>
39        <xsd:attribute name="status" type="xsd:integer"/>
40        <xsd:attribute name="summary" type="xsd:string"/>
41        <xsd:attribute name="totalSlack" type="xsd:double"/>
42        <xsd:attribute name="unplanned" type="xsd:string"/>
43        <xsd:attribute name="userText1" type="xsd:string"/>
44        <xsd:attribute name="userText2" type="xsd:string"/>
45        <xsd:attribute name="userText3" type="xsd:string"/>
46        <xsd:attribute name="userText4" type="xsd:string"/>
47        <xsd:attribute name="userText5" type="xsd:string"/>
48             </xsd:complexType>
49     </xsd:element>
50  </xsd:schema>';
51    :INSTANCE1 :=
52  '<Task
53            UID="AJ\&apos;UF`2=_```)O0H;&quot;P!```?P```0" earlyStart="2010-04-20T08:00:00" category="Run"
54            baseTime="2010-03-26T09:22:00" lateStart="2010-04-20T08:00:00" start="2010-04-20T08:00:00"
55            proxy="false" earlyFinish="2010-05-12T17:00:00" lateFinish="2010-05-12T17:00:00"
56            critical="true" status="2" shortName="OASIS 3.2" outlineLevel="4" baseFinish="2010-06-11T17:00:00"
57            finish="2010-05-12T17:00:00" summary="false" baseStart="2010-05-17T08:00:00" baselineDuration="20.0"
58            milestone="false" name="OASI 3.2.1 : Association d&apos;un plan A  un PFO" fixed="true"
59            locked="false" key="false" percComp="1.0" totalSlack="0.0" unplanned="false"/>';
60  end;
61  /
PL/SQL procedure successfully completed.
Elapsed: 00:00:00.00
SQL> set define on
SQL> --
SQL> declare
  2    V_XML_SCHEMA xmlType := XMLType(:XMLSCHEMA1);
  3  begin
  4    DBMS_XMLSCHEMA.registerSchema
  5    (
  6      SCHEMAURL        => :SCHEMAURL1,
  7      SCHEMADOC        => V_XML_SCHEMA,
  8      LOCAL            => TRUE,
  9      GENBEAN          => FALSE,
10      GENTYPES         => TRUE,
11      GENTABLES        => TRUE,
12      ENABLEHIERARCHY => DBMS_XMLSCHEMA.ENABLE_HIERARCHY_NONE
13    );
14  end;
15  /
PL/SQL procedure successfully completed.
Elapsed: 00:00:00.46
SQL> desc TASK_TABLE
Name                                      Null?    Type
TABLE of SYS.XMLTYPE(XMLSchema "http://xmlns.example.com/testcase.xsd" Element "Task") STORAGE Object-relational TYPE "Task3632_T"
SQL> --
SQL> insert into TASK_TABLE values ( XMLTYPE(:INSTANCE1))
  2  /
1 row created.
Elapsed: 00:00:00.01
SQL> commit
  2  /
Commit complete.
Elapsed: 00:00:00.09and am able to extract the value of the name attribute correct
SQL> select XMLCAST(XMLQUERY('/Task/@name' passing OBJECT_VALUE returning content) as VARCHAR2(64))
  2    from TASK_TABLE
  3  /
XMLCAST(XMLQUERY('/TASK/@NAME'PASSINGOBJECT_VALUERETURNINGCONTEN
OASI 3.2.1 : Association d'un plan A  un PFO
Elapsed: 00:00:00.00Could you try this simplied test in your database...
Edited by: mdrake on Nov 30, 2010 8:36 PM