UTF-8 characters getting rejected during external file load

Question

Hi All,
I have a column called AssetName declared as NVARCHAR2(100) declared in an external table which maps to a file called Example.dat
When the AssetName is coming in with some characters like the one present in the name shown below, the data is getting rejected. Can someone please help me analyze this?
Data getting rejected:
Competitors PortuguêsDB Info
Version - 11gR1
NLS_LANGUAGE     AMERICAN
NLS_TERRITORY     AMERICA
NLS_CURRENCY     $
NLS_ISO_CURRENCY     AMERICA
NLS_NUMERIC_CHARACTERS     .,
NLS_CHARACTERSET     AL32UTF8
NLS_CALENDAR     GREGORIAN
NLS_DATE_FORMAT     DD-MON-RR
NLS_DATE_LANGUAGE     AMERICAN
NLS_SORT     BINARY
NLS_TIME_FORMAT     HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT     DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT     HH.MI.SSXFF AM TZR
NLS_TIMESTAMP_TZ_FORMAT     DD-MON-RR HH.MI.SSXFF AM TZR
NLS_DUAL_CURRENCY     $
NLS_COMP     BINARY
NLS_LENGTH_SEMANTICS     BYTE
NLS_NCHAR_CONV_EXCP     FALSE
NLS_NCHAR_CHARACTERSET     AL16UTF16
NLS_RDBMS_VERSION     11.1.0.6.0Edited by: Chaitanya on May 2, 2012 9:13 PM

Answer 1

Hi Justin,
Here are the asnwers;
OK. But that implies that there is an error message in the log file. What is the error message?
-- the message is pointing to the previous column even though there is valid data:
Sample data:
The 1st and 3rd rows are getting inserted but 2nd row is rejected.
LineNumber#|#CEID#|#SessionId#|#ReqDate#|#APC#|#CTC#|#LangCode#|#DestProdCode#|#EPCode#|#EPActionCode#|#DeviceCode#|#BswrName#|#BwsrVer#|#BwsrUserAgent#|#Platform#|#NoofItems#|#UserID#|#Namespace#|#AcctNum#|#Email_address#|#FolderID#|#FolderName#|#FolderType#|#EMFormat#|#EMDeliveryType#|#EMDisposition#|#EMLinkType#|#EMSLID#|#EMRAID#|#EMVWID#|#EMListType#|#NLID#|#NLName#|#NLEID#|#NLEName#|#NLFormat#|#NLLinkType#|#NLTMPL#|#NLCSTM#|#NLDOPT#|#RDREmail#|#RDRFname#|#RDRLName#|#RDRCompname#|#WDID#|#WDName#|#WDORGUID#|#WDORGNS#|#WDDomain#|#WDDOPT#|#WDFldrCount#|#WDArticleView#|#RSSFeed#|#RSSType#|#HomePage#|#AId#|#AName#|#AType#|#DMD#|#LinkType#|#AOPT
4144#|#312010576517717406#|#27139ZzZKJHEQT2CAAAGUAYAAAAAQDLJAAAAAABSGAYTEMBVGAZDCMRTG4ZTENRT#|#20120502163835.1502#|#T#|#D#|#en#|#F.COM#|#AE#|#AV#|#D#|#IE#|#7.0#|#Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB7.3; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E)#|#WinXP#|##|#FP181483#|#26#|#9ERN000800#|##|#301104820#|#Competitors Português#|#GBL#|#ht#|#sch#|#inl#|#sa#|##|##|##|##|##|##|##|##|#ht#|#sa#|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|#30114820#|#Competitors Português#|##|##|#sa#|#
4733#|#312020576517823023#|#27139ZzZKJHEQT2CAAAGUAYAAAAAQDLJAAAAAABSGAYTEMBVGAZDCMRTG4ZTENRT#|#20120502165454.4284#|#T#|#D#|#en#|#F.COM#|#AE#|#AV#|#D#|#IE#|#7.0#|#Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB7.3; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET4.0C; .NET4.0E)#|#WinXP#|##|#FP181483#|#26#|#9ERN000800#|##|#301104820#|#Competitors Português#|#GBL#|#ht#|#sch#|#inl#|#sa#|##|##|##|##|##|##|##|##|#ht#|#sa#|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|#301104820#|#Competitors Português#|##|##|#sa#|#
1#|#512020578010952807#|#27141ZzZKJHEQOKCAAAGUBIAAAAAJSX2AAAAAABSGAYTEMBUGEYDAMRVHEYDSMRQ#|#20120410065913.0698#|#S#|#D#|#en#|#F.COM#|#DU#|#SP#|#D#|#IE#|#7.0#|#Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 3.5.30729; InfoPath.3; .NET4.0C; .NET4.0E; MS-RTC LM 8; SLCC1; InfoPath.2; MS-RTC S; USPortal)#|#WinNT#|##|#X000745674#|#30#|#9DEL001400#|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|##|#Error:
****** The FileName is Action_20120502_141003_fodsapp2_Rejected.dat ******
LOG file opened at 05/03/12 00:56:01
Field Definitions for table EXT_TABLE_ACTION
  Record format DELIMITED BY NEWLINE
  Data in file has same endianness as the platform
  Rows with all null fields are accepted
  Fields in Data Source:
    LINENUMBER                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    CEID                            CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    SESSIONID                       CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    REQDATE                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    APC                             CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    CTC                             CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    LANGCODE                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    DESTPRODCODE                    CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EPCODE                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EPACTIONCODE                    CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    DEVICECODE                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    BWSRNAME                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    BWSRVER                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    BWSRUSERAGENT                   CHAR (2000)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    BWSRPLATFORM                    CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NOOFITEMS                       CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    USERID                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NAMESPACE                       CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    ACCTNUM                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMAIL_ADDRESS                   CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    FOLDERID                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    FOLDERNAME                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    FOLDERTYPE                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMFORMAT                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMDELIVERYTYPE                  CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMDISPOSITION                   CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMLINKTYPE                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMSLID                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMALID                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMVWID                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    EMLISTTYPE                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLID                            CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLNAME                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLEID                           CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLENAME                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLFORMAT                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLLINKTYPE                      CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLTMPL                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLCSTM                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    NLDOPT                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RDREMAIL                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RDRFNAME                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RDRLNAME                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RDRCOMPNAME                     CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDID                            CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDNAME                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDORGUID                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDORGNS                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDDOMAIN                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDDOPT                          CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDFLDRCOUNT                     CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    WDARTICLEVIEW                   CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RSSFEED                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    RSSTYPE                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    HOMEPAGE                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    ASSETID                         CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    ASSETNAME                       CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    ASSETTYPE                       CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    DISSEMINATIONMTHD               CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    LINKTYPE                        CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
    AOPT                            CHAR (255)
      Terminated by "#|#"
      Enclosed by "#$" and "$#"
      Trim whitespace same as SQL Loader
error processing column ASSETID in row 2 for datafile /ODS/data/work/ACTION.dat
ORA-01722: invalid numberEdited by: Chaitanya on May 2, 2012 10:17 PM