Unicode data

We are using Oracle 8.1.6. Database character set is US7ASCII and the National Characterset is UTF8.
NLS_LANGUAGE = AMERICAN
NLS_TERRITORY = AMERICA
NLS_CURRENCY = $
NLS_ISO_CURRENCY = AMERICA
NLS_NUMERIC_CHARACTERS = .,
NLS_CHARACTERSET = US7ASCII
NLS_CALENDAR = GREGORIAN
NLS_DATE_FORMAT = DD-MON-RR
NLS_DATE_LANGUAGE = AMERICAN
NLS_SORT = BINARY
NLS_TIME_FORMAT = HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT = DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT = HH.MI.SSXFF AM TZH:TZM
NLS_TIMESTAMP_TZ_FORMAT = DD-MON-RR HH.MI.SSXFF AM TZH:TZM
NLS_DUAL_CURRENCY = $
NLS_COMP = BINARY
NLS_NCHAR_CHARACTERSET = UTF8
NLS_RDBMS_VERSION = 8.1.6.0.0
We have created a table with NVARCHAR2 datatype. Now, we want to load multilingual data. We prepared the Arabic Data using the UNIPAD application. Then we copied that data and pasted in the values part of our insert statement in SQL*PLUS with the prefix n before the data. The data was inserted successfully. When we tried to query the data it displays onlly question marks.
Now we have the doubt that the data was inserted properly or only the question marks are inserted. Also I want to know how to query the data from database? what are all the other methods available for loading UTF8 data into the database ?
null

If u say UTF8 can not be used as the National characterset, how oracle accepts that as the National characterset? Is it not validating the value passed? This is CORRECT, no validation is performed. The National Character set in Oracle 8 and 8i was designed to support FIXEDWIDTH character sets. So that customers who need to support Asian Multibyte character sets can gain the performance benefit of fixed width character sets.
Also I found that UTF 8 is a valid value for the characterset from V$NLS_VALID_VALUES. Are the values specified applicable only for the Database characterset? This view returns all the character set definition files that Oracle ships with a given database release. This contains database character sets , national character sets and obsolete character sets.
If so,where can I get the valid values for National characterset?The FIXEDWIDTH character sets, all those character set that end with the name FIXED . For example JA16SJISFIXED, ZHT16BIG5FIXED etc. In Oracle9i, customers can define either UTF-8 or UTF-16 as the Unicode national character set.
Please check out the Globalization & NLS FAQ http://otn.oracle.com/products/oracle8i/htdocs/faq_combined.htm for more information.

Similar Messages

Unable to show Unicode Data in Oracle RESTful Service JSON

Hi Everyone.
I have stored unicode data in Oracle database and when i retrieve in sql query it is showing the same. But when i retrieve the data in json using oracle RESTful web service (GET), it bringing with unknown character as shown below.
next: {},$ref: "http://000.00.00.00:8085/ords/mobile/sch/loginm/?user=SURESH&pwd=123&page=1"
items: [
uri: {},$ref: "http://000.00.00.00:8085/ords/mobile/sch/loginm/41"
stud_id: 41,
stud_code: "1001",
stud_name: "à®…à®ªà¯à®¤à¯à®²à¯ à®œà®ªà¯à®ªà®¾à®°à¯"
My Database Setup as below:
SQL> SELECT name,value$ FROM sys.props$;
NAME                                                          VALUE$
DICT.BASE                                                  2
DEFAULT_TEMP_TABLESPACE               TEMP
DEFAULT_PERMANENT_TABLESPACE     USERS
DEFAULT_EDITION                                   ORA$BASE
Flashback Timestamp TimeZone                    GMT
TDE_MASTER_KEY_ID
DBTIMEZONE                                        -07:00
DST_UPGRADE_STATE                         NONE
DST_PRIMARY_TT_VERSION               11
DST_SECONDARY_TT_VERSION          0
DEFAULT_TBS_TYPE                              SMALLFILE
NLS_LANGUAGE                              AMERICAN
NLS_TERRITORY                                   AMERICA
NLS_CURRENCY                                   $
NLS_ISO_CURRENCY                         AMERICA
NLS_NUMERIC_CHARACTERS               .,
NLS_CHARACTERSET                         AL32UTF8
NLS_CALENDAR                                   GREGORIAN
NLS_DATE_FORMAT                              DD-MON-RR
NLS_DATE_LANGUAGE                         AMERICAN
NLS_SORT                                        BINARY
NLS_TIME_FORMAT                         HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT               DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT               HH.MI.SSXFF AM TZR
NLS_TIMESTAMP_TZ_FORMAT          DD-MON-RR HH.MI.SSXFF AM TZR
NLS_DUAL_CURRENCY                    $
NLS_COMP                                   BINARY
NLS_LENGTH_SEMANTICS          BYTE
NLS_NCHAR_CONV_EXCP          FALSE
NLS_NCHAR_CHARACTERSET          AL16UTF16
NLS_RDBMS_VERSION               11.2.0.1.0
GLOBAL_DB_NAME                    MOBILE
EXPORT_VIEWS_VERSION
SQL> select DECODE(parameter, 'NLS_CHARACTERSET', 'CHARACTER SET',
2 'NLS_LANGUAGE', 'LANGUAGE',
3 'NLS_TERRITORY', 'TERRITORY') name,
4 value from v$nls_parameters
5 WHERE parameter IN ( 'NLS_CHARACTERSET', 'NLS_LANGUAGE', 'NLS_TERRITORY');
NAME          VALUE
LANGUAGE      AMERICAN
TERRITORY     AMERICA
CHARACTER SET AL32UTF8
          8
WORKLOAD_CAPTURE_MODE
WORKLOAD_REPLAY_MODE
Awaiting you solution.
-- Abdul Jabbar

Kumar,
Ftping the PG.xml to mds folder will not help the page to goto MDS directory
You have to import the file using xmlimporter
I understand you have done the import, but it is not success.
Could you please post what is the script you used to import the PG.xml
and once you run what was the output you have got.
May be you can refer the URL for the scripts
http://apps2fusion.com/at/61-kv/331-oa-framework-scripts
With regards,
Kali.
OSSI.

How to load unicode data files with fixed records lengths?

Hi!
To load unicode data files with fixed records lengths (in terms of charachters and not of bytes!) using SQL*Loader manually, I found two ways:
Alternative 1: one record per row
SQL*Loader control file example (without POSITION, since POSITION always refers to bytes!) 
LOAD DATA
CHARACTERSET UTF8
LENGTH SEMANTICS CHAR
INFILE unicode.dat
INTO TABLE STG_UNICODE
TRUNCATE
A CHAR(2) ,
B CHAR(6) ,
C CHAR(2) ,
D CHAR(1) ,
E CHAR(4)
) Datafile:
001111112234444
01NormalDExZWEI
02ÄÜÖßêÊûÛxöööö
03ÄÜÖßêÊûÛxöööö
04üüüüüüÖÄxµôÔµ Alternative2: variable length records
LOAD DATA
CHARACTERSET UTF8
LENGTH SEMANTICS CHAR
INFILE unicode_var.dat "VAR 4"
INTO TABLE STG_UNICODE
TRUNCATE
A CHAR(2) ,
B CHAR(6) ,
C CHAR(2) ,
D CHAR(1) ,
E CHAR(4)
) Datafile:
001501NormalDExZWEI002702ÄÜÖßêÊûÛxöööö002604üuüüüüÖÄxµôÔµ Problems
Implementing these two alternatives in OWB, I encounter the following problems:
* How to specify LENGTH SEMANTICS CHAR?
* How to suppress the POSITION definition?
* How to define a flat file with variable length and how to specify the number of bytes containing the length definition?
Or is there another way that can be implemented using OWB?
Any help is appreciated!
Thanks,
Carsten.

Hi Carsten
If you need to support the LENGTH SEMANTICS CHAR clause in an external table then one option is to use the unbound external table and capture the access parameters manually. To create an unbound external table you can skip the selection of a base file in the external table wizard. Then when the external table is edited you will get an Access Parameters tab where you can define the parameters. In 11gR2 the File to Oracle external table can also add this clause via an option.
Cheers
David

Reading Unicode data from a file...

I am writing an application that needs to read some configuration data from a file. An end user edits the configuration file to provide the configuration data. The Java code reads this file and uses the configuration data supplied by the user.
The user can also save non-ascii characters as part of the configuration data. hence, I do not want to use java properties files. What are the other options available that allow me reading Unicode data into my Java code and will also allow user to save the configuration file as Unicode?

Java characters are Unicode characters. Read file data that consists of Unicode characters as Java characters or strings.
You can read the data as primitive char values using the DataInputStream class. The InputStreamReader class can also read Unicode (UTF-16) data.
Data can be written using the OutputStreamWriter class.

Pass unicode data in SQL Server 2008 stored procedure parameter

Hi,
I want to pass unicode data in a SQL stored procedure. But I am not sure that how to append N with NVarchar datatype.
For example I Create a table LocalizationTest and wants to insert a few records.
Create table LocalizationTest
Field1 NVarchar(255)
INSERT INTO LocalizationTest
VALUES(N'123 Illini Dr, 東皮奧里亞, 8989')
the above given statement works.
To explain it more , script A works but script B does not work.
DECLARE @X NVARCHAR(255)
[A]
SET @X=N '123 Illini Dr, 東皮奧里亞, 8989'
INSERT INTO LocalizationTest
VALUES(@X)
[B]
SET @X= '123 Illini Dr, 東皮奧里亞, 8989'
INSERT INTO LocalizationTest
VALUES(@X)
What is the correct way to execute script B because @X will be passed in a SQL Stored Procedure?
Thanks
Sharma M.

If you do not pass the value as a Unicode value there is nothing left of the Unicode characters but question marks. Once this has happened, AFAIK there is no way to undo it (other than resetting the value as Unicode characters again).
Affirmative.
Demo - This is what happens if you convert UNICODE (nvarchar) to varchar with implicit conversion (try to force 2 bytes into one byte).
3F hex is '?'.
CREATE TABLE #LocalizationTest (Field1 VARCHAR(255))
INSERT INTO #LocalizationTest
VALUES(N'123 Illini Dr, 東皮奧里亞, 8989')
DECLARE @X NVARCHAR(255), @dSQL NVARCHAR(MAX)
SET @X=N'123 Illini Dr, 東皮奧里亞, 8989'
INSERT INTO #LocalizationTest VALUES(CONVERT(NVARCHAR(255),@X))
SET @dSQL = N'INSERT INTO #LocalizationTest VALUES(N'''+@X+''')'
PRINT @dSQL
EXEC sp_ExecuteSQL @dSQL
SELECT *, Field1Bin=convert(binary(30), Field1) FROM #LocalizationTest
DROP TABLE #LocalizationTest
123 Illini Dr, ?????, 8989 0x31323320496C6C696E692044722C203F3F3F3F3F2C203839383900000000
123 Illini Dr, ?????, 8989 0x31323320496C6C696E692044722C203F3F3F3F3F2C203839383900000000
123 Illini Dr, ?????, 8989 0x31323320496C6C696E692044722C203F3F3F3F3F2C203839383900000000
Kalman Toth Database & OLAP Architect
SQL Server 2014 Design & Programming
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

Unable to insert and retrieve Unicode data using Microsoft OLE DB Provider

Hi,
I have an ASP.NET web application that uses OLEDB connection to Oracle database.
Database: Oracle 11g
Provider: MSDAORA
ConnectionString: "Provider=MSDAORA;Data Source=localhost;User ID=system; Password=oracle;*convertNcharLiterals*=true;"
When I use SQL Develeoper client and add convertNcharLiterals=true; in sqldeveloper.conf then I am able to store and retrieve Unicode data.
The character sets are as follows:
Database character set is: WE8MSWIN1252
National Language character set: AL16UTF16
Select * from nls_database_parameters where parameter in ('NLS_CHARACTERSET','NLS_LENGTH_SEMANTICS','NLS_NCHAR_CHARACTERSET');
PARAMETER VALUE ---------------------------------------
NLS_CHARACTERSET WE8MSWIN1252
NLS_LENGTH_SEMANTICS BYTE
NLS_NCHAR_CHARACTERSET AL16UTF16
I have a test table:
desc TestingUni
Name Null Type
UNI1 VARCHAR2(20)
UNI2 VARCHAR2(20)
UNI3 NVARCHAR2(20)
I execute the below mentioned query from a System.OleDb.OleDbCommand object.
Insert into TestingUni(UNI3 ) values(N'汉语漢語');
BUT when retrieving the same I get question marks (¿¿¿¿) instead of the Chinese characters (汉语漢語)
Is there any way to add the above property(convertNcharLiterals) when querying the Oracle database from OLEDB connection?
OR is there any other provider for Oracle which would help me solve my problem?
OR any other help regarding this?
Thanks

using OraOLEDB Provider.
set the environment variable ORA_NCHAR_LITERAL_REPLACE to TRUE. Doing so transparently replaces the n' internally and preserves the text literal for SQL processing.
http://docs.oracle.com/cd/B28359_01/server.111/b28286/sql_elements003.htm#i42617

Importing non-unicode data into unicode 10gR2 database

Hi:
I will have to import non-unicode data into unicode 10gR2 database. The systems the data is coming from are the following: CODA, Timberline, COMMS, CMS, LIMS. These are all RDBMS, sql-enabled systems. We are talking about pretty big amounts of data (a couple hundred GB combined).
Did anybody go through a similar exersize?
I know I'll have to setup nls_length_semantics to CHAR.
What other recommendations could you guys give?
TIA,
Greg

I think "nls_length_semantics" isn't mandatory at this point, and you must extract a little quantity of information from every source and do some probes injecting them into the Oracle10g database.

LSMW: Codepage conversion error with a Unicode data file

Hi all,
I am currently developing a LSMW upload program which has to use a Unicode data file. The underlying system/target system is NOT a Unicode system. The data file also contains non-Latin2 characters.
In the step "Specify Files", I have specified my Unicode data file and specified the codepage type "4110 - Unicode UTF-8".
In the step "Read Data", then I get the runtime error "CONVT_CODEPAGE", exception "CX_SY_CONVERSION_CODEPAGE".
I would expect that all non-Unicode characters are automatically transformed to "#", but the conversion progam breaks. The character transformation to "#" would be fine.
I am really wondering why, at first, I am able to specify the Unicode codepage type, but then, the file cannot be converted correctly.
What do I make wrong, what can I do to avoid the error?
Thanks a lot in advance for helping me out...
Regards,
Klaus

Hello,
You need convert the file with the format UTF-8. In notepad you can choose this option.
Regards,
Oscar.

Encoding Problem: non-Unicode Data to Unicode format of XI

Hi SDN,
I have a JDBC sender to SAP BW scenario. The database is MS SQL server.
The code page of db CP1CIAS
Description:SQL Server Sort Order 52 on Code Page 1252 for non-Unicode Data
Some fields with values like ZAKADY TWORZYW SZTUCZNYCH are failing in XI Mapping with error
Fatal Error: com.sap.engine.lib.xml.parser.Parser~
XMLParser : #0 not allowed in Character data sections
in the trace.
Please help how should i get over this code page errors. By installing this code page on XI server help?

There is no such global setting, this is b/c your source has Unicode I trust, and the only one other thing to try would be this:
Arthur My Blog

Unicode data in non-utf8 oracle 8.1.7

Hi,
I have to migrate unicode data from a UTF-8 Oracle 9.0.2 database to non-utf8 oracle 8.1.7. The tables are small and I am reading and writing into the database using java code.The column which contained the unicode data have been made nchar in oracle 8.1.7.
When I try to insert the data,I get the error:
java.sql.SQLException: ORA-12704: character set mismatch
Can I have unicode data stored in nchar columns in a non-utf8 database?
Is there any documentation available on the same?
Thanks,
Shipra

Check out the Oracle Unicode Database Support paper on OTN - http://technet.oracle.com/tech/globalization/content.html
Basically NCHAR prior to Oracle9i can not be Unicode. If you need to store Unicode data in 8.1.7, you need to use UTF8 as the database character set.
Nat

Plz its URGENT : Storing unicode data in MS SQL Server 2000 through JSPs

Hello All,
I'm trying to store unicode data, entered from JSP page into the SQL Server. For that I've tried the following :
1> I put tag -
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
2> Also set in JSP tag -
<%@page contentType="text/html;charset=UTF-8"%>
But, still data is being entered in ISO-8859-1 format, don't know why. I tried with function for convertion - private String toUniCode(String strPar)-it successfully shows me the unicode data in alret msg, but it doesn't enters unicode data in SQL Server. In SQL Server only '??????' get entered. I kept data-type in SQL Server as nvarchar to store data in unicode.
Would it be possible for me, to accept the data as UTF-8 itself & can I store it in SQL Server as it is? How can I do that? I'm accepting data in 'marathi' language.
Plz, anybody Help me, I'm trying for this from around more than 1 week.
Thanks in advance for any replies!

Hello dmorris800,
Thanx for your help. In fact I've tried lot many alternatives for that. Later I realised that it was problame of Driver, not of code. I was using jdbc:odbc driver which doesn't support unicode, or I don't know what was the problame with it.
But I downloaded the driver named :'TaveConnect30C'. It is the connection optimised driver of Atinav.com This is the JDBC3 Type 4 Driver for MS SQL Server 6.5/7.0/2000 & trial version of which can be downloaded from http://www.atinav.com/download.htm
It is really very good type-4 Driver.
Cheers
-Yogesh

Using updatable ResultSet to update Unicode data ?

Is it possible to use Unicode data in updateString() methods for updatable resultset ? Or I only can do it using OraclePreparedStatement ? I've opened an updatable ResultSet and trying to update NCHAR column using the code below:
rset.updateString(6, "\uFF23\uFF23");
which fails with "java.sql.SQLException: Cannot map Unicode to Oracle character".
An attempt to do the same thing with regulair English data
rset.updateString(6, "CC");
causes "java.sql.SQLException: ORA-12704: character set mismatch" on insertRow(). The server primary encoding is UTF8 and I have AMERICAN_AMERICA.UTF8 in NLS_LANG in the registry. I would really appreciate any help on this ...

Thanks ! I guess I was looking in the wrong jdbc directory (the one that comes with JDev) ...

SAP XI 2, JDBC Inbound Adapter. Non Unicode data problem.

Hi All,
As far a I understand the data from inbout JDBC adapter in XI 2 should be in Unicode format. Is it possible to accept non unicode data using this adapter? If answer is yes then how to specify correct data encoding?
Best Regards.
Victor.

Hi,
Yes, tecnicaly XMB is aware of the encoding and not the adapter, but when you read data from file you can tell to the adapter that file is in specific encoding e.g. file.encoding = "ISO-8859-5"
This value is used by adapter to create xml file wich is passed to XMB. By default the passed XML is UTF8 encoded.
So I need similar setting for JDBC adapter and my question is if I can do it?
Best Regards.
Victor.

Import/export unicode data

Using the import (xls) functionality in SQL Developer (1.1.1.25) I cannot import a field in an Excel spreadsheet that has unicode data. I get the ORA-00911: invalid character message.
The environmental preference is set for UTF-8 encoding. The field being imported to is defined as NVARCHAR2.
Trying to export this field after manually entering the unicode data to the database does not produce an output file (either cvs, or xsl) that is properly encoded (file encoding is is set to UTF-8).
What am I missing?

Hello Massimo,
I bet the following IBM Redbooks publication answers your question:
[DB2 Optimization Techniques for SAP Database Migration And Unicode Conversion|http://www.redbooks.ibm.com/abstracts/sg247774.html?Open]
Hans-Juergen

Crystal Reports 10 Wrapping Unicode data

I am using crystal reports 10, and when viewing a report through IE, any field with unicode data is not wrapping the text. However, when the same database field has no unicode data, the field wraps correctly. Does crystal 10 not support field wrapping when unicode data is in the field?

Is this a database field that is unicode in the database? - Yes. This is an oracle db, set to an nvarchar2 type, containing unicode date.
Are you creating a text object and typing with a unicode font? - The data is entered into the system via IE. Not sure what font the user is using to enter the data, but the data appears as the correct language (Chinese), its just not wrapped.
Are you formatting a database field to use a unicode font once it's place on the report? Yes.
Does the Page/Job Server machine have this unicode font installed? Yes.
Does this happen only when viewing the report from eportfolio, or also from Crystal Reports on the CE10 server? Yes. Viewing the report through RDC, I get upside down question marks instead of the chinese characters. I dont know how to resolve this either.

UNICODE data files with SQLLDR

how can i load UNICODE data files with SQLLDR.
my Oracle instance is on UNIX with NLS_CHARACTERSET WE8ISO8859P1.
I have .dat files extracted from SQL Server using bcp utility with -w option.
When i use -c option i'm not getting the european characters correctly like the a and e with 2 dots on top....
when i load UNICODE (-w) file with CHARACTERSET UTF8 in my control file, it doesnt go thru. Any solution for this ? Thanks !

I just created a unicode textfile on windows with some westeuropean characters and imported it into we8iso8859p1 database on linux using controlfile parameter CHARACTERSET UTF16.
They got all properly converted.
As Justin mentioned, unicode on windows means generally UTF16 Little Endian.
Best regards
Maxim

Unicode data

Similar Messages

Maybe you are looking for