UTF8 characterset problem

I have a database that has been installed with the UTF8 characterset.
Therefore the £ sign is ASCII 49827 in this characterset and not ASCII 163 as used in ISO8859P1. I believe my problem stems from me using UTF complaint clients to enter the £ sign into the database. Because the Clients are UTF8 compaint they are passing ASCII 49827 for the £ sign into the database. However when non UTF8 compliants try to view or manipulate the data from this database, instead of them seeing the £ sign they see Â£.
I presume the solution should be to ensure all viewing clients are UTF8 compliant ?
My problem is that I have a 3rd party program that is taking the output from the database in the form of a text file and is then converting the output into a PDF. Hence in the PDF the £ sign is appearing as Â£, since this is what is effectively stored in the database / text file output
I presume it never makes sense to try and convert the Database using CSALTER to WE8ISO8859P1 from UTF8 ? ( as WE8ISO8859P1 is a sub set of UTF8 ? )
The routine that is creating the test file from the database is an E-Business Suite routine, so I cannot interfer with it and put in a translate command.
Any suggestions ?
thanks,
Jim

what is NLS_CHARACTERSET value of your database?
I always use AR8MISO8859P6 and it's perfect for Arabic language.
For your Application Server, in the registry, check
NLS_LANG = AMERICAN_AMERICA.AR8MSWIN1256
REPORT_ARABIC_NUMERAL = ARABIC
REPORTS_PATH = (Make sure your font path is included here)
Add these entries in your uifont.ali file under [ PDF:Subset]
[ PDF:Subset ]
Arial..Italic.Bold.. = "Arialbi.ttf"
Arial..Italic... = "Ariali.ttf"
Arial...Bold.. = "Arialbd.ttf"
Arial..... = "Arial.ttf"
"Arabic Transparent"..Italic.Bold.. = "ARIALBI.TTF".....
"Arabic Transparent"..Italic... = "ARIALI.TTF".....
"Arabic Transparent"...Bold.. = "Arialbd.ttf"
"Arabic Transparent"..... = "artro.ttf"
Tahoma = "tahoma.ttf".....ar8mswin1256
Arial = "Tahoma"
"Tahoma Bold" = "tahomabd.ttf"
Make sure Regional and Language option in control panel is properly configured for Arabic.
restart the Windows Server 2003 and arabic should work properly on Server 2003 also.
I'm using Oracle Application Server 10g on Windows 2003 Server and Arabic Language is working perfectly for forms as well as PDF Reports.
I'm using Tahoma font for Arabic.
Hope this will help and solve your problem.
Note: Make sure that the font which you are using for Arabic in your reports is included in the uifont.ali
regards,
Saadat Ahmad
Message was edited by:
saadatahmad

Similar Messages

PDF printing with UTF8 characterset

Hi,
Stats:
E-BIZ version :- 11.5.10.2
DB:- 10.2.0.3
Report BUilder :- 6i
Character Set :- UTF8.
I have some doubt while viewing/printing pdf reports from Oralce Application. Can you please suggest if it is possible to print pdf's from oracle apps with UTF8 characterset and without having 3rd party software to convert pdf report to postscript and a printer that can understand postscript. We do have PASTA and IX configured in our enviornment.Reports created are in BI/XML publisher.
Actually we have one 3rd party tool for printing and wanted to get rid of it due to financial constraints. Can you please suggest if it is possible to print pdf's from oracle apps without having 3rd party tool. I have read lot of document and completely lost. Oracle some where says it is possible and at other place says 'If you are on UTF8 chacterset then you need to have XML/BI publisher with PASTA and 3rd party software' but in my enviornment we have some pdf reports that are bypassing 3rd party software for printing. I am just lost.
Any help would be appreciated
Thanks,
JD

Hi,
This line confuses me, do i require 3rd party software to print from oracle apps if my characterset is UTF8(althoug i am using XML publisher), I believe yes -- See (Note: 422508.1 - About Oracle XML Publisher Release 5.6.3), Step 8 Enable PDF Printing in Oracle Applications. (System Administrator)
Workaround section says
6. From Oracle Applications via the Adobe Acrobat Reader, a PDF output file can be viewed and
printed.>>>> NO i not want to use it.This is a workaround to print PDF directly from the application. If you do not want to use this approach, use the other one mentioned above.
7.Although, it may be possible to create a custom print driver or print program using the Adobe
Acrobat Distiller, viable instructions on how to perform such a custom setup is very scarce, see
Note 262657.1--intended for Latin 1 character set environments.>>>> I am on UTF8
I would not recommend this approach as this may (or may not) work.
8. Use Pasta, an Oracle post printing program, to change a copy of the report output file to the
desired or printable output format.>>>>>> I have PASTA but does that mean i can print all my pdf reports using it. Don't i need 3rd party tool now.See (Note: 239196.1 - PASTA 3.0 Release Information).
9. Lastly, use another format like Postscript, that is fully supported for viewing and printing>>>>> How to use it? Can anyone please explain.Change the output of the concurrent program to Postscript (Concurrent > Program > Define), and you can view the output using Ghost Viewer.
Note: 117112.1 - How to read Postscript File Formats on a MS Windows Operating System and Convert To Another File Format
Thanks,
Hussein

UTF8 Database Problem

Hi
This is Sanjay Developer , working j2EE ,Oracle Platforms.
I got a issue to be cleared ,
When I insert a polish special character through JDBC API's in Oracle 8i DB of UTF8 Characterset, I get an error java.sql.SQLException saying that inserted value too large for the column.
Can u please help me in this regard
Best Regards
Sanjay.

Hey the Oracle Error Code is java.sql.SQLException: ORA-01401: and it is inserted value too large for a column.
Actually the scneraio is , I insert the multiple records in the table say 45 number of times using the for loop.Now
I have increased the column field length to varchar2(4000) even then the same above exception is coming.But the polish data which I wanna insert is 20 bytes.
The data will be polish special characters like , ćśwnętrąćywżwnętrzny.
Please Justin track through this and try to solve the issue if possible ...

Characterset Problem after migrating to new database

Hi, I'm developing a application on local system with these settings
NLS_CHARACTERSET:     WE8MSWIN1252
DAD CHARACTERSET: UTF-8
and then we moved it to our server with these settings
NLS_CHARACTERSET:     WE8MSWIN1252
DAD CHARACTERSET:
after that we are having character set problem, some characters are not displayed correctly. Not just in application but also the data in the database.
(a result from a query which been done with sql commands from apex)
http://img340.imageshack.us/img340/9123/charsetprob.jpg
But the characters are displayed correctly on csv export.
On the application itself, sometimes its always displayed correctly for the first time the page was rendered, after a partial refresh or paging the same problem occurs.
1st time rendered
http://img690.imageshack.us/img690/2310/charsetprob2.jpg
after paging
http://img690.imageshack.us/img690/3784/charsetprob3.jpg
is it because DAD Characterset was not set on our server?
can someone please enlight me, I would be very thankful for your help.
Danny

Sorry but I still has not resolve this problem yet. Can someone help me?
edit: case solved
Edited by: raitodn on 30.06.2010 07:16

UTF8 character problems

I am working in a pan-european organisation and have encountered a problem with printing a special character from the Swedish alphabet. It shows up in the OPP log with an Invalid UTF8 encoding message. Does anyone have any suggestions on how I could get round this?

Hi Tim,
thanks for the reply.
The output does not even get generated - it fails before that stage.
I am using reports 6i to extract the data - basically I am replacing the layout.
top of the XML is:
<?xml version="1.0"?>

<CBASCINV_V5>
<LIST_G_F_DEL_DETAIL_ID>
and the offending piece if text with the character in it is:
Supplier: KAR Sj÷ding
The offending character is whatever is represented by the division sign.
If I try to load the file into Word via the data import, it throws out an error message saying 'an invalid character was found in texy content' and highlighting this character.
This does not apply to all Swedish characters - this <C_FROM_ADDRESS_2>KonstruktionsvÃ¤gen 14</C_FROM_ADDRESS_2>
prints without any problems!
Thanks again
Mike

Open dataset in UTF8. Problems between Unicode and non Unicode

Hello,
I am currently testing the file transfer between unicode an non unicode systems.
I transfered some japanese KNA1 data from non unicode system (Mandt,Name1, Name2,City) to a file with this option:
set local language pi_langu.
open dataset pe_file in text mode encoding utf-8 for output with byte-order mark.
Now I want to read the file from a unicode system. The code looks like this:
open dataset file in text mode encoding utf-8 for input skipping byte-order mark.
The characters look fine but they are shifted. name1 is correct but now parts of the city characters are in name2....
If I open the file in a non unicode system with the same coding the data is ok again!
Is there a problem with spaces between unicode an non-unicode?!

Hello again,
after implementing and testing this method, we saw that the conversion is always taken place in the unicode system.
For examble: we have a char(35) field in mdmp with several japanese signs..as soon as we transfer the data into the file and have a look at it the binary data the field is only 28 chars long. several spaces are missing...now if we open the file in our unicode system using the mentioned class the size is gaining to 35 characters
on the other hand if we export data from unicode system using this method the size is shrinking from 35 chars to 28 so the mdmp system can interprete the data.
as soon as all systems are on unicode this method is obselete/wrong because we don't want to cut off/add the spaces..it's not needed anymore..
the better way would be to create a "real" UTF-8 file in our MDMP system. The question is, is there a method to add somehow the missing spaces in the mdmp system?
so it works something like thtat:
OPEN DATASET p_file FOR OUTPUT IN TEXT MODE ENCODING UTF-8 WITH BYTE-ORDER MARK.
"MDMP (with ECC 6.0 by the way)
if charsize = 1.
*add missing spaces to the structure
*transfer strucutre to file
*UNICODE
else.
*just transfer struc to file -> no conversion needed anymore
endif.
I thought mybe somehow this could work with the class CL_ABAP_CONV_OUT_CE. But until now I had no luck...
Normally I would think that if I'am creating a UTF-8 file this work is done automatically on the transfer command

DB Characterset Problem

Dear All,
Please let me to know how to find the current database characterset.
Please also advice me how to change db charset, pre-requesits and its steps.
I will be very thakful to you all.
Aqeel Nawaz

Hi,
Please let me to know how to find the current database characterset.
check NLS parameters
Please also advice me how to change db charset, pre-requesits and its steps.
Refer
http://download.oracle.com/docs/cd/B10501_01/server.920/a96529/ch10.htm
http://www.oracle-base.com/articles/10g/CharacterSetMigration.php
http://www.oracle.com/technology/tech/globalization/pdf/TWP_Character_Set_Migration_Best_Practices_10gR2.pdf
- Pavan Kumar N

Arabic_lang characterset problem with Toad

Hi there
I have install oracle10g DB and Developer
and also i install Toad 8.0 but i have problem the Arabic character its not showing in Toad but with the form and DB its ok i can read Arabic characters....
anyone can help me in this?
thanx in advance...

What did you choose for character sets when creating the database?
Please note that otn has a forum dedicated to discussion realted to Globalization Support features (language and character sets, etc.).

AL32UTF8 characterset problem

Hi
I have a db called DB1 which have
select * from v$nls_parameters;
PARAMETER     VALUE
NLS_LANGUAGE     AMERICAN
NLS_TERRITORY     AMERICA
NLS_CURRENCY     $
NLS_ISO_CURRENCY     AMERICA
NLS_NUMERIC_CHARACTERS     .,
NLS_CALENDAR     GREGORIAN
NLS_DATE_FORMAT     DD-MON-YY
NLS_DATE_LANGUAGE     AMERICAN
NLS_CHARACTERSET     WE8ISO8859P1
NLS_SORT     BINARY
NLS_TIME_FORMAT     HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT     DD-MON-YY HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT     HH.MI.SSXFF AM TZH:TZM
NLS_TIMESTAMP_TZ_FORMAT     DD-MON-YY HH.MI.SSXFF AM TZH:TZM
NLS_DUAL_CURRENCY     $
NLS_NCHAR_CHARACTERSET     WE8ISO8859P1
NLS_COMP     BINARY
select chr(200) from dual ; give -> È
i had another db DB2
select * from v$nls_parameters;
NLS_LANGUAGE     ENGLISH
NLS_TERRITORY     AUSTRALIA
NLS_CURRENCY     $
NLS_ISO_CURRENCY     AUSTRALIA
NLS_NUMERIC_CHARACTERS     .,
NLS_CALENDAR     GREGORIAN
NLS_DATE_FORMAT     DD/MON/RR
NLS_DATE_LANGUAGE     ENGLISH
NLS_CHARACTERSET     AL32UTF8
NLS_SORT     BINARY
NLS_TIME_FORMAT     HH12:MI:SSXFF AM
NLS_TIMESTAMP_FORMAT     DD/MON/RR HH12:MI:SSXFF AM
NLS_TIME_TZ_FORMAT     HH12:MI:SSXFF AM TZR
NLS_TIMESTAMP_TZ_FORMAT     DD/MON/RR HH12:MI:SSXFF AM TZR
NLS_DUAL_CURRENCY     $
NLS_NCHAR_CHARACTERSET     AL16UTF16
NLS_COMP     BINARY
NLS_LENGTH_SEMANTICS     BYTE
NLS_NCHAR_CONV_EXCP     FALSE
select chr(200) from dual ; give -> NULL !!!
please help me fix DB2 problem?
Thanks

I am assuming you would like to change the character set of DB2 to match that of DB1. If your database is 9i or greater you might want to take a look at the docs on character set migration.
http://download.oracle.com/docs/cd/B10501_01/server.920/a96529/ch10.htm#1656

Calendar sync characterset problem

Hi,
when I synchronize with sony clié Pocket (PALM OS 5), the accentuated characters are changed : ex: "Comité" on outlook becomes "ComitÃ©" on Palm and "Allée" on Palm becomes "All¿" on outlook.
How can I resolve this problem
Thanks

Hi,
Can you tell me what version of the Calendar Sync for Palm you are running? Also, what version of Outlook, as well as the version of the Connector for Outlook, and the Palm desktop you have.
Thanks,
Lily

UTF8 problem with XMLGEN

Hi All,
I'm having problems with the XML generation. The problem is that when we try to generate XML using a query, such as:
select xmlgen.getXML('select content_id, locale_id, content from bc_content_local where delete_p = ''0''',1) from dual;
It works fine so long as of the information retrieved by the query is ASCII. But if there are UTF8 characters in there, the
generation of the XML fails.
I wasn't actually getting an error message. It would work and return XML but as soon as the first UTF-8 character was encountered,
the XML just stopped.
Two questions:
1) Does the XML generation support UTF-8? 2)
If it does (I seem to remember hearing that it did) what has to be done so that this
works correctly?
We are using a UTF8 characterset we set during database creation. I have also tried setting up NLS_LANG in the client registrty to american_america.utf8 - but in both client and server I get teh same message.
Database: Oracle 8.1.7 Standard Edition on Sun-Solaris 2.8
Any help greatly appreciated,
Nilendu Misra
[email protected]

Ok, I found we have DBMS_XMLQUERY installed on the schema other than SYS too. But when I issue the same statement using this package I get a different error:
SQL> select dbms_xmlquery.getXML('select content_id, locale_id, content
2 from bc_content_local where delete_p = ''0''',1) from dual;
select dbms_xmlquery.getXML('select content_id, locale_id, content
ERROR at line 1:
ORA-29532: Java call terminated by uncaught Java exception:
java.lang.NullPointerException
ORA-06512: at "SYSTEM.DBMS_XMLQUERY", line 212
ORA-06512: at "SYSTEM.DBMS_XMLQUERY", line 220
ORA-06512: at "SYSTEM.DBMS_XMLQUERY", line 210
ORA-06512: at "SYSTEM.DBMS_XMLQUERY", line 228
ORA-06512: at line 1
I tried searching the XML forum and Metalink but I found most of the reports on this nature of problem are still unanswered.
Thanks in appreciation,
Nilendu
null

Character set migration error to UTF8 urgent

Hi
when we migrated from ar8iso889p6 to utf8 characterset we are facing one error when i try to compile one package through forms i am getting error program unit pu not found.
When i running the source code of that procedure direct from database using sqlplus its running wihtout any problem.How can i migrate this forms from ar8iso889p6 to utf8 characterset. We migrated from databas with ar8iso889p6 oracle 81.7 database to oracle 9.2. database with character set UTF8 (windows 2000) export and import done without any error
I am using oracle 11i inside the calling forms6i and reports 6i
with regards
ramya
1) this is server side program yaa when connecting with forms i am getting error .When i am running this program using direct sql its working when i running compiling i am getting this error.
3) yes i am using 11 i (11.5.10) inside its calling forms 6i and reports .Why this is giving problem using forms.Is there any setting changing in forms nls_lang
with regards

Hi Ramya
what i understand from your question is that you are trying to compile a procedure from a forms interface at client side?
if yes you should check the code in the forms that is calling the compilation package.
does it contains strings that might be affected from the character set change???
Tony G.

UTF8 handling in OC4J

Dear all, I got some problems in CMP ejb dealing with UTF-8 charset.
My OS platform is traditional chinese win2000, installing OC4J 9.0.2
and 9iJdevleoper. My 9iDB Server with UTF8 characterset is on an AIX server.
Through my 9iJdeveloper and OC4J, I created a CMP and got it deployed. But no matter what I tried, the CMP sample client inserted record in Big5 encoding into the DB rather than in UTF-8.
I set the CMP project complier characterset to UTF-8
What else do I need to set(e.g. *.xml OC4J config files) ?
rgds,
gabriel

Dear All,
I want to display japanese characters in the browser from servlet, so i set the following things in my program,
res.setContentType( "text/html; charset=UTF-8");
     PrintWriter out = res.getWriter();
     out.println("<html>");
     out.println("<h1>Hello World111</h1>");
out.println("HIpoOIIlpt/gj=");
     out.println("</body></html>");
But I'm not able to see the japanese chars instead some junk chars are displayed.
Please help me, this is very urgent.
Thanks in Advance,
Dayalan

Change characterset of db

Hello
When I want to change WE8MSWIN1252 to UTF-8 or al32utf8 using export import.
What should be the order?
Export data.
Create new databse with new characterset
Import data
or
Do I need to perform any additional step to convert characterset prior to import ?

Hi,
1. Run Csscan utility on ur existing DB to determine any other problems can occurs during conversion.
csscan system/password full=y tochar=UTF8 array=10240 process=10
2.Check CSSCAN logs and error.log files to see if any character conversion problem occurs.....
3. if problem with Varchar2 field length then u can to run the following script to change the fields length or change the type to CLOB.
--To generate the script run the following query
select 'alter table '||owner||'.'||table_name||' modify ('||column_name||' varchar2('||DATA_LENGTH||' CHAR));'
from dba_tab_columns
where data_type = 'VARCHAR2';4.Repeat step 1 and 2
5. Compile all invalid objects
6. Export ur current DB
7. Create new DB with UTF8 Characterset
8.Import into new DB make sure the Enviornment Variable NLS_LANG=UTF8 is set to avoid statistics error
9. Generate object statistics after import.
plz mark as correct/helpful if it is
Baig,
[My Oracle Blog|http://baigsorcl.blogspot.com/]

Bad problem on run as a web

Hi
I have Oracle9i DB with UTF8 characterset and i have a problem on Arabic data entry when i run report on a web, but when i run it on paper i can see it right!!!
(Oracle9iDS , report9i)
but i can see true data with English word.
also i change the characterset of report as a web to UTF8.
How can i solve it?
Thanks

Hi
I have Oracle9i DB with UTF8 characterset and i have a problem on Arabic data entry when i run report on a web, but when i run it on paper i can see it right!!!
(Oracle9iDS , report9i)
but i can see true data with English word.
also i change the characterset of report as a web to UTF8.
How can i solve it?
Thanks

UTF8 characterset problem

Similar Messages

Maybe you are looking for