Arabic characters showing as garbage

Post Author: microsoftee
CA Forum: .NET
I have a report created with version of Crystal Report that came with Visual Basic 6.
Now I have to use same report in my .net application. When I show this report in my application or open it in Crystal Reports XI, X or 8 version it shows garbage character in place of Arabic text everywhere in all reports e.g. "C?U? C???UU?" .
Please help me to solve this problem.
Regards,
Adil

Post Author: microsoftee
CA Forum: .NET
Thanks for reply.
Its not related to DB connection because its showing the report text fields (constant fields) as garbage. In CR designer it sometimes shows Arabic data and text fields correctly but in my application its always showing garbage characters.
Regards,
Adil

Similar Messages

N8- Arabic characters show up as question marks in...

Hi ..
I noticed that the subject of the email is shown in the right way ( correct form of arabic characters)..
but the body of the email which is formatted in some font and color show up as ???????????
that replaces the arabic characters !!!
while the exact same email show up correctly in the browser ,, but not the email ..
ps: my phone is N8 ..
thanks in advance..

Dear petrib, what you are saying is 100% right, but its also Nokia issue to fix the problem with Microsoft for their customers to be satisfied... the problem is not when using Windows Live through PCs, I have the problem in my Nokia device and i am trying to contact Nokia to solve it with Microsoft... Am I right ??

Arabic Characters Issue

Hi
Following is our environment
DB Version: Oracle 11g R2 (11.2.0.3.0) 64bit
OS : OEL 5U2
Characterset: AMERICAN_AMERICA.AR8MSWIN1256
We have an opensource application built on php. CHARSET was defined as AR8MSWIN1256 in the configuration file. Data was inserted using browser based interface. Use access the system using IE 8 since it is web based application. Data comprise of both Arabic and English. It is displayed perfectly fine using browser ie Arabic shows proper Arabic characters and English shows correct English.
Problem started when a requirement came to generate some reports using Oracle Reports 10g. Arabic data show as garbage in the reports. Vendor was asked to provide some solution. They suggested to change the CHARSET to AL32UTF8 in the config file of the application. After making the changes, the new data that is inserted in the database can be seen correctly for both languages regardless of the tool (be it SQLDeveloper or Oracle Reports). The old data, however, shows garbage. Surprisingly when data is extracted using scripts in flat files and then imported in the test database after setting environment variable NLS_LANG=AMERICAN_AMERICA.UTF8 using @/../filename.sql, it converts it properly. Since data is huge and this is taking way too much time, I was hoping if someone could help me in quickly perform this migration? Already tried CSSCAN/CSALTER and DMU but did not succeed. DMU stopped at 5th stage when it was supposed to issue ALTER DATABASE CHARACTER SET command.
Currently I am installing database with AL32UTF8 characterset and planning to import the schema in it. Is my approach correct? Any help will be highly appreciated.
Thank you
myuser@DB>select dump(name,1016) from mytable where id like '1';
DUMP(NAME,1016)
Typ=1 Len=28 CharacterSet=AR8MSWIN1256: d9,81,d8,b1,d9,8a,d9,82,20,d8,b9,d9,85,d9,84,20,d8,a7,d9,84,d9,82,d8,b7,d8,a7,d8,b9
myuser@DB>select dump(name,1016) from mytable where id like '2';
DUMP(NAME,1016)
Typ=1 Len=93 CharacterSet=AR8MSWIN1256: d8,aa,d8,b9,d8,a7,d9,85,d9,8a,d9,85,20,d9,85,d9,86,20,d8,a7,d9,84,d9,85,d8,af,d9,8a,d8,b1,20,d8,a7,d9,84,d8,aa,d9,86,d9,81,d9,8a,d8,b0,d9,8a,20,d9,84,d9,84,d9,82
myuser@DB>select value from NLS_DATABASE_PARAMETERS where parameter LIKE '%CHARACTERSET';
VALUE
AR8MSWIN1256
UTF8Edited by: user560883 on May 4, 2012 3:34 AM
Edited by: user560883 on May 4, 2012 3:39 AM

Hi Sergiusz
Firstly I would like to thank you for replying.
Secondly I was able to move further with the DMU (the issue was due to more sessions that I had to kill to allow DMU to proceed with ALTER DATABASE CHARACTER SET command).
Here is what I have done so far without any luck.
1) Created a test instance with source database characterset ie AR8MSWIN1256 and performed a full import using DataPump (impdp).
2) Used DMU to perform conversion/migration to AL32UTF8. (this step took almost 5 hours).
3) Used SQLDeveloper to verify the results and data still show as garbage.
Thing that worked for me but is way to slow and not reliable.
1) Save data in file (.sql) using Windows XP client or windows 2003 server. Basically I am generating the whole SQL statements for UPDATE eg UPDATE table SET xx)
2) SET NLS_LANG=AMERICAN_AMERICA.UTF8 on command prompt of Windows XP client and use SQLPLUS to open sql prompt.
3) Use @path\file.sql (that was generated in earlier step) to update records.
4) Verify via SQLDeveloper that arabic shows correctly.
Issue with above approach is since we have millions of records stored in multiple tables, sometimes while generating the file with SQL Statements, the server CPU touch 100% and then freeze. Also file size grow exponentially and to verify how much of the work was done prior to freezing becomes very difficult.
I still have the DB after using the DMU tool intact so if you could think of some other workaround that will be great.
Again, thank you for helping me with this.

Arabic Charecters looks like garbage in notification mailer messages

Hi,
We successfully configured notification mailer ( inbound & outbound). we receiving email messages in English correctly but when we get Arabic email message, Arabic characters looks like garbage. i already tried to check RESET_NLS and restart the mailer but still Arabic characters unreadable.
Could you please Help?
Thanks in advance.
Ibrahim.

Hi Ibrahim,
ORA-06512: at "APPS.WF_EVENT", line 1564
ORA-06512: at line 1
[Dec 23, 2013 1:32:31 PM AST]:1387794751156:-1:-1:HRMDBHVQRDCW1:10.34.244.34:-1:-1:1:20420:SYSADMIN(0):-1:Thread[inboundThreadGroup2,5,inboundThreadGroup]:10.34.244.34:18401:1387794751156:777:ERROR:[SVC-GSM-WFALSNRSVC-345051-10021 : oracle.apps.fnd.wf.bes.AgentListenerProcessor.read()]:Could not executeUpdate() on { CALL WF_EVENT.LISTEN ( p_agent_name => :1, p_wait => :2, p_correlation => :3, p_deq_condition => null, p_message_count => :4, p_max_error_count => :5 )} -> java.sql.SQLException: ORA-20002: 3802: Agent does not exist.
ORA-06512: at "APPS.WF_EVENT", line 1564
ORA-06512: at line 1
Please see if the following doc helps you:
Workflow Deferred Agent Listener Cannot be Started After Upgrading to RDBMS 11g (Doc ID 1072604.1)
Workflow Agent Listener Service WF_DEFERRED Will Not Start, Mailer May Be Down (Doc ID 958178.1)
Workflow mailer notification errors with Ora-08103 Object No Longer Exists Error In Wf_xml_generate (Doc ID 1302169.1)
Thanks &
Best Regards,

Oracle XML Publisher Java API's showing arabic characters as question marks

Hi All,
I have created a custom xml publisher report. All the setups in xdo.cfg and the fonts have been installed. When i run the report as concurrent program using the XDODTEXE as the executable this report executes fine displaying the arabic characters in the PDF output.
I have integrated this xml report to a OAF page where am getting the output of the arabic characters as ???????
Following is the java code i have used to generate the blob for the xml publisher report.
pageContext.writeDiagnostics(this,"Inside process Template",4);
AppsContext appsContext = ((OADBTransactionImpl)pageContext.getRootApplicationModule().getOADBTransaction()).getAppsContext();
String applicationShortName = dataDefApplication;
String dataSourceCode = dataDefCode;
OutputStream os = new ByteArrayOutputStream();
try {
DataTemplate dataTemplate = new DataTemplate(transaction.getAppsContext(), dataDefApplication, dataDefCode);
//Get Parameters
ArrayList parameters = dataTemplate.getParameters();
//set Parameter Values as ArrayList of oracle.apps.xdo.dataengine.Parameter
Iterator it = parameters.iterator();
while (it.hasNext())
Parameter p = (Parameter) it.next();
pageContext.writeDiagnostics(this,"Processing Parameters "+p.getName(),4);
if (p.getName().equals("P_AUCTION_HEADER_ID"))
if(AuctionHeaderId != null)
p.setValue(AuctionHeaderId);
else
p.setValue(null);
dataTemplate.setOutput(os);
dataTemplate.processData();
System.out.println(os.toString());
} catch (SQLException e) {
System.out.println("SQLException occurred.");
} catch (XDOException e) {
System.out.println("XDOException occurred.");
} catch(Exception e){
System.out.println("Exception (other) occurred.");
byte[] xmlb = os.toString().getBytes();
BlobDomain blob = new BlobDomain(xmlb);
return blob;
Kindly let me if i had missed something.
Thanks
Anoop

On a related note, I am seeing a couple of different types of 'incorrect' characters based on different NLS_LANG settings.
If it is set to AMERICAN_AMERICA.UTF8, I get characters like this:
Ø±Ù‚Ù… Ø§Ù„Ù…ÙˆØ¸Ù�
If it is set to ARABIC_UNITED ARAB EMIRATES.AR8MSWIN1256, I get characters like this:
ÑÞã ÇáãæÙÝ
Do any of you know what these characters are?
Thanks for any insight.

Arabic characters appear as empty squares when using certain HTML tags or font styles

Only when HW acceleration is on. Arabic characters appear as empty squares when using "italic" or "oblique" font styles or when using <i> or <em> html tags.
Try this code to replicate the problem
<pre>
<p>مشكلة ظهور المربعات الخالية بدل الحروف</p>
<p style="font-style: italic;">Italic مشكلة ظهور المربعات الخالية بدل الحروف</p>
<p style="font-style: oblique;">Oblique مشكلة ظهور المربعات الخالية بدل الحروف</p>
<i>i tag مشكلة ظهور المربعات الخالية بدل الحروف</i> <br> <br>
<em>em tag مشكلة ظهور المربعات الخالية بدل الحروف </em>
</pre>

After lots of research, I found the problem. The boxes (squares) show up whenever there is a font in the webpage that does not have Arabic within its Unicode range such as Times New Roman Italic or Oblique. Normally, Firefox will pick another font to display the characters but now, a newly introduced feature is interfering.
To fix the problem without turning off hardware acceleration.
Go to about:config
locate: gfx.font_rendering.directwrite.use_gdi_table_loading
which is True by default in FF4.0 Beta 10, and change it to False.
This is a bug that has to be fixed.

Problem by entering Persian\Arabic characters in String Control

I'm working on a Jet Printer project. I must make an user interface using LabVIEW. This printer must print some Unicode characters on factory's products. Specialy Persian and Arabic characters.
But it seems that there is not a string control with capability of support Persian\Arabic characters which accept and show this characters correctly.
I also add "UseUnicode=True" to LabVIEW.INI file. But it was not solved.
I'm using Windows XP SP3 and LV2009

ChristianL has written an excellent primer on Unicode and LabVIEW. Also, I have some sprinkled posts things you need to watch out for while using Unicode and LabVIEW.
a.lia-user-name-link[href="/t5/user/viewprofilepage/user-id/88938"] {color: black;} a.lia-user-name-link[href="/t5/user/viewprofilepage/user-id/88938"]:after {content: '';} .jrd-sig {height: 80px; overflow: visible;} .jrd-sig-deploy {float:left; opacity:0.2;} .jrd-sig-img {float:right; opacity:0.2;} .jrd-sig-img:hover {opacity:0.8;} .jrd-sig-deploy:hover {opacity:0.8;}

ColdFusion 8 drops Arabic characters when generating PDF doc

Hello All,
Please let me know what I'm doing wrong here! I have trouble with generating a PDF document from ColdFusion.
The cfm document contains mixed English and Arabic text and it seems that the ColdFusion's embedded PDF Generator drops Arabic characters when creating the PDF file.
I attached a bare bone cfm document (see print_test.cfm) that I used as an example to the stated problem.
The document:
displays fine in FireFox 3.0.10 (see attached print_test_screenshot.jpg) Used link:
http://localhost:8500/Print_test.cfm?display=yes
This image file also shows the characters that get dropped by the ColdFusion's embedded PDF Generator.
is converted fine in PDF by the FireFox 3.0.10 using print command line (see attached print_test_firefox.pdf) Used command:
“C:\Program Files\Mozilla Firefox\firefox.exe" -print "http://localhost:8500/Print_test.cfm?display=yes" -printmode pdf -printfile "c:\pdf\print_test_firefox.pdf" -printdelay 150
is NOT converted to PDF properly by the ColdFusion using the embedded PDF generator (see attached print_test_cf.pdf) Used command: http://localhost:8500/Print_test.cfm
The print_test.cfm file, which I had to remove since this forum allows me to post only 3 attachments, has the following content:
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<cfsavecontent variable="MyPage">
<head>
<title>PRINT TEST</title>
</head>
<body>
<table width="810" border="0">
<tr>
    <td width="225" ><div align="center"><strong>ARABIC TEXT PRINT TEST</strong></div></td>
    <td width="225" ><div align="center"><strong><span dir="rtl">نظام بصمة الوجه في دولة</span></strong></div></td>
</tr>
</table>
</body>
</html>
</cfsavecontent>
<cfif not(isdefined("url.DISPLAY"))>
        <cfdocument format="pdf" filename="c:\pdf\print_test_cf.pdf" overwrite="yes">
        <cfoutput>#mypage#</cfoutput>
        </cfdocument>
    <cfelse>
    <cfoutput>#mypage#</cfoutput>
</cfif>
Thank you all for your help,
Adrian

"I suppose you did it through the cfdocument tag in a cfm document". nope i used
the iText library (the one that ships w/cf) directly in cf to see where the
problem actually was. i don't think this is something you want to do?
i reported this as a bug to adobe, you can help get something done by adding
your own bug report here:
https://www.adobe.com/cfusion/mmform/index.cfm?name=wishform&product=12&6213=6
================ the cf file i used ================
// file
thisPDFFile="c:\Inetpub\wwwroot\iText\arabicLigatureTest.PDF";
// get objects
pdfFile = createObject("java", "java.io.FileOutputStream").init(thisPDFFile);
pageSize = createObject("java", "com.lowagie.text.PageSize").init();
bidiTable = createObject("java", "com.lowagie.text.pdf.PdfPTable").init(1);
//one column table
phrase = createObject("java", "com.lowagie.text.Phrase");
baseFont = createObject("java", "com.lowagie.text.pdf.BaseFont");
Font = createObject("java", "com.lowagie.text.Font");
Phrase=createObject("java", "com.lowagie.text.Phrase");
// landscape to fit this map image, the rotate() bit
//pdfDocument = createObject("java",
"com.lowagie.text.Document").init(PageSize.A4.rotate(), 0, 0, 0, 0);
// portrait
pdfDocument = createObject("java",
"com.lowagie.text.Document").init(PageSize.A4, 0, 0, 0, 0);
tableCell = createObject("java", "com.lowagie.text.pdf.PdfPCell");
PdfWriter = createObject("java", "com.lowagie.text.pdf.PdfWriter");
PdfWriter.getInstance(pdfDocument, pdfFile);
// add metadata BEFORE opening pdf doc
pdfDocument.addTitle("This is a quick and dirty arabic ligature test");
pdfDocument.addSubject("arabic ligature PDF test");
pdfDocument.addAuthor("PaulH");
pdfDocument.addCreator("arabicItext testbed");
pdfDocument.addKeywords("CFMX and iText are a great combination by golly!");
// lets setup unicode font
msUnicode=baseFont.createFont("c:
windows
fonts
ARIALUNI.ttf",
BaseFont.IDENTITY_H, BaseFont.EMBEDDED);
thisFont=Font.init(msUnicode,12);
// open doc to add stuff to then close, duh
pdfDocument.open();
bidiTable.setWidthPercentage(100);
bidiTable.setRunDirection(PdfWriter.RUN_DIRECTION_RTL);
// leading, text, font
arabicPhrase=phrase.init(2,"نظام بصمة الوجه في دولة",thisFont);
c=tableCell.init(arabicPhrase);
c.setArabicOptions(8); //
c.setBorder(0);
c.setGrayFill(5.00);
bidiTable.addCell(c);
for (i=1; i LTE getU.recordCount;i=i+1) {
     arabicPhrase=phrase.init(22,getU.uniText+,thisFont);
     c=tableCell.init(arabicPhrase);
     c.setArabicOptions(8);
     c.setBorder(0);
     c.setGrayFill(5.00);
     bidiTable.addCell(c);
pdfDocument.add(bidiTable);
pdfDocument.close();
</cfscript

How to print Arabic characters in Oracle BI Publisher report

Dear Experts,
Kindly suggest me how to print arabic characters in BI Publisher.
Regards,
Mohan

see link
https://blogs.oracle.com/BIDeveloper/entry/non-english_characters_appears

Arabic characters are not getting displayed in oracle pdf output

Hi,
I am trying to print arabic characters in report output but junk characters are getting displayed in output.
Using 10g report builder, added the arabic labels in report layout.
Followed below steps:
1. Set NLS_LANG=ARABIC_United Arab Emirates.AR8MSWIN1256
2.Set REPORTS_PATH to the system font directoy such as C:\SYSROOT\Fonts
3.transferred the arialbd.ttf to $ORACLE_HOME/guicommon/tk/admin/AFM
4.Open uifont.ali under$ORACLE_HOME/guicommon/tk/admin, set the font alias
entries at [PDF:Subset] section.
[PDF:Subset]
Arial...Bold.. = "arialbd.ttf"
5. open datap462.ppd under $ORACLE_HOME/guicommon/tk/admin/ppd, set the font information like
*Font Arial-Bold: Standard "(001.001)" Standard ROM
6.added following entries:
Add this under the following section
## setting for Reports Runtime
REPORTS_PATH=$ORACLE_HOME/reports/templates:$ORACLE_HOME/reports/samples/demo:$ORACLE_HOME/reports/integ:$ORACLE_HOME/reports/printers:$ORACLE_HOME/
guicommon/tk/admin/AFM:${REPORTS_PATH};
export REPORTS_PATH
b) Add this in the end of the Reports.sh file
PRINTER=dds62; export PRINTER
tk90_PRINTER=dds62; export tk90_PRINTER
tk90_PRINT_STATUS=echo; export tk90_PRINT_STATUS
=======================================
After having all these steps, still my report output is coming with junk characters.
Please help me on this and this is very urgent requirement for me and i am trying on this since 3 days.
Thanks,
Harini

Hello,
Try to set the Font Subsetting like below in the file uifont.ali
[PDF:Subset]
* = "arialbd.ttf"
If it works after this modification, the problem will be related to the Font Aliasing
Troubleshooting Guide for Font Aliasing / Font Subsetting / Font Embedding Issues (Doc ID 350971.1)
Regards

Problem with Arabic characters

Hi:
I don't know if this is the correct place to post the question, but here it goes...
I have an SQL 2005 database, connected via a Linked Server to an Oracle Database.
I have a table in SQL that contains arabic characters, and I need to insert it into an Oracle table.
These characters appear as "????" after being inserted in the oracle table.
I guess I hace some collation/characterset problem, but cannot finf the solution.
The column where the arabic characyers are saved in SQL is defined as:
     [Remarks] [nvarchar](1000) NULL,
And default SQL server collation is: SQL_Latin1_General_CP1_CI_AS
When I do a select on this table, it can see arabic correctly.
ORACLE NLS CONFIGURATION IS:
PARAMETER VALUE
NLS_LANGUAGE AMERICAN
NLS_TERRITORY AMERICA
NLS_CURRENCY $
NLS_ISO_CURRENCY AMERICA
NLS_NUMERIC_CHARACTERS .,
NLS_CHARACTERSET AR8MSWIN1256
NLS_CALENDAR GREGORIAN
NLS_DATE_FORMAT DD-MON-RR
NLS_DATE_LANGUAGE AMERICAN
NLS_SORT BINARY
NLS_TIME_FORMAT HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT HH.MI.SSXFF AM TZR
NLS_TIMESTAMP_TZ_FORMAT DD-MON-RR HH.MI.SSXFF AM TZR
NLS_DUAL_CURRENCY $
NLS_COMP BINARY
NLS_LENGTH_SEMANTICS BYTE
NLS_NCHAR_CONV_EXCP FALSE
NLS_NCHAR_CHARACTERSET AL16UTF16
NLS_RDBMS_VERSION 11.1.0.6.0
The sql sentence in SQL server that moves the data to oracle is:
INSERT INTO openquery(Oracle_DB, 'select Ticket_NO,Remarks from webportal.webcc_escal_det')
     (Ticket_NO,Remarks )
     SELECT Ticket_NO, Remarks
     FROM Details(nolock)
Thanks in advance!!
Mariana

I think first you should check your character set
SELECT * FROM NLS_DATABASE_PARAMETERS where parameter = 'NLS_CHARACTERSET'
For oracle to display correctly, you need to change your character set that caters to Arabic

Oracle Reports 11.1.2 junk Arabic characters in PDF

Hi guys,
When I generate a report with Arabic characters, they appear as junk characters.
I did the following:
Set NLS_LANG=AMERICAN_AMERICA.AR8MSWIN1256
Include C:\WINDOWS\Fonts in REPORTS_PATH (in the Registry: HKEY_LOCAL_MACHINE\SOFTWARE\ORACLE\KEY_OH258674538 )
Open uifont.ali and set the font alias:
   [PDF:Subset]
   "Arabic Transparent"...Bold.. ="arialbd.ttf"
   "Arabic Transparent"="arialbd.ttf"
Installed Arabic keyboard in Windows server that hosts Reports server
Changed the location to United Arab Emirates in Windows
Run the report with DESTYPE=FILE and DESFORMAT=PDF
I also tried to change the font name of the field that contains the Arabic data in the report to things like: Tahoma, Arial, Courier New, but with no luck.
Environment Specs:
OS: Windows 2008 R2
Oracle Reports 11.1.2 (installed on the top of Weblogic 10.3.6.0)
Thanks in advance.

hi,
you have to touch following files.
$ORACLE_HOME/guicommon/tk/admin/AFM
$ORACLE_HOME/guicommon/tk/admin/AFM/Symbol.afm
$ORACLE_HOME/guicommon/tk/admin/TTF
$ORACLE_HOME/guicommon/tk/admin/uiprint.txt
$ORACLE_HOME/guicommon/tk/admin/uifont.ali
$ORACLE_HOME/guicommon/tk/admin/PPD/datap462.ppd
$ORACLE_HOME/guicommon/tk/admin/PPD/screenprinter.ppd
$ORACLE_HOME/bin/reports.sh
convert your true type font to afm and copy ttf/afm files to respective directory
regards

Data Integrator: Arabic characters are not correctly displayed

Hi,
I'm trying to load Arabic text via an UTF8 flat file into an Oracle database.
I've read several topics and set the correct code page settings (also during install) for the datastore and flat file.
Already in flat file preview (see attached screenshot), the wrong characters are displayed. The characters as they are displayed, are inserted in the database. So I think that if I get the flat file preview correctly, the text is inserted correctly into the database.
On the other hand: When i copy the contents of the flat file, via a bodi job, to another flat file, the target flat file does contain the correct characters (when opened in a utf8 file reader).
I tried several solutions and also went through the Code Page help topic on the BODI site.
Does anyone know a solution to my problem or know this is a BODI bug or something?
I'm using Designer version 11.5.3.9 (I went through fix notes of versions after 11.5.3.9, but saw nothing mentioned about my problem). The Oracle database does support arabic characters as I can insert them via e.g. SQL Developer.
Thanks a lot in advance!
Picture of the flat file settings and data preview:
[flat file settings and data preview|http://img169.imageshack.us/my.php?image=arabcharyx3.jpg]
Edited by: Willem van Opzeeland on Jul 23, 2008 2:13 PM: added info

Hé Amr, thanks a lot! This sounds good.
I indeed saw a kind of this solution somewhere else. What I did not is restarting the computer, since it is a shared server. Maybe that was why it didn't solve my problem.
Before I restart an additional question: I need to convert some files with Turkish characters as well.
Have you got a value which I can put in NLS_LANG, which supports these characters and Arabic characters both at the same time?

Accented characters showing up as ? in JRE1.3 but ok in 1.2

I'm implementing a database web interface product that utilizes JSPs (on SunOS 5.7).
The problem is in the search form. When using accented characters (French language), the JSP calls on URLEncode, but all accented characters show up as '?'.
However, when editing a record, using accented characters is not a problem (i.e., the accented characters are properly stored in the fields).
Back on the server, I ran a small program to output accented characters and also to call java.net.URLEncoder to convert the characters.
The default JDK is J2SE (1.3.1). Compiliing and running the program results in question marks.
Using JDK 1.2, the accented characters show up fine.
It would appear that URLEncoder is not at fault, but instead, JDK 1.3.1 doesn't seem to handle the accented characters.
I figure there must be a setting somewhere, but I'm not sure where.
Here's the program I used (written in Win98, using standard Win-based character set and Unicode format \u00xx; in Unix, "more" displays the Win accented characters fine but "vi" displays them as \xxx; compiles and displays perfectly when using JDK 1.2):
import java.net.*;
class mine {
public static void main(String args[]) {
System.out.println("��") ;
System.out.println(URLEncoder.encode("��")) ;
System.out.println("\u00e0\u00e2\u00e4");
System.out.println("\351");
System.out.println("\351\347\356\364\373\340\350\342\344\374\357") ;
The output with JDK 1.2 is:
��
%E9%E7%EE%F4%FB%E0%E8%E2%E4%FC%EF
��
The output with JDK 1.3.1 is:
%3F%3F%3F%3F%3F%3F%3F%3F%3F%3F%3F

Between jdk1.2 and jdk 1.3 the default encoding of the vm changed.
You can get it by executing:
System.out.println("Default Encoding:" + System.getProperty("file.encoding"));
or
System.out.println("Default Encoding:" + (new java.io.InputStreamReader(System.in)).getEncoding());
The default encoding is used during the conversion of bytes to strings and vice verca.
Assume your default encoding is ISO8859_1. Then calling new String(byte[]) is equivalent to calling
new String(byte[], "ISO8859_1")
Now if you are converting a character from one encoding scheme to another and there is no mapping
for this character in the target scheme. Then the character will be replaced by a default character
which is (quite often) the question mark.
You can set the default encoding for a vm by passing it as a command line parameter
java -Dfile.encoding=ISO8859_1
java -Dfile.encoding=Cp1252

Help:displaying Arabic characters using XSL

How do I display static Arabic characters using XSL in a HTML page, from within a JSP?
I need to display a HTML page wherein static Arabic characters have to be shown. I use the following XSL document with static Arabic characters inside:
<?xml version = '1.0'?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
<xsl:output method="html"/>
<xsl:template match="/">
<HTML>
<HEAD/>
<xsl:apply-templates/>
</HTML>
</xsl:template>

<xsl:template match="booklist">
<BODY BGCOLOR="#CCFFFF">
<H1>^GFcI cSGZOI
</H1>
<P> This will illustrate the transformation of XML file containing list of books to a HTML table form
</P>
<xsl:apply-templates/>
</BODY>
</xsl:template>
<xsl:template match="booklist/book">
<xsl:apply-templates/>
</xsl:template>
<xsl:template match="booklist/book/title">
<xsl:apply-templates/>
</xsl:template>
<xsl:template match="booklist/book/author">
<xsl:apply-templates/>
</xsl:template>
<xsl:template match="booklist/book/publisher"/>
<xsl:template match="booklist/book/price"> Price: $
<xsl:apply-templates/>
</xsl:template>
</xsl:stylesheet>
When I try to read the XSL document using an IO stream, like this,
InputStream is = getClass().getResourceAsStream("myXSLDocument.xsl");
XSLStylesheet stylesheet = new XSLStylesheet(inputStream, null);
from within a JSP, I get a null pointer exception as shown below:
java.lang.NullPointerException:
at oracle.xml.parser.v2.XSLStylesheet.<init>(XSLStylesheet.java:175)
at mip.portlets._cardvalidaterportlet._cardentry._jspService(_cardentry.java:143)
at oracle.jsp.runtime.HttpJsp.service(HttpJsp.java)
at oracle.jsp.app.JspApplication.dispatchRequest(JspApplication.java)
at oracle.jsp.JspServlet.doDispatch(JspServlet.java)
at oracle.jsp.JspServlet.internalService(JspServlet.java, Compiled Code)
at oracle.jsp.JspServlet.service(JspServlet.java)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:588)
at oracle.portal.provider.v1.http.JspRenderer.renderBody(JspRenderer.java:133)
at oracle.portal.provider.v1.RenderManager.render(RenderManager.java:164)
at oracle.portal.provider.v1.http.ServletProviderResponse.showPortlet(ServletProviderResponse.java:510)
at oracle.portal.provider.v1.http.HttpProvider.dispatchProviderAction(HttpProvider.java:647)
at oracle.portal.provider.v1.http.HttpProvider.service(HttpProvider.java:383)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:588)
at org.apache.jserv.JServConnection.processRequest(JServConnection.java, Compiled Code)
at org.apache.jserv.JServConnection.run(JServConnection.java, Compiled Code)
at java.lang.Thread.run(Thread.java:479)
I have no problems parsing the same XSL containing static Arabic text using Transviewer beans' XSLTransformPanelSample class. This means that my XSL has no errors in it.
null

You need to use the correct and the same character encoding (charset) thorough the complete process.
Whenever you get question marks, then it means that the charset used does not recognize the bytes (which on its turn are apparently encoded by a different charset).
This is an important read, read it from top to bottom, preferably twice: [http://www.joelonsoftware.com/articles/Unicode.html].

Arabic characters showing as garbage

Similar Messages

Maybe you are looking for