Search no mapped unicode characters as question mark

No mapped unicodes characters are replace by question mark.
I want to search/detect these characters to correct them (i may spend too much time to find the character "?" in a big document, because of real question mark).
How can i do ?

Arnis' .mif suggestion is the way I've tackled this problem from time to time, but save a spare copy before you start <g> You may not need to, though. I haven't checked, but see if you can find a page with both a normal question-mark and one you know indicates a unicode character. Then copy/paste the unicode question-mark into the Find/replace dialogue and see what happens; I suspect it will have its own value, not the same as a normal question-mark.

Similar Messages

PDF Preview for a PO template with polish characters shows question marks

When I view the PDF using application I see the polish characters(Boilerplate text) as question marks. But when I view it through XML Publisher Dsktop version 5.5.0 it is fine I have download the new version of adobe 7.08 and I can see the polish characters but the preview in XML publisher in the application stll shows "?"

No I havent configured any fonts on desktop/application .. when I view Document properties on the PDF which works the XML Publisher version 5.5.0 and that of the application is 5.6.0.
In the fonts tab on the desktop version there is one additional one listed fromt he application one - AlbanyWTJ(Embedded Subset)

Display extended ascii characters as question mark in xml file

I am creating a XML file with encoding as UTF-8. Some tag values contain some extended ascii characters. When i run the java program to create the file in windows, the extended ascii characters are display correctly. But in linux it is displaying as ?(question mark).
i am not able to rectify this. can anyone help me....
Its urgent
Thanks in advance.
Message was edited by:
Rosy_Thomas@Java

Probably the locale is not set for the shell you are running in. The default 'C' locale uses the ASCII encoding which defines only 128 characters. See if giving the commandexport LC_CTYPE=en_US.UTF-8before starting the program fixes the issue.

Oracle Translation Builder: Japanese characters in question mark (????)

Hi All,
We need to translate a custom from labels from English to Japanese, so that both US and Japan can use that form.
So we have used Oracle Translation Builder to specify the translation. As an initial step, we just changed the labels to some other english words. And now we have generated American .fmx and Japanese .fmx. And we are able to see the difference.
Now in Oracle translation Builder(OTB), if i paste Japanese characters in the translation editor, we are able to see the Japanese characters. But if we save&close the OTB and re-open it, we see all the question(???) marks. Even if we generate/upload the Japanese.fmx to applications, we are seeing the same Japanese ??? marks in the applications.
Can you please let me know, what am i missing...
(I have installed the Asian language (ARIALUNI.ttf) in my local system.)

May be You should set the environment variable NLS_LANG to "JAPANESE_JAPAN.WE8MSWIN1252" or "AMERICAN_AMERICA.JA16SJIS" will allow you to store Japanese providing the input data is truly JA16SJIS and if the database is also in a character set that can store Japanese like UTF8 or JA16SJIS).
Or use Oracle Translation Hub it is useful tool. It replaces the OTB :-)
Edited by: user9212008 on 2.4.2010 1:09

Oracle XML Publisher Java API's showing arabic characters as question marks

Hi All,
I have created a custom xml publisher report. All the setups in xdo.cfg and the fonts have been installed. When i run the report as concurrent program using the XDODTEXE as the executable this report executes fine displaying the arabic characters in the PDF output.
I have integrated this xml report to a OAF page where am getting the output of the arabic characters as ???????
Following is the java code i have used to generate the blob for the xml publisher report.
pageContext.writeDiagnostics(this,"Inside process Template",4);
AppsContext appsContext = ((OADBTransactionImpl)pageContext.getRootApplicationModule().getOADBTransaction()).getAppsContext();
String applicationShortName = dataDefApplication;
String dataSourceCode = dataDefCode;
OutputStream os = new ByteArrayOutputStream();
try {
DataTemplate dataTemplate = new DataTemplate(transaction.getAppsContext(), dataDefApplication, dataDefCode);
//Get Parameters
ArrayList parameters = dataTemplate.getParameters();
//set Parameter Values as ArrayList of oracle.apps.xdo.dataengine.Parameter
Iterator it = parameters.iterator();
while (it.hasNext())
Parameter p = (Parameter) it.next();
pageContext.writeDiagnostics(this,"Processing Parameters "+p.getName(),4);
if (p.getName().equals("P_AUCTION_HEADER_ID"))
if(AuctionHeaderId != null)
p.setValue(AuctionHeaderId);
else
p.setValue(null);
dataTemplate.setOutput(os);
dataTemplate.processData();
System.out.println(os.toString());
} catch (SQLException e) {
System.out.println("SQLException occurred.");
} catch (XDOException e) {
System.out.println("XDOException occurred.");
} catch(Exception e){
System.out.println("Exception (other) occurred.");
byte[] xmlb = os.toString().getBytes();
BlobDomain blob = new BlobDomain(xmlb);
return blob;
Kindly let me if i had missed something.
Thanks
Anoop

On a related note, I am seeing a couple of different types of 'incorrect' characters based on different NLS_LANG settings.
If it is set to AMERICAN_AMERICA.UTF8, I get characters like this:
Ø±Ù‚Ù… Ø§Ù„Ù…ÙˆØ¸Ù�
If it is set to ARABIC_UNITED ARAB EMIRATES.AR8MSWIN1256, I get characters like this:
ÑÞã ÇáãæÙÝ
Do any of you know what these characters are?
Thanks for any insight.

Web Service response from XMLA (using BW SAP) returns french Accent characters as question marks '?'

I am using .Net Framework 4 C# web service project.
I am connecting with XMLA service (using as web reference) in my C# project. The issue seems to be able to handle the French characters once i am getting response back from the XMLA execute method.
At this moment the data is coming back as '??' whenever it contains french special characters.
I am pasting the code below and would appreciate help at earliest.
sapqasbwi.MsXmlAnalysis _sMxlA = new sapqasbwi.MsXmlAnalysis(); // Create XMLA reference object.
System.Net.NetworkCredential _nc = new System.Net.NetworkCredential(); // Creating Network credentials object
_nc.UserName = userid;
_nc.Password = _password;
_sMxlA.Credentials = _nc.GetCredential(new System.Uri(url), "Basic");
_sMxlA.Url = url;
sapqasbwi.ExecuteCommand cmd = new sapqasbwi.ExecuteCommand();
cmd.Statement = stText; // sText contains the query
_bwPropertyList.DataSourceInfo = "default";
_bwPropertyList.Format = "Tabular";
_bwPropertyList.AxisFormat = "ClusterFormat";
_bwPropertyList.Content = "SchemaData";
_bwParameters.PropertyList = _bwPropertyList;
_sMxlA.RequestEncoding = System.Text.Encoding.GetEncoding("ISO-8859-1"); // already tried utf 8
//Execute BW Query
System.Xml.XmlElement returnXML;
returnXML = _sMxlA.Execute(cmd, _bwParameters); // Execute method only returns an XML element object.
This particular object is containing the '??' whenever a french character is found
The output i am receiving is as follows
<MainServiceAndStatuses>
<MainService>Entreposage ?? long terme</MainService>
<MainServiceStatus>Service Termin??</MainServiceStatus>
<TransactionID>1000006216_10_Cde client standard</TransactionID>
</MainServiceAndStatuses

Hi
Can you please send me the direct link for C# forum, i cannot find it on this forum.
thank
TheNauman

Question marks in PDF for non-english characters.

I'm get report from APEX 3.0.1 (Default Report Layout) with BI Publisher 10.1.3.3.1 Base.
In Adobe Reader 7.0.8 instead of non-english(cyrillic) characters see question marks.
How to tune BI Publisher?

After installation BI Publisher 10.1.3.3.1 Base (standalone, OC4J) :
Directory of F:\bip\jdk\lib\fonts
13/10/2007 21:16 15 196 128R00.TTF
13/10/2007 21:16 18 473 348 ALBANWTJ.ttf
13/10/2007 21:16 18 777 132 ALBANWTK.ttf
13/10/2007 21:16 18 676 084 ALBANWTS.ttf
13/10/2007 21:16 18 788 600 ALBANWTT.ttf
13/10/2007 21:16 276 384 ALBANYWT.ttf
13/10/2007 21:16 12 860 B39R00.TTF
13/10/2007 21:16 18 800 MICR____.TTF
13/10/2007 21:16 6 580 UPCR00.TTF
Directory of F:\bip\jdk\jre\lib\fonts
01/08/2006 19:25 75 144 LucidaBrightDemiBold.ttf
01/08/2006 19:25 75 124 LucidaBrightDemiItalic.ttf
01/08/2006 19:25 80 856 LucidaBrightItalic.ttf
01/08/2006 19:25 344 908 LucidaBrightRegular.ttf
01/08/2006 19:25 317 896 LucidaSansDemiBold.ttf
01/08/2006 19:25 698 236 LucidaSansRegular.ttf
01/08/2006 19:25 234 068 LucidaTypewriterBold.ttf
01/08/2006 19:25 242 700 LucidaTypewriterRegular.ttf
Directory of F:\bip\jre\1.4.2\lib\fonts
24/03/2004 19:12 75 144 LucidaBrightDemiBold.ttf
24/03/2004 19:12 75 124 LucidaBrightDemiItalic.ttf
24/03/2004 19:12 80 856 LucidaBrightItalic.ttf
24/03/2004 19:12 344 908 LucidaBrightRegular.ttf
24/03/2004 19:12 317 896 LucidaSansDemiBold.ttf
24/03/2004 19:12 698 236 LucidaSansRegular.ttf
24/03/2004 19:12 234 068 LucidaTypewriterBold.ttf
24/03/2004 19:12 242 700 LucidaTypewriterRegular.ttf
What is wrong?
In Adobe Reader's Document Properties -> Fonts
+Helvetica:
Type: Type1
Encoding: Ansi
Actual Font: ArialMT
Actual Font Type: TrueType
I feel BIP use wrong encoding . . .

Special Characters shown as question marks

Hi everyone.
I have an iPhone 4 since December 2010 but im having a problem, everytime i recieve or send a text message with special characters such as:
ñ á é ç ó etc... i recieve this characters with question mark (?) i called IUSACELL which is my carrier here in México and the told me that this is an iPhone problem because they ran somes test with some iPhones they have there and everything went fine. This is quite annoying.
The problem showed up when i had iOS 4.3.5, now i'm iOS 5 Beta 5 and is still there!!
Regards.
Some images here.
The word is "Llegué"
The word is "Quedé"
The word is "Años"
The word is "Quién"
PS. Sorry for my bad english

Sounds that you have a problem with the font that is used to display those characters. 
You can try some different default fonts (e.g. Arial, Verdana, Tahoma) to see if you can identify the not working font. 
You will have to reinstall or refresh that font.
*http://en.wikipedia.org/wiki/Punctuation
*http://en.wikipedia.org/wiki/Dash

Special Character being replaced by Question Marks in Java Mapping

Hi All,
I need some help on Java Mapping related to special characters.
The problem is that i'm using a Java Mapping to add some information to the XML inside the Interface Mapping. This works fine on our development environment but, in our production environment, it replaces the special character with question marks (eg.: á --> ??).
I'm suspecting of some configuration on the Java Virtual Machine that sets the encoding, but i don't have access to it. Does anyone have any clues about this problem?
Thanks a lot,
Leonardo

Hi Leonardo
Have a look at this forum thread, this might help you to solve your problem.
Java Map Causing error because of ampersand &

Special characters in URL parameters retrieved as question marks

Hello,
I am posting a simple HTML form to a WebDynpro application, and then I retrieve the 2 parameters with the following code :
IWDWebContextAdapter adapter = WDWebContextAdapter.getWebContextAdapter();
String comment= adapter.getRequestParameter("comment");
Problem : some special characters (those with accents for instance) are retrieved as question marks. Their ascii character is always 65533 (unicode rather?).
I guess this is a problem of charset, but where could I change it ?
Trying to encode afterwards does not change the characters, I always get the question marks. But I may not do it the right way...
Any hint on that ?
Thanks a lot.
Best Regards,
Nicolas

Hi,
refer to following code.
Stop using deprecated object IWDWebContextAdapter
IWDProtocolAdapter adapter = WDProtocolAdapter.getProtocolAdapter();
     try {
          byte comment[]= adapter.getRequestObject().getParameter("comment").getBytes("ASCII");
          String str = new String(comment);
     } catch (UnsupportedEncodingException e) {
          // TODO Auto-generated catch block
          e.printStackTrace();
Ashu

Arabic characters are displaying as question marks in forms 10g

We have migrated our application from forms 6i to forms 10g and now in forms 10g the arabic characters are displaying as question marks while it displays correctly in the old application using forms 6i. I have already set the character set to AR8MSWIN1256 in the registry, but it didn't help. Somebody please help.

@ Sarah, Al-Salamu Alikum We Rahmatu Allah we Barakatu,
Sarah Habibty, why new installation ? In order to select a new suitable character set !!!
Then creating a new instance from the db is a better alternative since it saves time,effort and another back up of his current db is exist safely if needed for any purposes in the future.
@Amer,honestly speaking...
Modifing ur NLS_LANG to > AMERICAN_AMERICA.AR8MSWIN1256
Works for me in both Arabic and English data in 2 applications.This works in my pc.But it didn't works at my boss pc this can happened don't have any reason for that.!!!!
i spent lot's of time trying to search but what i had got is that solution i suggested by a friend of mine.
Now please could you advise me, is it better to create a new instance of database as Amatu Allah has suggested or is it better to change the character set through sql as some others have suggested? Again i suggest to select the short cut way ; to reset the character set through sql after taking a back up from ur data that is currently exist.
then retest again doing the select and test ur data input and retrieval.
SQL> select * from v$nls_parameters
2 where parameter in ('NLS_CHARACTERSET','NLS_LANGUAGE');watching the output if it works that's fine saving ur time & effort .
if not working with the correct NLS_CHARACTERSET then use my previous solution.
Hope this helps...
Regards,
Amatu Allah

Version 6.0 running under Win 7 - non-alphabetic characters typed appear as something other than what I typed -- É for question mark for example.

Forward slash appears as lower case e-acute é, question mark as upper-case É. Some, not all shifted numerals also map differently. Shift-3 for instance is forward slash instead of hash symbol.
I played around with character sets - various unicode and western sets - this resolved the problem in an earlier FF version, even after I`d reverted to what I started out with ( I can`t even remember what the default is now.) It was also suggested elsewhere in this forum that the problem could be resolved using the Region and Language settings in Windows Control Panel. This is obviously wrong, because the keyboard is working fine in other applications. It was also suggested I try to resolve by activating the language toolbar in the taskbar, but the option doesn`t even show up so I assume it was never installed.
My judgement this problem is definitely not OS, but Firefox.

See:
* http://support.microsoft.com/kb/306993 - HOW TO: Use the Language Bar in Windows XP
* http://windows.microsoft.com/en-US/windows-vista/The-Language-bar-overview - The Language bar (overview)
* http://windows.microsoft.com/en-US/windows7/The-Language-bar-overview The Language bar (overview)
It is possible that you have switched the keyboard layout by accident. 
Windows remembers that setting per application.
* Make sure that you have the Language bar visible on the Windows Taskbar.
* You can do that via the right-click context menu of the Taskbar: Toolbars > Language Bar.
* Check the keyboard language (keyboard layout) setting for the application that has focus via the icon on the Language bar.
* You need to do that while Firefox has focus because Windows remembers the keyboard layout setting per application.
* The default keys to rotate the layout is a combination (Ctrl+Shift or Alt+Shift) that can easily be used in Firefox to activate a menu item.
* To avoid an unintentional switch assign a specific key sequence (Alt/Ctrl+Shift+number) to select keyboard layouts and remove the key combination to rotate layouts (Alt+Shift or Ctrl+Shift)
* Control Panel > Regional and Language Options > Keyboards and Languages > Change keyboards > Advanced key settings > Change key sequence

Mail with French / Spanish accented characters appear as Question marks

Hi
I am facing issues in mails that have French / Spanish accented characters in mail subject.Accented characters appear as Question marks (?) when received in the inbox.Mail subject is read from properties file.
Please let me know the following
- Should I have the entries in properties file in Unicode ? For example French accent character � is represented as á
- Should I replace msg.setSubject(subject); to msg.setSubject(subject,"UTF-8");
Please suggest.
Below is code snippet :
 Session session = getSession();
 // create a message
 Message msg = new MimeMessage(session);
 // set the from and to address
 InternetAddress addressFrom = new InternetAddress(from);
 InternetAddress[] addressTo = new InternetAddress[recipients.length];
 for (int i = 0; i < recipients.length; i++)
 addressTo[i] = new InternetAddress(recipients);
 msg.setFrom(addressFrom);
 msg.setRecipients(Message.RecipientType.TO, addressTo);
 msg.setSentDate(new Date());
* msg.setSubject(subject);*
 MimeMultipart mp = new MimeMultipart("related");

String subject = "\u00C 9tat de l'inscription en ligne";You need 4 hex digits after \u. You only included 3.
mailSubject = new String(subject.getBytes(), "UTF-8");
message.setSubject(MimeUtility.encodeText(mailSubject,"UTF-8", "B"), "UTF-8");Remove the above two lines. You're trying to make
this much too hard. All you need is:
message.setSubject(subject, "utf-8");
Should I use ISO8859_1 as Charset or UTF-8 ?I think the characters you're included are
representable in iso-8859-1 so you can use
that.
I am using Outlook express as my mail client. Do we have to decode it ?No.

ISO-8859-1 Special Characters turn to Question Marks; How to post Resumes?

I am building a web based application and I have a TextArea in an HTML form. Users can copy and paste their resumes (source - Microsoft Word Docs) into this text area. Once the resume is posted, tomcat handles the request. The request is posted to another JSP, Struts Action Class (Any Java Class that can write to a database).
When I do a System.out.println(request.getParameter("resume")); I the special characters like bullets and quotes and a bunch of others are getting transformed to Question Marks. When I insert the resume into an Oracle Database (into a clob field) they are still being saved a question marks.
I have a JSP Page that displays the posted resume. It has 2 things - It writes the request.getParameter("resume") to the HTML and this comes out fine. But when it writes the resume that is retrieved from the oracle database, i am getting back question marks.
I understand that Java uses unicode for character encoding/representation and I tried changing my HTML page's charset to UTF-8. Did not work. I see that there are a million websites that let users copy and paste their resumes. How are these resumes stored and retrieved from a database using server side java? Any help will be greatly appreciated.
Thanks,
-kal

The characters that the character set "ISO-88591-1" supports are as follow. Confirm your characters are in the range:
0x0 0x1 0x2 0x3 0x4 0x5 0x6 0x7 0x8 0x9 0xa 0xb 0xc 0xd 0xe 0xf 0x10 0x11 0x12 0x13 0x14 0x15 0x16 0x17 0x18 0x19 0x1a 0x1b
0x1c 0x1d 0x1e 0x1f 0x20 0x21 0x22 0x23 0x24 0x25 0x26 0x27
0x28 0x29 0x2a 0x2b 0x2c 0x2d 0x2e 0x2f 0x30 0x31 0x32 0x33 0x34 0x35 0x36 0x37 0x38 0x39
0x3a 0x3b 0x3c 0x3d 0x3e 0x3f 0x40 0x41 0x42 0x43 0x44 0x45 0x46 0x47 0x48 0x49
0x4a 0x4b 0x4c 0x4d 0x4e 0x4f 0x50 0x51 0x52 0x53 0x54 0x55 0x56 0x57 0x58 0x59 0x5a
0x5b 0x5c 0x5d 0x5e 0x5f 0x60 0x61 0x62 0x63 0x64 0x65 0x66 0x67 0x68 0x69 0x6a 0x6b 0x6c 0x6d 0x6e 0x6f
0x70 0x71 0x72 0x73 0x74 0x75 0x76 0x77 0x78 0x79 0x7a 0x7b 0x7c 0x7d 0x7e 0x7f
0x80 0x81 0x82 0x83 0x84 0x85 0x86 0x87 0x88 0x89 0x8a 0x8b 0x8c 0x8d 0x8e 0x8f
0x90 0x91 0x92 0x93 0x94 0x95 0x96 0x97 0x98 0x99 0x9a 0x9b 0x9c 0x9d 0x9e 0x9f
0xa0 0xa1 0xa2 0xa3 0xa4 0xa5 0xa6 0xa7 0xa8 0xa9 0xaa 0xab 0xac 0xad 0xae 0xaf
0xb0 0xb1 0xb2 0xb3 0xb4 0xb5 0xb6 0xb7 0xb8 0xb9 0xba 0xbb 0xbc 0xbd 0xbe 0xbf
0xc0 0xc1 0xc2 0xc3 0xc4 0xc5 0xc6 0xc7 0xc8 0xc9 0xca 0xcb 0xcc 0xcd 0xce 0xcf
0xd0 0xd1 0xd2 0xd3 0xd4 0xd5 0xd6 0xd7 0xd8 0xd9 0xda 0xdb 0xdc 0xdd 0xde 0xdf
0xe0 0xe1 0xe2 0xe3 0xe4 0xe5 0xe6 0xe7 0xe8 0xe9 0xea 0xeb 0xec 0xed 0xee 0xef
0xf0 0xf1 0xf2 0xf3 0xf4 0xf5 0xf6 0xf7 0xf8 0xf9 0xfa 0xfb 0xfc 0xfd 0xfe 0xff

Characters such as apostrophes and smart quotes turning into boxes or question marks

We recently upgraded from CF5 to CF7 and are having a problem
with previously saved text that no longer displays correctly. Some
characters (apparently, non-ASCII characters such as curly
apostrophes and smart quotes) are rendering as boxes or question
marks. We recently upgraded to Oracle 10g from Oracle 8i, but this
problem appears to be independent of the database that the text is
stored in. Here is sample code that will illustrate the problem:
<CFSET string1="Department’s">
<CFSET string2="hey—there">
<CFOUTPUT>
string1 is #string1#
 
string2 is #string2#
</CFOUTPUT>
output looks like this:
string1 is Department?s
string2 is hey?there
These are rendered as boxes when viewed in Internet Explorer.
(They show up as question marks when I copy and paste them here.)
The Demoronize UDF helps *some* of the time, but this is
still happening with a lot of text, especially text that gets
pasted from a website into a form, then saved to a database. Does
anybody have a solution for this? This is breaking my applications
and is incredibly annoying. I'd like to either replace the
problematic characters at the time they are displayed, or replace
them when they are input in the database in the first place (and go
back and update all the previously saved data to replace the
problematic characters with plain text equivalents).
Any suggestions appreciated.

I finally isolated the problematic characters so I edited the
DeMoronize UDF (available at cflib.org) by adding the following
text replacements at the bottom:
text = Replace(text, chr(8208), "-", "ALL");
text = Replace(text, chr(8209), "-", "ALL");
text = Replace(text, chr(8210), "–", "ALL");
text = Replace(text, chr(8211), "–", "ALL");
text = Replace(text, chr(8212), "—", "ALL");
text = Replace(text, chr(8213), "—", "ALL");
text = Replace(text, chr(8214), "||", "ALL");
text = Replace(text, chr(8215), "_", "ALL");
text = Replace(text, chr(8216), "‘", "ALL");
text = Replace(text, chr(8217), "’", "ALL");
text = Replace(text, chr(8218), ",", "ALL");
text = Replace(text, chr(8219), "'", "ALL");
text = Replace(text, chr(8220), "“", "ALL");
text = Replace(text, chr(8221), "”", "ALL");
text = Replace(text, chr(8222), """", "ALL");
text = Replace(text, chr(8223), """", "ALL");
text = Replace(text, chr(8226), "·", "ALL");
text = Replace(text, chr(8227), ">", "ALL");
text = Replace(text, chr(8228), ".", "ALL");
text = Replace(text, chr(8229), "..", "ALL");
text = Replace(text, chr(8230), "...", "ALL");
text = Replace(text, chr(8231), "·",
"ALL");

Search no mapped unicode characters as question mark

Similar Messages

Maybe you are looking for