Lost characters (?) in Strings (UTF-8, Chinese)

Hi,
I keep having troubles with "lost" characters in Chinese.
Some Chinese characters in UTF-8 are displayed correctly and also stored correctly in my file, but some other characters just get lost(?) in the string.
Does anybody know what possibly could be the mistake?
thanks for your help
thomas

Try the following for testing fonts on your OS.
import java.awt.*;
public class TestFonts{
public static void main(String[] args) throws java.lang.Exception{
String sample = new String(new char[]{(char)0x4e00, (char)0x505a});//choose your own characters in the array char[]
java.awt.Font[] fonts = java.awt.GraphicsEnvironment.getLocalGraphicsEnvironment().getAllFonts();
int q=0;
   for (int j = 0; j< fonts.length; j++){
       q = fonts[j].canDisplayUpTo(sample);
       if ((q == -1) ||(q == sample.length())){
                System.out.print(fonts[j].getFamily());
                System.out.print(" :    ");
                System.out.println("YES ");
                System.out.println();
   }//end of for
}

Similar Messages

Characters in String : Unicode 16-bit to custom 32-bit

I understand that internally in Java, characters in Strings are actually Unicode characters, with each character represented with 16 bits.
So, character �L� in Unicode is 0x004C
which is also 0000 0000 0100 1100
Now, I wish to encode each of the 4 bits above into individual ASCII characters:
= 0 0 4 C
= 0x30 0x30 0x34 0x43
= 00110000 00110000 00110100 01000011
So, from the original 16-bit character in Java, I want a final 32-bit.
Eventually, I�ll need to send the final result over the network, via OutputStream/writer and socket.
Can someone help me on this ? Or give me some ideas... Thanks.

trick: prepend the number with 1 and use substring... like int charWith1 = c + 0x10000. That'll make charWith1 to be of the format 0x1XXXX. Then call hexstring on that, you get a string like "1XXXX." Then you can drop the 1 with a call to substring.
of course there are methods that use only bit operations and additions to do it, making it a bit faster.. like this:
byte byte0 = (byte) ((c & 0x000F) + '0');
byte byte1 = (byte) (((c & 0x00F0) >> 4) + '0');
...

Removing non-numeric characters from string

Hi there,
I need to have the ability to remove non-numeric characters from a string and I do not know how to do this.
Does any one know a way?
Example:
Present String: (02)-2345-4607
Required String: 0223454607
Thanks in advance

Dear NickM
Try this this will work...........
create or replace function char2num(mstring in varchar2) return integer
is
-- Function to remove Special characters and alphebets from phone no. string field
-- Author - Valid Bharde.(India-Mumbai)
-- Date :- 20 Sept 2006.
-- This Function will return numeric representation.
-- The Folowing program is gifted to NickM with respect to his post on oracle site regarding Removing non-numeric characters from string on the said date
mstatus number :=0;
mnum number:=0;
mrefstring varchar2(50);
begin
mnum := length(mstring);
for x in 1..mnum loop
if (ASCII(substr(upper(mstring),x,1)) >= 48 and ASCII(substr(upper(mstring),x,1)) <= 57) then
mrefstring := mrefstring || substr(mstring,x,1);
end if;
end loop;
return mrefstring;
end;
copy the above program and use it at function for example
SQL> select char2num('(022)-453452781') from dual;
CHAR2NUM('(022)-453452781')
22453452781
Chao!!!

Number of repeated characters in string array

Hi,
I m trying to get number of repeated characters in string array. I couldnt figure out where am i doing mistake.
thank you,
For example: count({"alpha, beta,"}, 'a')
a is repeated 3
l is repeated 1 etc.
public class Test
public static int count(String[] stringArray, char c)
public String [] str = new String [2];
int count = 0;
str[0]
str[1]
for(int i = 0; i<str.length(); i++)
if (str.charAt(i)
count++;
return count;

There is a difference between a String and a String [].
A String [] is an array of String class objects:/* Traverse_Array_Of_Strings_1.java */
public class Traverse_Array_Of_Strings_1
public static void main(String [] argv)
    /* here is an array of Strings */
    String [] s = { "hello", "how", "are", "you" };
    int i, j;
    System.out.println("s.length = "+ s.length );
    for (i= 0; i < s.length; i++)
      System.out.println("s= <"+ s[i] +">");
      for (j= 0; j < s.length(); j++)
System.out.print(s[i].charAt(j) +", ");
System.out.println("\n-----");
}output:java> javac Traverse_Array_Of_Strings_1.java
java> java Traverse_Array_Of_Strings_1
s.length = 4
s= <hello>
h, e, l, l, o,
s= <how>
h, o, w,
s= <are>
a, r, e,
s= <you>
y, o, u,
Edited by: vim_no1 on Jul 15, 2010 7:43 AM

Flex2b3 Remoting not support utf-8 (chinese,japanese),

hi,i just test the flex2b3+amfphp1.2 but when i get data from
database(utf-8,chinese,japanese) got the error
Error #2044: Unhandled NetStatusEvent:. level=error,
code=Client.Data.UnderFlow
at amfphp/initApplication()
at amfphp/___Application1_creationComplete()
at flash.events::EventDispatcher/dispatchEvent()
at mx.core::UIComponent/set initialized()
at mx.managers::LayoutManager/::doPhasedInstantiation()
at mx.core::UIComponent/::callLaterDispatcher2()
at mx.core::UIComponent/::callLaterDispatcher()
but when i clear the chinese&japanese data only english
data that work!
is the flex2b3 remoting not support chinese etc....???
please help me !thanks
sorry my poor english!

hi,i just test the flex2b3+amfphp1.2 but when i get data from
database(utf-8,chinese,japanese) got the error
Error #2044: Unhandled NetStatusEvent:. level=error,
code=Client.Data.UnderFlow
at amfphp/initApplication()
at amfphp/___Application1_creationComplete()
at flash.events::EventDispatcher/dispatchEvent()
at mx.core::UIComponent/set initialized()
at mx.managers::LayoutManager/::doPhasedInstantiation()
at mx.core::UIComponent/::callLaterDispatcher2()
at mx.core::UIComponent/::callLaterDispatcher()
but when i clear the chinese&japanese data only english
data that work!
is the flex2b3 remoting not support chinese etc....???
please help me !thanks
sorry my poor english!

Replace special characters in String

Dear Guru ,
Does SAP provide the standard function that can replace the special characters in String ?
For example :
I have one template string : " & & & & & output(s) have not been processed yet ! " and five parameters : "P1" , "P2" , "P3" , "P4" , "P5" .
And i would like to apply all parameters into the string to replace the "&" character . Is it possibile ?
My idea is sourcing from the Message String that in tcode : SE91 .
Thanks .
Best Regards,
Carlos Zhang

Hi Carlos,
I think instead of a standard FM you can write a one line command to do this job.
E.g.
constant: str1 type string value 'output(s) have not been processed yet ! '.
data: var1 type c,
         var2 type c,
         var3 type c,
         var4 type c,
         str    type string.
concatenate var1 var2 var3 var4 str1 into str separated by space.
So str will have the final value.
Thanks,
Mainak

How to get utf-8 Chinese Characters from Oracle DB by EJB

We have found that after disabling JIT in weblogic, the Chinese can be displayed correctly, otherwise, it doesn't work.How come this happens?

Thanks for all of your suggestions. It still refuses to work.
I entered the following: ��^�E on the HTML form using the Chinese(PRC)keyboard on my Win2K box.
I checked and verified the correct encoding in the servlet request (GB2312 for chinese characters)
request.getParameter(xxx) yields ???
new String(request.getParameter(xxx).getBytes("GB2312")) yields three boxes (values 20309, 27946 and 23380)
new String(request.getParameter(xxx).getBytes("GB2312"), "UTF-8") yields nothing
Any ideas?

How can i get the length of a string with Simplified Chinese?

when i use eventwriter to add content to a xmldocument,there are some chinese simplified string in it,i use String.length() for the length ,but it is not correct~how can i get the right length for eventwriter?

Below is a simple patch for this problem. Using this patch you need to pass 0 as the length argument for any XmlEventWriter interfaces that take a string length.
Regards,
George
diff -c dbxml-2.3.10/dbxml/src/dbxml/nodeStore/NsEventWriter.cpp dbxml-2.3.10.patch/dbxml/src/dbxml/nodeStore/NsEventWriter.cpp
*** dbxml-2.3.10/dbxml/src/dbxml/nodeStore/NsEventWriter.cpp    Fri Nov 3 12:26:11 2006
--- dbxml-2.3.10.patch/dbxml/src/dbxml/nodeStore/NsEventWriter.cpp      Thu Mar 15 13:58:13 2007
*** 234,239 ****
--- 234,241 ----
        CHECK_NULL(text);
        CHECK_SUCCESS();
+       if (!length)
+               length = ::strlen((const char *)text);
        if (!_current)
                throwBadWrite("writeText: requires writeStartDocument");
        try {
*** 413,418 ****
--- 415,422 ----
        CHECK_NULL(dtd);
        CHECK_SUCCESS();
+       if (!length)
+               length = ::strlen((const char *)dtd);
        if (_current) {
                if (!_current->isDoc())
                        throwBadWrite("writeDTD: must occur before content");
diff -c dbxml-2.3.10/dbxml/src/dbxml/nodeStore/NsWriter.cpp dbxml-2.3.10.patch/dbxml/src/dbxml/nodeStore/NsWriter.cpp
*** dbxml-2.3.10/dbxml/src/dbxml/nodeStore/NsWriter.cpp Tue Jan 2 16:01:14 2007
--- dbxml-2.3.10.patch/dbxml/src/dbxml/nodeStore/NsWriter.cpp   Thu Mar 15 13:59:25 2007
*** 326,331 ****
--- 326,333 ----
                needsEscape = false;
        else
                needsEscape = true;
+       if (!length)
+               length = ::strlen((const char *)chars);
        writeTextWithEscape(type, chars, length, needsEscape);
*** 336,341 ****
--- 338,345 ----
                              bool needsEscape)
        if(_entCount == 0) {
+               if (!len)
+                       len = ::strlen((const char *)chars);
                if ((type == XmlEventReader::Characters) ||
                    (type == XmlEventReader::Whitespace)) {
                        char *buf = 0;
*** 381,386 ****
--- 385,392 ----
NsWriter::writeDTD(const unsigned char *data, int len)
        if(_entCount == 0) {
+               if (!len)
+                       len = ::strlen((const char *)data);
                _stream->write(data, len);
}

String utf-16 conversion

Hello,
I call rfc (via xi) and get result as flat xml String from r/3.
This string contains english and hebrew characters. The english is o.k. but the value nodes in hebrew looks like " ׳ ׳�׳ ׳�׳׳ ׳׳�׳¨׳׳/׳׳׳�׳� "
how can i convert the string in order to see my language characters?
I think the source unicode is utf-8, and i need to convert it to utf-16 but i'm not sure about that nor how to do that.
Thanks for your help.
Roni.

Hi Roni,
If your RFC returns an XML file as a java.lang.String object, the String itself is by definition UTF-16. To see if the XML file is correct, you could write it to disk and open it with your favourite text editor. Something like this.
private void save(String xml) throws IOException {
OutputStream out = new FileOutputStream(new File("/tmp/result.xml"));
out.write(xml.getBytes("UTF-8"));
out.close();
Or whatever supported encoding you like and that's supported by your text editor, e.g. ISO-8859-8 is Latin/Hebrew Alphabet; see http://java.sun.com/j2se/1.4.2/docs/guide/intl/encoding.doc.html
Obviously, to correctly see the characters you need the necessary fonts too.
In case the above doesn't work, it means the xml String you receive from the RFC call is already corrupt. However, if it does work, the RFC as such works correctly.
The next step is likely to parse the XML to extract the information you need and store it in your Web Dynpro context. An XML parser usually expects bytes (a java.io.InputStream) as input, which means you need to convert the String to bytes and by doing that, you need to choose a character encoding. It could be something like the following.
SAXParserFactory.newInstance().newSAXParser().parse(new ByteArrayInputStream(xml.getBytes("UTF-8")), handler);
Note that the character encoding you specify here does make a difference. It should be the same, in order not to "confuse" the XML parser, as defined in the XML file's document type declaration, e.g. <?xml version="1.0" encoding="UTF-8"?>
BTW, what exactly do you do with the received XML to obtain the value nodes?
Kind regards,
Sigiswald

Special characters in String variable sent from php.

Hello. Assuming that I send some String variable from php into flash:
AS3:
var MyImportedString:String;
var variables_page_text:URLVariables = new URLVariables();
var varSend_page_text:URLRequest = new URLRequest("MyPHP.php");
varSend_page_text.method = URLRequestMethod.POST;
varSend_page_text.data = variables_page_text;
var varLoader_page_text:URLLoader = new URLLoader;
varLoader_page_text.dataFormat = URLLoaderDataFormat.VARIABLES;
varLoader_page_text.addEventListener(Event.COMPLETE, var_comp_page_text);
varLoader_page_text.load(varSend_page_text);
function var_comp_page_text(event:Event):void {
    MyImportedString = event.target.data.MyVariable;
php:
<?php
header('Content-Type: text/html; charset=utf-8');
$MyString = "some tekst &";
print "MyVariable=" . $MyString;
?>
   I've noticed that the special character '&' residing inside String, throws an error: #2101: The String passed to URLVariables.decode() must be a URL-encoded query string containing name/value pairs.
My first thought was, it has something to do with html entities, but other entities (like <> or ") don't throw any error. Besides, the use of php functions like htmlentities(); or html_entity_decode(); doesn't make any difference in this case:
print "MyVariable=" . htmlentities($MyString);
or
print "MyVariable=" . html_entity_decode($MyString);
I've also noticed that characters like '%', '^', '+' don't show up at all;
What does it mean? Any ideas?
Reagards.

Thank You 'moccamaximum'.
Ok. So here is the solution (php function posted by 'moccamaximum' does the trick):
AS3:
var MyImportedString:String;
var variables_page_text:URLVariables = new URLVariables();
var varSend_page_text:URLRequest = new URLRequest("MyPHP.php");
varSend_page_text.method = URLRequestMethod.POST;
varSend_page_text.data = variables_page_text;
var varLoader_page_text:URLLoader = new URLLoader;
varLoader_page_text.dataFormat = URLLoaderDataFormat.VARIABLES;
varLoader_page_text.addEventListener(Event.COMPLETE, var_comp_page_text);
varLoader_page_text.load(varSend_page_text);
function var_comp_page_text(event:Event):void {
    MyImportedString = event.target.data.MyVariable;
     trace(MyImportedString);        // Output: some text &%^+
php:
<?php
header('Content-Type: text/html; charset=utf-8');
$MyString = "some text &%^+";
print "MyVariable=" . flash_encode($MyString);
function flash_encode($string){
     $string = rawurlencode(utf8_encode($string));
     $string = str_replace("%C2%96", "-", $string);
     $string = str_replace("%C2%91", "%27", $string);
     $string = str_replace("%C2%92", "%27", $string);
     $string = str_replace("%C2%82", "%27", $string);
     $string = str_replace("%C2%93", "%22", $string);
     $string = str_replace("%C2%94", "%22", $string);
     $string = str_replace("%C2%84", "%22", $string);
     $string = str_replace("%C2%8B", "%C2%AB", $string);
     $string = str_replace("%C2%9B", "%C2%BB", $string);
     return $string;
?>

Supplementary characters and string functions

I am using AL32UTF8 as my database character set and plan to store Japanese supplementary characters in the DB character set itself. Do I need to use any special string functions for these supplementary Japanese characters.

With the AL32UTF8 character set, supplementary characters like any other characters, except that they are the widest (4 bytes). You just need standard multibyte processing.
With AL16UTF16 (NCHAR), and depending on your needs, you may want to use certain SQL function variants that have 4 in their name: LENGTH4, INSTR4, SUBSTR4, LIKE4.
When retrieving AL32UTF8 supplementary characters through JDBC or OCI in UTF-16 mode, you have to take care of the fact that one AL32UTF8 supplementary character becomes 2 UTF-16 code units (a surrogate pair). This is important for buffer allocations, length calculations, and any code that can split strings into substrings.
-- Sergiusz

Convert integers to equivalent characters in string - NOT ASCII code character

I have to output my data and associated string information to a string array and then to a spreadsheet file.
I want to do this by converting integers (and other numbers) to an identical string of characters.
I have tried Type Cast with a string constant as the type input but it DOES NOT WORK. Instead, I get the ASCII character whose numerical designation matches the integer, e.g. integer "50" become capital "P".
I want integer "50" to be string "50".
Please advise and no, I do not want to make arrays of clusters.
Solved!
Go to Solution.

I found my answer but only after searching for "Number" conversion rather than "Integer" conversions.
In the Programming palette - String Functions - String/Number Conversion - Number to Decimal String:
"Converts number to a string of decimal digits at least width characters wide or wider if necessary. If number is floating-point, it is rounded to a 64-bit integer before conversion."

How to Avoid Special Characters in string

Hai.
I want only Alphabets & Digits to be entered in to my string.No any other special characters except spaces.How can I do this?
Solved!
Go to Solution.

MikeS81 wrote:
see the attached example.
I would allow a few more, e.g. 0 and 8 to allow editing of the entered string (backspace, cursor buttons, delete key, etc.).
Message Edited by altenbach on 11-21-2008 12:49 AM
LabVIEW Champion . Do more with less code and in less time .
Attachments:
check_char_LV80MOD.vi ‏14 KB
FilterStringInput.gif ‏6 KB

How to replace special characters in string.

Hello,
I want to replace special characters such as , or ; with any other character or " ".I find out there is no such function is java for this.There is only replace() but it accepts only chars.If anybody know how to do this?.
Thanks,

Hello,
I want to replace special characters such as , or ;
with any other character or " ".I find out there is no
such function is java for this.There is only replace()
but it accepts only chars.If anybody know how to do
this?.
Thanks,Can't you just do the following?
public class Test
     public static void main(String[] args)
     String testString = "Hi, there?";
     System.out.println(testString.replace(',',' '));
}

Search set of Characters in String in mapping

Hello All,
I want to search for a set of characters in a string and I want to do this in mapping.
Can anyone help me in resolving this?
Example:-
String = "SAP PI is an Integration Tool"
Search = "an Integ"
OR
just search for "an Integ" in the String.
The String length can always change and the position of "an Integ" can also change.
Please help!
Thanks for your help and time,
Abhi
Edited by: Abhi_1516 on Nov 19, 2009 7:08 PM

Thanks Sunil, for your quick response.
I tried using that, but it's returning the index of the first occurrance of the Sub String and not "-1" as you have described.
I am trying to write an UDF and I am getting syntax error ... where I am doing wrong?
+int ind = (param2 + 7);+
String str1 = param1.substring(param2,ind);
String flag;
if ( (str1.equals("an Integ")) )
+ flag = "a";+
else
+ flag = "b";+
return (flag);
param1 and param2 are input parameter in the UDF.
THanks for your help,
Abhi
Edited by: Abhi_1516 on Nov 19, 2009 7:35 PM

Lost characters (?) in Strings (UTF-8, Chinese)

Similar Messages

Maybe you are looking for