URLEncoder.encode() for double-byte characters

I use URLEncoder.encode(String s) and I know that this api is deprecated.
Instead I use URLEncoder.encode(String s, String enc) api and I pass-in a URL as the value for 1st parameter which is "http://regexp.tistory.com/entry/깨진-한글-URL-변환" and for the 2nd parameter I pass in "UTF-8".
But I believe that the double-byte characters in this URL is not encoded properly.

Sorry but no.
Here's a link to what did go into RH6.
http://www.adobe.com/devnet/logged_in/mhu_rh_whatsnew.html

Similar Messages

Support for double-byte characters

Does RH6 have support for double-byte characters for
localization/translation to Asian languages? This feature was in
X3, removed from X5, but did it make it into 6?
Thanks,
Mike

Sorry but no.
Here's a link to what did go into RH6.
http://www.adobe.com/devnet/logged_in/mhu_rh_whatsnew.html

Using Double Byte Characters in URL For Session Variables

When I supply the value for a session variable in the URL for an IRPT page where the value contains double byte characters, Japanese in this case, the characters are corrupted by the time they are entered for the session variables. Does anyone know a solution to this problem or experience in this area? Currently using xMII 11.5 SR3.

Hi Bryan,
I would suspect that under the covers the session variable is of datatype string. For double byte characters, it would need to be wstring. There is a better explanation to be found at:
Link: [Kanji and Java Datatypes|http://www.unix.com.ua/orelly/java-ent/jenut/ch10_04.htm] or you can try google on Kanji Datatype OR Kanji Java Datatype
It could also be a problem with the operating system which I ran into about 10 years ago, but I would hope that Microsoft had moved beyond that by now.
Maybe some more technical folks could chime in to confirm or deny my explanation.
Mike
Edited by: Michael Appleby on Jul 8, 2008 5:23 PM

Given filename or path contains Unicode or double-byte characters.Retry using ASCII characters for filename and path What does this mean? it happen when I publish an OAM

Given file name or path contains Unicode or double-byte characters. Retry using ASCII characters for filename and path
What does this mean? It is happening when I try to publish an OAM for Dreamweaver.
Also: How can I specify the browser in Edge Animate? It is just going wherever. Are there no Preferences for Edge Animate?
BTW. Just call it Edge. Seriously. Do you call it Illustrator Draw? Photoshop Retouching?

No, my file name is mainContent.oam
My project name is mainContent.an
This error happens when I try to import into Dreamweaver. Sorry, I wasn't clear on that earlier.
I thought maybe it was because I had saved my image as a png. So re-saved as a svg, still get the error.
DO I have a setting is Dreamweaver CC that is wrong? Should I try this in Dreamweaver CS6? I might try that next.
Why is this program so difficult? I know Flash. I know After Effects. I can work the timeline part just great. It's always in the export that I have problems.
On a MacPro, 10.7.
Are you an Adobe person or just a nice helper?

Double Byte Characters for Japanese Kanji Language

Hello All,
How can you identify the Double Byte characters and how we can check whether they are double byte characters or not.
Can you please tell me the double byte characters from Japanese Kanji language for the characters.
This is very urgent.I will reward you with points.
Thanks,
Karan

*& Report YTEST_LOGIC
REPORT teched_unicode_solution_1               .
*** Exercise 1: Distinction between byte and character length
*** after Unicode enabling
parameter: param type c.
PERFORM test1 USING param.
* FORM test1
FORM test1 USING text TYPE c.
DATA: len1 TYPE i,
        len2 TYPE i,
        off TYPE i.
DESCRIBE FIELD text LENGTH len1 IN BYTE MODE.
DESCRIBE FIELD text LENGTH len2 IN CHARACTER MODE.
WRITE:/ LEN1, LEN2.
ENDFORM.                                                    "test1
Use the above code to find which characters are double bytes and which are not...
The double byte characters will have double the length when they are in the byte mode..
reward points for helpful answers
Edited by: Rahul Kavuri on Mar 26, 2008 6:35 PM

How best to send double byte characters as http params

Hi all
I have a web app that accepts text that can be in many languages.
I build up a http string and send the text as parameters to another webserver. Hence, whatever text I receive i need to be able to represent on a http query string.
The parameters are sent as urlencoded UTF8. They are decoded by the second webserver back into unicode and saved to the db.
Occassionally i find a character that i am unable to convert to a utf8 string and send as a parameter (usually a SJIS character). When this occurs, the character is encoded as '3F' - a question mark.
What is the best way to send double byte characters as http parameters so they always are sent faithfully and not as question marks? Is my only option to use UTF16?
example code
<code>
public class UTF8Test {
public static void main(String args[]) {
encodeString("\u7740", "%E7%9D%80"); // encoded UTF8 string contains question mark (3F)
encodeString("\u65E5", "%E6%97%A5"); // this other japanese character converts fine
private static void encodeString(String unicode, String expectedResult) {
try {
String utf8 = new String(unicode.getBytes("UTF8"));
String utf16 = new String(unicode.getBytes("UTF16"));
String encoded = java.net.URLEncoder.encode(utf8);
String encoded2 = java.net.URLEncoder.encode(utf16);
System.out.println();
System.out.println("encoded string is:" + encoded);
System.out.println("expected encoding result was:" + expectedResult);
System.out.println();
System.out.println("encoded string16 is:" + encoded2);
System.out.println();
} catch (Exception e) {
e.printStackTrace();
</code>
Any help would be greatly appreciated. I have been struggling with this for quite some time and I can hear the deadline approaching all too quickly
Thanks
Matt

Hi Matt,
one last visit to the round trip issue:
in the Sun example, note that UTF8 encoding is used in the method that produces the byte array as well as in the method that creates the second string. This is equivalent to calling:
String roundTrip = new String(original.getBytes("UTF8"), "UTF8");//sun exampleWhereas, in your code you were calling:
String utf8 = new String(unicode.getBytes("UTF8"))//Matt's code
[/code attracted
The difference is crucial. When you call the string constructor without a second (encoding) argument, the default encoding (usually Cp1252) is used. Therefore your code is equivalent toString utf8 = new String(unicode.getBytes("UTF8"), "Cp1252")//Matt's code
i.e.you are encoding with one transformation format and decoding back with a different transformation format, so in general you won't get your original string back.
Regarding safely sending multi-byte characters across the Internet, I'm not completely sure what the situation is because I don't do it myself. (When our program is run as an applet, the only interaction it has with the web server is to download various files). I've seen lots of people on this forum describing problems sending multi-byte characters and I can't tell whether the problem is with the software or with the programming. Two possible methods come to mind (of course you need to find out what your third party software is doing):
1) use the DataOutput/InputStreams writeUTF/readUTF methods
2) use the InputStreamReader/OutputStreamWriter pair with UTF8 encoding
See this thread:
http://forum.java.sun.com/thread.jsp?forum=16&thread=168630
You should stick to UTF8. It is designed so that the bytes generated by encoding non-ASCII characters can be safely transmitted across the Internet. Bytes generated by UTF16 can be just about anything.
Here's what I suggest:
I am running a version of the Sun tutorial that has a program running on a server to which I can send a string and the program sends back the string reversed.
http://java.sun.com/docs/books/tutorial/networking/urls/readingWriting.html
I haven't tried sending multi-byte characters but I will do so and test whether there are any transmission problems. (Assuming that the Sun cgi program itself correctly handles characters).
More later,
regards,
Joe
P.S.
I thought one the reasons for the existence of UTF8 was to
represent things like multi-byte characters in an ascii format?Not exactly. UTF8 encodes ascii characters into single bytes with the same byte values as ASCII encoding. This means that a document consisting entirely of ASCII characters is the same whether it was encoded as UTF8 or ASCII and can consequently be read in any ASCII document reader (e.g.notepad).

How to display double byte characters with system.out.print?

Hi, I'm a newbie java programmer having trouble to utilize java locale with system io on dos console mode.
Platform is winxp, jvm1.5,
File structure is:
C:\myProg <-root
C:\myProg\test <-package
C:\myProg\test\Run.java
C:\myProg\test\MessageBundle.properties <- default properties
C:\myProg\test\MessageBundle_zh_HK.properties <- localed properties (written in notepad and save as Unicode, window notepad contains BOM)
inside MessageBundle.properties:
test = Hello
inside Message_zh_HK.properties:
test = 喂 //hello in big5 encoding
run.java:
package test;
import java.util.*;
public class Run{
public static void main(String[] args){
    Locale locale = new Locale("zh","HK");
    ResourceBundle resource =
        ResourceBundle.getbundle("test.MessageBundle", locale);
    System.out.println(resource.getString("test"));
}//main
}//classwhen run this program, it'll kept diplay "hello" instead of the encoded character...
then when i try run the native2ascii tool against MessageBundle_zh_HK.properties, it starts to display monster characters instead.
Trying to figure out what I did wrong and how to display double byte characters on console.
Thank you.
p.s: while googling, some said dos can only can display ASCII. To demonstrate the dos console is capable of displaying double byte characters, i wrote another helloWorld in chinese using notepad with C# and compile using "csc hello.cs", sure enough, console.write in c# allowed me to display the character I was expecting. Since dos console can print double byte characters, I must be missing something important in this java program.

after google a brunch, I learned that javac (hence java.exe) does not support BOM (byte order mark).
I had to use a diff editor to save my text file as unicode without BOM in order for native2ascii to convert into a ascii file.
Even the property file is in ascii format, I'm still having trouble to display those character in dos console. In fact, I just noticed I can use system.out.println to display double byte character if I embedded the character itself in java source file:
public class Run {
     public static void main(String[] args) throws UnsupportedEncodingException{
          String msg = "中文";    //double byte character
                try{
                System.out.println(new String(msg.getBytes("UTF-8")) + " new string"); //this displays fine
                catch(Exception e){}
                Locale locale = new Locale("zh", "HK");
          ResourceBundle resource = ResourceBundle.getBundle("test.MessagesBundle", locale);
                System.out.println(resource.getString("Hey"));      //this will display weird characterso it seems like to me that I must did something wrong in the process of creating properties file from unicode text file...

How to check double byte characters

Hi
My requirement: I have to accept the string (may include double byte characters and special characters). Need to check that wether that string contains any special characters(like %,&,..), if so should display error message.
My solution: Starting i tried by usign the ASCII values. But the my code dividing the Double Byte characters into two characters.
Code:
package JNDI;
public class CharASCIIValues {
     public static void main(String[] args) {
          // TODO Auto-generated method stub
          String s = args[0];
          char ch[] = s.toCharArray();
          for(int i=0;i<=ch.length;i++){
               System.out.println(" "+ch[i]+"="+(int)ch);
I ran with some double characters (japanese)
But i got the out put was = ?=63 ?=63 ?=63 ?=63 ?=63 ?=63 1=49 2=50 3=51 h=104 e=101 l=108 l=108 o=111
The ? are double byte charcters.
Queries:
Do i need to set any java setting to support DB characters.
Please help me to come out this problem....any help/information will be appreciated.

First of all Java strings are encoded in a modified version of UTF-8 that uses 2 bytes per character. That is the char datatype is equivalent to an unsigned short.
Second what exactly do you mean by double byte? Whether a character ends up encoded in two bytes or not depends on the encoding used (UTF-8, UTF-16 (both unicode), BIG5, GB2312 (both chinese), iso-8859-1(Latin-1), ASCII, etc...). This means that there are no "double byte characters" there are only "double byte characters when encoded in <your encoding>".
Where does your string come from? What encoding are you using to read the string in the first place? Are you sure you are creating the string using the right encoding?

Text strings from VISA read don't match identical looking text constants - could it be double byte characters"

Our RS232-enabled instrument sends ASCII strings to COM 1 and I read strings in. For example I get the string "TPM", or at least it looks like "TPM" if I display it. However, if I send that to the selector input of a Case structure, and create a case for "TPM", whether the two appear to match varies. Sometimes it matches, and measuring its length returns 3. Sometimes it measures 7 or 11 or 12 characters long, and it doesn't match. I can reproduce a match or a mismatch by my choice of the command that went to the instrument prior to the command that causes the TPM response, but have made no sense of this clue. I have run it through Trim Whitespace, with Both Ends (the default) explicitly selected. I have also turned the string into a byte array, autoindexed a For loop on that, and only passed the bytes if they don't equal 32, or if they don't equal 0, thinking spaces or nulls might be in there, but no better.
The Trim Whitespace function's Help remarks that it does not remove "double byte characters". But I can't find anything else about "double byte characters". Could this be the problem? Are there functions that can tell whether there are "double byte characters", or convert into or out of them? By "double byte characters", do they just mean Unicode?
Solved!
Go to Solution.

Cebailey,
The double byte characters are generally used for characters specific to languages other than English. If you display your message in " '\' Codes Display" in a string indicator do you see any other characters? You could also use Hex Display to see count the number of bytes in the message. You are probably getting messages with non-printable characters that might need to be trimmed before using your application. If you want more information the '\' Codes Display, there's a detailed description found in the LabVIEW Help. You can also find the same information on our website in the LabVIEW Help. Backslash ('\') Codes Display
Caleb WNational Instruments

Invoke-WebRequest - Double byte characters issue in windows 8.1

I try write a powershell script to download a file from web server but failed. The path have double byte characters.
I could run in Windows server 2012 and 2012 R2 successfully, but fail in Windows 8 & 8.1
Do there any difference below Windows server and client powershell?
Region and setting are same in Windows 2012 & Windows 8
Script as below
Invoke-WebRequest -Uri " http://hostname/m/%E9%...../......./...../xxx.jpg"

Security settings are one possible cause of this.
Since we don't have your URL we cannot reproduce this.
It is "different". Using "difference" had me confused for qa bit. I though you were trying to figure out the difference between two things.
Use:
$wc=New-Object System.Net.WebClient
$ws.DownloadFile($url,'c:\file.jpg')
You will see less issues and it is faster.
¯\_(ツ)_/¯

Regular Expressions and Double Byte Characters ?

Is it possible to use Java Regular Expressions to parse
a file that will contain double byte characters ?
For example, I want a regular expression to match the following line
tag="double byte stuff" id="double byte stuff"

The comments on the bytes/strings were helpful. Thanks.
But I'm still confused as to what matching pattern could be used.
For example a pattern like:
[A-Za-z]
I assume would not match any double byte characters.
I also assume the following won't work either:
[\\p{Alpah}]
because it is posix - US-ASCII only.
So how do you say "match the tag, then take any characters,
double byte, ascii, whatever, then match the text tag - per the
original example ?

Double byte characters in a String - Help needed

Hi All,
Can anyone tell me how to find the presence of a double byte ( Japanese ) character in a String. I need to check whether the String contains a Japanese character or not. Thanx in advance.
Ramya

/** returns true if the String s contains any "double-byte" characters */
public boolean containsDoubleByte(String s) {
for (int i=0; i<s.length(); i++) {
    if (isDoubleByte(s.charAt(i)) {
      return true;
return false;
/** returns true if the char c is a double-byte character */
public boolean isJapanese(char c) {
if (c >= '\u0100' && c<='\uffff') return true;
return false;
// simpler: return c>'\u00ff';
/** returns true if the String s contains any Japanese characters */
public boolean containsJapanese(String s) {
for (int i=0; i<s.length(); i++) {
    if (isJapanese(s.charAt(i)) {
      return true;
return false;
/** returns true if the char c is a Japanese character. */
public boolean isJapanese(char c) {
// katakana:
if (c >= '\u30a0' && c<='\u30ff') return true;
// hiragana
if (c >= '\u3040' && c<='\u309f') return true;
// CJK Unified Ideographs
if (c >= '\u4e00' && c<='\u9fff') return true;
// CJK symbols & punctuation
if (c >= '\u3000' && c<='\u303f') return true;
// KangXi (kanji)
if (c >= '\u2f00' && c<='\u2fdf') return true;
// KanBun
if (c >= '\u3190' && c <='\u319f') return true;
// CJK Unified Ideographs Extension A
if (c >= '\u3400' && c <='\u4db5') return true;
// CJK Compatibility Forms
if (c >= '\ufe30' && c <='\ufe4f') return true;
// CJK Compatibility
if (c >= '\u3300' && c <='\u33ff') return true;
// CJK Radicals Supplement
if (c >= '\u2e80' && c <='\u2eff') return true;
// other character..
return false;
/* NB CJK Unified Ideographs Extension B not supported with 16-bit unicode. Source: http://www.alanwood.net/unicode */
}

Suggest double byte characters

Hello,
I am running one concurrent program that generates output
In the output china characters are coming i want to replace with the double byte characters.
Thanks in advance
Cheers.

I think it's pretty standard to use varchar2 for this. I've never heard of anyone wanting to store double-byte character data as a NUMBER. What advantages could you imagine in such a scheme?
Justin

Double Byte Characters

Which is better: store double byte characters (from other rdbms) as NUMBER or VARCHAR2?
thanks in advance to those who will reply

I think it's pretty standard to use varchar2 for this. I've never heard of anyone wanting to store double-byte character data as a NUMBER. What advantages could you imagine in such a scheme?
Justin

Java apps refuse to accept double byte characters

Java apps refuse to accept double byte characters
In my user account, all java apps now refuse to accept double-byte characters (Chinese, Japanese, etc). I have another clean account, and that one works fine.
Things I tried doing:
* repair permissions
* search/delete .plist files with java as a part of the name
* search/detete .plist file that has to do with TCIM, input method
Nothing worked…
MacBook Pro 15" early 2011, Lion 10.7.3.
Can anyone help?

Well, there is no guarantee that you can detect double-byte characters. However if you believe strongly that a file DOES contain double-byte characters, written in big-endian or little-endian format, then you can look at the first two bytes of the file:
FFFE big-endian.
FEFF little-endian.
Code tip: Open the file as a FileInputStream, then wrap it in a PushbackInputStream. This allows you to read the first two bytes (so you can examine them), and push them back. If you find the expected encoding, then you can wrap the PushbackInputStream in an InputStreamReader, specifying the appropriate (big-endian or little-endian) decoding.
Setup tip: I believe the decoding will only work if you have internationalization set up do this by copying i18n.jar from the lib directory (of the JRE) to the extension directory (of the JRE).

URLEncoder.encode() for double-byte characters

Similar Messages

Maybe you are looking for