Encoding of UTF8 Characters in URL Strings

I need to link to a URL that has a right single quotation mark in it (u+2019).
This is it: "/News/Case-Studies/UNICEF-Headquarters’-Redesigned-Lobby-Space"
When I paste the link in to a browser, it works.
When I create a link with this URL as the href and click on it, it works.
When I put it in a <CFLocation> tag, it does not work. I need to make this work.
When I take the URL from a browser address bar and paste it into a text editor, it converts the right single quote to the percent-encoded string "%E2%80%99". I have not been able to recreate this encoding. URLEncodedFormat() yields a completely different string.
When I parse the url and note the ASCii value of each character, I get three characters for the right single quote: 226 8634 8482.
I came up with an encoding that worked, but resulted in special characters in the address bar of the browser (don't remember what the technique was at this point).
What encoding can I perfrom at the CF server to duplicate the proper UTF8 encoded string of %E2%80%99?
Any help would be appreciated.

I appreciate your replies, but I'm still mystified.
My user has pasted in a URL with a unicode single right quotation mark. I need to encode it as %E2%80%99.
When I parse the single right quotation mark, I get three ascii bytes; chr(226) & chr(8364) & chr(8482)
The first byte properly tells me that a three-byte unicode character is beginning (asc 226, or hex e2).
I would think the next two bytes would be an asc 128 (hex 80) and an asc 153 (hex 99), which I could then easily convert to %E2%80%99, the proper sequence for a right single quotation mark..
But the next two bytes report as different and significantly higher asc values (8364 and 8482).
I don't see how I can possibly convert this properly.
If I simply put a chr(8217) where the unicode character was, it works, but how on earth do I arrive at that?
How do I get from chr(226) & chr(8364) & chr(8482) to chr(8217)?
Still looking for ideas. Thanks.

Similar Messages

Japanese Characters working as URL parameters, turning to question marks when in URL string itself

I'm having some trouble getting coldfusion to see japanese
characters in the URL string.
To clarify, if I have something like this:
http://my.domain.com/index.cfm?categorylevel0=Search&categorylevel1=%E3%82%A2%E3%82%B8%E3% 82%A2%E3%83%BB%E3%83%93%E3%82%B8%E3%83%8D%E3%82%B9%E9%96%8B%E7%99%BA
All of my code works correctly and the server is able to pass
the japanese characters to the database and retrieve the correct
data.
If I have this instead:
http://my.domain.com/index.cfm/Search/%E3%82%A2%E3%82%B8%E3%82%A2%E3%83%BB%E3%83%93%E3%82% B8%E3%83%8D%E3%82%B9%E9%96%8B%E7%99%BA
My script (which works fine with English characters) parses
CGI variables and converts these to the same URL parameters that I
had in the first URL using a loop and a CFSET url.etc..
In the first example, looking at the CF debug info shows me
what I expect to see:
URL Parameters:
CATEGORYLEVEL0=Search
CATEGORYLEVEL1=アジア・ビジネス開発
In the second example it shows me this:
URL Parameters:
CATEGORYLEVEL0=Search
CATEGORYLEVEL1=???·??????
Can anyone suggest means for debugging this? I'm not sure if
this is a CF problem, an IIS problem, a JRUN problem or something
else altogether that causes it to lose the characters if they are
in the URL string but NOT as a parameter.

My suggestion was that you test with the
first url, not the second. However, I can see a source of
confusion. I overlooked your delimiter, "/". It should be "?" and
"=" in this case. With these modifications, we get
<cfif Len(cgi.query_string) neq 0>
<cfset i = 1>
<cfloop list="#cgi.query_string#" delimiters="&"
index="currentcatname">
<cfoutput>categorylevel#i# =
#ListGetAt(currentcatname,2,"=")#</cfoutput><br>
<cfset i = i + 1>
</cfloop>
If it is a failing of Coldfusion, the above test should fail,
too.
Now, an adaptation of the same test to your second url.
<cfset url2 = "
http://my.domain.com/index.cfm/Search/%E3%82%A2%E3%82%B8%E3%82%A2%E3%83%BB%E3%83%93%E3%82% B8%E3%83%8D%E3%82%B9%E9%96%8B%E7%99%BA">
<cfset query_str =
ListGetAt(replacenocase(url2,".cfm/","?"),2,"?")>
<cfif Len(query_str) neq 0>
<cfset i = 1>
<cfloop list="#query_str#" delimiters="/"
index="currentcatname">
<cfoutput>categorylevel#i# =
#currentcatname#</cfoutput><br>
<cfset i = i + 1>
</cfloop>

UTF8 characters not correctly displayed whilst having encoding set to UTF8

Although the Encoding in Tools > Preferences > Environment is set to UTF8, SQL Developer is not able to display the UTF characters correctly.
I know for sure that I have tested this before using an older version of SQL Developer and then then this worked OK.
Can somebody tell me if I need to change anything else within SQL Developer to make sure the UTF8 characters like (Ὦ φῶς τελευταν σε προσλέψαιμ) are displayed correctly?
Our database (both SQL Server and Oracle) are both completely Unicode aware.
I'm using version 1.1.2.25 build MAIN-25.79.

Hello Barry,
'Where are you seeing this'
Well we are seeing this in the most used tab display on a table. So for instance our database is called PV50. Then from the connections window I double click on PV50 > Tables > <table_name> (in my example QUEUE_MESSAGE).
Then the table is opened. Then I goto the 'DATA' tab of this table and look at the column in which the UTF8 characters are stored. In there I see the wrong display at the moment. I hope this helps to sort out the problem.
If not please let me know.

Dreamweaver still encodes special characters in URL - Bug?

Dreamweaver 6 is still encoding my special characters when I enter a URL through the control panel AND hit enter. When I paste the link in code view or just paste it in the control panel Link field without hitting Enter, no formatting occurs.
I have the setting under Code Rewriting in Preferences set to "Do not encode special characters", but regardless the reformatting occurs whenever I hit enter in the Link field in the Control Panel.
For example:
The link I'm pasting in is a dynamic one and is set to %%DC%%
If I just paste the link into the control panel then click elsewhere the link is set and no formatting occurs. If I paste it in, then hit Enter the URL changes to %Ü%%
Is this a bug or am I doing something incorrectly?

I just tried it and it's happening in both.
How it's occuring to me:
- Open a new or old document.
- Type in a random set of letters, highlight, then click inside in the Link field on the Control Panel
- Type %%DC%%
- Click off the random set of letters, and in code view the Link is still set to %%DC%% (so far so good)
Now if you click back onto the random letters that are now linked, you'll see that the URL in the Link field now changes to %Ü%%, but the actual link in Code View remains %%DC%%.
- Now click inside the link field in the control panel, but don't type or change the URL.
- Click somewhere else to move the cursor out of the control panel
- The link is now set to %Ü%% in both Code View and in the control panel

Encoding URL String inside a .JAD file

hi,
Can you guys please kindly teach me on how to encode a URL String(eg. MIDlet-Server-URL: http://123.123.123.1) into the MIDlet .JAD file so that my MIDlet can use the getAppProperty() to get the URL String value.
I heard about this once but I do not know how to add the value into my .JAD file and implement the getAppProperty() into my MIDlet source code.
Thanks alot.
Warmest regards,
Qingyan

Application-specific attributes don't begin with "MIDlet-", so use something like "Server-URL" rather than "MIDlet-Server-URL". In your JAD file, you would include
Server-URL: http://123.123.123.1
In your code, you would then call getAppProperty("Server-URL") to get the URL. getAppProperty() is a method of the MIDlet class, so you could call getAppProperty() from your MIDlet's constructor.

Invalid Characters in URL

I'm trying to pass query variables in a URL. Within the code,
the link is (CFM page)?Category=#rsCatSum.category1#
The actual URL comes out as (CFM
page)?Category=Skin%20Creams%20&%20Lotions%20. The category
should show "Skin Creams & Lotions". However, with the extra
%20 characters, the category is not found and the result is a blank
page.
Does anyone know what is causing the extra "%20" characters
to be added to the URL?
I appreciate your help!!

Spaces and some special characters (such as the ampersand
"&") are not allowed in URLs. Thus, they should always be
"encoded". You can probably use UrlDecode() to convert the URL
string back to what you're expecting.

RegExp for excluding special characters in a string.

Hi All,
Im using Flex RegExpValidator. Can anyone suggest me the correct expression to validate this condition?....
I have tried this expression :----- /^[^///\/</>/?/*&]+$/...But in this it is also negating the alphabets.Also I have tried with opposite condition that in the String we should have alphabets and the expression is:-- ([a-z]|[A-Z]|[0-9]|[ ]|[-]|[_])*..... Please can anyone help me on this.
Thanks in advanced to all.
Munira

sorry but you are posting things back that do not make any sense
what do you mean with the below comment?
munira06 wrote:
Yes you are correct ,but I have tried this with single special character
say
Re: RegExp for excluding special characters in a string.
here is a sample app taken from the live docs
using ^[a-zA-Z0-9 \-_]*$ as the regex accepts all characters from a-z, A-Z, 0-9 - [space] and_
run the example tell me what regex you are using and what test strings fail when they should pass or pass when they should fail
<?xml version="1.0" encoding="utf-8"?>

<s:Application xmlns:fx="http://ns.adobe.com/mxml/2009"
        xmlns:s="library://ns.adobe.com/flex/spark"
        xmlns:mx="library://ns.adobe.com/flex/mx">
    <fx:Script>
        <![CDATA[
            import mx.events.ValidationResultEvent;
            import mx.validators.*;
            // Write the results to the
            private function handleResult(eventObj:ValidationResultEvent):void {
                if (eventObj.type == ValidationResultEvent.VALID) {
                    // For valid events, the results Array contains
                    // RegExpValidationResult objects.
                    var xResult:RegExpValidationResult;
                    reResults.text = "";
                    for (var i:uint = 0; i < eventObj.results.length; i++) {
                        xResult = eventObj.results[i];
                        reResults.text=reResults.text + xResult.matchedIndex + " " + xResult.matchedString + "\n";
                } else {
                    reResults.text = "";
        ]]>
    </fx:Script>
    <fx:Declarations>
        <mx:RegExpValidator id="regExpV"
                source="{regex_text}" property="text"
                flags="g" expression="{regex.text}"
                valid="handleResult(event)"
                invalid="handleResult(event)"
                trigger="{myButton}"
                triggerEvent="click"/>
    </fx:Declarations>
    <s:Panel title="RegExpValidator Example"
            width="75%" height="75%"
            horizontalCenter="0" verticalCenter="0">
        <s:VGroup left="10" right="10" top="10" bottom="10">
            <s:Label width="100%" text="Instructions:"/>
            <s:Label width="100%" text="1. Enter text to search. By default, enter a string containing the letters ABC in sequence followed by any digit."/>
            <s:Label width="100%" text="2. Enter the regular expression. By default, enter ABC\d."/>
            <s:Label width="100%" text="3. Click the Button control to trigger the validation."/>
            <s:Label width="100%" text="4. The results show the index in the text where the matching pattern begins, and the matching pattern. "/>
            <mx:Form>
                <mx:FormItem label="Enter text:">
                    <s:TextInput id="regex_text" text="xxxxABC4xxx" width="100%"/>
                </mx:FormItem>
                <mx:FormItem label="Enter regular expression:">
                    <s:TextInput id="regex" text="ABC\d" width="100%"/>
                </mx:FormItem>
                <mx:FormItem label="Results:">
                    <s:TextInput id="reResults" width="100%"/>
                </mx:FormItem>
                <mx:FormItem >
                    <s:Button id="myButton" label="Validate"/>
                </mx:FormItem>
            </mx:Form>
        </s:VGroup>
    </s:Panel>
</s:Application>

URL openStream problem. URL String length

Hi,
My problem is about length of the url string. I'm simply creating a URL and trying to call openStream() to get content. But if the length of url string exceeds 118 characters, I'm getting an exception. It says Server returned Http response code 505.
If I try the same url string in a browser it's working.
Thanks for all replies in advance...

the problem solved, it was about white space not length... I didn't notice the white space there sorry!

How to count number of repeated characters in a String

I have a String.... 10022002202222.
I need to know how many 2's are there in the string... here the string contains eight 2's..
Thanks in advance..

it is workingYes, but... attention to surprises...
SQL> var v1 varchar2(1000);
SQL> exec :v1 := 'How to count the number of occurences of a characters in a string';
PL/SQL procedure successfully completed.
SQL> select length(:v1) - length(replace(:v1,'c')) from dual;
LENGTH(:V1)-LENGTH(REPLACE(:V1,'C'))
6
SQL> exec :v1 := 'cccccc';
PL/SQL procedure successfully completed.
SQL> select length(:v1) - length(replace(:v1,'c')) from dual;
LENGTH(:V1)-LENGTH(REPLACE(:V1,'C'))
SQL> select length(:v1) - nvl(length(replace(:v1,'c')),0) from dual;
LENGTH(:V1)-NVL(LENGTH(REPLACE(:V1,'C')),0)
6
SQL>

How to search special characters in a string

Hi all,
I want to search special characters in all string columns and all rows in the table.
The table has about 5 string columns and about 5.000.000 rows. For each row and column, I have to search entries, which included special characters like ", !, ? or something else (f.ex. "Mama?Mia" or "!!!Hotel out of order!!!"). The problem, the character could stand at each position in the string.
What's the best and most performance possibility to search such entries?? Is it possibility only by SQL; is there a special function for this?? Or must I use PL/SQL.
Thanks for helping
Dana

HTH
Laurent Schneider
OCM DBA
SQL> select * from z;
S
Mama?Mia
a b c
123
SQL> select * from z where translate(s,'~ABCDEFGHIJKLMNOPQRSTUVWXYZ abcdefghijklmnopqrstuvwxyz1234567890','~') is not null;
S
Mama?Mia
SQL> select * from z where regexp_like(s, '[^[:alnum:][:space:]]');
S
Mama?Mia

How do I drop the last 3 characters in a string?

Hello. I'm trying to find a way to drop the last 3 characters in a string. The length varies because it is a last name field. The problem is that when a customer has a suffix on their name, III for example, it is appended to the last name all in the last name field. If I use the ProperCase function, I end up with "Smith Iii". How can I tell it to drop the last 3 characters? I'll then append an UpperCase edition of the last 3 characters to that. Thank you!

Use the instring and right string functions then UpperCase

How to find out if there are repeated characters in a string

hey guys
well i kinda have a little problem figuring out how to find out
if there are repeated characters in a string.
if anyone can help, would appreciate it.
thanks
milos

Try using the StringTokenizer class. if u already know which character to trace. this could do the job.
eg. String str = "here and there its everywhere";
StringTokenizer st = new StringTokenizer(str, "e");
int rep = st.countTokens();

Can't CF use non English characters in URLs ???? (critical for SEO)

Hi all,
I want to use non English characters (Greek characters) for folders of the URLs.
eg   http://www.mysite.com/Φάκελος/index.cfm
where "Φάκελος" is a non English word (Greek).
When the called page is simple HTML eg   www.mysite.com/Φάκελος/index.HTM
it's displayed just fine.
When the called page is CF page eg   www.mysite.com/Φάκελος/index.CFM
I get a "FILE NOT FOUND" error.
In the page where the link exists everything is UTF-8.
What's the problem ? Can't CF use non English characters in URLs ????
It's critical for SEO issues.
I use CF9. Any ideas ???
Thanks in advance.
Anastassios

I don't have this setting in the email application. But as I know, html with Exchange is working only with the 2007 version, my server is still 2003 so I think in my case it's plain text only.
But I'm telling again: good old (and now starting to miss) E60 with MfE worked very well!

Removing non english characters from my string input source

Guys,
I have problem where I need to remove all non english (Latin) characters from a string, what should be the right API to do this?
One I'm using right now is:
s.replaceAll("[^\\x00-\\x7F]", "");//s is a string having chinese characters.
I'm looking for a standard Solution for such problems, where we deal with multiple lingual characters.
TIA
Nitin

Nitin_tiwari wrote:
I have a string which has Chinese as well as Japanese characters, and I only want to remove only Chinese characters.
What's the best way to go about it?Oh, I see!
Well, the problem here is that Strings don't have any information on the language. What you can get out of a String (provided you have the necessary data from the Unicode standard) is the script that is used.
A script can be used for multiple languages (for example English and German use mostly the same script, even if there are a few characters that are only used in German).
A language can use multiple scripts (for example Japanese uses Kanji, Hiragana and Katakana).
And if I remember correctly, then Japanese and Chinese texts share some characters on the Unicode plane (I might be wrong, 'though, since I speak/write neither of those languages).
These two facts make these kinds of detections hard to do. In some cases they are easy (separating latin-script texts from anything else) in others it may be much tougher or even impossible (Chinese/Japanese).

Need help in replacing special characters in a string

Hi,
please let me know the best way to replace all the special characters in a string with space.
other than alphabets and numbers
with regards.
sumanth.

please let me know the best way to replace all the special characters in a string with space.
other than alphabets and numbers
>
Sumanth Nag Kristam wrote:
> actually i need to replace hexa decimal char 0X1A in a string.... that is 'substitue' as per the chart
> any pointers....
>
> chk the link for the ASCII codes
> http://www.techonthenet.com/ascii/chart.php
But in Hexa decimal value there is no special characters?

Encoding of UTF8 Characters in URL Strings

Similar Messages

Maybe you are looking for