How to Identify non-english characters in a Text

Hi Experts,
I have a text coming from KNA1-NAME1 which contains non-english characters / language at times. I want to identify them in my code so that I can skip them.
Can you please guide with some Command / FM that help to identify these non-english characters?
Regards,
Nirmal

Hi,
I am fine with english characters A-Z, a-z or 0-9 or special characters. But it contains some chinese, japanes or non-english language characters which I dont want.
The logic explained by you above would expect me to list all the valid characters. Also it would be a performance constraint. Hence i wanted something as FM or standard procedure. Can we use ASCII somehow ?
Regards,
Nirmal

Similar Messages

How to add non English characters

I install weblogic 10.3.3.0, SOA Suite 11.1.1.2, and SOA Suite 11.1.1.3 on Windows 2008 (English version). The Location of Regional and language option is set to local place. I also add non-Unicode.
I can add new holiday rules using non English characters in the BPM workspace. Then, I shutdown my computer as normal. However, after I restart my computer and weblogic domain as well as SOA Suite 11g. The non English characters become ??????
How to configure Weblogic domain and SOA Suite to show non English characters?

is both English and Korean letters are in the same column without any space gab or any separator, ? Pl re check

How to retrieve non-english characters from a query

Hello,
My apologies if this post is not in its proper place, but I was a bit confused where to add it.
I'm running a query using SQL Developer on a table which contains several companies names from many different countries, and one of the checks I need to make to ensure data consistency is to search for all rows which the name of company contains special or non-english characters (like ç, ã, ä as example).
I don't know what can I use to do this. I tried to collate using NLS_SORT but it didn't work.
Is there someway to select only the rows that contain these special or non-english characters, excluding from the results the rows that only have english characters? Please have in mind that we have many languages in this table.
The field I would like to make the conditions on is VARCHAR2.
Please let me know if there is any extra information I should provide you so that you can help me.
Thank you in advance for the help.
Regards,
Luís

Hi Luis,
My apologies if this post is not in its proper place, but I was a bit confused where to add it.This is the Forum for the SQL Developer Data Modeler product.
I suggest you try using the SQL and PL/SQL Forum: PL/SQL
David

How to detect Non-English characters

I have a report containing Korean language and English in a single column.
My requirement is to detect the Korean language and pass it to the place holder column and detect English language and pass it to other place holder column.
Please help me guys.

is both English and Korean letters are in the same column without any space gab or any separator, ? Pl re check

How to send e-mails containing non-english characters

Hi,
I would like to send email using JavaMail,
but I have a problem with sending non-english Characters.
How to change/use different charset?
What should I do to send non-english chars?
thanks!

Send mail as text/html (HTML enabled content) , Specify charset in the header part (GB23... or UTF-8)of HTML
Its easy,
I hope it would solve ur problem
cheers
Rajendra Bandi

Identify Non English Character in a String

All,
We have a requirement to Identify the Non English Characters from the User Key In data and return an error message saying only valid English, Numeric and some special characters are allowed.
For Example, If the User enters data like "This is a Test data" then the return value should be true. or if he enters something like "My Native Language is inglés" then it should return false. Similarly any Chinese, russian or japansese character entryies should also return false.
How can we achieve this?
Thanks,
Nagarajan.

Hi Nagarajan,
You could use Unicode character blocks or simply craft a regular expression that contains all the characters you need. The latter is easy to understand and gives you full control over which characters you want to allow. E.g. I assume you might want something like this:
if(!"This is a proper input string".matches("[\\s\\w\\p{Punct}]+")) {
// Issue error message and re-get input string
The String method matches() takes a regular expression as input parameter. If you haven't dealt with regular expressions before, check out the Java API help for class java.util.regex.Pattern. Here's a short breakdown of the pattern I used:
<ol>
<li>The square brackets [] enclose a list of allowed characters; here you can explicitly list all allowed characters.</li>
<li>You can specify ranges like a-z as a character class, list individual characters like ;:| or utilize predefined character classes (\s for any whitespace character, \w for all letters a-z and A-Z, underscore and 0-9 and the posix class \p for a list of punctuation symbols). For a complete list check Java API help on java.util.regex.Pattern.
<li>The + at the end indicates that the characters listed can occur once or more.</li>
</ol>
There's other ways to achieve what you want, but I think this might be an easy way to start with.
Cheers, harald

Word Replacements for Non- English Characters

Hi
Does anyone have an idea on implementing Word Replacements for non- english characters in TCA- DQM 11i.
We are trying to identify, capture and cleanse common accented characters like à, â , ê
However, the default language for replacement is American English , So even if we add these in the existing lists it will not take any effect
Is creating a new Word replacement list for every language the solution ?? any patch recommendations???
Thanks in advance

It seems that this is an issue that has popped up in various forums before, here's one example from last year:
http://forum.java.sun.com/thread.jspa?forumID=16&threadID=490722
This entry has some suggestions for handling mnemonics in resource bundles, and they would take care of translated mnemonics - as long as the translated values are restricted to the values contained in the VK_XXX keycodes.
And since those values are basically the English (ASCII) character set + a bunch of function keys, it doesn't solve the original problem - how to specify mnemonics that are not part of the English character set. The more I look at this I don't really understand the reason for making setMnemonic (char mnemonic) obsolete and making setMnemonic (int mnemonic) the default. If anything this has made the method more difficult to use.
I also don't understand the statement in the API about setMnemonic (char mnemonic):
"This method is only designed to handle character values which fall between 'a' and 'z' or 'A' and 'Z'."
If the type is "char", why would the character values be restricted to values between 'a' and 'z' or 'A' and 'Z'? I understand the need for the value to be restricted to one keystroke (eliminating the possibility of using ideographic characters), but why make it impossible to use all the Latin-1 and Latin-2 characters, for instance? (and is that in fact the case?) It is established practice on other platforms to be able to use characters such as '�', '�' and '�', for instance.
And if changes were made, why not enable the simple way of specifying a mnemonic that other platforms have implemented, by adding an '&' in front of the character?
Sorry if this disintegrated into a rant - didn't mean to... :-) I'm sure there must be good reasons for the changes, would love to understand them.

Non-English characters

Hello, I have read several times that since Java uses Unicode, it solves the problems of non-English characters automatically or something like that.
But my app is not working as expected. Would someone help please?
I have a client/server combo written in Java. The server can send messages in English or Japanese. The Japanese messages are hard-coded as String literals in the server source code. On the client side, they are displayed on a JEditorPane. But the Japanese characters are all garbled. The OS on the server side and client side are, of course, different.
My supposition, which is obviously wrong as it is not working, is that since both ends of communication are Java app, I need not worry about any encoding conversions for String literals.
Suggest me what is wrong here?

How is the required encoding/decoding supposed to be done?
When I didn't worry about non-English characters, I did the following, which WORKED.
// SENDER side
Socket socket ;
PrintWriter out = new PrintWriter(socket.getOutputStream(),true);
String outMessage = "my message";
out.println(outMessage);//RECEIVER
Socket socket ;
BufferedReader in = new BufferedReader(new InputStreamReader(socket.getInputStream()));
String inMessage = in.readLine();When non-English characters are involved, I did the following, which DID NOT WORK. Please someone correct me.
// SENDER side
Socket socket ;
PrintWriter out = new PrintWriter(socket.getOutputStream(),true);
String outMessage = "my message";
String utfString = new String(outMessage.getBytes(),"UTF-8");
out.println(utfString);//RECEIVER
Socket socket ;
InputStreamReader ins = new InputStreamReader(clientSocket.getInputStream(),"UTF-8");
BufferedReader in = new BufferedReader(ins);
String inMessage = in.readLine();The received message is still garbled.

Non english characters in DN cannot be retrieved

We are using Netscape directory server 4, protocal V3. We have a problem related to non-english characters appearing in RDN.
We publish to Ldap entries using the values from database. For example, we have pubulished an entry to Ldap, based on DB values, the entry should have a DN like: ou=Liege BELGIUM ... LGG1a, <other components of DN>. However, when we call netscape search API (search against uid attribute which does not have non-english characters), the search return the entry, but when further call getDN() method on the returned Ldap Entry, it only returns Li, instead of the complete DN value.
It seems the entry is corrupted in Ldap. I wanted to delete the corrupted entry and re create new one to test. I tried many ways, but none of them worked, I think it is because DN is corrupted, there is no key value to identify the Ldap entry for any operation(modify, delete).
You help and insights are much appreciated.
Thanks.
Han Shen

LDAP uses the UTF8 encoding. You must store data in the directory using the UTF8 encoding. This includes DN values. This also means that if you want to be able to view the values in your native character set and font, you must use an application that can convert the UTF8 LDAP data back to the native character encoding. The directory console by default should work for LATIN-1 (ISO 8859) languages if the LOCALE is set correctly.

Non-English characters not displaying correctly - Serious Issue

My corporate email is on a Lotus Domino server with Lotus Traveler installed.
I have set my PlayBook (with OS 2) up to syncronize with the corporate email trough Active Sync (see http://alturl.com/qh3nn), which works perfectly.
I have however noticed that in some emails special non-english characters are displayed correctly but in some emails special non-english characters are displayed as a black diamond with a question mark inside.
This is of course a serious issue as most non English speaking countries use some special characters.
When trying to understand this problem how can I analyse the emails and see what character set is being used?
And of course better; has someone solved this?

I am having the same problem. Is there any update available?

Encoding non english characters with utf 8 on jsp (Critical!!)

I am inserting hebrew characters from JSP into oracle db and everything is fine until this point. But when I try to retrieve the information from the database, the characters are not displayed properly (I get some garbage characters). I am sure that the data stored in the database is correct, but not sure why there is a problem in displaying the data in the JSP.
I came across a thread on TSS
http://www.theserverside.com/discussions/thread.tss?thread_id=28944
and followed the suggestions given there like having
<%@ page contentType="text/html; charset=UTF-8" pageEncoding="UTF-8" %>
<META http-equiv="Content-Type" content="text/html; charset=UTF-8">and also this
<%
//Some JDBC and sql statement query UTF-8 data and then ...
String str = rs.getString("utf8_data");
str = new String(str.getBytes("ISO-8859-1"),"UTF-8");
%>
<%= str %>Now, the data getting displayed is partly correct, I mean to say, some characters are still coming as squares.
Any ideas will be of great help.

even i doubt the database charset for this issue. But what I dont understand is how only certain hebrew characters are getting stored properly and why others are corrupted?
Also, can anyone let me know how i can view the Non-English characters present in the database directly, as TOAD is not able to display them

Why Rpad does not work in non-English characters...????

Ηι ,
I have the classic table of emp in user scott....
When i insert another row containing non-English characters the rpad function does not work......
SQL> select ename , rpad(ename,12,'.') from emp;
ENAME                          RPAD(ENAME,12,'.')
SMITH                          SMITH.......
ALLEN                          ALLEN.......
WARD                           WARD........
JONES                          JONES.......
MARTIN                         MARTIN......
BLAKE                          BLAKE.......
CLARK                          CLARK.......
KING                           KING........
TURNER                         TURNER......
JAMES                          JAMES.......
FORD                           FORD........
MILLER                         MILLER......
SCOTT                          SCOTT.......
ADAMS                          ADAMS.......
ΠΑΝΑΓΙΩΤΟΥ ΠΑΝΑΓΙWhen i convert it to English characters then it works....
PANAGIOTOU PANAGIOTOU..
How can i make it to work....????
I use 10g v.2
Many thanks...
Sim

Hi ,
SQL> select length('ΠΑΝΑΓΙΩΤΟΥ') from dual;
LENGTH('ΠΑΝΑΓΙΩΤΟΥ')
                  10
SQL> select vsize('ΠΑΝΑΓΙΩΤΟΥ') from dual;
VSIZE('ΠΑΝΑΓΙΩΤΟΥ')
                 20When i issue the command
SQL> select ename , rpad(ename,25,'.') from emp;
ENAME                          RPAD(ENAME,25,'.')
SMITH                          SMITH....................
ALLEN                          ALLEN....................
WARD                           WARD.....................
JONES                          JONES....................
MARTIN                         MARTIN...................
BLAKE                          BLAKE....................
CLARK                          CLARK....................
KING                           KING.....................
TURNER                         TURNER...................
JAMES                          JAMES....................
FORD                           FORD.....................
MILLER                         MILLER...................
SCOTT                          SCOTT....................
ADAMS                          ADAMS....................
ΠΑΝΑΓΙΩΤΟΥ                     ΠΑΝΑΓΙΩΤΟΥ.....It worked.... setting as 25 characters for padding.....
Thanks....for the useful remark
Sim

Non English Characters do not appear as is while downloading in CSV

Hi All,
My report output has some non english characters. Downloading the output in CSV the non english characters dont show as is, rather appear as *???*
I am using classic Report Template.
How to overcome this?
Should I create a custom Report Template?
If Yes, then how to incorporate the custom template
Thanks,
Sombit

Hi,
You can create a custom template using BI Publisher + RTF Template.
There you can set the font, graphs, ...
But you need commercial version of Oracle BI.
Regards
J :D

Non english characters in commnd line sqlplus

Guys,
In linux,
How to see hindi characters in terminal based SQLPLUS?
IN GUI based SQLPLUS,i can see hindi characters but in COmmand line SQLPLUS,the hindi rows show empty boxes.

Check the thread on similar kind of doubt.
Re: non-english characters in sqlplus
Regards,
Sabdar Syed.

Missing/corrupted non-english characters in Preview

I know there have been posts on this recently, but this is such a significant problem that I thought it worth keeping live.
Preview does not display non-english characters in PDFs properly. Things like greek characters are either displayed as the english equivalent or are missing or something else more bizzare. This happens on my MBP and my partners MB, both running Leopard. Acrobat, Word etc have no problems. I had no issues with Tiger
I would like to report this directly to Apple but I couldn't find how...

Suggestions
1) Try with NLS_LANG as
SWEDISH_SWEDEN.WE8DEC
2) Make a paramform and enter via paramform (unencoded)
(This is just for testing purpose)
3) Change machine locale to swedish and try
4) Which reports version is this ?
Please see
BUG 2713695 - NLS CHARACTERS FOR PARAMETERS CHANGE TO QUESTION MARKS WHEN PASSED ON URL BAR
Get in touch with Support to see if this is the issue and if "yes" get a one-off patch.
[    All Docs for all versions    ]
http://otn.oracle.com/documentation/reports.html
[     Publishing reports to web - 10G ]
http://download.oracle.com/docs/html/B10314_01/toc.htm (html)
http://download.oracle.com/docs/pdf/B10314_01.pdf (pdf)
[   Building reports - 10G ]
http://download.oracle.com/docs/pdf/B10602_01.pdf (pdf)
http://download.oracle.com/docs/html/B10602_01/toc.htm (html)
[   Forms Reports Integration whitepaper 9i ]
http://otn.oracle.com/products/forms/pdf/frm9isrw9i.pdf
---------------------------------------------------------------------------------

How to Identify non-english characters in a Text

Similar Messages

Maybe you are looking for