System python interactive shell - cannot input non-ascii charecters

If I open Terminal.app (with default setup, in particular utf-8 is the default encoding) I can input non-ascii characters without any problem, in particular I can input all itelian accented letters. But I can't input such characters in system's python2.6 or python2.5 shells: all I get is Terminal giving a beep error sound.
I have a custom python version (2.4.4) downloaded from python.org website and with that version on python I don't have any problem.
Can you help me with this?

If anyone still has this problem, also with a downloaded Python install from python.org, the solution is to easy_install readline.
Follow these steps:
Check if you already have access to the easy_install command from a Terminal.app command line.
If not, google "python how to install setuptools/distutils". It's pretty easy you may just need to paste one or two terminal commands. This then gives you access to easy_install on the command line.
In a Terminal.app commandline run the following command: easy_install readline
This should make the Terminal Python use readline which is a much improved version of the age old libedit library (which is the culprit for this issue).

Similar Messages

[zsh] cannot input non ASCII characters

When inputing non-ASCII characters (Chinese, for example) under command line, it becomes something like
ä½?
what is really should be printing is
你好
I've searched a little bit on this, and answer has always been "zsh has unicode support already after 4.3.1",
but how come it appears no so in 4.3.10 ?

SamC wrote:Could this be a problem with your terminal?
hardly, cause I've also tried this with xterm.
Setting "setopt multibyte" and "setopt printeightbit" doesn't help as well.

TimesTen Error :5126: A system managed cache group cannot contain non-stand

I have created few cache groups in TimesTen.
And when i fired script to create fillowing cache group its gives me error.
please see the details mentioned below.
CREATE USERMANAGED CACHE GROUP C_TBLSSTPACCOUNTINGSUMMARY
AUTOREFRESH MODE INCREMENTAL INTERVAL 5 SECONDS STATE ON
FROM
schema.tablename
ACCOUNTINGSUMMARYID DOUBLE,
INPUTFILENAME VARCHAR(255) NOT NULL,
ACCOUNTINGSTATUS VARCHAR(255) NOT NULL,
RECORDCOUNT DOUBLE,
LASTUPDATEDDATE DATE NOT NULL,
CREATEDATE TIMESTAMP DEFAULT SYSDATE,
PRIMARY KEY (ACCOUNTINGSUMMARYID),
PROPAGATE);
then error occurs like==>
5121: Non-standard type mapping for column JISPRATCORBILLINGDEV501.TBLSSTPACCOUNTINGSUMMARY.ACCOUNTINGSUMMARYID, cache operations are restricted
5126: A system managed cache group cannot contain non-standard column type mapping
The command failed.

If you have access to Oracle Metalink, Please take a look at the Note:367431.1
Regards,
Sabdar Syed.

Non-ascii character problem

hi
Scenario: Reading Flat-File and writing into Oralce Table.
In my database procedure, I have declared a column say X as VARCHAR2 to store string values. In the flat-file, some times the data for column X comes as Non-ASCII string values (e. SäHKOTOIM) and because of this the database procedure raises ORA-06502:PL/SQL:numeric or value error.
So, how I can identify that the flat file has non-ascii values so that I can reject that record and move with another record?
your suggestion will be greatly appreciated.
Regards
shakeel

Hi,
You set you nls_database_parameters which is compatiable with you input (non- ascii) characters.
Try to use the LCSSCAN in order to know the relevant character set with respective to input and set the nls_parameters
https://students.kiv.zcu.cz/doc/oracle/server.102/b14225/ch12scanner.htm#i1016925
- Pavan Kumar N

Can ims5.2p1 do sieve filter searches with non-ASCII chars?

Particularly, is it possible with the
Subject header line, which is
=?xxx?Q?xxxxx?= or =?xxx?B?xxxxx?= encoded
Resolved the fileinto foldername part, but
now found that seems like ims's sieve filter
cannot do non-ASCII matches... Thanks.

Hi, back! Spent a few hours experimenting and found
that everything is working great (including the creation
of international non-ASCII foldernames) when I used
utf-8 encoding in the sieve filters rules for the
the match strings and the folder names... at least
so far so good... for your ref and sorry for bothering.

[Solved] no non-ASCII character input in rxvt-unicode

Hello everyone,
For some days now, I can't write any non-ASCII characters any more in rxvt-unicode and rxvt-unicode-patched. Unfortunately, downgrading the rxvt-unicode package doesn't seem to help. To have at least a temporary solution, I'd like to know at least which packages I could try to downgrade as well. Any ideas, anyone?
greez,
maxmin
Last edited by Maximalminimalist (2011-03-12 13:12:26)

When I try to type a non-ASCII-character I get nothing at all. This happens with my custom keyboard layout (modified programmer dvorak) and in some layouts I already tried (us: altgr-intl, ch, de and fr)
When I paste a non-ASCII characters in rxvt-unicode I get
maxmin ~ $ ?
This happens only on my x86_64 desktop which is more up to date than my i686 laptop. (I'm afraid now to do any updates.)
EDIT: I'm sorry, I don't know what you mean with locale settings. What do you mean with that?
EDIT2: Maybe just typing locale in the terminal is what you mean:
maxmin ~ $ locale
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
LANG=en_US.utf8
LC_CTYPE="en_US.utf8"
LC_NUMERIC="en_US.utf8"
LC_TIME="en_US.utf8"
LC_COLLATE="en_US.utf8"
LC_MONETARY="en_US.utf8"
LC_MESSAGES="en_US.utf8"
LC_PAPER="en_US.utf8"
LC_NAME="en_US.utf8"
LC_ADDRESS="en_US.utf8"
LC_TELEPHONE="en_US.utf8"
LC_MEASUREMENT="en_US.utf8"
LC_IDENTIFICATION="en_US.utf8"
LC_ALL=
With other terminal emulators I get sometimes also nothing and sometimes right displayed but wrong interpreted character in vim. I didn't take notes while doing that but I'll try again if needed.
Last edited by Maximalminimalist (2011-03-06 21:51:23)

Cannot connect to WPA network with non-ascii password

In my office somebody thought it would be a good idea to encrypt the wireless network with a WPA password containing a non-ascii character. It is fine by the WPA2 standards, but the airport password prompt doesn't allow me to introduce suche characters.
I have also tried to put the password directly in Keychain but it didn't work either. Besides, I tried the /System/Library/PrivateFrameworks/Apple80211.framework/Versions/Current/Resourc es/airport utility and it also didn't work.
Any ideas, experiences, comments??
Thanks a lot

Anyway, it seems strange to me this limitation the Apple airport utility and that there is no command line way to overcome this "UI problem".
It appears that OSX is enforcing WPA Personal's "no non-ASCII" rule, whereas Windows isn't.
There may be a command-line fix, but I don't know what it might be.

Security error: Cannot authorize operation for invalid non-ASCII URL

I have an error that popped up with Flash Player 10.1.85.3 or 10.1.82.76.
In our application, we load users' avatars with their original filename. Some filenames have non-ASCII characters (i.e. Hebrew, accents, or umlauts) and I can no longer load those files from a different subdomain.
For example, I'm trying to load this image (with the Loader class and a LoaderContext):
http://photos.myawesomedomain.com/images/awesöme.jpg (o with umlaut)
It comes to me encoded in UTF-8:
http://photos.myawesomedomain.com/images/awes%C3%B6me.jpg (umlaut converted to %C3%B6)
When I try to load the file from http://myawesomedomain.com/myawesome.swf, I get this error:
*** Security Sandbox Violation ***
Connection to http://photos.myawesomedomain.com/images/awesÃ¶me.jpg halted - not permitted from http://myawesomedomain.com/myawesome.swf
Error: Cannot authorize operation for invalid non-ASCII URL http://photos.myawesomedomain.com/images/awesÃ¶me.jpg
If I try this with a player earlier than 10.1.82.76, it works. It also works if I move the file to the same domain as the SWF (http://myawesomedomain.com/images/awesöme.jpg) -- but that's not an option for me. Files without unusual characters work regardless of the player version.
The error occurs when I try to access the bitmap data of the loaded image. I've tried encoding the URL differently, but Flash always reports it as "http://photos.myawesomedomain.com/images/awesÃ¶me.jpg" - with the umlaut converted to strange characters. The cross domain file allow-access-from "*.myawesomedomain.com"
Has anyone run into this? Is there a way I can fix it without renaming the users' photos (we have tens of thousands of these)?
I feel like I must be missing something obvious; hardly anything comes up in Google for this, but I don't think it would be an uncommon problem. I believe https://bugs.adobe.com/jira/browse/FP-5580 is related.
Thanks!

The problem is based on the player version, not the browser.
The problem showed up in Chrome first because it auto-updates the player; when Firefox users installed the updated player, they started having the problem, too.

Cannot login with password containing non-ascii characters

Hello,
I have web application, form based login. UTF-8 is specified "everywhere".
And it works, except for passwords.
If user register itself with password containing non-ascii characters, it is correctly written in database, but when doing either programmatic login or normal form based login, if fails.
If the password is only ascii, it works.
Username of login could be ascii or non-ascii, it doesn't matter, both works.
I'm using sun java application server 9.1.
jdbc realm.
I'm not using hashing passwords, just clean (now)
I tried configure realm Charset: UTF8 as last chance, but it doesn't work either.
The problem is only with non-ascii characters in password.
Any help very appreciated
Thanks a lot

hi,
I know all that, but that's not the case. My app uses preparedStatements, everything is properly configured, in all pages, utf-8 is going from user to db and back without any problems.
The only problem is with password field. As I am using form based login, with jdbc realm configured (again, nicely working when only ascii characters), I have very little chance to do something bad through the login phase.
I'm not talking about special characters, I'm talking about non-ascii characters, let's say - Chinese, arabish, Russian alphabet etc.
When user registers (my code), the fields are properly written to db. I have checked that, trust me.
But the Sun app server realm seems to have some problems with the password field.
(realm uses jdbc connection to mysql, the url contains all extra parameters to be sure about utf8. there is nothing more what can be configured...)
If I try other alphabet codes in login and ascii in password, it works. But soon, as I use other alphabet code also in password, it doesn't work anymore.
My only idea is, that I could try MD5 to create ascii only characters (I hope it works that way) on the client with javascript and then set Digest to MD5 in realm configuration. But still, it seems very strange. The clear way storage should also function? (now set Digest to 'none')
Is it a bug of Sun App Server?
thanks

Cannot rename file with non-ASCII characters when using the

My application moves files from one directory to another by calling File[] srcFiles = srcDir.listFiles() to get a list of files in the source directory, and then calling srcFiles.renameTo(destFile) to rename each file.
This does not work (renameTo returns false and the file is not moved) under the following circumstances:
- the file's leaf name contains non-ASCII characters, for example "�"
- the OS is Solaris 9
- the LANG and LC_* environment variables are unset, i.e. the C locale is being used
If I set the LANG environment variable to, for example, en_GB.UTF-8 then the rename succeeds.
I have tried calling srcFiles[index].getName().getBytes("UTF-8") and the non-ASCII characters are being replaced with ? (0x3f) characters when LANG is unset.
Is this a bug in the JRE? I would argue that since my code does not actually manipulate the filename (I just use the File object that File.listFiles() gives me) then the rename should succeed. Of course I would not expect the file name to be displayed correctly if I printed it out.
I have reproduced this behaviour with JDK 1.4.2_05 and 1.5.0_04 on Solaris 9.
Francis

Thanks for the info Alan.
I considered setting the locale in the environment (this sounds like the "correct" fix to me and we might implement it later), but this application shares a WebLogic server with many other applications so we would have to do a huge amount of testing to make sure that the locale change wouldn't break the other apps. In the end I worked around the problem by making the code that generates the filenames in the first place strip out any non-ASCII characters (the names of the files are not critically important).
Looking forward to JSR-203, in the meantime perhaps a note about this behaviour in the java.io.File javadoc would be useful.

Non ascii characters being sent from a parameter in a form

Hi!
I have seen many topics posted on passing non ascii characters through parameters from one servlet to another and converting them into whatever format is necessary.
However, I have not seen anyone answer the following question. I have a jsp page (html) with the character encoding set to utf-8. The user inputs some data in to a text field which is inside a form. The data could be in non ascii characters such as hebrew or arabic. This form is then sent to another jsp where i try to retreive the data from teh text field. No matter what i do, i cannot get the data presented correctly. It is either question marks or other wierd symbols.
I have tried every permetation of encoding of the actual html page, the ecoding of the string from request.getParameter etc but it still is not presented on the new html page correctly.
Can anyone help??
Spencer

Ok, I solved the problem.
I had to put at the top request.setCharacterEncoding("utf-8");
Spencer

Non-ascii charsets in an applet woes

I'm having trouble getting russian, chinese, japanese, and greek charactersets to display correctly in an applet (plugin is jre 1.4.2_02).
1) yes the strings are in i18n'ized properties
2) yes the non-ascii characters are unicode escaped (i.e. \u####) in the properties file
3) yes the computer displaying the applet has its locale and languages set to the correct language
4) yes the computer displaying the applet has the fonts available to display
All the above is done and works great for ascii or extended ascii sets, but it shows junk for the 4 languages listed above.
Anyone run into this problem before?
Please help me out.
Thanks,
Andrew

Ok, I got Russian and Greek to work. I had to switch all my awt controls to swing.
However, I cannot get the Chinese/Japanese characters to display. I double and triple checked the encodings to make sure it was correct (it is).
However, the font.properties.ja (japanese) lists a font called MSMINCHO.TTC and one called MSGOTHIC.TTC. Both are actually in TTF files on my system. I tried correcting the font.properties.ja with TTF; but to no avail.
Also, font.properties.zh (chinese) lists SIMSUN.TTC - which I do NOT have, but this shouldn't be a problem because both font.properties.zh_TW (trad. chinese) and font.properties.zh_CN (simplified chinese) both list fonts thatI DO have (and the only Chinese locales I support are zh/TW and zh/CN. Is this a problem? If so, where can I get simsun.ttc (I search and searched and could not find the file).
Please help,
Andrew

Problem searching some PDF files in Acrobat Reader – Non-ASCII characters

Acrobat Reader cannot search some .pdf files. I have put an example document up on Scribd here.
Any attempt to search for any word that can be clearly seen to be in the document fails with “No matches were found.”
This example document is NOT a scanned document – words and characters can be selected.
A hex display tool shows that the characters in a PDF document that can be successfully searched are in the ASCII/1252 range (A=0x41, etc).
Copying and pasting characters in the example document to a hex display tool shows that the characters in the document are not in the ASCII range.
For example the letters A to Z in the example document are in the range ‘A’ = 0xDF (decimal 223), ‘B’ = 0xDE (decimal 222), through to ‘Z’ = 0xC6 (decimal 198).
However, characters in these non-ASCII ranges are displayed perfectly by Acrobat Reader, as can be see if the example document is opened.
Therefore, as Acrobat Reader knows what these characters are, it doesn’t seem unreasonable to say that it should be able to search for and find them.
Tests were performed using Acrobat Reader X v10.1.4.
Can anyone say what this problem is?

Hi Pat, thanks for your reply.
Your reference to the title of that page being 'HARNESSES' indicates that, when you view that document in Adobe Reader, you are seeing 'HARNESSES', not
"ØßÎÒÛÍÍÛÍ". And that the remainder of the document is similarly being displayed in readable English language.
Yes as you say, you can search for 'ß' and get hits on 'A' (to use that as an example) in the example document.
But the need to form a word to be searched for into whatever code mapping this is using (for example having to enter "ØßÎÒÛÍÍ" for HARNESSES - I'm not even sure how that would be entered from a keyboard) doesn't seem to be very convenient.
Its clear the example document is using some code mapping other than ASCII / Windows-1252 (which has 'A' as 0x41). But it is also clear that Adobe Reader knows what that mapping is, and knows to use it, as its displaying (for example) 'A' for the code 0xDF.
So I guess the question is - why isn't Adobe Reader's knowledge of this mapping being extended to its search input?

Non ascii characters are padding without reason

Hi all,
here is my issue :
I have description field in my jsp page, when user enters some non ASCII characters as shown below :
This is user had entered the input string is :
"Hello Ã?Â?Ã?Â?Ã?Â?Ã?Â Hello" (without quotes)
When he edits for the first time without change anything in the the string and save, then it became :
"Hello Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã? Hello" (without quotes)
Then again one more time, it became :
"Hello Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â?Ã?Â? Hello" (without quotes)
Like wise it is getting increased its size. I'm saving the data to Oracle 10g database from jsp.
Please suggest what to do to rectify the problem.
Thanks & regards,
Achchayya

But I didnt changed anything from server.xml except two changes
1) from : <?xml version='1.0' encoding='iso-8851-1'?>
    to : <?xml version='1.0' encoding='UTF-8'?>
2)
from : <Connector port="8888" protocol="HTTP/1.1"
               connectionTimeout="20000"
               redirectPort="8443" />
to : <Connector port="8888" protocol="HTTP/1.1"
               connectionTimeout="20000"
               redirectPort="8443"
               URIEncoding="UTF-8"/>here is my JSP :
<%@ page pageEncoding="UTF-8" %>
<html>
<head>
<title>The servlet example </title>
<meta http-equiv="content-type" content="text/html; charset=utf-8">
</head>
<body>
<h1>A simple web application</h1>
<form method="POST" action="HelloWorld">
<label for="name">Enter your name </label>
<input type="text" id="name" name="name"/><br><br>
<input type="submit" value="Submit Form"/>
<input type="reset" value="Reset Form"/>
</form>
</body>
</html>Servlet Code :
import java.io.IOException;
import java.io.PrintWriter;
import javax.servlet.ServletException;
import javax.servlet.http.HttpServlet;
import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;
public class HelloWorld extends HttpServlet {
protected void doPost(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException {
* Get the value of form parameter
     System.out.println("response char set "+response.getCharacterEncoding());
     System.out.println("request char set "+request.getCharacterEncoding());
response.setCharacterEncoding("UTF-8");
String name = request.getParameter("name");
String welcomeMessage = "Welcome "+name;
System.out.println("Name : "+name);
* Set the content type(MIME Type) of the response.
response.setContentType("text/html");
PrintWriter out = response.getWriter();
* Write the HTML to the response
out.println("<html>");
out.println("<head>");
out.println("<title> A very simple servlet example</title>");
out.println("</head>");
out.println("<body>");
out.println("<h1>"+welcomeMessage+"</h1>");
out.println("</body>");
out.println("</html>");
out.close();
protected void doGet(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException {
     response.setCharacterEncoding("UTF-8");
     doPost(request, response);
} web.xml :
<?xml version="1.0" encoding="UTF-8"?>
<web-app version="2.4"
xmlns="http://java.sun.com/xml/ns/j2ee"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://java.sun.com/xml/ns/j2ee
http://java.sun.com/xml/ns/j2ee/web-app_2_4.xsd">
<servlet>
<servlet-name>HelloWorld</servlet-name>
<servlet-class>HelloWorld</servlet-class>
</servlet>
<servlet-mapping>
<servlet-name>HelloWorld</servlet-name>
<url-pattern>/HelloWorld</url-pattern>
</servlet-mapping>
<welcome-file-list>
<welcome-file>
HelloWorld.html
</welcome-file>
</welcome-file-list>
<context-param>
     <param-name>PARAMETER_ENCODING</param-name>
     <param-value>UTF-8</param-value>
</context-param>
</web-app>please have a look at my files and suggest me BalusC.
Thanks for your patience.
regards,
Achchayya
Edited by: achayya on Oct 16, 2009 7:26 AM

Java.security.KeyStoreException: Cannot store non-PrivateKeys

I have been getting this exception:
Exception in thread "main" java.security.KeyStoreException: Cannot store non-PrivateKeys
     at sun.security.provider.JavaKeyStore.engineSetKeyEntry(Unknown Source)
     at java.security.KeyStore.setKeyEntry(Unknown Source)
     at KeyStoreExample.encrypt(KeyStoreExample.java:89)
     at KeyStoreExample.main(KeyStoreExample.java:39)
while running this code:
private static void encrypt(char[] password, String plaintext)
throws Exception
    System.out.println("Generating a TripleDES key...");
    // Create a Blowfish key
    KeyGenerator keyGenerator = KeyGenerator.getInstance("TripleDES");
    keyGenerator.init(168);
    Key key = keyGenerator.generateKey();
    System.out.println("Done generating the key.");
    // Create a cipher using that key to initialize it
    Cipher cipher = Cipher.getInstance("TripleDES/ECB/PKCS5Padding");
    cipher.init(Cipher.ENCRYPT_MODE, key);
    byte[] plaintextBytes = plaintext.getBytes();
    // Perform the actual encryption
    byte[] cipherText = cipher.doFinal(plaintextBytes);
    // Now we need to Base64-encode it for ascii display
    BASE64Encoder encoder = new BASE64Encoder();
    String output = encoder.encode(cipherText);
    System.out.println("Ciphertext: "+output);
    /* Create a keystore and place the key in it
     * We're using a jceks keystore, which is provided by Sun's JCE.
     * If you don't have the JCE installed, you can use "JKS",
     * which is the default keystore. It doesn't provide
     * the same level of protection however.
    KeyStore keyStore = KeyStore.getInstance("JKS", "SUN");
    // This initializes a blank keystore
    keyStore.load(null, null);
    // Now we add the key to the keystore, protected
    // by the password.
    keyStore.setKeyEntry("LuisTest", key, password, null);
    // Store the password to the filesystem, protected
    // by the same password.
    FileOutputStream fos = new FileOutputStream(FILENAME);
    keyStore.store(fos, password);
    fos.close();The error fires when it gets to this line
    keyStore.setKeyEntry("LuisTest", key, password, null);

Maybe you should try defining the type of entry that
you want stored into the KeyStore, i.e. privateKey,
SecretKey, TrustedCertificateEntry. The setKeyEntry
method that you're using expects a certificate chain
to accompany the Key if it is used as a private key.
If you don't want to use the key as one of the
available types, perhaps you need to use the
CertStore object as opposed to the KeyStore object.Hi,
I've got the same exception althought I specified the type of entry. Here is my test code :
public void createKeyStore() {
     try {
          KeyGenerator keyGen = KeyGenerator.getInstance("DES");
          SecureRandom random = SecureRandom.getInstance("SHA1PRNG", "SUN");
          keyGen.init(56, random);
          SecretKey secretKey = keyGen.generateKey();
          KeyStore ks = KeyStore.getInstance(KeyStore.getDefaultType());
          char password[] = {'j', 's', 'd', '4', '9', '4' };
          // Create an empty keystore
          ks.load(null, password);
          KeyStore.SecretKeyEntry skEntry = new KeyStore.SecretKeyEntry(secretKey);
          ks.setEntry("symKey", skEntry, new KeyStore.PasswordProtection(password));
          // store away the keystore
          java.io.FileOutputStream fos =
               new java.io.FileOutputStream("mystore");
          ks.store(fos, password);
          fos.close();
     } catch (NoSuchAlgorithmException nsaex) {
          nsaex.printStackTrace(System.err);
     } catch (NoSuchProviderException nspex) {
          nspex.printStackTrace(System.err);
     } catch (KeyStoreException ksex) {
          ksex.printStackTrace(System.err);
     } catch (CertificateException cex) {
          cex.printStackTrace(System.err);
     } catch (IOException ioex) {
          ioex.printStackTrace(System.err);
} ... and what I don't understand is that the main idea of this code is taken from the Java API documentation itself. See this url for reference
http://java.sun.com/j2se/1.5.0/docs/api/java/security/KeyStore.html

System python interactive shell - cannot input non-ascii charecters

Similar Messages

Maybe you are looking for