Problem with files containing non-English characters

I wrote a program that traverses a directory for files of a given extension and then displays the absolutePath in a JList. Double-clicking on a filename will open it in the registered program. It works perfectly for English filenames. The problem is when I have other characters in the filename. For example, if I have a file titled "Mexico.txt" with an accented e, it shows up in the list with a block in place of the e. So the first problem is not being able to properly display the special characters. Next, if I double-click that file it sees the absolutePath as "m%3Fxico.txt" which I'm guessing is some sort of unicode encoding. Unfortunately, that encoding is not handled properly by the Runtime.getRuntime() method. I get a "file does not exist" error. All features work fine with English characters.
Any help with these issues is greatly appreciated.

Send mail as text/html (HTML enabled content) , Specify charset in the header part (GB23... or UTF-8)of HTML
Its easy,
I hope it would solve ur problem
cheers
Rajendra Bandi

Similar Messages

Cannot login with password containing non-ascii characters

Hello,
I have web application, form based login. UTF-8 is specified "everywhere".
And it works, except for passwords.
If user register itself with password containing non-ascii characters, it is correctly written in database, but when doing either programmatic login or normal form based login, if fails.
If the password is only ascii, it works.
Username of login could be ascii or non-ascii, it doesn't matter, both works.
I'm using sun java application server 9.1.
jdbc realm.
I'm not using hashing passwords, just clean (now)
I tried configure realm Charset: UTF8 as last chance, but it doesn't work either.
The problem is only with non-ascii characters in password.
Any help very appreciated
Thanks a lot

hi,
I know all that, but that's not the case. My app uses preparedStatements, everything is properly configured, in all pages, utf-8 is going from user to db and back without any problems.
The only problem is with password field. As I am using form based login, with jdbc realm configured (again, nicely working when only ascii characters), I have very little chance to do something bad through the login phase.
I'm not talking about special characters, I'm talking about non-ascii characters, let's say - Chinese, arabish, Russian alphabet etc.
When user registers (my code), the fields are properly written to db. I have checked that, trust me.
But the Sun app server realm seems to have some problems with the password field.
(realm uses jdbc connection to mysql, the url contains all extra parameters to be sure about utf8. there is nothing more what can be configured...)
If I try other alphabet codes in login and ascii in password, it works. But soon, as I use other alphabet code also in password, it doesn't work anymore.
My only idea is, that I could try MD5 to create ascii only characters (I hope it works that way) on the client with javascript and then set Digest to MD5 in realm configuration. But still, it seems very strange. The clear way storage should also function? (now set Digest to 'none')
Is it a bug of Sun App Server?
thanks

Problem in converting Spool to PDF file, having non-English characters

Hi All,
I have problem in converting Spool to PDF format.
Scenario : I have a spool which has non-English characters. I am using CONVERT_ABAPSPOOLJOB_2_PDF FM to perform conversion. But my output is having junk values( ie # ) for non-English characters. Any pointers to solve this issue will be appreciated.
I even tried with report RSTXPDFT4 , it also gives me the same junk characters.
Regards,
Navin.

Hi All,
I have problem in converting Spool to PDF format.
Scenario : I have a spool which has non-English characters. I am using CONVERT_ABAPSPOOLJOB_2_PDF FM to perform conversion. But my output is having junk values( ie # ) for non-English characters. Any pointers to solve this issue will be appreciated.
I even tried with report RSTXPDFT4 , it also gives me the same junk characters.
Regards,
Navin.

How to send e-mails containing non-english characters

Hi,
I would like to send email using JavaMail,
but I have a problem with sending non-english Characters.
How to change/use different charset?
What should I do to send non-english chars?
thanks!

Send mail as text/html (HTML enabled content) , Specify charset in the header part (GB23... or UTF-8)of HTML
Its easy,
I hope it would solve ur problem
cheers
Rajendra Bandi

Problems with password including non-ASCII characters

I am a German language user with a German keyboard but an English OS as main language. Therefore my passwords (simple user and admin) includes non-ASCII characters used in German, French and Spanish language, which increases security. This works fine in the majority of login scenarios. There are, however, 3 scenarios where neither my non-ASCII simple user nor my non-ASCII admin PW are accepted:
1) running "sudo" in Terminal;
2) When I try to shut down and another user account is still open. Doing this brings up a login window asking for the PW of the other user that does not accept non-ASCII;
3) Using Leopard/SnowLeopard CacheCleaner. Upon opening, this app asks for an admin PW, but does not recognize non-ASCII.
Am I right in assuming that this has to do with non-ASCII PWs? I thought ASCII times were gone given the remarkable language flexibility of Mac OS over the years. I know this stupid problem only from Win XP. There it is even worse.
Is there a way to overcome this problem without always temporarily changing my PW? Thanks.

I think the problem is with the applications themselves and should be reported to the developer. Although some non-ASCII characters are acceptable for an admin password, in my experience most Unix systems don't like non-ASCII characters in passwords. It may be easier to avoid them if you can.
OS X should simply request your admin password to shut down when another user account is open. An alert dialog usually appears warning that the other user is still logged in and giving you the option to log the other account out then shut down. But in my experience the only authorization needed is for your admin account.

Problem with Vcard and non-English character

VCard feature is what I would like to use, but I have quite a few contacts with Non-English name (Korean).
I know Ipod can display in Korean, but when I create a v-card with Korean character and copy the vcard file over into /contacts folder, I can see the filename as the person's name (From windows explorer), but I can ONLY see first character of the file when I display contacts in iPod.
Does anyone have tips/tricks on displaying all the filename in IPod contacts?
Thanks.
Windows XP Pro

Because i use the string nota into a jsp page and i print the string nota into a textarea and the text is with no newline, example:
<textarea name="nota" rows="4" cols="60"><%= nota %></textarea>
the text into textarea is:
first linesecond linethird line
but i want that the text displayed into textarea is equal the text into the CDATA section:
first line
second line
third line

[AS] Problem with non English characters in file path

I wrote a script that exports a pdf file from ID, rasterizes it in PS, applies an action, saves it as another pdf file, and finally creates a Mail message, and attaches the file to it (the last part is written in AppleScript).
The problem is that it doesn't work when the path to this file contains non English characters.
This works:
make new attachment with properties {file name:"/Volumes/Macintosh HD/BackUp Tetard/Test.pdf"}
but this doesn't:
make new attachment with properties {file name:"/Volumes/Macintosh HD/BackUp Têtard /Test.pdf"}
I remember vaguely that I read somewhere that AppleScript can work with Unicode — in other words with such characters — starting from some version, don't remember which exactly, but it seems to me — Leopard.
I am on Mac OS X 10.4.11 right now. Will updating solve this problem? Does anybody know any solution to this problem: a scripting addition, some hidden setting, etc.
I made a little test: used a Russian character — ё and it works, but when I use — ê (Dutch) it doesn't. May it have something to do with the Region setting in International panel?
Thanks in advance,
Kasyan

Kasyan, as of Leopard AppleScript treats all text as Unicode pre this you can specify 'as Unicode text'. Try a test with these.
-- Leopard
set x to POSIX path of (path to desktop)
-- Pre Leopard
set x to POSIX path of (path to desktop as Unicode text)
-- Leopard
set x to POSIX path of (choose file without invisibles)
-- Pre Leopard
set x to POSIX path of ((choose file without invisibles) as Unicode text)

Non-english characters in file names show as question marks

It's probably iocharset=utf8 question, but it's not only cd-rom - native partitions with "defaults" options behave no better. What is the correct solution? Current locale is en_US.UTF-8, which should be OK.

native partitions with "defaults" options behave no better
What filesystems?
For ntfs read http://wiki.archlinux.org/index.php/HAL
Policies
NOTE: this is deprecated from hal => 0.5.10
and
mount.ntfs linking
As of hal => 0.5.10 the above policy may not work. This is a workaround forcing hal to use the ntfs-3g driver instead of the standard ntfs driver. Please note that this method will use the ntfs-3g driver for all NTFS drives on your system! As root create a symbolic link from mount.ntfs to mount.ntfs-3g.
# ln -s /sbin/mount.ntfs-3g /sbin/mount.ntfs
Possible issues using this method:
if mount is called with "-i" option it doesn't work
possible issues with the kernels ntfs module
Locale issues
If you use KDE, you may have problem with filenames containing non-latin characters. This happens because kde's mounthelper is not parsing correctly the policies and locale option. There is a workaround for this:
1) Remove the "/sbin/mount.ntfs-3g" which is a symlink. code: rm /sbin/mount.ntfs-3g
2) Replace it with a new bash script containing:
#!/bin/bash
/bin/ntfs-3g $1 $2 -o locale=en_US.UTF-8 #put your own locale here
3) Make it executable: chmod +x /sbin/mount.ntfs-3g
There is only a problem with partition labels containing spaces, so if you have such a label, replace the space with an underscore, otherwise when you try to mount it you will get an error.
4) Add NoUpgrade=sbin/sbin/mount.ntfs-3g to pacman.conf.
I think your understand Russian. Welcome to http://linuxforum.ru/index.php?showtopic=53488 and
http://archlinux.org.ru/

Flex, xml, and non-English characters

Hello! I have a Flex web app with AdvancedDataGrid. And I use httpService component to load some data to grid. The .xml file contains non-english characters in attributes (russian in my case) like this:
<?xml version="1.0" encoding="utf-8" ?>
   <Autoparts>
    <autopart DESCRIPTION="Барабан">
</Autoparts>
And when i run app, AdvancedDataGrid display it like "ÑÐŸÐ". How can i fix it? I try to change encoding="utf-8" with some another charsets, bun unsuccesfully. Thank you.

Try changing the xml structure by using CDATA instead of having the russian part as an attribute and see if that makes any difference.
What I meant is use something like this:
<?xml version="1.0" encoding="utf-8" ?>
   <Autoparts>
    <autopart>
       <description><![CDATA[Барабан]]></description>
</autopart>
</Autoparts>
instead of the current xml.

Formatting non-English Characters in Database Extracts

Hi
I am trying to create data flat file with Oracle SQL extracts. The data file is position based i.e. Position 1-30 for First Name, 31-50 for Last name, etc. I encountered problems when the data fields contain non-English characters. The position shift right by 1 with every non-English characters. For example, if there is one Spanish char in First Name, Last Name will start from 32, instead of 31. If there are two Spanish chars, Last Name will start from 33 (shift 2). Is there any way, in a database session, to restrict the formats of these text fields such that non-English characters will not affect the data field position in the flat files?
Thanks in advance
Jason

An alternative might be to tab or comma delimit your data.
Eric

Search for description containing non-English chars -- ?

Hello!
I've implemented a search class, which allows customers to search folders/documents by name, owner, description, etc.
And here's the problem: if description contains non-English (Russian, in my case) characters, search does not work! Everything (AS infrastructure, CM SDK DB, etc) was installed using UTF-8 Unicode charset. When I debug the code, I see that when I build AttributeQualification and later compose a comples SearchQualification, value in these is correct, but when I call getSQL(), I see string like this:
... ( nls_upper(ALIASDOCUMENT.DESCRIPTION) LIKE nls_upper('????') ) ...
So it seems as if SQL converted passed UNICODE value into ANSI string, and since server's system language is English, my Russian letters were lost -- ?
Can anybody shed some light here? Is there a way to search for UNICODE descriptions (and content, for that matter)?
Thanks,
Sasha.

Hi Sasha,
I want you to try the following code. It should output the file description and query to a text file. Use internet explorer / or notepad to open this file and ****specify that the file encoding is UTF8.*****
thanks,
matt.
java -classpath ...blah blah.. RussianSearch parameterfile=c\cmsdkparameters.txt
cmsdkparameters.txt contains:
Username = system
Password = oracle9i
SchemaPassword = cmsdk
Domain = ifs://ifspm-sun2.us.oracle.com:1521:mjs92.us.oracle.com:cmsdk903
ServiceConfiguration = SmallServiceConfiguration
Service = TestService
import oracle.ifs.beans.LibraryService;
import oracle.ifs.beans.LibrarySession;
import oracle.ifs.beans.ClassObject;
import oracle.ifs.beans.Document;
import oracle.ifs.beans.DocumentDefinition;
import oracle.ifs.beans.Folder;
import oracle.ifs.beans.FolderDefinition;
import oracle.ifs.beans.LibraryObject;
import oracle.ifs.beans.PublicObject;
import oracle.ifs.beans.Search;
import oracle.ifs.beans.SearchResultObject;
import oracle.ifs.common.IfsException;
import oracle.ifs.common.AttributeValue;
import oracle.ifs.common.CleartextCredential;
import oracle.ifs.common.Credential;
import oracle.ifs.common.ParameterTable;
import oracle.ifs.search.AttributeQualification;
import oracle.ifs.search.AttributeSearchSpecification;
import oracle.ifs.search.SearchClassSpecification;
import oracle.ifs.search.SearchSortSpecification;
import java.io.FileOutputStream;
import java.io.OutputStreamWriter;
import java.io.PrintWriter;
import java.util.Hashtable;
import java.util.Vector;
* Copyright (c) 2003 Oracle Corporation. All rights reserved.
* Matt Shannon.
* Description:
* Test searching in Russian Language
* View output file in notepad or IE - make sure to specify character
* set of document to be UTF8 when opening.
public class RussianSearch implements Runnable
// set to 'false' to prevent the class from freeing objects that it creates
public static final boolean performCleanup = true;
protected ParameterTable m_parametertable;
private Vector m_ObjectsRequiringCleanup;
public RussianSearch(String[] args)
    // parameter file is retrieved through command line argument parameterfile=
    m_parametertable = new ParameterTable(args, "parameterfile");
public static void main(String[] args)
    new Thread(new RussianSearch(args)).start();
   *   This is where you write your test program.
public void run()
    LibraryService service = startService();
    LibrarySession session = establishSession(service);
    if (session == null)
      return;
    try
      DocumentDefinition ddef = new DocumentDefinition(session);
      ddef.setAttribute(PublicObject.NAME_ATTRIBUTE,
        AttributeValue.newAttributeValue("blah.txt"));
      ddef.setAttribute(PublicObject.DESCRIPTION_ATTRIBUTE,
        AttributeValue.newAttributeValue("Я скучаю по родине"));
      ddef.setEmptyContent();
      Document newdoc = (Document) session.createPublicObject(ddef);
      addObjectRequiringCleanup(newdoc);
      /* Construct AttributeSearchSpecification.
       * Attribute based conditions are allowed, context conditions are not!
      AttributeSearchSpecification attrSrchSpec =
        new AttributeSearchSpecification();
      /* Construct SearchClassSpecification.
       * This represents the FROM and SELECT clauses of the query.
      SearchClassSpecification srchClsSpec = new SearchClassSpecification();
      srchClsSpec.addSearchClass(Document.CLASS_NAME);      // from clause
      srchClsSpec.addResultClass(Document.CLASS_NAME);      // select clause
      /* Construct SearchSortSpecification.
       * This represents the ORDER BY clause of the query.
      SearchSortSpecification srchSortSpec = new SearchSortSpecification();
      // upper case ascending sort on Name
      srchSortSpec.add(Document.CLASS_NAME, PublicObject.NAME_ATTRIBUTE,
        SearchSortSpecification.ASCENDING, "nls_upper");
      /* AttributeQualification is a WHERE clause component representing an
       * attribute condition.
      // scalar AttributeQualification - name like '%.html'
      AttributeQualification aq = new AttributeQualification();
      aq.setAttribute(Document.CLASS_NAME, PublicObject.DESCRIPTION_ATTRIBUTE);
      aq.setOperatorType(AttributeQualification.LIKE);
      aq.setValue("%родине");
      // set SELECT & FROM clauses
      attrSrchSpec.setSearchClassSpecification(srchClsSpec);
      // set ORDER BY clause
      attrSrchSpec.setSearchSortSpecification(srchSortSpec);
       // set WHERE clause
      attrSrchSpec.setSearchQualification(aq);
      /* Construct Search, supply SearchSpecification */
      Search s = new Search(session,attrSrchSpec);
      System.out.println("File encoding system property: "+System.getProperty("file.encoding"));
      boolean append = false;
      FileOutputStream fos = new FileOutputStream("c:/test.txt",append);
      OutputStreamWriter osw = new OutputStreamWriter(fos);
      System.out.println("Default character encoding: "+osw.getEncoding());
      osw = new OutputStreamWriter(fos,"UTF8");
      System.out.println("New character encoding: "+osw.getEncoding());
      PrintWriter out = new PrintWriter(osw,true);
      out.println(s.getSQL());
      SearchResultObject obj = null;
      // Open Search!
      s.open();
      try
         * A SearchResultObject encapsulates a row of a search result. It
         * contains 1 or more LibraryObjects (depending on number of result
         * classes specified).
        while ( (obj = s.next()) != null )
          Document d = (Document)(obj.getLibraryObject(Document.CLASS_NAME));
          out.println(d.getName() + " " + d.getDescription());
      catch (Throwable e)
        if ((e instanceof IfsException) &&
          (((IfsException)e).containsErrorCode(22000)))
        else
          System.out.println("Unexpected exception occurred in selector cursor");
          System.out.println((e instanceof IfsException)
            ? ((IfsException)e).toLocalizedString()
            : e.toString());
      finally
        out.close();
        if (performCleanup)
          cleanup();
        s.close();
        s.dispose();
    catch (Throwable e)
      System.out.println("Fatal exception occurred in run():");
      System.out.println((e instanceof IfsException)
        ? ((IfsException)e).toLocalizedString()
        : e.toString());
    finally
      disconnectSession(session);
public LibraryService startService()
    String schemapassword = m_parametertable.getString("SchemaPassword");
    String domain = m_parametertable.getString("Domain");
    String servicename = m_parametertable.getString("Service",domain);
    String serviceconfiguration =
      m_parametertable.getString(
        "ServiceConfiguration","SmallServiceConfiguration"
    LibraryService service = null;
    try
      if (servicename != null &&
        LibraryService.isServiceStarted(servicename))
        // The service name was specified, and is already running.
        // So just use it.
        System.out.println("Service already running: "+servicename);
        service = LibraryService.findService(servicename);
        System.out.println("Existing service retrieved");
      else
        service = LibraryService.startService(
          servicename, schemapassword, serviceconfiguration, domain);
        System.out.println("Service started: '"+servicename+
          "' (version: "+service.getVersionString()+")");
    catch (Throwable e)
      System.out.println("Unable to start service:");
      System.out.println((e instanceof IfsException)
        ? ((IfsException)e).toLocalizedString()
        : e.toString());
    return service;
public LibrarySession establishSession(LibraryService service)
    String username = m_parametertable.getString("Username");
    String password = m_parametertable.getString("Password");
    return establishSession(service, username, password);
public LibrarySession establishSession
    LibraryService service,
    String username,
    String password
    LibrarySession session = null;
    try
      CleartextCredential cred = new CleartextCredential(username,
        password);
      session = establishSession(service, cred);
    catch (Throwable e)
      System.out.println("Unable to create credential:");
      System.out.println((e instanceof IfsException)
        ? ((IfsException)e).toLocalizedString()
        : e.toString());
    return session;
public LibrarySession establishSession
    LibraryService service,
    Credential cred
    LibrarySession session = null;
    if (service != null)
      try
        String username = cred.getName();
        session = service.connect(cred, null);
        System.out.println("Session established for " + username);
      catch (Throwable e)
        System.out.println("Unable to create session:");
        System.out.println((e instanceof IfsException)
          ? ((IfsException)e).toLocalizedString()
          : e.toString());
    return session;
public void disconnectSession(LibrarySession session)
    System.out.println("Disconnecting session");
    try
      session.disconnect();
    catch (Throwable e)
      System.out.println("Error disconnecting session:");
      System.out.println((e instanceof IfsException)
        ? ((IfsException)e).toLocalizedString()
        : e.toString());
public void addObjectRequiringCleanup(LibraryObject lo)
    Vector v = getObjectsRequiringCleanupVector();
    v.addElement(lo);
private Vector getObjectsRequiringCleanupVector()
    if (m_ObjectsRequiringCleanup == null)
      m_ObjectsRequiringCleanup = new Vector();
    return m_ObjectsRequiringCleanup;
   * Frees objects that were marked as requiring clean up
public void cleanup()
    Vector v = getObjectsRequiringCleanupVector();
    System.out.println("Cleanup - delete objects created during the session");
    int count = (v == null) ? 0 : v.size();
    System.out.println("# of objects to free: "+count);
    // Free the objects in reverse order from which they were added
    for (int i = count - 1; i >= 0; i--)
      LibraryObject lo = (LibraryObject)v.elementAt(i);
      try
        discardObject(lo);
      catch (Exception e)
        System.out.println("Unable to discard an object during cleanup - continuing...");
public void discardObject(LibraryObject lo) throws IfsException
    if (lo != null)
      try
        System.out.println("Attempting to free: "+getDisplayName(lo));
        LibrarySession session = lo.getSession();
        if (lo instanceof Folder)
          System.out.println("Attempting to free Folder with Deep Option!");
          // free Folder using "Deep" option to free
          // all items in the folder, and all of their items, etc.
          Folder folder = (Folder)lo;
          FolderDefinition def = new FolderDefinition(session);
          def.setFolderDepthOption(
            Folder.SYSTEMOPTIONVALUE_FOLDER_DEPTH_DEEPEST);
          folder.free(def); // removes object from the repository, with options
        else
          // just a regular free
          lo.free();
      catch (Exception e)
        System.out.println("Unable to free an object during cleanup - continuing");
        System.out.println((e instanceof IfsException)
          ? ((IfsException)e).toLocalizedString()
          : e.toString());
public String getDisplayName(LibraryObject lo)
    throws IfsException
    String displayName;
    if (lo != null)
      displayName = lo.getClassObject().getName()
        + " '" + lo.getName() + "'";
    else
      displayName = "<null object>";
    return displayName;
}

Non-English Characters (Encoding)

Using the XMP Toolkit I'm having problems reading and writing non-English characters. For example: keywords read which should be "casa campesina, cultivos agrí colas, zona cafetera, café, plátano" read as "casa campesina, cultivos agrÃcolas, zona cafetera, cafÃ©, plÃ¡tano". I have the same problem with other languages such as Norwegian.
Does anyone else have this type of problem? Or perhaps a suggestion as to what I might be doing to cause such a problem?
Best regards,
Glenn Rogers
Developer of DBGallery: Photo DATAbase System

Hi Glen,
if you write non ASCII characters using our toolkit, you have to make sure to encode your string in UTF8.
If you see this while reading, the data in the file might not be valid UTF8. If it's local encoding (for example mac local encoding) our library will try to convert it based on the OS you are running it on. So it you got mac local encoding in the EXIF of the file and you are using the toolkit on windows, this might cause the wrong characters you are seeing.
In order to avoid this please always use UTF8 encoded strings.
Regards,
Samy
XMP Team

Non English characters conversion issue in LSMW BAPI Inbound IDOCs

Hi Experts,
We have some fields in customer master LSMW data load program which can
contain non-English characters. We are facing issues in LSMW BAPI
method with non-English characters Conversion. LMSW steps read and
conversion are showing the non-English characters properly with out any
issue. While creating inbound IDOCs most of the non-English characters
replaced with '#' and its causing issues in creating customer master data in
system. In our scenario customer data with non-English characters in
the first name, last name and address details. Any specific setting
needs to be done from our side? Please suggest me to resolve this issue.
Thanks
Rajesh Yadla

If your language is a unicode tehn you need to change the options like IN SAP you need to change it to unicode in the initial screen Customize local layout(ALT F12) options 118 --> Encoding ....

How to Identify non-english characters in a Text

Hi Experts,
I have a text coming from KNA1-NAME1 which contains non-english characters / language at times. I want to identify them in my code so that I can skip them.
Can you please guide with some Command / FM that help to identify these non-english characters?
Regards,
Nirmal

Hi,
I am fine with english characters A-Z, a-z or 0-9 or special characters. But it contains some chinese, japanes or non-english language characters which I dont want.
The logic explained by you above would expect me to list all the valid characters. Also it would be a performance constraint. Hence i wanted something as FM or standard procedure. Can we use ASCII somehow ?
Regards,
Nirmal

I have non English characters showing up.

This morning I wanted to make a change in my Security & Privacy settings and when prompted to authenticate the dialogue box contained non-English characters. Even the OK button appeared to be in Chinese are the like.
Any ideas welcome. OS X 10.8.1

I'ts not all of the text though. It's just the authentication popup that asks you for your password when you want to unlock the padlock to make changes. It comes up with "System Preferences" then two lines of non-english characters followed by "Type your password to allow this". Then of course you have the Name and Password text fields. The Cancel button is normal and the what would normally be the OK button, is in non-english text.
Everything else system-wide is fine.
It's got me...

Problem with files containing non-English characters

Similar Messages

Maybe you are looking for