Non-english characters in file names show as question marks

It's probably iocharset=utf8 question, but it's not only cd-rom - native partitions with "defaults" options behave no better. What is the correct solution? Current locale is en_US.UTF-8, which should be OK.

native partitions with "defaults" options behave no better
What filesystems?
For ntfs read http://wiki.archlinux.org/index.php/HAL
Policies
NOTE: this is deprecated from hal => 0.5.10
and
mount.ntfs linking
As of hal => 0.5.10 the above policy may not work. This is a workaround forcing hal to use the ntfs-3g driver instead of the standard ntfs driver. Please note that this method will use the ntfs-3g driver for all NTFS drives on your system! As root create a symbolic link from mount.ntfs to mount.ntfs-3g.
# ln -s /sbin/mount.ntfs-3g /sbin/mount.ntfs
Possible issues using this method:
if mount is called with "-i" option it doesn't work
possible issues with the kernels ntfs module
Locale issues
If you use KDE, you may have problem with filenames containing non-latin characters. This happens because kde's mounthelper is not parsing correctly the policies and locale option. There is a workaround for this:
1) Remove the "/sbin/mount.ntfs-3g" which is a symlink. code: rm /sbin/mount.ntfs-3g
2) Replace it with a new bash script containing:
#!/bin/bash
/bin/ntfs-3g $1 $2 -o locale=en_US.UTF-8 #put your own locale here
3) Make it executable: chmod +x /sbin/mount.ntfs-3g
There is only a problem with partition labels containing spaces, so if you have such a label, replace the space with an underscore, otherwise when you try to mount it you will get an error.
4) Add NoUpgrade=sbin/sbin/mount.ntfs-3g to pacman.conf.
I think your understand Russian. Welcome to http://linuxforum.ru/index.php?showtopic=53488 and
http://archlinux.org.ru/

Similar Messages

How to load file thru reader which contains non-english char in file name

Hi ,
I want to know how to load file in english machine thru reader which contains non-english chars in file names (eg. 置顶.pdf)
as LoadFile gives error while passing unicode converted file name.
Regards,
Arvind

You don't mention what version of Reader? And you are using the AcroPDF.dll, yes?
Sent from my iPad

[AS] Problem with non English characters in file path

I wrote a script that exports a pdf file from ID, rasterizes it in PS, applies an action, saves it as another pdf file, and finally creates a Mail message, and attaches the file to it (the last part is written in AppleScript).
The problem is that it doesn't work when the path to this file contains non English characters.
This works:
make new attachment with properties {file name:"/Volumes/Macintosh HD/BackUp Tetard/Test.pdf"}
but this doesn't:
make new attachment with properties {file name:"/Volumes/Macintosh HD/BackUp Têtard /Test.pdf"}
I remember vaguely that I read somewhere that AppleScript can work with Unicode — in other words with such characters — starting from some version, don't remember which exactly, but it seems to me — Leopard.
I am on Mac OS X 10.4.11 right now. Will updating solve this problem? Does anybody know any solution to this problem: a scripting addition, some hidden setting, etc.
I made a little test: used a Russian character — ё and it works, but when I use — ê (Dutch) it doesn't. May it have something to do with the Region setting in International panel?
Thanks in advance,
Kasyan

Kasyan, as of Leopard AppleScript treats all text as Unicode pre this you can specify 'as Unicode text'. Try a test with these.
-- Leopard
set x to POSIX path of (path to desktop)
-- Pre Leopard
set x to POSIX path of (path to desktop as Unicode text)
-- Leopard
set x to POSIX path of (choose file without invisibles)
-- Pre Leopard
set x to POSIX path of ((choose file without invisibles) as Unicode text)

Java.io.File and non-unicode characters in file name

Unix filesystem object names are byte sequences. These byte sequences are not required to correspond to any character sequence in the current or any locale. How do I open a file if it has characters that do not corrospond to a valid unicode encoding for some current locale? Unless I am missing something, if I do a list on a parent directory that has some file names like this, those file names do not get added to the list. Hmmm....
R.

OK, create.c is a program that will create a file whose name is not a character in the 'ja' locale.
Lister.java defines a class that lists files in the current directory. For each file, it spits out the 'toString()' version of the file, the char array of the name as hex, and the 'getBytes' byte array of the name.
So, what you can do is compile and run create.c, which will create a file whose name is a single byte whose hex value is 99. Then compile and run Lister.java, which will give you the following output (shown for two different locales:
$ export LANG=
$ java Lister
name:?; chars:99,; bytes:99,
$ export LANG=ja
$ java Lister
name:?; chars:fffd,; bytes:3f,
---------------------------------------------Note that when running in the JA locale, there is no character corresponding to byte value 0x99. So, Java uses the replacement character 0xFFFD, and the '?' character 0x3F, as a replacement.
The point is that there are files which Java cannot uniquely represent as a straight String. I suppose we could get the filename via JNI, do the conversion ourselves, and then use the private-use area of Unicode to encode all our strings, but ugh.
//create.c
#include <stdio.h>
int main()
   const char* name = "\x99";
   FILE* file = fopen( name, "w" );
   if( file == NULL )
      printf( "could not open file %s\n", name );
      return 1;
   fclose( file );
   return 0;
// Lister.java
import java.io.*;
public class Lister
    public static void main( String[] args )
        new Lister().run();
    public void run()
        try
            doRun();
        catch( Exception e )
            System.out.println( "Encountered exception: " + e );
    private void doRun() throws Exception
        File cwd = new File( "." );
        String[] children = cwd.list();
        for( int i = 0; i < children.length; ++i )
            printName( children[ i ] );
    private void printName( String s )
        System.out.print( "name:" );
        System.out.print( s );
        System.out.print( "; chars:" );
        printCharsAsHex( s );
        System.out.print( "; bytes:" );
        printBytesAsHex( s );
        System.out.println();
    private void printCharsAsHex( String s )
        for( int i = 0; i < s.length(); ++i )
            char ch = s.charAt( i );
            System.out.print( Integer.toHexString( ch ) + "," );
    private void printBytesAsHex( String s )
        byte[] bytes = s.getBytes();
        for( int i = 0; i < bytes.length; ++i )
            byte b = bytes[ i ];
            System.out.print( Integer.toHexString( unsignedExtension( b ) ) + "," );
    private int unsignedExtension( byte b )
        return (int)b & 0xFF;
}

Non-english caracters in file names

Hi,
I use archlinux, KDE, Dolphin.
I have a problem with file names with the norwegian caracters ø æ å in some file names. I get the message that "the file does not exist". I can change the file name in the terminal, but it's a lot of work. In Dolphin the place of this letters there are a question sign. In the terminal there are different signs and a number.
Can anybody tell me what causes the problem and a way to solve it.

harida wrote:What I meant was, can it have something to do with the fact that I have downloaded these files from a torrent site,
and that they have been stored on ntfs by the user sharing them?
I don't know, but I just experienced something similar.
I used cpio to pass files from a Bluewhite64 JFS /home partition to my new Maxtor Basics 1TB external USB disk, which I had reformatted from NTFS to JFS. SOME file and directory names containing the letter 'ø' or 'Ø' are visible in file managers and in a console, yet when I try to open them the system claims they don't exist. I can NOT open them from the command line either. The names appear garbled under Bluewhite64 as well, but there I can open them without problems. I had always thought I would get safe copies with cpio...
I have LOCALE="nb_NO.utf8" in /etc/rc.conf, and
nb_NO.UTF-8 UTF-8
nb_NO ISO-8859-1
activated in /etc/locale.gen
Interestingly, with the keyboard mapped to 'no.latin1', the letter 'ø' appears as a 'funny' character on the console under runlevel 3. When I try the other choice for Norwegian, 'no.map.gz', I get a dvorak keyboard instead of qwerty. You can never win.
The problematic files in question, i.e. of the ones I copied, are old and have passed through various OS's. That may be part of of the problem, but it does not explain the Norwegian keyboard anomalies in Arch, or the fact that the files are loadable and readable under Bluewhite64.
Last edited by whaler (2009-04-26 23:12:37)

Refinement Panel show "file name" values with question mark instead of spaces

Hi,
I customized Refinement Panel to refine by file name. In some cases the value (file name) is shown with question mark instead of space. It looks like gibberish and the refine by that value doesn't bring the result.
Any ideas how to solve?
keren tsur

Hi Keren,
Please try to reset index in Central Administration > Application Management > Manage service applications > click the Search service application > Crawling > Index Reset > check the box Deactivate search
alerts during reset > Reset Now > Ok.
Then restart a full crawl in the Central Administration > Application Management > Manage service applications > click the Search service application > Crawling > Content Sources.
In addition, please capture a screenshot of the issue.
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact
[email protected]
Regards,
Rebecca Tu
TechNet Community Support

Removing non-English characters from data.

Ours is global system with some data with non-English characters. We want to download file by removing this non-English characters.
Any suggestions how we can remove these non-English characters from file..?

The FM u said
     Replace non-standard characters with standard characters
   Functionality
     SCP_REPLACE_STRANGE_CHARS processes a text so that it only contains
     simple characters. Special characters and national characters are
     replaced in such a way that the text remains reasonably legible.
     The character set 1146 is used by default. In this case the following
     replacements are made, for example:
      Æ ==> AE        (AE)
      Â ==> A         (Acircumflex)
      Ä ==> Ae        (Adieresis)
      £ ==> L         (sterling)
     Note that the new text can be longer than the old.
So i dont think it ll be useful for eliminating the sp. chars.
U have to check each and every alphabet with std 26 alphabets
Thanks & Regards
vinsee

Remove LF characters from file names

I have a folder full of files with filenames that contain LF character (ASCII code 10). I want to use Automator's "Replace Text" funcion to remove these non printing characters from file names. Is there a way to do it?
If automator is not able to do this task, I will take a bash script or applescript solution as well...

Take a look at: http://stackoverflow.com/questions/4417588/sed-command-to-fix-filenames-in-a-dir ectory
(I changed tr -d "\r\n" to tr -d "\n", but try both)
for f in ~/Desktop/*
do
    new="$(printf %s "$f" | tr -d "\n")"
    if [ "$f" != "$new" ]; then
        mv "$f" "$new"
    fi
done

Formula to show non english characters from clob in crystal report

Hi
I am using the database Oracle 11g with a field clob in one of the table that i want to show in the crystal report
But the problem is when i put the clob field in crystal report it is outputting the results perfectly for English characters but not for the Arabic ones and returning the string like (¿¿¿¿ ¿¿¿¿ ¿¿¿ ¿¿¿¿ ¿¿¿¿ ¿¿¿ ¿ ¿¿¿¿¿ ¿¿¿)
so is there any way to show the arabic (non english) characters perfectly on crystal report with clob field

Hi Azeem,
Make sure the arabic font should install in your system.
Try this:
Create a text field in your Crystal Report (a label).
Place Arabic characters into that field (just by typing them into it on the report definition).
Run the report. If they display correctly then its probably not Crystal, but rather would point to an issue in the data retrieval and supply to Crystal via your dataset (or whatever datasource you are using).
If they don't display - then its definitely Crystal.

I have non English characters showing up.

This morning I wanted to make a change in my Security & Privacy settings and when prompted to authenticate the dialogue box contained non-English characters. Even the OK button appeared to be in Chinese are the like.
Any ideas welcome. OS X 10.8.1

I'ts not all of the text though. It's just the authentication popup that asks you for your password when you want to unlock the padlock to make changes. It comes up with "System Preferences" then two lines of non-english characters followed by "Type your password to allow this". Then of course you have the Name and Password text fields. The Cancel button is normal and the what would normally be the OK button, is in non-english text.
Everything else system-wide is fine.
It's got me...

Problem in converting Spool to PDF file, having non-English characters

Hi All,
I have problem in converting Spool to PDF format.
Scenario : I have a spool which has non-English characters. I am using CONVERT_ABAPSPOOLJOB_2_PDF FM to perform conversion. But my output is having junk values( ie # ) for non-English characters. Any pointers to solve this issue will be appreciated.
I even tried with report RSTXPDFT4 , it also gives me the same junk characters.
Regards,
Navin.

Hi All,
I have problem in converting Spool to PDF format.
Scenario : I have a spool which has non-English characters. I am using CONVERT_ABAPSPOOLJOB_2_PDF FM to perform conversion. But my output is having junk values( ie # ) for non-English characters. Any pointers to solve this issue will be appreciated.
I even tried with report RSTXPDFT4 , it also gives me the same junk characters.
Regards,
Navin.

Non English characters conversion issue in LSMW BAPI Inbound IDOCs

Hi Experts,
We have some fields in customer master LSMW data load program which can
contain non-English characters. We are facing issues in LSMW BAPI
method with non-English characters Conversion. LMSW steps read and
conversion are showing the non-English characters properly with out any
issue. While creating inbound IDOCs most of the non-English characters
replaced with '#' and its causing issues in creating customer master data in
system. In our scenario customer data with non-English characters in
the first name, last name and address details. Any specific setting
needs to be done from our side? Please suggest me to resolve this issue.
Thanks
Rajesh Yadla

If your language is a unicode tehn you need to change the options like IN SAP you need to change it to unicode in the initial screen Customize local layout(ALT F12) options 118 --> Encoding ....

Handling Non-English characters in the payload

Hi Gurus,
We are currently facing an issue in XI with Non-English characters. When we are trying to process Non-English characters in the payload , they are getting converted in to Junk characters at the receiver end. This scenario inbound to SAP ( File to Idoc scenario ) . Is there a way that Non-English characters can be handled in XI.
Regards,
Nick

Hi Nick,
I have knowledge of some problems when showing some kind of chinese character when
dusplaying XML messages. If it's the case, check notes:
#1135671 - ITS HTML viewer: incorrect display of xml documents
#1072127 - ITS HTML Control: xml file rendering problem
With regards,
Caio Cagnani

Formatting non-English Characters in Database Extracts

Hi
I am trying to create data flat file with Oracle SQL extracts. The data file is position based i.e. Position 1-30 for First Name, 31-50 for Last name, etc. I encountered problems when the data fields contain non-English characters. The position shift right by 1 with every non-English characters. For example, if there is one Spanish char in First Name, Last Name will start from 32, instead of 31. If there are two Spanish chars, Last Name will start from 33 (shift 2). Is there any way, in a database session, to restrict the formats of these text fields such that non-English characters will not affect the data field position in the flat files?
Thanks in advance
Jason

An alternative might be to tab or comma delimit your data.
Eric

How to retrieve non-english characters from a query

Hello,
My apologies if this post is not in its proper place, but I was a bit confused where to add it.
I'm running a query using SQL Developer on a table which contains several companies names from many different countries, and one of the checks I need to make to ensure data consistency is to search for all rows which the name of company contains special or non-english characters (like ç, ã, ä as example).
I don't know what can I use to do this. I tried to collate using NLS_SORT but it didn't work.
Is there someway to select only the rows that contain these special or non-english characters, excluding from the results the rows that only have english characters? Please have in mind that we have many languages in this table.
The field I would like to make the conditions on is VARCHAR2.
Please let me know if there is any extra information I should provide you so that you can help me.
Thank you in advance for the help.
Regards,
Luís

Hi Luis,
My apologies if this post is not in its proper place, but I was a bit confused where to add it.This is the Forum for the SQL Developer Data Modeler product.
I suggest you try using the SQL and PL/SQL Forum: PL/SQL
David

Non-english characters in file names show as question marks

Similar Messages

Maybe you are looking for