[solved] ntfs-3g: Invalid or incomplete multibyte or wide character

Question

Hi all, i've a problem with an ntfs partition and (i think) locales.
#nickinicki-laptop koko # touch /mnt/vista/ò
touch: cannot touch `/mnt/vista/ò': Invalid or incomplete multibyte or wide character
nickinicki-laptop koko # grep -v \# /etc/locale.gen
en_US.UTF-8 UTF-8
en_US ISO-8859-1
es_ES.UTF-8 UTF-8
es_ES ISO-8859-1
es_ES@euro ISO-8859-15
it_IT.UTF-8 UTF-8
it_IT ISO-8859-1
it_IT@euro ISO-8859-15
pt_BR.UTF-8 UTF-8
pt_BR ISO-8859-1
nickinicki-laptop koko # locale -a
C
en_US
en_US.iso88591
en_US.utf8
es_ES
es_ES@euro
es_ES.iso88591
es_ES.iso885915@euro
es_ES.utf8
italian
it_IT
it_IT@euro
it_IT.iso88591
it_IT.iso885915@euro
it_IT.utf8
POSIX
pt_BR
pt_BR.iso88591
pt_BR.utf8
spanish
nickinicki-laptop koko # locale
LANG=it_IT.iso885915@euro
LC_CTYPE="it_IT.iso885915@euro"
LC_NUMERIC="it_IT.iso885915@euro"
LC_TIME="it_IT.iso885915@euro"
LC_COLLATE=C
LC_MONETARY="it_IT.iso885915@euro"
LC_MESSAGES="it_IT.iso885915@euro"
LC_PAPER="it_IT.iso885915@euro"
LC_NAME="it_IT.iso885915@euro"
LC_ADDRESS="it_IT.iso885915@euro"
LC_TELEPHONE="it_IT.iso885915@euro"
LC_MEASUREMENT="it_IT.iso885915@euro"
LC_IDENTIFICATION="it_IT.iso885915@euro"
LC_ALL=
nickinicki-laptop koko # grep -i locale /etc/rc.conf
# LOCALE: available languages can be listed with the 'locale -a' command
LOCALE="it_IT.iso885915@euro"
nickinicki-laptop koko # mount.ntfs-3g -o locale=$LANG /dev/sda1 /mnt/vista
nickinicki-laptop koko # touch /mnt/vista/ò
touch: cannot touch `/mnt/vista/ò': Invalid or incomplete multibyte or wide character
nickinicki-laptop koko # tail /var/log/messages.log
Aug 27 18:45:57 nickinicki-laptop ntfs-3g[3660]: Version 2009.4.4 integrated FUSE 27
Aug 27 18:45:57 nickinicki-laptop ntfs-3g[3660]: Mounted /dev/sda1 (Read-Write, label "VISTA", NTFS 3.1)
Aug 27 18:45:57 nickinicki-laptop ntfs-3g[3660]: Cmdline options: locale=it_IT.iso885915@euro
Aug 27 18:45:57 nickinicki-laptop ntfs-3g[3660]: Mount options: silent,allow_other,nonempty,relatime,fsname=/dev/sda1,blkdev,blksize=4096
Aug 27 18:46:19 nickinicki-laptop ntfs-3g[3660]: Could not convert filename to Unicode: 'ò': Invalid or incomplete multibyte or wide character
Aug 27 18:46:19 nickinicki-laptop ntfs-3g[3660]: Could not convert filename to Unicode: 'ò': Invalid or incomplete multibyte or wide character
Does anybody has a clue on what's happening?
Thanks in advance!
Last edited by kokoko3k (2009-08-28 16:25:21)

Answer 1

I know i'm writing this thread alone, but i'm experimenring more and more.
I was able to reproduce the issue even on an totally up-to-date system (every package upgraded to the latest version) using an ntfs filesystem on a file image:
Gozer ~ # cd /var/cache/pacman/pkg
########### Install latest ntfs-3g:
Gozer pkg # pacman -U ./ntfs-3g-2009.4.4-1-i686.pkg.tar.gz
loading package data...
checking dependencies...
(1/1) checking for file conflicts [########################################################] 100%
(1/1) upgrading ntfs-3g [########################################################] 100%
########### Make a 100MB file:
Gozer pkg # dd if=/dev/zero of=/tmp/image.ntfs bs=1024 count=100000
100000+0 records in
100000+0 records out
102400000 bytes (102 MB) copied, 0.899782 s, 114 MB/s
########### force mkfs.ntfs to make an ntfs filesystem there:
Gozer pkg # mkfs.ntfs /tmp/image.ntfs -F
/tmp/image.ntfs is not a block device.
mkntfs forced anyway.
The sector size was not specified for /tmp/image.ntfs and it could not be obtained automatically. It has been set to 512 bytes.
The partition start sector was not specified for /tmp/image.ntfs and it could not be obtained automatically. It has been set to 0.
The number of sectors per track was not specified for /tmp/image.ntfs and it could not be obtained automatically. It has been set to 0.
The number of heads was not specified for /tmp/image.ntfs and it could not be obtained automatically. It has been set to 0.
Cluster size has been automatically set to 4096 bytes.
To boot from a device, Windows needs the 'partition start sector', the 'sectors per track' and the 'number of heads' to be set.
Windows will not be able to boot from this device.
Initializing device with zeroes: 100% - Done.
Creating NTFS volume structures.
mkntfs completed successfully. Have a nice day.
########### My locales:
Gozer pkg # locale
LANG=en_US.iso88591
LC_CTYPE="en_US.iso88591"
LC_NUMERIC="en_US.iso88591"
LC_TIME="en_US.iso88591"
LC_COLLATE="en_US.iso88591"
LC_MONETARY="en_US.iso88591"
LC_MESSAGES="en_US.iso88591"
LC_PAPER="en_US.iso88591"
LC_NAME="en_US.iso88591"
LC_ADDRESS="en_US.iso88591"
LC_TELEPHONE="en_US.iso88591"
LC_MEASUREMENT="en_US.iso88591"
LC_IDENTIFICATION="en_US.iso88591"
LC_ALL=en_US.iso88591
########### Make the mountpoint and load the loop module
Gozer pkg # mkdir /mnt/ntfs.test
Gozer pkg # modprobe loop
########### mount the filesystem through ntfs-3g-2009.4.4-1
Gozer pkg # ntfs-3g -o loop,locale=$LANG /tmp/image.ntfs /mnt/ntfs.test/
########### Try to create a file with accented letters and get the error:
Gozer pkg # touch /mnt/ntfs.test/àèìòu
touch: cannot touch `/mnt/ntfs.test/àèìòu': Invalid or incomplete multibyte or wide character
Gozer pkg # ls -la /mnt/ntfs.test/àèìòu
ls: cannot access /mnt/ntfs.test/àèìòu: Invalid or incomplete multibyte or wide character
########### umount the filesystem
Gozer pkg # umount /mnt/ntfs.test
########### Get the outdated ntfs-3g package from arch rollback machine repo and install it
Gozer pkg # wget http://arm.kh.nu/extra::2009-1-1/os/i686/ntfs-3g-1.5130-1-i686.pkg.tar.gz
--2009-08-28 09:39:35-- http://arm.kh.nu/extra::2009-1-1/os/i686/ntfs-3g-1.5130-1-i686.pkg.tar.gz
Resolving arm.kh.nu... 75.119.207.164
Connecting to arm.kh.nu|75.119.207.164|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 360413 (352K) [application/x-tar]
Saving to: `ntfs-3g-1.5130-1-i686.pkg.tar.gz'
100%[=========================================================================>] 360,413 277K/s in 1.3s
2009-08-28 09:39:36 (277 KB/s) - `ntfs-3g-1.5130-1-i686.pkg.tar.gz' saved [360413/360413]
Gozer pkg # pacman -U ./ntfs-3g-1.5130-1-i686.pkg.tar.gz
loading package data...
checking dependencies...
(1/1) checking for file conflicts [########################################################] 100%
(1/1) upgrading ntfs-3g [########################################################] 100%
########### Mount the filesystem again with ntfs-3g-1.5130-1
Gozer pkg # ntfs-3g -o loop,locale=$LANG /tmp/image.ntfs /mnt/ntfs.test/
########### Try to create a file with accented letters:
Gozer pkg # touch /mnt/ntfs.test/àèìòu
Gozer pkg # ls -la /mnt/ntfs.test/àèìòu
-rwxrwxrwx 1 root root 0 2009-08-28 09:41 /mnt/ntfs.test/àèìòu
...This time everything worked as expected!
Can someone try all this and reports his results here please?
Thanks.
Last edited by kokoko3k (2009-08-28 07:49:38)