Batchloader file with en dash characters in metadata not loading

I'm trying to batch load metadata which has en dash characters (long hyphens) in the data.
After I have loaded the batch file the en dash characters are not displayed correctly in UCM.
I have manually added metadata which includes the en dash character using the UCM checkin page and it works fine.
I have tried escaping the character in the batchloader file but it didnt work, I tried using \
Is there anything else I could try?
Thanks.

Try one of options available here: http://www.fileformat.info/info/unicode/char/2013/index.htm

Similar Messages

Firefox doesn't reconvert special characters in the file names when download a file with any special characters in the file name

<blockquote>Locking duplicate thread.<br>
Please continue here: [/questions/815207]</blockquote><br>
if i try to download a file with any special characters in file name (e.g. File_Name.pdf), it doesn't reconvert them from the "sanitize url" process and download the file an incorrect name (e.g. File%5FName.pdf).
This is really annoying.
Thank you for your patient

Start Firefox in <u>[[Safe Mode]]</u> to check if one of the extensions is causing the problem (switch to the DEFAULT theme: Firefox (Tools) > Add-ons > Appearance/Themes).
* Don't make any changes on the Safe mode start window.
* https://support.mozilla.com/kb/Safe+Mode
* [[Troubleshooting extensions and themes]]

When I click on the iPhoto a gray appears along with the perpetual wheel but does not load. Any recommendations?

When I click on the iPhoto a gray appears along with the perpetual wheel but does not load. Any recommendations?

Assuming you're using iPhoto 09 or later:
Option 1
Back Up and try rebuild the library: hold down the command and option (or alt) keys while launching iPhoto. Use the resulting dialogue to rebuild. Choose to Rebuild iPhoto Library Database from automatic backup.
If that fails:
Option 2
Download iPhoto Library Manager and use its rebuild function. This will create a new library based on data in the albumdata.xml file. Not everything will be brought over - no slideshows, books or calendars, for instance - but it should get all your albums and keywords back.
Because this process creates an entirely new library and leaves your old one untouched, it is non-destructive, and if you're not happy with the results you can simply return to your old one. .
Regards
TD

Cannot rename file with non-ASCII characters when using the

My application moves files from one directory to another by calling File[] srcFiles = srcDir.listFiles() to get a list of files in the source directory, and then calling srcFiles.renameTo(destFile) to rename each file.
This does not work (renameTo returns false and the file is not moved) under the following circumstances:
- the file's leaf name contains non-ASCII characters, for example "�"
- the OS is Solaris 9
- the LANG and LC_* environment variables are unset, i.e. the C locale is being used
If I set the LANG environment variable to, for example, en_GB.UTF-8 then the rename succeeds.
I have tried calling srcFiles[index].getName().getBytes("UTF-8") and the non-ASCII characters are being replaced with ? (0x3f) characters when LANG is unset.
Is this a bug in the JRE? I would argue that since my code does not actually manipulate the filename (I just use the File object that File.listFiles() gives me) then the rename should succeed. Of course I would not expect the file name to be displayed correctly if I printed it out.
I have reproduced this behaviour with JDK 1.4.2_05 and 1.5.0_04 on Solaris 9.
Francis

Thanks for the info Alan.
I considered setting the locale in the environment (this sounds like the "correct" fix to me and we might implement it later), but this application shares a WebLogic server with many other applications so we would have to do a huge amount of testing to make sure that the locale change wouldn't break the other apps. In the end I worked around the problem by making the code that generates the filenames in the first place strip out any non-ASCII characters (the names of the files are not critically important).
Looking forward to JSR-203, in the meantime perhaps a note about this behaviour in the java.io.File javadoc would be useful.

Reading a text file with foreign language characters

I'm trying to convert foreign language characters to English looking characters. I have code that works, but only if I hard code the string with foreign language characters and pass it to the function. I cannot figure out how to get my program to read
in the foreign characters from my file, they come in as garbage.
Since the function works when I pass a hard coded string to it, I'm pretty sure the problem is the way I have the Streamreader set up, it's just not reading the characters correctly...
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
Dim FileRdr As StreamReader = New StreamReader "m:\test\charReplace.txt", System.Text.Encoding.UTF7)
Dim ReplaceWrtr As StreamWriter ReplaceWrtr = System.IO.File.CreateText("M:\test\CharReplaceOut.txt")
Do While FileRdr.Peek() >= 0
Dim currentRec As String = FileRdr.ReadLine
removeAccent(currentRec)
ReplaceWrtr.WriteLine(currentRec)
Loop
ReplaceWrtr.Close()
End Sub
'Replace foreign language characters with English characters
Function removeAccent(ByVal myString As String)
Dim A As String = "--"
Dim B As String = "--"
Const AccChars As String = "ŠŽšžŸÀÁÂÃÄÅÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖÙÚÛÜÝàáâãäåçèéêëìíîïðñòóôõöùúûüýÿ"
Const RegChars As String = "SZszYAAAAAACEEEEIIIIDNOOOOOUUUUYaaaaaaceeeeiiiidnooooouuuuyy"
For i As Integer = 1 To Len(AccChars)
A = Mid(AccChars, i, 1)
B = Mid(RegChars, i, 1)
myString = Replace(myString, A, B)
Next
removeAccent = myString
End Function
I know that removing the accent changes the meaning of the word, but this is what the user wants so it's what I need to do.
Any help is greatly appreciated!! :)
Thanks!
Joni

Finally got it to work. I had to remove the first 5 characters from the replacement string (ŠŽšžŸ), couldn't find encoding that would handle these, and to be honest, I didn't really need them. The important ones are still there, was probably
just overkill on my part.
UTF7 worked for the rest...
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
Dim FileRdr As StreamReader = New StreamReader("m:\test\charReplace.txt", System.Text.Encoding.UTF7)
Dim ReplaceWrtr As StreamWriter
ReplaceWrtr = System.IO.File.CreateText("M:\test\CharReplaceOut.txt")
Do While FileRdr.Peek() >= 0
Dim currentRec As String = FileRdr.ReadLine
removeAccent(currentRec)
ReplaceWrtr.WriteLine(currentRec)
Loop
ReplaceWrtr.Close()
End Sub
'Replace foreign language characters with english characters
Function removeAccent(ByRef myString As String)
Dim A As String = "--"
Dim B As String = "--"
Const AccChars As String = "ÀÁÂÃÄÅÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖÙÚÛÜÝàáâãäåçèéêëìíîïðñòóôõöùúûüýÿ"
Const RegChars As String = "AAAAAACEEEEIIIIDNOOOOOUUUUYaaaaaaceeeeiiiidnooooouuuuyy"
For i As Integer = 1 To Len(AccChars)
A = Mid(AccChars, i, 1)
B = Mid(RegChars, i, 1)
myString = Replace(myString, A, B)
Next
removeAccent = myString
End Function
Thanks for all your help! Greatly appreciated :)
-Joni

Export to flat file with unicode (chinese) characters??

I have an SSIS (2013) package that needs to send an email notification with query results (via attachment). I have a data flow task with a source sql query that gathers 2 columns - ID and NAME. ID is varchar, NAME is nvarchar (some records have Chinese symbols).
The destination is a .txt file. When I copy/paste a field w/ Chinese symbols to a .txt file, it shows up fine, so i know Notepad can handle the characters. I also have the .txt file set to Unicode encoding (I also tried ANSI originally). When I run the package,
it says that it successfully moves 50 fields to the flat file. However, when I open the flat file, I see that it shows 10 records. It stops when it gets to the record with a Chinese symbol in it...but doesn't produce an error. My plan was to then take the
attachment and use it in a Send Mail task. (i have the smtp/mail notification working fine...just need to figure out how to get the data to all export to the flat file correctly)
Does anyone know how I can get the ID and NAME fields from a query into an email notification (either as an attachment, or even formatted nicely (with tabs) in an email would work).

Hi,
Based on my test, I can reproduce the similar issue in my environment. When we create the Flat File Connection Manager with the default settings, the data in flat file stops when goes to the Chinese characters.
To fix the issue that makes the Chinese characters to actually get written into the flat file, we should check the Unicode checkbox on the right hand side of Locale property in Flat File Connection Manager. In this way, the flat file can display Chinese
characters.
The following screenshot is for your reference:
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Naming files with non English characters.

I'm using filemaker to creat PDF's through Acrobat 10.1.12. I need to use Polish, Hungarian, Czech and Slovakian characters in the file name but the characters are not recognised and so the file name will not create. This is for Windows, the problem does not occur on a mac.

Hi
Have a look at csv upload -- suggestion needed with non-English character in csv file it might help you.
Thanks,
Manish

Uploading data file with specific encoding and other metadata

Hello everyone.
I've been recently testing Microsoft Codename "Data Hub". When select the option to upload a CSV or XLSX file to populate my database, it basically has two problems, in my opinion:
1. It would be great if I could select the file's encoding. If my file is in Spanish, it won't properly load latin characters (e.g. accents, or special characters). The information ends up showing with a bunch of weird characters.
2. It also doesn't let me select which character to use as data separator. It uses the comma as the default. Some of the data might contain commas, so I usually change the separator to a pipe in my CSV files.
Does anybody know any workarounds?
Thanks.

Hey there, and apologies. I wanted to reach out and see if this is still a problem for you.
I also wanted to check if this is a question about Azure SQL Database or something else?
Thanks Guy

Files with accented / special characters dissapear / not visable

I did everything which was suggested in threath http://discussions.apple.com/thread.jspa?threadID=875688&threadrate=2&messageid= 4170111#4170111 but have another problem which maybe new:
All the files appeared when I first used the USB HD on my Airport Extreme but a few weeks ago I tried to play a song via my Itunes and suddenly all my files containing special characters or accented characters where not recognized anymore. For example "josé gonzales - heartbeat.mp3" was gone...! Also in Finder.
I connected my harddrive to directlly to my mac and all the files we visable again! I did the account trick with password and moved all the files in the sharedfolder but still alle the files with accented characters where not visable??? I can't seem to find a solution? Does anyone got the same problem?
Qryn

Actually, The inso filters do not even work for me for PDF file versions 1.2+. Is anyone else experiencing the same difficulties ? How often does Oracle update the INSO filters to keep up with vendors (Adobe/Microsoft) coming out with newer versions of their document products ?
null

Problems uploading a text file with line feed characters from Windows

Hi,
I am using the FM GUI_UPLOAD to load a text file in which at the end of each line there is a line feed character. When I upload the file, the FM interprets the entire file as ONE record; it does not recognize the line feed character at the end of each file line. I am using the parameter in the FM "HAS_FIELD_SEPARATOR" and it does not do anything to remidiate this issue.
The funny thing is that WS_upload works like a charm and it separates every line in the text file according to the line feed character at the end of each file line.
Why a FM that is obsolete would work better and with less effort than the new one? We are on 4.6c and will go to ECC6.0 May 2009.
Can anybody recommenced a way to process this type of file using GUI_upload?
The file to process is downloaded from a bank Website into a Windows PC. Sending the file to Unix first is not an option.
Thanks,
Pierre Martinez
Edited by: Pierre Martinez on Aug 15, 2008 1:09 AM

Hi,
I have done that and Notepad does NOT interpret the line feed character. The file looks all messed up. Notepad does NOT split the data into records. The Hex character at the end of each file line is 0A.
The user will download the file into a Windows desktop from the bank's website and from there an ABAP program needs to read it and parse it. But the ABAP program can not even catch the entire file with gui_upload. WS_upload can catch it with no issues.
I tried catching the file into an internal table of data type string using GUI_upload, but it only catches two bytes of the file and nothing else.
I will try catching the file in some other type of data type for the internal table in gui_upload.
Once I catch it, I can split the file by the line feed character. I need to catch it first, but "my glove" is not big enough. Defining the internal table for the gui_upload as character is a guessing game since I really do not know how big the text file is since GUI_upload will put it in a one record.
Thanks.

XML output file with Control M Characters

Hi,
I am using JDOM API 1.0 on Solaris platform.
Using the XMLOuputter I write the XML data to a file. But the XML file contains Control-M characters at the end of each line..like
<User>^M
<Name>Satish</Name>^M
<id>12567</id>^M
</User>^M
File f = new File(path,Constants.USER_XML);
Document doc = getDocument();
XMLOutputter out = new XMLOutputter();
out.setFormat(Format.getPrettyFormat());
Format outFormat = out.getFormat();
outFormat.setLineSeparator(System.getProperty("line.separator"));
outFormat.setIndent(" ");
try{
FileWriter fw = new FileWriter(f);
out.output(doc,fw);
} catch(IOException iox) {}I am not writing the Control-M characters. Also I am using the default encoding which is UTF-8. So how to avoid the control characters. Thanks in advance.
Regards,
Satish

Those are carriage-return (CR) characters. I don't know anything about the classes you are using but I would suggest you let the software decide what line endings it is going to use (the XML default is line-feed (LF) only) instead of telling it. Just a guess.
It's also possible that those CRs were in your input document and you are just copying them to the output document. XML parsers are supposed to normalize those characters to only LF but perhaps your parser isn't doing that. Just another guess.

[Solved]Amarok don't play files with non latin1 characters in filename

I know that this problem is not in amarok, i patched phonon from aur http://aur.archlinux.org/packages.php?ID=27465
/src/import/gstreamer/mediaobject.cpp
at line 365 in bool MediaObject::createPipefromURL(const QUrl &url)
QByteArray encoded_cstr_url = url.toEncoded();
m_datasource = gst_element_make_from_uri(GST_URI_SRC, encoded_cstr_url.constData(), (const char*)NULL);
//for utf8 locale replace toLocal8Bit to toAscii
//toLocalFile fails for files with "?" in filenames. toLocalFile("a?c.s") => "a"
+ if ( url.toString().indexOf("file://") == 0 )
+ g_object_set(m_datasource, "location", url.toString().replace(0,7,"").toLocal8Bit().constData(), NULL);
if (!m_datasource)
return false;
and now amarok plays ALL files
Last edited by klama (2009-08-03 12:23:16)

which phonon backend are you using? try with a different one

Cp and tar files with non printable characters

Hi all,
Maybe it's a silly question but just got stuck with this.
We have an XSan with diverse material from varios departaments. Besides having a backup on tape I was trying to just do a plain copy from a terminal of all the files to another disk just using cp or tar.
But whenever cp or tar encounters a file with a nonprintable char they don't copy it.
Let's say in the client Finder the named the file "opción.txt"
The file shows up in terminal with an ? but cp or tar won't get the file.
any clues?
thanks!

Hi
Have a look at csv upload -- suggestion needed with non-English character in csv file it might help you.
Thanks,
Manish

Problems with compressing files with right hand click. it does not work.

Problems with compressing files with right hand click.
I am using the compress function in the Mac OS (File > Compress XX) from time to time. Today it does not work anymore. OS 10.5.6
I get a message: The content list cannot be created for compressing.
I tried it with files and folders and keep getting this message. Anybody any idea as to how to fix this

Thanks I love my macbook!!!!
I also got further problems such as copy-paste not working etc.
so I fixed it just this morning by running Applejack 1.5 and am back up running noticing your post.
thanks for helping though!

While saving multiple attachments from mail, files with same name are added and not replaced

While saving Multiple Attachments from Mail, existing file with same name are not overwritted but new files are added in the folder.

Bjørn Larsen a écrit:
Hi all
Hope to get some help with Elements Organizer.
I have 12-15 years of digital photos that I now want to import into my newly aquirede Adobe Elements Organizer / Photoshop. Since my Nikon names the files with continous numbers from 0001 to 9999 I have multiple files with the same name although they are not alike at all. My previous software had no problems with that since I keep the photos in separate file folders based on import date. I generally import photos after each event and so name the folder with the date and some event info (e.g. 2014.12.24 - Christmas at grandparents).
That is a common situation, I have the same limitation for files not going over 9999 on my Canons...
Now - when I import my photos into Elements Organizer I get a lot of error messages with "same name exist .....) Hmmmmmmm
Please sate the exact wording of the error message, I have never seen a message stating 'same name exist...' or equivalent; only messages about files already in the catalog. Files already in the catalog mean that some files have the same 'date taken' and file size in Kb.
Any suggestions. I'm using a mac and tried to rename files based on date taken. The mac can do that but it takes ages to go into each folder and run the renaming script there.
I also use a similar folder creation scheme (such a date naming is the default for the downloader). That way I never get a message about duplicates for the same file names.
However - I can't be the first or only person with this problem so I figure that some workaround must be known out there. Maybe the import action can recognize date taken or - well. Thank you very much in advance if you can help me out here.
You can alsways set the downloader to rename the imported files with a unique new name, there are many options in the 'advanced' dialog of the downloader. I don't know about Macs, but I don't thing there is a difference.

Batchloader file with en dash characters in metadata not loading

Similar Messages

Maybe you are looking for