Nerving Problem with UTF-8 and ISO-8859-1

Hi,
I´m looking for a solution to serve this problem for many hours now, maybe someone can help me:
1.) We need to send our Mails with the ISO-8859-1-Charset because otherwise Windows-Users get the text in the message twice: once as plain, and after a question mark formated. So I changed the NSPreferredMailCharset in the com.apple.mail.plist to ISO-8859-1:
defaults write com.apple.mail NSPreferredMailCharset "ISO-8859-1"
2.) So far so good. It works until I add an attachment to a message. Adding an attachment forces the sending of the mail again as Unicode (UTF-8). I could change the encoding manual, but thats not the way we can work in our company.
My question is: is there any way to force mail to encode as ISO-8859-1? It can´t be that we have to change the encoding for every message.
Thanks a lot
florian
PS: I´m not sure if this is important: we use the osx in German.

I was thinking that since he is from Austria & references a company, there is a very strong possibility that the character "€" (the Euro currency symbol, Unicode 20AC, UTF-8 E2 82 AC) would frequently appear in messages.
Even if he sets a preference for ISO-8859-1 as the default with Terminal, or manually changes messages to ISO-8859-1, it would not be possible to include this symbol in such messages, since there is no "€" in ISO-8859-1.
Similar problems would occur with other symbols sometimes used in business (for example "™"), in engineering ("Ω"), in mathematics ("∑"), or even with some general punctuation marks such as the dagger ("†").
Other possible problems are the use of other currency symbols the Euro replaced (the franc's "₣" or the lira's "₤") or others still in use (the Israeli new sheqel's "₪ or rupee's "₨"). Ligatures in an international environment would really complicate things as well, as this Wikipedia article about the Œthel illustrates.
Note that in none of these cases would the presence or absence of an attachment matter -- ISO-8859-1 simply isn't up to the task.
I suspect that in some cases, if it is possible, setting the default to Windows-1252 (Windows Latin 1 in Mail's list?) would help, since it does include at least the Euro & dagger. I haven't played around with this much, but I do note that in a new message window containing "€" in the body, if I set the text encoding to Windows Latin 1, Automatic, or UTF-8, Mail doesn't complain, but if I set it to ISO Latin 1, I get an error saying the message can't be saved & an "Invalid Text Encoding" alert if I try to send it.
As for how messages are received at the other end, Windows apps (not just Outlook) are notorious for continuing to use non-Unicode API's even after the OS itself has long since moved to Unicode as its internal standard. Some of them employ bass-ackwards fixes like deciding ISO-8859-1 declarations are supposed to be Windows-1252 ones. Worse, Windows itself sometimes seems to interpret a few Windows-1252 code positions as their ISO-8859-1 control equivalents!
All this makes life that much more complicated for people trying to avoid problems like the above.

Similar Messages

British Pound Sterling with UTF-8 and ISO-8859-15

Please excuse my long-windedness ... I'm simply trying to answer all possible questions up front and give the most possible information. I've searched through tons of forums and all over various sites and references and am not able to come up with a concrete solution to this. I'd appreciate any help anyone has.
I'm having some trouble with character sets and international currencies.
Our server was recently upgraded from Red Hat 7.3 to Red Hat 8.0. I understand that the default system encoding thus changed from ISO-8859-15 to UTF-8. I have verified this by executing the following:
public class WhichEncoding {
public static void main(String args[])
    String p = System.getProperty("file.encoding");
    System.out.println(p);
}I have two machines, one which represents the old system (7.3) and one representing the new (8.0), which I will call machine73 and machine80 respectively.
[machine73:~]# java WhichEncoding
ISO-8859-15
[machine80:~]# java WhichEncoding
UTF-8I have also verified that the JVM is using the correct default character set by executing the following:
import java.io.ByteArrayOutputStream;
import java.io.OutputStreamWriter;
public class WhichCharset {
    public static void main (String[] args) {
        String foo = (String)(new OutputStreamWriter(new ByteArrayOutputStream())).getEncoding();
        System.out.println(foo);
}which yields:
[machine73:~]# java WhichCharset
ISO-8859-15
[machine80:~]# java WhichCharset
UTF8Here comes the problem. I have the following piece of code:
import java.text.NumberFormat;
import java.util.Locale;
public class TestPoundSterling
    public static void main (String[] args)
        NumberFormat nf = NumberFormat.getCurrencyInstance(new Locale("en", "GB"));
        System.out.println(nf.format(1.23));
}When I compile and execute this, I see mixed results. On machine73, I see what I would expect to see, the British Pound Sterling followed by 1.23. To be sure, I outputted the results to a file which I viewed in a hex editor, and observed [A3 31 2E 32 33 0A], which seems to be correct.
However, when I execute it on machine80, I see a capital A with a circumflex (carat) preceding the British Pound Sterling and the 1.23. The hex editor shows [C2 A3 31 2E 32 33 0A].
I looked up these hexadecimal values:
Extended ASCII
0xC2 = "T symbol"
0xA3 = lowercase "u" with grave
ISO-8859-1
0xC2 = Capital "A" with circumflex (carat)
0xA3 = British Pound Sterling
Unicode Latin-1
0x00C2 = Capital "A" with circumflex (carat)
0x00A3 = British Pound Sterling
(This explains why, when I remove /bin/unicode_start and reboot, I see a "T symbol" and "u" with a grave in place of what I saw before ... probably an irrelevant sidenote).
I found a possible answer on http://www.cl.cam.ac.uk/~mgk25/unicode.html#utf-8 under the Examples section. Apparently, a conversion between Unicode and UTF-8 acts differently based on the original Unicode value. Since the Pound Sterling falls between U-00000080 � U-000007FF (using the chart on the mentioned site), the conversion would be (as far as I can tell):
U-000000A3 = 11000010 10101001 = 0xC2 0xA3
This appears to be where the extra 0xC2 pops up.
Finally, to the whole point of this: How can I fix this so that things work as they should on machine80 like they did on machine73. All I want to see at the command line is the Pound Sterling. Getting the 0xC2 preceding the Pound Sterling causes some parts of my applications to fail.
Here's some additional information that might be of use:
[machine73:~]# cat /etc/sysconfig/i18n
LANG="en_US.iso885915"
SUPPORTED="en_US.iso885915:en_US:en"
SYSFONT="lat0-sun16"
SYSFONTACM="iso15"
[machine73:~]# echo $LANG
en_US.iso885915
[machine80:~]# cat /etc/sysconfig/i18n
LANG="en_US.UTF-8"
SUPPORTED="en_US.UTF-8:en_US:en"
SYSFONT="latarcyrheb-sun16"
[machine80:~]# echo $LANG
en_US.UTF-8Any help is very, very much appreciated. Thanks.

you didn't look hard enough, this is a faq...
there three options:
1) change the system encoding by setting LANG or LC_CTYPE environment variables... assuming you use bash:bash$ export LC_CTYPE=en_GB.iso88591 you can check the available locales with locale -a ... pipe it to grep en_GB to filter out the non-british english locales
-OR-
2) change the java default encoding from the command line with -Dfile.encoding... run with$ java -Dfile.encoding=ISO-8859-1 yourclass-OR-
3) set the encoding from within the program with OutputStreamWriter, or use a PrintStream that has the encoding set..PrintStream out = new PrintStream(new FileOutputStream(FileDescriptor.out), true, "ISO-8859-1");
System.setOut(out);see also the internationalization tutorial & the javadoc of the related classes....

Is there a fix for the connectivity problems with iPhone 5S and ISO 7.0.2?

Is there a fix for the bluetooth connectivity problems with iPhone 5S and ISO 7.0.4?
I am having problems connecting the BT Audio and the handsfree phone connectyion is unreliable in 2012 Mitsubishi Lancer XL.
All worked OK with ISO 6.

Hello CraigNicholson
You would need to sync with iTunes to get that process to work for you. Check out the article below for more information on how to resolve that issue to get the proper token to use Push Notifications again.
iPad and iPod touch: Unable to use YouTube or Push notifications
http://support.apple.com/kb/ts3305
Regards,
-Norm G.

Latin Charset Problems UTF-8 and ISo-8859-1

Hello all,
I'm having problems displaying latin characters in my application such as ~, ^, ´, ` and so on.
Using jinitiator works fine, but i'm using java 1.5.0_04, it's a client requisit.
I'm using IAS 10gr2 and forms 10gr2 also.
Is there any configuration property that i can change to allow a correct char displaying.
Can anyone help me please?
Thanks in advanced
João Antunes

Hello Francois,
Thanks for replying.
It only happens when i'm writing, all the values queried to the DB are returned ok.
My NLS_LANG=AMERICAN_AMERICA.WE8ISO8859P1.
Thanks in advanced
João Antunes

I have problem with my iphone 3gs , ISO 5.0.1 , i tried to update it to new 5.1.1 and not getting and showing below massage the iphone could not be updated. an unknown error occurred 11

I have problem with my iphone 3gs ( ISO 5.0.1) , it is stuck on apple LOGO and just restaring from time to time after long time will open then i am able to see all app so i tried to update it to new 5.1.1 but not getting update and showing below messege the iphone could not be updated. an unknown error occurred 11
thanks

if itunes can no longer pickup your ipod, and you cant even do anything to your ipod, your best option is to either call apple care, or just take it to the nearest apple shop. i had a similar problem, mines currently at apple care repairs and they might just end up giving me a replacement.

Decode UTF-8 to ISO-8859-1

I am using the Google Maps API, it return in utf-8,
so for some countries, caracters are wrong,
My server is ISO-8859-1
So, how to convert the result from utf-8 to iso-8859-1 ?
I tried :
<cfprocessingdirective pageEncoding="UTF-8">
<cfcontent type="text/html; charset=UTF-8">
<cfset setEncoding("URL", "UTF-8")>
<cfset setEncoding("FORM", "UTF-8")>
and
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
No change. always the wrong caracters,
Thanks for any help with this mess.
Pierre.

I am using CF v7.
My server and CF are ISO-8859-1.
But I am using Google Maps API , which returns country names in UTF-8.
I tried the Google Maps directives, with adding parameter eo=ISO-8859-1 in the Google Key <script>,
same result.
Then I have to convert to ISO-8859-1 , at least in that page for country names.
(I have a specific problem with Thailande, Google Maps returns : Tha๏lande
and in the data base it writes : tha&#3663 ;lande (an Access database)
I answer to injun [576871] ,
Diificult to insert that code, because I am in a JavaScript code already.
So it will not accept <cfscript> again inside ? I will try.
Thanks for any help.
Pierre.

XML Encoding Issue - Format UTF-16 to ISO-8859-1

Dear Groupmates,
I have data in my Internal table which i am converting to XML using custom Transformation.
Data is going to third party.The third party system requires data in ISO-8859-1 Format but SAP is generating the same in UTF-16 Format.I have been able to change the format of file from
utf-16 to ISO-8859-1 format but after conversion i am getting invalid tag information in form of characters
like &lt , &gt etc..in my file.
Here is the code i have used to set the encoding to ISO-8859-1 :-
DATA: xmlout TYPE xstring.
DATA: ixml TYPE REF TO if_ixml,
streamfactory TYPE REF TO if_ixml_stream_factory,
encoding TYPE REF TO if_ixml_encoding,
ixml_ostream TYPE REF TO if_ixml_ostream.
ixml = cl_ixml=>create( ).
streamfactory = ixml->create_stream_factory( ).
ixml_ostream = streamfactory->create_ostream_xstring( xmlout ).
encoding = ixml->create_encoding(
character_set = 'ISO-8859-1' byte_order = 0 ).
ixml_ostream->set_encoding( encoding = encoding ).
Sample Output :-
<?xml version="1.0" encoding="iso-8859-1"?>
<AMS_DOC_XML_EXPORT_FILE><AMS_DOCUMENT AUTO_DOC_NUM="FALSE" DOC_CAT="CA" DOC_CD="CA" DOC_DEPT_CD="045" DOC_ID="XR10281060830400001" DOC_IMPORT_MODE="OE" DOC_TYP="CH" DOC_UNIT_CD ="NULL" DOC_VERS_NO="01">
<CH_DOC_HDR AMSDataObject="Y">
<DOC_CAT Attribute="Y"><![CDATA[CA]]></DOC_CAT>
<DOC_TYP Attribute="Y"><![CDATA[CH]]></DOC_TYP>
Please let me know if anyone has idea how i can get rid of the invalid tag information.
Thanks !
With Regards,
Darshan Mulmule

Darshan,
Did you get an answer for this question? We have same requirement to create XML file in ISO-8859-1 format with Attributes is set to "Y" and CDATA is being used for data.
Can you please let me know if you still remember how did you achieve it?
Satyen...

Mail Sender - Encoding (I need to change from UTF-8 to ISO-8859-1)

Hi,
I'm getting data from email (in ms exchange) using the Mail Sender Adapter.
In the e-mails exists characters as ç (ccedil), ã (atilde), õ (otilde) and others. The XI cannot read this characters because the encode in XML is UTF-8.
How I do to change the encode in XI from UTF-8 to ISO-8859-1 ?
Thank you!

Unfortunately most mail server do not apply the codepage to the content type of a mail.
In this case you have to set the content type with help of the MessageTransformBean:
Transform.ContentType text/plain;charset="ISO-8859-1"
Regards
Stefan

HTTP-Receiver: Code page conversion error from UTF-8 to ISO-8859-1

Hello experts,
In one of our interfaces we are using the payload manipulation of the HTTP receiver channel to change the payload code page from UTF-8 to ISO-8859-1. And from time to time we are facing the following error:
u201CCode page conversion error UTF-8 from system code page to code page ISO-8859-1u201D
Iu2019m quite sure that this error occurs because of non-ISO-8859-1 characters in the processed message. And here comes my question:
Is it possible to change the error behaviour of the code page converter, so that the error will be ignored?
Perhaps the converter could replace the disruptive character with e.g. u201C#u201D?
Thank you in advance.
Best regards,
Thomas

Hello.
I'm not 100% sure if this will help, but it's a good Reading material on the subject (:
[How to Work with Character Encodings in Process Integration (NW7.0)|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/502991a2-45d9-2910-d99f-8aba5d79fb42]
The part of the XSLT / Java mapping might come in handy in your situation.
you can check for problematic chars in the code.
Good luck,
Imanuel Rahamim.

Xml Parse throws SaxParseException.Encoding is UTF-8 insteadof ISO-8859-1 ?

Hi All,
I'm having some korean characters in my xml. when i tried to parse the xml i'm getting SaxParseException .
<?xml version="1.0" encoding="UTF-8"?> --- Throwing Exception
<?xml version="1.0" encoding="ISO-8859-1"?> --- No Exception, successfully parsed
I'm not sure why UTF-8 is failing and ISO is passing. But I'm always getting xml with UTF-8 format? Can anyone know the reason?
I also like to know the differences between UTF-8 and ISO, i don't find any good article/document for this.
Thanks,
J.Kathir

When SAX throws an exception when the encoding is set to UTF-8, then the XML contains something that is not a valid UTF-8 code (i.e. your source file is not encoded using UTF-8). Also: whenever you ask about an exception you should definitely post the entire exception, including message and stack trace.
If it doesn't throw an exception when it is set to ISO-8859-1, then it does not mean that this is the correct choice. ISO-8859-1 is defined from 0 up to 255, so any byte stream is correct in that encoding ('though not necessarily meaninful).
You absolutely have to find out which encoding the file really is, before you can parse it. If it should contain Korean characters then it is definitely not ISO-8859-1 (or any other encoding from the ISO-8859 family), as those only support latin, cyrillic and similar scripts.

Problems with the richTextEditor and quotes

Hello
I'm having problems with quote chars and the richText
control's htmlText. When users enter quotes into the richTextEditor
control. The quotes breaks the HTML text, meaning it's no longer
well formatted. Is there an escape char that I need to use. Or do I
need to force some kind of refresh on the control prior to using
the htmlText string?

I have been using RTE in a content management system and
found a need to replace non-standard quote characters with proper
UTF-8 character counterparts. Curly quotes in particular are
problematic. Use a replace function to substitute non-standard for
standard characters.

Abap Proxy Convert UTF-8 to ISO-8859-1

Dear,
I have the following scenario:
Abap Proxy-> PI -> WebService.
I need to change the encondig UTF-8 to ISO-8859-1 when the SAP ECC sends data to the PI.
How do I do this?
I have a XSLT program that performs the this conversion, UTF-8 to ISO-8859-1, between PI and WebService.
Regards,
Sérgio Salomã

To understand more about Character Encoding in SAP Process Integration. You can refer the following link:
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/502991a2-45d9-2910-d99f-8aba5d79fb42?quicklink=index&overridelayout=true

Problems with ListViews Drag and Drop

I'm surprised that there isn't an Active X control that can do this more
easily? Would
be curious to find out if there is - although we aren't really embracing the
use of
them within Forte because it locks you into the Microsoft arena.
---------------------- Forwarded by Peggy Lynn Adrian/AM/LLY on 02/03/98 01:33
PM ---------------------------
"Stokesbary, Michael" <[email protected]> on 02/03/98 12:19:52 PM
Please respond to "Stokesbary, Michael" <[email protected]>
To: "'[email protected]'" <[email protected]>
cc:
Subject: Problems with ListViews Drag and Drop
I am just curious as to other people's experiences with the ListView
widget when elements in it are set to be draggable. In particular, I am
currently trying to design an interface that looks a lot like Windows
Explorer where a TreeView resides on the left side of the window and a
ListView resides on the right side. Upon double clicking on the
ListView, if the current node that was clicked on was a folder, then the
TreeView expands this folder and the contents are then displayed in the
ListView, otherwise, it was a file and it is brought up in Microsoft
Word. All this works great if I don't have the elements in the ListView
widget set to be draggable. If they are set to be draggable, then I am
finding that the DoubleClick event seems to get registered twice along
with the ObjectDrop event. This is not good because if I double click
and the current node is a folder, then it will expand this folder in the
TreeView, display the contents in the ListView, grab the node that is
now displayed where that node used to be displayed and run the events
for that as well. What this means, is that if this is a file, then Word
is just launched and no big deal. Unfortunately, if this happens to be
another directory, then the previous directory is dropped into this
current directory and a recursive copy gets performed, giving me one
heck of a deep directory tree for that folder.
Has anybody else seen this, or am I the only lucky one to experience.
If need be, I do have this exported in a .pex file if anybody needs to
look at it more closely.
Thanks in advance.
Michael Stokesbary
Software Engineer
GTE Government Systems Corporation
tel: (650) 966-2975
e-mail: [email protected]

here is the required code....
private static class TreeDragGestureListener implements DragGestureListener {
     public void dragGestureRecognized(DragGestureEvent dragGestureEvent) {
     // Can only drag leafs
     JTree tree = (JTree) dragGestureEvent.getComponent();
     TreePath path = tree.getSelectionPath();
     if (path == null) {
          // Nothing selected, nothing to drag
          System.out.println("Nothing selected - beep");
          tree.getToolkit().beep();
     } else {
          DefaultMutableTreeNode selection = (DefaultMutableTreeNode) path
               .getLastPathComponent();
          if (selection.isLeaf()) {
          TransferableTreeNode node = new TransferableTreeNode(
               selection);
          dragGestureEvent.startDrag(DragSource.DefaultCopyDrop,
               node, new MyDragSourceListener());
          } else {
          System.out.println("Not a leaf - beep");
          tree.getToolkit().beep();
}

Problems with Customer Service AND unexplained charges!

I've been with Verizon for I-don't-know-how-many years, and through the years you are bound to have a few problems here and there but some of the problems are just ridiculous! It's also the same reocurring problem!!!!!!!!!!!!!!!! I was with Alltel first, before it was bought out by Verizon. The years I was with Alltel, I didn't have near as many problems. It seems EVERY time I do the smallest change or something to my phone or bill, I get a ridiculous amount of charges that I was NOT aware of, nor told about... EVEN IF I ask "So this isn't going to change my bill, or there will not be any unexpected/unexplained charges that I don't know about?"... BUT not matter how many times I ask... and NO matter how many times I am told "no"... there always is. For example.... last year, I updated and signed a new 2 year contract and purchased the first Driod. Before, my 30 day warranty was up, I was having problems with my Driod, and decided to send it in and get a new one. Before I did this.. I called customer service to make sure there would be no interuption in my bill, and there wouldn't be any unexpect charges, and there would be no difference in anything. I was told there was not, and once I recieved my new phone, just send it in and nothing would be changed. Of course, when I get my bill.. I see I was charged $500 for the new phone. It was explained to me that my credit card was reimbursed (which I never check that card, because I never used it expect to purchase the phone) and that I was recharged for the new phone, since it was a new phone. So I had to fork out the $500 (on top of my bill) and then wait months to get the $100 rebate card. Months after that, I "assumed liablity of my line" because I was on a plan with my family. I decided to have my own line, so I "assumed liability." I was not told that when I did that, I "renewed" my contract date. So I just added 6 more months to my 2 year contract. Was NOT told about that! Then again...... I was recently having problems with my Driod (the screen went black and would not come back on.) I had to turn on an OLD motorola razor, so I would not be without a phone for two days while I was waiting on my phone to come in. As soon as my phone came in, I had my Droid turned back on. I recieved my bill recently, and my bill was $200 over what it normally should be.... so I called in... apparently, when I had my phone replaced, they dropped off my data package and when I recieved my replacement driod, they never put it back on. So I was being charged for alllll my data usage... again I was NOT told about this. I wasn't even aware that they had dropped off my data package, and when/where did they get the authority to do that??? These are just a FEW of the problems that I have had.................................
Does anyone have these reoccuring problems!?

I understand that my bill can be viewed online, and I do view it fairly regularly, so if there are any unexplained charges, I can call Verizon asap. The problem does not come from me not understanding my bill, but from customer service. I have been with Verizon for a very long time, and it is a continuing problem. Where did Verizon get the 'OK' to drop my data package off my plan? Who authorized that?
After calling Verizon and trying to find out the problem, the gentleman told me that when I activated on old phone while I was waiting on my new Droid to arrive, my data package was dropped off and I "should" have been told about that. When I reactiviated my new Droid, I "should" have called and had them restart my data package. I was not aware that when you activate an old phone that data plan is taken off your plan. In all my years of having cell phones, I never make two years with one phone. I have always, at one point, had to turn on an old phone, and my data package has NEVER changed. Why would I have my data package dropped and why would I have to call Verizon to have it restarted. I would never know to do that unless I was TOLD that my data packaged HAD to be re-added when I recieved my new phone, but I was never told of that.
All of that is beside the point, the point is, Verizon was never given the authorization to change my plan. Never. My bill was taken care of and readjusted, and I am thankful for that. It does not change the fact it is always a hassle with Verizon Customer Service and I am always the one having to PROVE that I am not at fault, or that I was NEVER told of certian things. EVERY TIME I HAVE CALLED CUSTOMER SERVICE, I AM TOLD "I'M SORRY, THEY SHOULD HAVE TOLD YOU THAT."
"they should" does not help my bill with the extra armount of charges.

Problems with dropped calls and no reception on Samsung Continuum

My mother and I both purchased a Samsung Continuum in late March 2011, and have experienced the same problems with the phone. The device drops at least 2-3 calls per day, often on the same conversation; we have not found that location or time of day makes a difference. The phone freezes up frequently, even if no apps are running in the background. We lose our 3G network reception frequently, and cannot access our texts, emails, or the internet. The screen saver kicks in even when we are actively dialing a number, or typing in a text message. The overall performance of the phone is also poor, and it is quite slow much of the time.
We have raised this issue several times with a representative at one of the Verizon stores, but he states that he can find no problem with the phone, and that these issues may not be covered under our insurance plan. None of my friends with non-Samsung phones are having the same problems with phone reception and performance. I am aggravated enough with these issues that I am considering reactivating my old Blackberry, which worked like a charm.
I am not upset that my phone has not been updated to Android 2.2. I just want the phone to perform as stated, and not fail at its primary function: making and receiving phone calls. I am not certain if these problems originate with the phone, Verizon, or Samsung, nor do I care. I just want to resolve these issues as soon as possible, or I will have to look at other alternatives.
Thank you.

If this doesn't work...now what??? I have a useless $400 plus piece of unreliable junk. My Motorola Razor was ions more reliable than this phone...very, very sad but true.
What carrier were you using with the Razor? AT&T? Same area?
Dave M.
MacOSG Founder/Ambassador  An Apple User Group  iTunes: MacOSG Podcast
Creator of 'Mac611 - Mobile Mac Support' (designed exclusively for an iPhone/iPod touch)

Nerving Problem with UTF-8 and ISO-8859-1

Similar Messages

Maybe you are looking for