Unicode mixup in fonts

I have a question about unicode mixups. I have a lot of old files with old fonts. If I need to upgrade some file, sometimes I need to change a font. Now some fonts will get you the problem that the unicode of the glyphs is not recognised or mixed up. Like when I have the word 'test' in Garamond Expert I want to change that to 'test' in Caslon Expert. It will give me '____'. If I look at the unicodes (easy copy/paste into the search/replace-enige) it does not say 'test' but something like <B776><B7765><B782><B771> (I am making these up) where <B776> stands for 't' etc. Now I do not want to replace each individual glyph nor want to miss out any. But a simple replacing of the font is not possible. Looking at the fonts coding in fontographer one can see that the 't' actually is at unicode <B776> but not at 't' where it should be. It worked in the past tough, so why not now! Strangely enough, if you type new text next to it (so in the same font) like 'test'test, the unicode says its '<B776><B7765><B782><B771>test' and the second part of the text will be converted like I want it. Also I find QuarkXPress has no problem with converting 'test' into Caslon Expert. (Original file was a Quark-document; used file was an update after I changed to InDesign couple of years ago)

Can you repeat your experiment and report the actual numbers you are seeing per character?
I don't think it has to do anything with Unicode. "Expert" fonts used to be notorious, because it assigned non-standard glyphs (characters) to standard codes -- to get an "ffl" ligature, you'd type a tilde. And most "Expert" fonts didn't comply to Adobe's "ExpertEncoding", so switching from one expert font to another wasn't guaranteed to be safe.
If a font is Unicode-compliant, this entire problem disappears, if only for the reason Unicode does *not* assign code points to expert symbols! But Opentype fonts do, and the Opentype code assures ligatures are applied automatically, and are translated back to their constituent characters when you apply another font which doesn't have the ligatures.
Modern fonts with all 'expert' options aren't called "Expert" anymore; look for Opentype Pro fonts. The Garamond Pro that came for free with your InDesign is a good example of a well-behaving, Unicode-compliant, automatically ligating and small-capping expert font.
function(){return A.apply(null,[this].concat($A(arguments)))}
Also I find QuarkXPress has no problem with converting 'test' into Caslon Expert.
I find it hard to believe QXP can translate from one "Expert" set in a font to another one with another encoding. Either the encoding is the same, and then you shouldn't have a problem in ID as well, or it's different.

Similar Messages

Khmer Unicode 2.0 font conflict with Adobe suite

I just downloaded Khmer Unicode 2.0. After I did, the Microsoft Word doc that supplied a Khmer translation read correctly. When I tried to copy and paste the Khmer into any Adobe apps (I tried 3, so have concluded it will be true of all) the font moved the letters around, deleted vowels, and generally messed up the phrases. It did it the same way every time I tried new things.
I even tried copying the font into the Adobe FONT folder, and that didn't make any difference. What could be creating this problem... I need to resolve it right away since I am trying to finish a project by the end of today.
I have 3 files to send someone, but don't see an option to attach them here
I am using Windows XP and Adobe Suite CS3
I just found this:
you should already know the answer to this. btw it's not just khmer, it's any
unicode encoded text.
first the usual suspects: what db driver? 100% sure you're using the correct dsn?
then this caught my eye: SET khmerReadWriteTest ='#form.text#'
uh either use cfqueryparam (good practice besides you turned on unicode in the
dsn anyway) or unicode hinting.:
SET khmerReadWriteTest=N'#form.text#'
But I have no idea where you do any of this.... Help please!

Is there a Windows machine on the network? It might be a conflict with non-Unicode symbols fonts used by them.

Cursor / window disappears with rxvt-unicode + xcompmgr + Xft font

The issue described in this thread is still outstanding for a number of users.
It seems to boil down to this: when using rxvt-unicode with xcompmgr and an Xft font (Liberation Mono, DejaVu Sans Mono, and Terminus were among those tested), the terminal cursor will disappear. Typing some text and pressing backspace will cause it to reappear.
Furthermore, the entire window sometimes disappears when switching workspaces in Openbox. Repeated workspace switches or minimizing / restoring the window (via a panel, such as tint2) can make it reappear.
A workaround is to set URxvt*cursorUnderline in ~/.Xdefaults, but some users prefer a block cursor.

The suggestion of installing libxft-lcd was made. I did so, commented-out the URxvt*cursorUnderline line in ~/.Xdefaults, logged out of X, and restarted slim from tty1.
% ldd /usr/bin/urxvt | grep Xft
libXft.so.2 => /usr/lib/libXft.so.2 (0x00007fd35f179000)
% pacman -Qo /usr/lib/libXft.so.2
/usr/lib/libXft.so.2 is owned by libxft-lcd 2.2.0-1
After restarting slim, the problem persists. After rebooting, the problem still persists.
xterm does not exhibit this problem, nor does emacs. I use both programs with libxft and blinking block cursors, and they both work as expected. This seems to be an issue with running rxvt-unicode in combination with xcompmgr. From my POV, it doesn't seem that intel drivers are to blame, but I suppose I wouldn't rule them out.
Last edited by hexadecagram (2011-10-09 21:23:43)

Why re-distillation removes mapping to Unicode for Type0 fonts?

Hello
I need to re-distill a PDF. I save it as postscript and convert to PDF using Adobe Distiller. After re-distillation some of fonts are OK but Type0 fonts are not searchable any more because their ToUnicode dictionaries are not kept.
Are there some parameters in settings of "Save As Postscript" or "Adobe Distiller" that can solve this problem?
Maya

We got PDFs from different sources and simplify them for a third-party
Viewer. The last step of our process is refrying of result PDF because the
Viewer has dificulties to display not flattened content, not RGB colors
etc.
I wonder why ToUnicode dictionary is removed for Type0 fonts but not for
Type1 fonts?
May be I can copy the relevant streams from original fonr dictionary to a
refried one?
Thanks a lot
On Wed, Jul 16, 2014 at 3:39 PM, Test Screen Name <[email protected]>

No unicode and no matrix font

I recently reinstalled my arch linux system and I found that unicode and matrix font (cmatrix -l) doesnt work in rxvt-unicode. Using "cmatrix -l" in the regular tty terminal works but neither does unicode. When I try to view Japanese texts it outputs garbage. I installed the asian fonts suggested in the fonts page in the wiki.

zowki wrote:
I have matrix.fnt in these locations:
/etc/fonts/matrix.fnt
/usr/share/kbd/consolefonts/matrix.fnt
It seems to only work in TTY terminals. Is it because matrix.fnt is a terminal only font?
Here I actually have mtx font in the standard path:
$ pacman -Ql cmatrix
cmatrix /usr/
cmatrix /usr/bin/
cmatrix /usr/bin/cmatrix
cmatrix /usr/man/
cmatrix /usr/man/man1/
cmatrix /usr/man/man1/cmatrix.1.gz
cmatrix /usr/share/
cmatrix /usr/share/fonts/
cmatrix /usr/share/fonts/misc/
cmatrix /usr/share/fonts/misc/mtx.pcf
cmatrix /usr/share/kbd/
cmatrix /usr/share/kbd/consolefonts/
cmatrix /usr/share/kbd/consolefonts/matrix.fnt
cmatrix /usr/share/kbd/consolefonts/matrix.psf.gz
Note this line: /usr/share/fonts/misc/mtx.pcf
But this font doesn't present in /usr/share/fonts/misc/fonts.dir so I can't use it.
I copied this font file out into a directory and tried to add the font manually. Say:
$ cp mtx.pcf ~/.fonts
and then run these in ~/.fonts directory:
$ cd ~/.fonts
$ mkfontdir
$ xset fp+ ~/.fonts
$ fc-cache
This makes the font available to the X server. But urxvt refuses to use it:
$ urxvt -fn "mtx"
unable to deduce codeset, ignoring font 'mtx'
urxvt: unable to load base fontset, please specify a valid one using -fn, aborting.
$ urxvt -fn "xft:mtx"
urxvt: unable to calculate font width for 'mtx:minspace=True', ignoring.
urxvt: unable to load base fontset, please specify a valid one using -fn, aborting.
On the other hand xterm is happy with this font, just type in xterm -fn mtx and it works. And
cmatrix also works fine. So I think you need to do something before you can use it with urxvt.
Maybe edit it using fontforge?
Please point out if I missed something.
Last edited by eirika (2009-10-02 15:34:41)

Update FM7 fonts to fm11 unicode support

Hi to all,
a customer of mine would upgrade to framemaker 11 from fm7. He make documentation in a lot of languages, western, but also Central europe, middle east, chinese, russian, etc.
In FM7 he used Helvetica CE, Arial CE, Times Greek, Helvetica Cyr, and so on.
Now he would like to convert his files to unicode support (Arial, Myriad...).
Suggestions?
Thanks.
Mario.

A further issue with the transition from overlay/codepage fonts to Unicode is whether or not the desired typefaces are available as Unicode, and whether or not they have all the required glyphs populated at the Unicode code points used in your documents.
Assuming that any arbitrary "Unicode" font covers more than a fraction of Unicode codepoints would be a mistake. Generating, scaling, hinting and otherwise optimizing 110 000 glyphs is a daunting task. I wouldn't be surprised if no single font has covered it all yet (other than Adobe Blank). The question then becomes: what's missing? I suspect most "Unicode" fonts have only a tiny fraction of Unicode space covered. There's also the question of whether variations (italic, bold, etc.) match the basic coverage.
You might expect font foundries to provide pages or PDFs detailing all the Unicode scripts a font covers, by variation, and showing at least a bitmapped preview of what each glyph looks like. This doesn't seem to be the case.
A few minutes in Adobe's Type Products discovered no obvious means of determining codepoint coverage. A couple of other big name foundries at least had icon sets, each icon representing a Unicode Script set, but no comprehensive list of codepoints covered. At least one site allowed pasting/typing arbitrary text into a dialog so you could see if a particular glyph was populated, and what it looked like. Hope you don't have questions about too many.
Unless I've missed something, this situation appears to be a mess.
And how does FM8+ behave when the document contains a codepoint not implemented by the font applied?
Zero-length character?
Blank?
[] or [?]?
Switches to font that has the codepoint?

Upgraded to 5.0 and now more fonts aren't showing up correctly

I had a previous problem with a colon not appearing correctly on websites and instead, I got FF 1A. Initially it looked like FF IR but FF 1A is the unicode or UTF font for that being it is a wider colon than normal.
I downloaded every font set I could find, even things that are odd shaped things I couldn't possibly ever use and the colon problem was taken care of, but then certain things in email started showing up with an FF 1A, or something else for that unicode and now that I've upgraded to 5.0, a lot more websites are showing these instead of the actual letters, numbers, or punctuation marks.
I even have Fontfinder installed but it isn't much help. I never had this problem until version 4.0.1 I don't know what else to do. I have Unicode UTF-8 for the character encoding because that is what fixed the colon problem, but now I'm having trouble with more characters.
I can't read the boxes, like I could for the colon FF 1A, but on this website
http://en.wikipedia.org/wiki/8_Man
Before each episode there are several boxes and each has a different set of numbers and letters and I zoomed in as much as I could and still can't make them out "魔女エスパー The Witch Esper" I can't tell if the first one is 98 54 or 9B 54. But there are several of these on this website, and I don't know what other fonts to try and install.
They are messed up in Internet Explorer, but most of them are just boxes with nothing in them, but I know this is support for Mozilla Firefox only and I don't really use Internet Explorer.
I can't seem to get online when someone in "Live Help" is available and there isn't a phone number to reach anyone in Support so I am very frustrated because these problems weren't happening before version 4 or 5 and I can't find any more fonts that would help. I believe "Wingdings" are automatically installed with Windows-XP, but these missing characters are supposed to be letters, numbers or punctuation marks, and they aren't showing up correctly, so windings wouldn't matter anyways and I am at my wits end.
I have never had a problem with any computer until now and I even reformatted and did every single update available for Windows-XP and even the ones that are still coming out.
For some reason below where it says
We've made some educated guesses about your current browser and operating system. When I click on "Show Details" under "installed plug-ins", it shows these
* Office Plugin for Netscape Navigator
* Adobe PDF Plug-In For Firefox and Netscape 10.1.0
* DRM Store Netscape Plugin
* DRM Netscape Network Object
But I don't know why and I doubt that is the problem. You can't even get Netscape anymore.
It's so frustrating because it is messing up reading email and doing surveys that I didn't have this problem with before using versions 4 or 5.
In my "Windows\Fonts" folder, I have 375 files over 41 MB so I don't know what to do. I'm about ready to throw the computer out the window being I can't respond properly to an email or do surveys, if I can't read the letters.
4.0.1 was was a clean install after I had to reformat a couple weeks ago but 5.0 was an update that I just did tonight.
I thank everyone in advance.
Susan

Thanks one again. I know you helped me the last to. I do have the Deja Vu font set in my folder. I downloaded and the last time. So I don't know if there is supposed to be more or not, but those were installed with Windows-XP after my reformat.
This is really driving me nuts. as I've done several re-formats on my computer and several friends computers and even upgraded hardware so I am not necessarily a software or programming expert, I am somewhat advanced when it comes to computers in general and can usually diagnose the problem but these font's are the problem and they never were before.
I did see in another forum that if you had a Dell Computer and did the Microsoft update for the onboard video card driver that it could be the culprit, but I have that disabled being I have a much better graphics card so the updates from Microsoft for the onboard video weren't installed.
It' a Dell Dimension 3000 with an Intel(R) 82865G Graphics Controller so I don't believe it is the culprit being it is disabled. The actual video card that I am using is a PCI Nvidia GeForce 9400 GT with 1 GB Memory. And I didn't have any problem before.
I appreciate the help. But still can't get things to work. Live Help Chat doesn't open for another two hours so maybe they can do "Remote Access" or something and can check setting and help me. But if you come up with other suggestions, they would be greatly appreciated.
Thanks again.
Susan

Hindi fonts in java

i have read in books that java supports unicode and hence all the language charectors. i have the unicodes for hindi fonts. i want to write them in TextArea or JTextArea. but the problem is that when i use command append(""+<code>), i see some numbers in the textarea instead of hindi fonts. is there any way i can add hindi fonts to textArea? i am intended to use them in applet.

let me explain a bit. i want my applet to display hindi fonts when i put it online. if i use the setFont() it displays hindi fonts but the fonts MUST be present in my system ( i have hindi fonts in my system ). i want a more flexible way so that there should be no need of hindi fonts on user's system. i tried making an Font object of hindi fonts and saving it on the disk using ObjectOutputStream. but when i read it back on another system, it does not show hindi fonts. even i have tried directly supplying the unicode of hindi fonts, but nothing works. please friends help me! is there nobody to guide me?

BBP_DOCUMENT_TAB- Entries with special charaters afetr unicode upgrade

Hi,
We are on SRM 5.0 (SRM_SERVER 550) Sp07. SAp 4.7 backend.
We are upgrading the system to unicode.
What we have observed is after PO creation the BBP_DOCUMENT_TAB has some special characters in the field 'Key'
For example:
BUS2121001##䟅㳤탇ᾣᾣઃ????#?? ######## 01############################
In the non unicode system the entry reads like below
BUS2121001GAEp#?g8Ia#####o# ################ 01###########
This does not cause problems in most of the SRM systems, but in one of the systems, the Clean_reqreq_up job is failing with a message 'Buffer table not up to date'. We are not sure if this is due to the entries in BBP_DOCUMENT_TAB which have special characters or not.
Can someone please explain the impact/risk of such entries in BBP_DOCUMENT_TAB. Is this a known issue. is there any solution for this?
Thanks & regards,
Srivatsan
Edited by: Srivatsan on Feb 29, 2008 1:14 PM

Hi,
The special characters may be due unicode/langauage issue.
See the foll notes:
Note 548016 - Conversion to Unicode
Related Notes
986907 - SQL Server settings for R3load based system copy
971646 - 6.40 Patch Collection Hom./Het.System Copy ABAP
956921 - IDES ERP 2005 ECC 6.0
952514 - Using the table splitting feature
938374 - Additional tools for MDMP --> Unicode conversion preparation
936441 - Oracle settings for R3load based system copy
932779 - Unicode conversion - analysis of nametab problems
928729 - Combined Upgrade & Unicode Conversion (CU&UC) FAQ
920831 - RFC with inactive text language
896144 - mySAP ERP 2005 Upgrade for R/3 or ERP MDMP Customers
895560 - Support for languages only available in Unicode system
871541 - Frequently used text patterns
857081 - Unicode conversion: downtime estimate
855772 - Distribution Monitor
852235 - Release Restrictions for SAP ERP 6.0
814707 - Troubleshooting for RFC connections Unicode/non-Unicode
812821 - Cascading Font settings
806554 - FAQ: I/O-intensive database operations
795267 - System Copy for 'SAP Web AS Java' based systems
793113 - FAQ: Oracle I/O configuration
791199 - Default editor changed to MSWord in SAPscript and SmartForms
750219 - Unicode UTF-8 printing with HP printers
747036 - mySAP ERP 2004 Upgrade for R/3 MDMP Customers
745030 - MDMP - Unicode Interfaces: Solution Overview
742662 - MS Word as Editor in SAPscript and Smart Forms
741821 - Release limitations concerning SAP ERP 2004
693168 - Minimized Downtime Service and Incremental Migration (IMIG)
673244 - SAPGUI: Recent corrections for Unicode support.
647495 - RFC for Unicode ./. non-Unicode Connections
638357 - Transport between Unicode and non-Unicode systems
585116 - Translation after installation of WebAS SP25
573044 - Unicode conversion for HR application
552464 - What is Big Endian / Little Endian? What Endian do I have?
551344 - Unicode Conversion
547444 - RFC Enhancement for Unicode ./. non-Unicode Connections
543715 - BW Migrations and System Copies for BW 2.0B / 2.1 Content
540911 - Unicode restrictions for R/3 Enterprise, ECC 5.0, ECC 6.0
508854 - SAPGUI: How to use Unicode
379940 - Unicode based mySAP availability
355771 - Oracle: Explanation of the new tablespace layout
330267 - Transports between Basis Releases 4.6* and 6.*
316903 - SAPGUI: How to use I18N mode
215015 - Unicode UTF-8 printing with a Lexmark printer
80727 - Transporting non-LATIN-1 texts
79991 - Multi-Language and Unicode support of mySAP solutions
73606 - Supported Languages and Code Pages
BR,
Disha.
Do reward points for useful answers.

Install Foreign Language Fonts

Hello,
I am trying to install foreign language unicode fonts (Japanese) on my Macbook Pro. In particular, I am trying to install these fonts: http://www.dennybritz.com/ttf30.zip. The fonts install fine under Windows.
However, Mac OS X does not recognize them as unicode or Japanese fonts. The font name contains weird characters and I cannot use them when typing in Japanese.
Any suggestions?
Thank you,
Denny
Message was edited by: dennybritz

Denny, I tried installing the two “marugo” fonts from the archive using Font Book, and they installed fine. I then tried using them: the katakana came out OK while typing, but not the kanji — however, kanji typed in a standard Apple Japanese font could be copied and pasted, and the font could then be changed to one of those in the archive.
I suspect that the problem is that these fonts date back to 2000, and that they were made for Windows; the reason that the font names appear strange is because the character set of the font names is encoded in Shift JIS, while the bytes in those names are treated as being MacRoman under Mac OS X. (Their intended names can be seen [here|http://www.wazu.jp/gallery/Fonts_Japanese.html] — search for “EPSON” in that page.) The font files would likely need to be modified (using an appropriate tool, e.g. FontForge) to work as expected under Mac OS X.

[XI R2] Display string characters in font: Wingdings

Hello,
My aim is to give the possibility to user to use the Wingdings font on WebiReport. This font is correctly installed and can be used with Wordpad.
I added the following part in the fontalias.xml file located in this path: ..BusinessObjects Enterprise 11.5win32_x86 onts
<FONT NAME="Wingdings">
<FONTFAMILY PLATFORM="ttf" NAME="Wingdings">
<FONTATTRIBUTE BOLD="false" ITALIC="false" LOGICAL="Wingdings" PHYSICAL="Wingdings.ttc,1;ARIALUNI.TTF"></FONTATTRIBUTE>
</FONTFAMILY>
<FONTFAMILY PLATFORM="win" NAME="Wingdings"></FONTFAMILY>
<FONTFAMILY PLATFORM="java" NAME=" Wingdings, 'Arial Unicode MS'"></FONTFAMILY>
<FONTFAMILY PLATFORM="html" NAME=" Wingdings, 'Arial Unicode MS'"></FONTFAMILY>
</FONT>
But it doesn't work, the font is converted in Arial and not Wingding...
Have you got any idea? Is it possible?
Thanks in advance for your help
Stéphane

I SOLVE THE PROBLEM.
BufferedReader dis = new BufferedReader(new InputStreamReader( urlConn.getInputStream(),"SJIS"));
"SJIS" - was the key

Greetings. I have finalized an Arabic Language brochure using indesign CS5.5. Once I opened it in CC 2014, I found Axtmanalblack font look like vertical rectangles crossed. Any suggestions?

Greetings Dears.
I have finalized an Arabic Language brochure using indesign CS5.5.
Once I opened it in CC 2014,
I found Axtmanalblack font look like vertical rectangles crossed. Any suggestions?
Thanks.
Tariq

AXT fonts don't work well in new versions of InDesign. Your best bet would be to replace the font with a Unicode compliant OpenType font. I believe there are a few Arabic fonts that are included with InDesign that would work.

What are these fonts used for?

InDesign CS4 has a list of fonts that are set apart from other fonts with horizontal divider lines. The preview under the Type > Fonts menu shows foreign language characters for most of the fonts. Yet, if these fonts are applied to text, standard English characters are displayed. What would one use these fonts for?

Yet, if these fonts are applied to text, standard English characters are displayed.
Well, yes, because changing the font should not change the character set -- i.e., changing the text "Russian" to a font containing Cyrillic should not change the text to "Русский". It's just circumstantial these fonts also contain Latin characters; if they wouldn't, the text would change to pink boxes (indicating 'missing glyph').
The fonts are set apart because ID uses some sort of classification, probably based on the Unicode coverage per font; it seems to group per script. Browsing my list, I see separations between fonts for Chinese, Japanese, Korean (?), Arabic, Thai, and Hebrew.

Fonts in Windows and Fonts in Java

Hello,
Say I have in my app:
String string = "\\u09A1";
I want to display this in my app. I can call:
GraphicsEnvironment.getLocalGraphicsEnvironment().getAllFonts();
I can then iterate through these and find out which ones can display this unicode character using,
font.canDisplayUpTo(string);
My question is, are these the fonts that Java can display (from charsets.jar) or the ones installed in Windows?
I would like to be able to get lists for both of these.
Any ideas?
Cheers,
Jim

Thank you. I did read that. I was not talking about drawing text in 'Hello World' alike applets/programs.
I should give an example:
I would like to print 'H' in Tahoma, 72, Bold (Windows format) at (100, 200).
Font sizes:
In Windows font size is 72 pixels.
In Java this is equal to 96 points (72 px * 96 (scr resolution for Toolkit) / 72 (pixels per point).
Real height in Windows and Java will be 64 px.
That's fine. For some fonts this does not work.
Positioning. See example above.
According to the article you refer to in java we should use y-coordinate 200 + 72 (font size) = 272.
In fact we have :
Java text 14 pixels below than expected.
Similar things happen to other parameters Weight, Styles, etc.
I do use AttributedString and TextAttribute classes to render text
Thanks in advance.
Alex

Embeding font in CS3.

Hi,
I am trying to embed font in CS3. The chinese text is visible
on local desktop but not on remote desktop.
Below are the steps that I have followed.
* created a new font in Library and given a linkage name to
it. [Tried with Arial UniCode MS and Lucida Sans Unicode]
* Given this font name to textField on stage.
* Registered this new font.
* enumerated the font in an array.Later assigned this
fontname to Font instance.
* Used FontInstance.fontName as textFormat's font and applied
this textformat as defaultTextFormat.
* Assigned chinese hardcoded text.
I tried with textFieldName.embedFont=true, but it didn't
help.
This swf shows chinese text on local desktop. But same swf
when viewed from a remote desktop, chinese text appears as squares.
Let me know if I am missing any step.
Thanks in advance.
Coder
My Email

1. Linkage name must be identical to font name.
2. The name of the text field is not important. It can be
anything like myText.
3. Assign font to text formats font propery as a string
textFormat.font = "Font Name"
4. Set myText.embedFont = true;
Then test. I think the key is that the font name has to be
the same as it would display in the flash font menu. For example,
when I use the font Gotham Book, I have to specify the assignment
string as "Gotham-Book" because that is how flash names the font.
Good luck!

Unicode mixup in fonts

Similar Messages

Maybe you are looking for