Unicode : Chinese

Hi ALL ,
Recently we moved to Unicode , and we are facing problem with an interface program for citybank
citybank -cityDirect specification is based on the field position in the flat file,it identifies fields from the field position.
File is downloaded to flat file with fields in the exact position , as it is specified in the internal table/ structure field length declaration .
<b>The issue .</b>
In Unicode system, the format of the file downloaded is disturbed because of Chinese characters in the file .
This is because Unicode system considers the length of a Chinese character as 1, even though it occupy 2 spaces/places compared to English ( in the flat file /Notepad ).
Ex:
ab ab ab ab
海 齐 尔 算 May be chinese is big and it is of 2 bytes where as english is 1 .
So when the user download the file in ANSI, the field length of field NAME1 ( which hold Chinese characters ) in the text file is increasing , and the entire file format is getting disturbed .
I know, I can count the bytes ,find out Chinese chr in the string , adjust the field length dynamically . But this does not seem to be standard solution.
Did anybody face this problem before?
Thanks for any reply ,

Hi,
I don't understand fully: If you download using unicode characters then all characters regardless of chinese or not should occupy 2 bytes. How do you change encoding within the record?
It won't be possible to convert to latin without losing information.
Regards,
Clemens

Similar Messages

Unicode Chinese Chars to GB2312 encoded chinese chars

Hi All,
In SAP how to covert the Unicode chinese characters to GB2312 encoded chinese characters, Can any one help on this.
Regards,
Prakash

Hi All,
My requirement is ECC 6.0 system is unicode chinese character system. So in this If I run a payment, it should be downloaded as File in GB2312 chinese charater format.
I know how to generate payment. So please provide help to download in the required format.
Hoping for good reply.
Regards,
Prakash

Export to flat file with unicode (chinese) characters??

I have an SSIS (2013) package that needs to send an email notification with query results (via attachment). I have a data flow task with a source sql query that gathers 2 columns - ID and NAME. ID is varchar, NAME is nvarchar (some records have Chinese symbols).
The destination is a .txt file. When I copy/paste a field w/ Chinese symbols to a .txt file, it shows up fine, so i know Notepad can handle the characters. I also have the .txt file set to Unicode encoding (I also tried ANSI originally). When I run the package,
it says that it successfully moves 50 fields to the flat file. However, when I open the flat file, I see that it shows 10 records. It stops when it gets to the record with a Chinese symbol in it...but doesn't produce an error. My plan was to then take the
attachment and use it in a Send Mail task. (i have the smtp/mail notification working fine...just need to figure out how to get the data to all export to the flat file correctly)
Does anyone know how I can get the ID and NAME fields from a query into an email notification (either as an attachment, or even formatted nicely (with tabs) in an email would work).

Hi,
Based on my test, I can reproduce the similar issue in my environment. When we create the Flat File Connection Manager with the default settings, the data in flat file stops when goes to the Chinese characters.
To fix the issue that makes the Chinese characters to actually get written into the flat file, we should check the Unicode checkbox on the right hand side of Locale property in Flat File Connection Manager. In this way, the flat file can display Chinese
characters.
The following screenshot is for your reference:
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Java, International language, Unicode, Chinese or accented characters

Hi, I've posted a message in the new to forum but think that this is more of an advanced problem.
Sorry for duplication.
I am having trouble getting java to output Strings that contain unicode characters out of the normal ascii set. This includes accented letters and chinese characters.
Example code:
String jintian = "??"
System.out.println(jintian) ;(The string jintian should refer to two chinese characters. I'm having trouble getting these to appear properly here, you may see ??.)
Basically if I run this code the output I get is ??. Questionmarks in place of the chinese characters.
There is either a problem here with Java or with my Shell but I don't know how to troubleshoot this.
I can tell you that my shell is able to display chinese characters, but with the ls command I have to use a flag. -v. I have tried using this -v flag with the java command but it is rejected.
One more thing, when compiling I am using the -encoding=UTF-8 flag.
I have the line ...
export LANG=en_UK.UTF-8... in my bash profile.
Any ideas, I would be really grateful.
Message was edited by:
stanton_ian
Message was edited by:
stanton_ian
In case anyone is interested in trying this themselves and doesn't know how to put in the Chinese characters here is a link to a pre-written very simple Class. http://freespace.virgin.net/i.stanton/NiHao.html .
You will need to save the file in utf8 encoding and compile it with the -encoding UTF-8 flag.

Between jdk1.2 and jdk 1.3 the default encoding of the vm changed.
You can get it by executing:
System.out.println("Default Encoding:" + System.getProperty("file.encoding"));
or
System.out.println("Default Encoding:" + (new java.io.InputStreamReader(System.in)).getEncoding());
The default encoding is used during the conversion of bytes to strings and vice verca.
Assume your default encoding is ISO8859_1. Then calling new String(byte[]) is equivalent to calling
new String(byte[], "ISO8859_1")
Now if you are converting a character from one encoding scheme to another and there is no mapping
for this character in the target scheme. Then the character will be replaced by a default character
which is (quite often) the question mark.
You can set the default encoding for a vm by passing it as a command line parameter
java -Dfile.encoding=ISO8859_1
java -Dfile.encoding=Cp1252

Unicode (Chinese) As Input In Global_AddressCleanse Transformation

Hi All,
Is it possible to use Unicode fields as input () for Global Address Transformation.
I am using Data Service 3.0.
If I use unicode fields as data input , Data Services does not perform any cleaning , infact it does give the output fields itself.
Thanks,
Amit

alexhunt wrote:
Hi all,
I can not figure out what is causing it to sometimes save as Unicode and sometimes as ANSI. Please let me know if there is anything further I can provide.
Hi, alex,
The file seems to be saved correctly and its not saved as Unicode. The file opened as Unicode.
Do simple experiment:
1. Start Notepad:
2. Type 'AAAA BBB CCC DDDDD':
3. Save it. As you can see in hex viewer, my file is correct:
4. Now open this file in notepad, you will be surprised:
This is true for XP, not sure how it works with Windows 7.
Try to open your file in that way:
Andrey.

Pc suite 7.0.8.2 no new messages after unicode SMS...

I was using 7.0.8.2 on XP quite happily until a strange problem appeared. after receiving a multipart unicode SMS on my 6300, pc suite was no longer aware of any new messages - i.e. when I look at the "inbox", it had every message up to the unicode (chinese) message, but nothing newer than that. that makes the program no longer useful for me. I did not have this problem with any of the previous versions of pc suite. (I am a long-time user).
has anyone else had this problem?

You can try to move that unicode SMS to SIM card.
What's the law of the jungle?

Language Conversion from Unicode 8 to Character Set

Hi,
I am creating a file programmatically containing Vendor Master data (FTP interface).
The vendor name and vendor address is maintained in the local language (Taiwanese) in SAP System, these characters are in Unicode 8 character set.
The Unicode character set should be converted to BIG5 for Taiwanese, and then send this information in the file.
How can I perform this conversion and change the character set of the values I'm retrieving from table (LFA1) to character set BIG5.
Is is possible to does this conversion in SAP, does sap allows this?
/Mike

Hi Manik,
I am also having a similar requirement, as I need to convert the unicode chinese character to GB2312 encoded chinese character,. I already posted in forums but didnt get the required the solution.
Can you please provide the solution which you implemented and also confirm whether it can be used to solve the above problem.
Hoping for your good reply.
Regards,
Prakash

BLOB unicode file name problem

Hi,
I am trying to upload pdf file into SecureLOB column, I am getting error when I try to upload file name/directory with unicode char, for other files/directory it works fine.
w_src_loc := bfilename('LDIR', in_file_name);
dbms_lob.open(w_src_loc, dbms_lob.lob_readonly);
dbms_lob.open gives file not found error in oracle 11g,
Can any one guide me what may be the problem?
DB's character set:
NLS_CHARACTERSET
AL32UTF8
NLS_NCHAR_CHARACTERSET
AL16UTF16
P.S. Oracle is running in Windows and unicode (chinese) enabled OS.
-Raj

> I am getting error when I try to upload file name/directory with unicode char,
ERROR? What Error?
I do not see any error.
my car won't go
tell me how to make my car go.
How do I ask a question on the forums?
https://forums.oracle.com/message/9362002#9362002

Chinese Character cannot be decoded

hi,
I would like to implement two JSP pages. The first JSP is just a html form, which is used to submit unicoded chinese data to a target JSP file.
The target JSP file received those data and display.
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> is added in the first JSP file. As a result, data will be submitted in UTF-8 format.
In target JSP, I used the following code to recieve and decode data:
<%@ page contentType="text/html; charset=UTF-8" %>
<%
String para = request.getParameter("para"); // where para is name of received parameter
byte[] bytes = para.getBytes();
para = new String(bytes, "UTF-8");
out.println("Recieved character: " + para);
%>
My Problem:
After I submitted chinese characters from the first JSP file, only some of them can be displayed on target JSP. Some of those characters are missing.
For example, when I input "�@", target JSP can display the character. On the other hand, when I input "�p", nothing is displayed. But I know that variable "bytes" stored 3 bytes for each chinese character. I would like ask why
para = new String(bytes, "UTF-8");
cannot encode properly. Is anything wrong about my coding?
Thx

More information can be provided.
OS: Windows 2000 server
web server: iPlanet
P.S. : I have set the Character set to UTF-8 in iPlanet.
thx.
hi,
I would like to implement two JSP pages. The
The first JSP is just a html form, which is used to
submit unicoded chinese data to a target JSP file.
The target JSP file received those data and
and display.
<meta http-equiv="Content-Type"
ype" content="text/html; charset=UTF-8"> is added in
the first JSP file. As a result, data will be
submitted in UTF-8 format.
In target JSP, I used the following code to
to recieve and decode data:
<%@ page contentType="text/html; charset=UTF-8"
F-8" %>
<%
String para = request.getParameter("para"); //
// where para is name of received parameter
byte[] bytes = para.getBytes();
para = new String(bytes, "UTF-8");
out.println("Recieved character: " + para);
%>
My Problem:
After I submitted chinese characters from the
m the first JSP file, only some of them can be
displayed on target JSP. Some of those characters are
missing.
For example, when I input "�@", target JSP can
P can display the character. On the other hand, when I
input "�p", nothing is displayed. But I know that
variable "bytes" stored 3 bytes for each chinese
character. I would like ask why
para = new String(bytes, "UTF-8");
cannot encode properly. Is anything wrong about my
coding?
Thx

Payment in GB2312 chinese characters

Hi All,
My requirement is ECC 6.0 system is unicode chinese character system. So in this If I run a payment, it should be downloaded as File in GB2312 chinese charater format.
I know how to generate payment. So please provide help to download in the required format.
Hoping for good reply.
Regards,
Prakash

Hi Prakash,
The answer I gave you is valid for PME formats, for the "classical" (old) programs I do not know where the settings can be.
Please, check the OSS note 628299, in fact there are few relevant notes for your issue.
Thanks,
Paulo
Edited by: Paulo Vitoriano on Aug 5, 2009 12:20 PM

Displaying Chinese Characters in a JLabel

I wish to display Chinese characters in a JLabel WITHOUT setting the JLabel's font. The following code works fine under Java 1.4.x for Mac OSX, and Java 1.5 for Windows. However, the characters do NOT display properly under Java 1.4.x for Windows. Does anyone have any idea why? I really need to get this to work under 1.4.x for Windows without having to call JLabel.setFont(...). Maybe it's a known bug in 1.4.x that has a workaround (hopefully)?
        javax.swing.JFrame frame = new javax.swing.JFrame("Chinese Test");
        JLabel label = new javax.swing.JLabel("\u54C8\u7F57", javax.swing.JLabel.CENTER);
        frame.getContentPane().add(label, java.awt.BorderLayout.CENTER);
        frame.getContentPane().setSize(200, 200);
        frame.setLocation(50, 50);
        frame.setSize(200, 200);
        frame.setVisible(true);

1. I do not wish to set the Font on the label(s) because we have localized our application in many languages using a custom localization scheme and I do not want to change all of the code.
2. Yes, I have all the forms of Chinese installed on my Windows system.
3. I found that if I use an HTML string of the form: <html><body><font face="SimSun">\unicode chinese chars...
then THAT WORKS. The JLabel renders the String in Chinese. This might be a good option for us.
4. All of it works automatically without the need for an HTML String under Java 1.5 because evidently 1.5 has built-in support for setting the proper font on the widget after analyzing the unicode characters.
- Eric

XmlLite with unicode content

Hello,
I am writing a little example of XML with some Unicode (Chinese text) in it. If I write to a file it works fine:
<?xml version="1.0" encoding="UTF-8"?><message>世界您好</message>
If I read from memory I get this:
㼼浸⁬敶獲潩㵮ㄢ〮•湥潣楤杮∽呕ⵆ∸㸿洼獥慳敧隸闧ꢂꗥ㲽洯獥慳敧
Here is my simple code:
CComPtr<IStream> stream;
std::shared_ptr<IXmlWriter> writer;
COM_VERIFY(CreateStreamOnHGlobal(nullptr, false, (LPSTREAM*)&stream), L"CreateStream");
COM_VERIFY(CreateXmlWriter(__uuidof(IXmlWriter), (void**)&writer, nullptr), L"CreateXmlWriter");
COM_VERIFY(writer->SetOutput(stream), L"SetOutput");
COM_VERIFY(writer->WriteStartDocument(XmlStandalone_Omit), L"StartDocument");
COM_VERIFY(writer->WriteStartElement(0, L"message", 0), L"StartMessage");
COM_VERIFY(writer->WriteString(originalText.c_str()), L"OriginalText");
COM_VERIFY(writer->WriteEndElement(), L"EndMessage");
COM_VERIFY(writer->WriteEndDocument(), L"EndDocument");
COM_VERIFY(writer->Flush(), L"FlushWriter");
STATSTG ssStreamData = { 0 };
COM_VERIFY(stream->Stat(&ssStreamData, STATFLAG_NONAME), L"GetSize");
SIZE_T cbSize = ssStreamData.cbSize.LowPart;
LPWSTR pwszContent = (WCHAR*) new(std::nothrow) BYTE[cbSize + sizeof(WCHAR)];
LARGE_INTEGER position;
position.QuadPart = 0;
COM_VERIFY(stream->Seek(position, STREAM_SEEK_SET, nullptr), L"SeekPosition");
SIZE_T cbRead;
COM_VERIFY(stream->Read(pwszContent, cbSize, &cbRead), L"Read");
pwszContent[cbSize / sizeof(WCHAR)] = L'\0';
What am I missing?
Thanks,
Pedro

Since the default output encoding is UTF-8, you cannot reinterpret the data as Unicode using the
pwszContent pointer. For debugging purposes you can cast it:
    LPCSTR p = (LPCSTR)pwszContent;
Then you will see a more valid content in Visual Studio, excepting the non-Latin letters.
In fact, the buffer (pwszContent) should be declared as
LPSTR instead of LPWSTR, since it is UTF-8.
In order to cast to Unicode:
    WCHAR ws[1000];
    MultiByteToWideChar( CP_UTF8, 0, p, -1, ws, 1000 );
Then you can assign it to wstring. To work with any length, see
MultiByteToWideChar.
In order to change the output encoding, consider the features related to
IXmlWriterOutput.

Flat file destination error

hi
i am adding new field to my existing package which is char(10).
getting this error:
[Flat File Destination [139]] Error: Data conversion failed. The data conversion for column "MEMBER_ID" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".
i right click flat file destination->i only see external and input column over there,
there is no output column.
in flat file connection mamanger ->outputcolumn->its char(10)
what needs to be change here?

Hi coool_sweet,
According to your description, you are trying to add a new source column to a flat file in an existing package.
Based on the error message, the issue should be caused by text was truncated when load new column to column "Column1" in Flat File Destination. Because the length of new column data should be more than 10 (with some junk values) in the Source,
while you are trying to convert the column to 10 as the character length.
To fix this issue, we can increase the length of column "Column1" in Flat File Connection Manager. Alternatively, if you still want to convert the new column to a column with length 10, we can right-click the Source component to select “Show Advanced
Editor”, then go to tab 'input and output properties' to expand the output column corresponds to the column "Column1", change TrancationRowDiposition property to RD_IgnoreFailure.
Besides, the issue can also be caused by using some special characters in the new column. We can check the Unicode checkbox on the right hand side of Locale property in Flat File Connection Manager to fix this issue. For more details, please see the following
thread:
https://social.msdn.microsoft.com/Forums/sqlserver/en-US/d3605656-4a13-47b6-b96e-45379e2b2a9f/export-to-flat-file-with-unicode-chinese-characters?forum=sqlintegrationservices
If there are any other questions, please feel free to ask.
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Is there a way to resize graphics to uniform dimensions?

I have multiple graphics in a FrameMaker 7 document. I’m using Illustrator CS3 to enhance them (adding text, arrows). The problem is, the size they are in Illustrator is not the size they end up as in the document. I save them as .ai files and export them to .jpg files, then import them by reference into the document. Some I have to scale down, some are good as they are. What’s the quickest way to get them all to a uniform size to each other in AI and in FrameMaker? Thanks for any suggestions.

I am under the impression that FrameMaker simply pushes the eps file through to the printer when creating the PDF or printing.
That could easily be the case, except for ...
If FrameMaker needs to send a non-embedded font to the printer, then it simply has to find the font and send it.
That's somewhat inconsistent with just pass it through.
If it is not on the system, I doubt FrameMaker does anything to the eps file before it sends it; any garbling in the output is likely due to the printer/Distiller not having access to the font required by the eps.
This could easily be true. In my test, Frame (7.1 Unix) didn't complain when opening the .fm that contained an .eps that included Arial Unicode Chinese characters. It displayed the thumbnail, with the glyphs apparently present. It generated a .ps file without complaint. Curiously, I distilled that .ps to .pdf on the same PC that created the EPS. That PC has that font. The glyphs were garbled in the PDF. Hmmm.
This scenario is our workflow, by the way, and not just a test scenario. We author on FM7.1/Unix, but edit and create graphical objects on Win64 PCs (which product objects are usually EPS, often with text, possibly Unicode). We Distill on the PCs. Today's test confirmed why I have a rule of: either embed the fonts, or convert text to outlines. If you convert text to outlines, of course, the EPS is no longer "text" when re-opened in AI.
Others have explained on this forum that Illustrator can (if you tell it to) save the AI-dependent information in the eps file. So, the eps file has the same information as is in the AI file.
As a recent member, I haven't seen that. Thanks. I suspect the same is true for PDFs saved from AI, but there's still the convert-to-outlines issue.
Possibly one could copy all the text to a new layer. Outline in the new layer. Hide the real text layers. Save as EPS. Now you'd have a portable print object with full original edit capability (and a few tens of kB more metadata that needs to be redacted from the final PDF for the sake of size).
It's easier to simply retain the .ai master.
We do the same for PSD, where the product is also an EPS, and has to be flattened for save as EPS.

New Language - How to Install?

Dear Nokia
Re: Nokia X3 Touch and Type
Hi. i have a Nokia X3 Touch and Type which was purchased in the UK. It does not support unicode Chinese -Simplified &
Traditional Languages.
May i know if Nokia Support Centre can help to install the Chinese languages into my phone so i can receive and write SMS in Chinese?
Thank you!
Regards
chin yit

Nokia,
Although my old Nokia can not use tradition chinese to edit SMS, it can display SMS chniese msg or list my phone name in tradition chinese. Recently I get X3-2 which is totally no function to display chinese charcter. Even I went to upgrade new version of X3-2 Nokia V.6.0. I need to contact person all over the world. you only support limited language. It is only a simple function. No wander your market share go down.

Unicode : Chinese

Similar Messages

Maybe you are looking for