Content Conversion - Special Characters
How content conversion behaves with special characters?
Do we need to avoid any text in the input string that needs to be converted?
Thanks
How content conversion behaves with special characters?
Do we need to avoid any text in the input string that needs to be converted?
>>>
There is no link between the content conversion and special characters directly. The dependency is actually on the encoding standard used. You can set your encoding standard in the file adapter.
Option:
File Type
Specify the document data type.
1. Binary
2. Text
Under File Encoding, specify a code page.
For encoding standard ref. the post by another SDNer in this thread itself.
Similar Messages
-
Using XML with special characters - not rendering
Hello,
I am using xml to populate the content of a Flash file, but
we have localized content for different global regions. So, when
the content contains special characters like "é" they do not
show up at all in the flash. I tried using é but that
just renders the actual code...
Is there a workaround for this?
ThanksHi Rothrock, thanks for your reply...
Flash Version: 8, but the swf was published to be 7+
compatible.
The font is Meta Normal, it is embedded, and it does include
the character.
I am retrieving the xml by using this script in the html
page:
<script type="text/javascript">
// <![CDATA[
var fo = new FlashObject("/templates/flash/index.swf" +
cKiller, "ad-flash", "710", "351", "7", "#FFFFFF");
fo.addVariable("xmlURL", "/flash_content/products.xml");
fo.write("ad");
// ]]>
</script>
I am creating the XML using Macromedia Homesite, with the
encoding declaration <?xml version="1.0" encoding="UTF-8" ?>
The XML is being read fine, only the special characters don't
show up... so it will cut off the word, or just have an empty space
where the character should be.
I am not sure how to specifiy Extended Latin charset in the
document... could you tell me how to do that?
Thanks -
File XML Content Conversion: Problem with special characters
Hello,
in a file sender cc content conversion is used to transform a flat structure to XML. What we experiencecd is that the message mapping failed due to a character that was not allowed in XML:
I was assuming that the file content conversion just creates XML messages with allowed characters. Is there any way to configure content conversion to remove control characters which are not allowed in XML? Unfortunately the sender system cannot be modified.
Thank you.Hi Florian,
Please use this UDF to remove special characters which prevent XML messages to form properly.
public static String removeSpecialChar(String s)
try
s=s.replaceAll("&","& amp ;");
s=s.replaceAll("<" , " & lt ;");
s=s.replaceAll(">", "& gt ;");
s=s.replaceAll("'", "& apos ;");
s=s.replaceAll("\"", "& quot ;");
catch(Exception e)
e.printStackTrace();
return s;
Please remove spaces between characters within double quotes. I have added them because otherwise you can't see this code properly. Please check this below link , please replace the characters with proper values as the display is causing a problem here
http://support.microsoft.com/kb/316063
regards
Anupam
Edited by: anupamsap on Jul 7, 2011 4:22 PM
Edited by: anupamsap on Jul 7, 2011 4:23 PM -
File Content Conversion (receiver) and special characters
Hi all,
I have a scenario that has a file receiver channel with content conversion. The record structure in the flat file is field-width delimited (hence no field separator) and the parameter 'fieldLengthTooShortHandling' has the value 'Cut' because the receiving system needs only specific widths for the fields. Hence if the field value exceeds the length permitted, the extra characters are clipped.
I observed that some characters are not handled properly while creating the text file. For example, one of the fields contained a "minus" character (not the hyphen). The flat file was created successfully. I opened the file in notepad and found that the "minus" character has appeared correctly and the column count in that record was as expected. However when the same file was opened in Textpad, the minus character was displayed as â | | ('a' with caret, bar, bar) So, all the fields after this field were shifted ahead by 2 characters and hence the total column count of the record had gone beyond the actual one.
All this started due to the error reported by the receiver system which processes the flat file. Due to shift of characters in the flat file, the processing failed. Moreover that system cannot process the special characters (like minus or non-Latin accented characters etc.) So although there is no issue in XI interface as such, I just want to know if anyone has more informtion on why the characters are displayed differently as mentioned above.
Regards,
ShankarDefine data type like
order_recordset
order_row 1..unbound
f1
f2
All are same except communication channel configuration,
Message Protcol : File content select, then below you got additional parameters.
there you fill
Document name : Your sender message type.
Document namespace : Give your scenario namespace
Recordset name : order_recordset ( mentioned in the data type)
Recordset structure : order_row, *
Name Value
order_recordset.fieldSeparator : 'nl'
order_row.fieldSeparator : ,
order_row.endSeparator : 'nl'
based on your text file you fill the above parameter values. -
German Special Characters in XSTRING to STRING conversion
Hi Experts,
I have a CSV file (created from a Windows Excel file) with German Special Characters (e.g. 'ä', 'Ä') and I am trying to read this into ABAP internal tables. By using the THTMLB tag 'thtmlb:fileUpload' I get an XSTRING and I am trying to convert this into STRING. However, wheny trying to do this I get an exception 'CX_SY_CONVERSION_CODEPAGE'.
This is my coding:
data: conv type ref to cl_abap_conv_in_ce.
conv = cl_abap_conv_in_ce=>create( input = lr_upload->file_content ).
conv->read( importing data = lv_content ).
Note: lr_upload is my XSTRING object from the file upload, lv_content is a STRING.
In the CSV file the German special characters look fine and the SAP system is a Unicode system, but it seems like there are some problems with the conversions somehow. Any ideas from the experts?
Thanks a lot and Regards,
JensAs you mention a csv file I'm wondering if your encoding is wrong: I.e. when you create your instance of cl_abap_conv_in_ce you don't specify the encoding of your source hex string, so that means the default encoding is used, which should be UTF-8 in your case. So if your csv file is not encoded in UTF-8, specify the correct encoding in the create method and see if that helps.
Depending on how you get the file contents you might actually be able to combine the file retrieval with the conversion in one step. E.g. if the file is read from the application server you could specify the used code page via [open dataset ... in legacy text mode ... code page|http://help.sap.com/abapdocu_70/en/ABAPOPEN_DATASET_MODE.htm#&ABAP_ALTERNATIVE_4@4@]. Similarly method gui_upload of class cl_gui_frontend_services also allows you to specify a code page.
If all of this doesn't help, post some further details on your file (e.g. sample content & encoding) and possibly add some further details from the exception you're getting. As you mention a Unicode system it basically means that we should be able to convert all characters without any problem as long as we specify the correct source code page.
Cheers, harald -
hi,
i am having a requirement to create/use "add link to a document" content type for a item in the document library.
so i got the code from below site :
http://howtosharepoint.blogspot.in/2010/05/programmatically-add-link-to-document.html
my issue is, if teh document library names are single words - like MOM, model, procedures etc this functionality is working fine and i am able to view the link to a document as an item.
but when the doc lib name contains special characters like , or / , this link to a document content type functionality is NOT working.
can anyone pls point me whether this is the actual issue ? ie, if the doc lib name contains special chars like , or / my
add link to a document wont work? is there any restrictions/limitations for doc lib names in SharePoint ?
for eg: my doc lib names are :
1) Report and analysis, Data
2) form / template
3) map/ plot
help is highly appreciated!hi,
its talking abt the subsite names and folders and NOT the document librraies.
is there any link which gives the naming convention / restricted names for document libs or splists , from msdn / blogs.technet.
thnx -
File content conversion only 100 characters read from source..
Hi,
In my case I have a sender channel with file content conversion set as follows;
Recordset structure : Record, 1
sequence: ascending
Key field type : String (case sensitive)
record.fieldseparator : 'nl'
record.fieldnames : Data
ignorerecordsetname: true
Idea is in ECC, when a custom program is run, it reads the shipment data and builds an xml file with data in various nodes like;
<shipmentId>6767667</shipmentId>
<DelvText>hjysks sag fhdososlhfiof </DelvText>
Now all this data is converted to a single string entry under tag called <Data> and passed on to the third party system by PI using above conversion.
And the resulting file will have all the data like this;
- <Record>
<Data><?xml version="1.0" encoding="UTF-8"?></Data>
</Record>
- <Record>
<Data><ShipmentId>6767667</ShiomentId>.........</Data>
It so happens that the data that is populated in the <DelvText> by the program is lost during conversion. I get only first 100 characters in the resulting above mentioned XML after the file content conversion happens. rest of the string is lost. I can see all other data perfect except for this long text.
This is the data I enter in the delivery's header text under shipment instruction field. I debugged the program and see that the entire text is indeed filled but gets lost after the file conversion happens !!
What can be the reason ?
thnksStefan, I appreciate your concern, thanks. But this is an already working interface and I cannot change it and can only assist with minor data mapping changes and troubleshooting such issues.
Scenario is simple, ECC has to send shipment data to third party via PI.
The shipment data has to be sent as an XML file with a single <Data> tag as I showed to you earlier.
It is so weird that when I type my delivery text less than 100 characters I can see that in full text in my XML file but only when the text is more than 100 characters, the XML has only 100 characters and it is passed to the third party like that and so third party is consdering this as incomplete info.
Would help if you can think and let me kjow what may create this kind of an issue or if you can point me where to look for issues.
thnks -
DW CS3: Auto Conversion of Special Characters?
In DW 8 special characters entered or pasted into the text in
Design view, were automatically converted to & encoded values.
If you were typing ø, ø was inserted in the code.
This was very usefull when pasting large portions of non-English
text.
It seems that this feature has been disabled in DW CS3. Why?
How do I enable this feature again?BennyO wrote:
> It seems that this feature has been disabled in DW CS3.
Why? How do I enable
> this feature again?
The feature has not been disabled. The default encoding in
CS3 is UTF-8,
which supports accented characters without the need to
convert them to
HTML entities, such as ø. All modern browsers
support UTF-8, so
there should be no need to use HTML entities, unless you are
saving
content in a database that doesn't also support UTF-8 (MySQL
3.23 or
4.0, for example).
If you want to go back to using HTML entities, change the
default
encoding to Western European (iso-8859-1).
David Powers, Adobe Community Expert
Author, "Foundation PHP for Dreamweaver 8" (friends of ED)
Author, "PHP Solutions" (friends of ED)
http://foundationphp.com/ -
XML Parsing Base64 Content - Special Characters Umlaut etc
Hello!
I am currently parsing an XML file which has it's content encoded in Base64. My application parses the XML file (from a provider) and pass on the content to a GUI where the user can change the value of the nodes and store the same back in a new XML (which is then to be sent back to the provider). The Application uses only "UTF-8" . I am currently using the Base64 class provided at http://iharder.net/base64
The problem I have is that the special characters like �, � etc, are being depicted as (?) i.e. unreadable. Only when I control the decoding process i.e. String resoolt = new String (result.getBytes(), "UTF-8") do I get the correct content, and the same can be posted on the GUI.
The application produces an XML file (The application in question is a translation app), which when re-opened in the application for retranslation has the same problem... it is shown with teh special characters with (?).
After a lot of debugging I found that the XML produced by the application does not need the forcing of content into UTF-8 using the code above, it is read automatically correctly (with all the content correct), but due to the coding I have done... String resoolt = new String (result.getBytes(), "UTF-8") the nodes are decoded with the earlier problem umlauts et al missing.
Now I could use a test to differntiate between the two cases XML from the provider or the XML which is produced by my own app, and doesn"t work on the Provider and treat them differently, but I don't want this solution since the XML which my app produces is not accepted as input at the providers.
So my query.. what is the best way to go about it now... I am quite stymied >(
Thanks!
TimAmazingly enough some other user has the identical problem to yours and has expressed it in exactly the same words. Has the same name as you too.
http://forum.java.sun.com/thread.jspa?threadID=606929&tstart=0
(Cross-posting is frowned on here.) -
Special characters in XML barcode content
Hello,
I made a barcoded form with a custom script that creates a custom XML as barcode content.
The decoding happens well when the user write plain text in the text fields, but whenever it inputs some special characters (for XML syntax), like ",<,>,=,etc... the content of barcode it is decoded as:
<barcode>
<!CDATA[... true content ...]>
</barcode>
how can I handle this situation?
I have to handle what the user writes or I have to change the decode activity?
Thank you very much for your support!
FabioSteve,
I have already encoded decode operation in UTF-8. In form level, because it is an acrobat form, no option to choose the encoding as in LC Designer. In further tests, if I change the extractToXML output to XDP instead of XFDF, then I will receive data rather than &# sequence. It is strange. Don't understand why XDP and XFDF would give out different encoding.
Tim -
Hi all,
I have Frame documents, which contain anchored frames with callouts. The callouts are created with Frame and contain german special characters like ä,ö,ü. These characters are not converted correctly.
Thanks for help.
Regards,
Rainer -
JMS sender communication channel content conversion
Hi,
I struck with the content conversion in the JMS Sender communication channel.
I have configured the communication channel with the filed fixed lengths. (Simple type)
The field fixed lengths i have given are 10,2,3,11
The contents in the file 1000000072 230 111
but, in the input xml after conversion iam getting 100000007 in the first field and 2 in the second field 23 in the third field.
I have configured the sender communication channel as in the document in SDN.
Even, i configured several communication channels. I didn't get this strange error any time.
I have gone through SDN to fix this issue, but i didn't get solution.
If anyone got rectified this kind of error, please answer your solution to me
Thanking you,
Regards,
Krishnaraju.Hi,
Thanks for all your support. The issue got resolved.
The issue is due to the file, In the file the special characters are appearing. We are not able to see these characters in the notepad, wordpad, text editor.
But, these characters are appearing in th syn text editor. So, we removed those characters and processessed the file. Now, it is successfull.
Regards,
Krishnaraju. -
File content conversion using SOAP adapter
Hi,
I'm using a receiver SOAP adapter in my IDOC to file scenario and need to do file content conversion in the receiver side.
Are any standard modules available for file content conversion in the SOAP adapter or do I need to write custom EJB modules for this.
Please note that I have to use a SOAP adapter, can't use any other adapter.
Thanks in advance
ShiladityaHi,
XML Document Conversion Type
● Enter recordTypes as the parameter name.
Under Parameter Value, enter the complete, comma-separated list of all names of recordset types that occur in the document to be converted.
If you decide to use this method, you can define a different conversion type for each recordset type that occurs in the XML document.
For example, you could name the recordset types as follows: RecordType1,RecordType2,RecordType3.
● Enter singleRecordType as the parameter name.
Under Parameter Value, enter the name of a recordset type that is to be used to convert all elements that occur in the XML document.
If you decide to use this method, define the same conversion type for each recordset type that occurs in the XML document.
You must enter exactly one parameter only. Whichever parameter you choose, you automatically exclude the second parameter.
You define further parameters for each recordset type.
In the remainder of this documentation the parameters are specified by the prefix <RecordType>. In your configuration, replace this name with the name of the recordset type.
Conversion Type List with Separators
● <RecordType>.fieldSeparator
Enter the field separator that is written between the individual fields of a record.
This specification is mandatory.
Conversion Type List with Fixed Field Length
● <RecordType>.fieldLengths
Specify a character string that contains a list of fixed field lengths that are separated by commas and which determines the number and the length of fields generated in the text file.
For example, you want to write a recordset with three elements that have field widths of five, ten, and fifteen characters. Enter:
<RecordType>.fieldLengths = 5,10,15
This specification is mandatory.
● <RecordType>.fieldLengthExceeded
Specify how you want to handle fields that exceed the configured field length. Permitted values for the parameter value are:
○ error (default)
Interrupts processing of message with error
○ cut
Cuts off superfluous characters
○ ignore
Ignores the field length restriction
Further Entries
● <RecordType>.beginSeparator
Enter a string. The string is placed in front of the first field of a recordset.
● <RecordType>.endSeparator
Enter a string. The string is appended to the last field of a recordset as a concluding character. The default is \r\n.
● contentType
Enter the MIME type of the converted payload. The default value is text/plain.
● addHeaderLine
Only define this parameter if you have already defined singleRecordType.
Define whether a header line is to be added to the result of the conversion.
○ none (default)
Does not insert a header line
○ fromXML
The header line is generated from the element name of the first recordset of the XML document
○ fromConfiguration
The header line is determined by the configuration parameter headerLine.
● headerLine
Only define this parameter if you have already set addHeaderLine=fromConfiguration.
The value that you define is placed in front of the result of the conversion as a header line.
● fixedLineWidth
Enter the maximum line length n (in characters) that can be written to the resulting document. The separator specified by lineSeparator is inserted in the resulting document every n characters.
● lineSeparator
Only define this parameter if you have already defined fixedLineWidth.
Specify the string that is written to the resulting document at the end of each line that is written with fixedLineWidth. The default is \r\n.
Use of Special Characters
You can use special characters in the following parameters: <RecordType>.fieldSeparator, <RecordType>.beginSeparator, <RecordType>.endSeparator, headerLine, and lineSeparator.
● Tabulator: \t
● Carriage Return (CR): \r
● Line Feed (LF): \n
● Arbitrary character: \x<code>
<code>indicates the hexadecimal character code of the character to be displayed.
Regards,
Phani -
Encoding problem after File Content Conversion
Hi SAP gurus!
we're about exporting debitor data via PI into CSV files. Therefore we use a mapping to an intermediate structure. In the receiver file adapter a file content conversion is done into the target CSV format.
We have a lot of data with eastern europe characters. Right after the mapping, everything is fine. All characters are processed correctly. After the file content conversion, the files written on the target system contain "?" instead of the special characters.
Does anybody have any hint to fix this problem? We already tried to change the "file.encoding" parameter, but hasn't helped.
Thanks in advance for your support!
Cheers,
MatthiasHello Satish,
thanks for your reply.
First, I have to explain, that the sender side isn't done by file adapter but IDoc adapter. So I cannot change the encoding on sender side.
Both on IDoc and file side, the data is ok. Only when inserting the file content converion, the files become corrupted.
Without using the FCC, tjhe target files are stored as UTF-8. When using FCC the files are stored as ANSI. (I tested this by opening the files in notepad and performing "Save As")
Do you have further ideas?
Cheers,
Matthias -
Special characters through gateway !
Hi,
I've a portlet. In Edit->preferences, I've a textarea where user can enter <HTML> content. If user enters " " for a extra space and hit finish, it is replaced by junk character like "__" . Response.Type="text/html".
I'm using GDK.Hi Harmony,
You dont have to worry about the conversion you can directly import the data through Import Manager.
I assume that your source is excel and will let you know the import step for this
1) Open the Import Manager
2) Select the Source, Source can be anything like Excel/Delimited Text or Fixed Text ( If it is text delimited than please specify the delimiter as well)
3) if source is in Excel then just import it and then map the fields ( Please change the data type of that particular column to Text in your excel so that excel does not change any data value automatically)
4) Once the mapping is done please import the data and check it would have special characters as well.
Note : Filed size at source as well as destination should match or destination should have more size so that it does not truncate the data value.
Let me know if it does not works
Thanks and Regards
Praful
Maybe you are looking for
-
Supply function in webdynpro for abap
Hi , I have tree structure as below. 1. Node A 1.a Node B 1.a.i Node C I have declared method 'Method_A' as supply function for Node A.similarly I have declared method 'Method_B'
-
How to move iWeb site with missing Domain.sites file
I've been asked to host a friend's iWeb site now that MobileMe is no longer an option. The problem is that the MacBook it was created with is long gone and the only original files remaining are the image files for the site. No Domain.sites file. Th
-
How can i use the visual j++ with the sun jdk or sumting more update than
what the j++ have
-
Why are my pictures blurry?
All of the pictures, and most of my videos, are blurry. Any suggestions? Do I need to change a setting somewhere?
-
New Mac Pro, EFI 1.5 update is not being applied, repeated reboots
I just unpacked my new Mac Pro (64 bit) and ran through the updates. It's stuck on EFI Update 1.5. It appears to apply, the system reboots a couple of times, but Software Update still says it's available and needs to be applied. Can someone help me f