Flat file transformation to xml with encoding in iso-8859-1

We have a BPEL process that picks up a flat fle (fixed length), transforms it to xml and emails it. The flat file is in iso-8859-1 (when I look at special characters like e-accent's in hex).
The basic transformation that you get from (the wizards) of BPEL don't do the trick, the special characters are corrupted and unreadable.
After that I changed all the encoding's (in xsd's and xsl's) from utf-8 into iso-8859-1 but doesn't help either. I also added an xsl:output section to my xsl (with "encoding="iso-8859-1") but that also fails...
Does anyone have a clue? We're using SOA Suite 10.1.3.1.
greetings,
Jan

just tried that but the problem is still there
I suspect that the output of the file adapter (reading the flat file) is already corrupted, you should be able to tell the file adapter what encoding the input file is...

Similar Messages

Debatch Flat File in to XML

Hi,
First I Created a Flat file in below format having 3 records. When I Validate Flat File Schema , I can see the XML single xml file generating with 3 records.
Shakeer,Newyork,US
Hussain,Chicago,US
Shahid,Newyork,US
Later my goal is to split each record and generate each record as a single XML file. I did modifications in my Flat File Schema. After validating Schema it generates a
single record XML file. Up to now its cool.
Now I want to apply my modified schema in Existing Application
in BizTalk console. How to do it?
When I drop my Flat file in Receive location the I can see my XML file in send location not as a single record XML file but as
all records in one single file.
Please help how to resolve it?
PS.Shakeer Hussain

Hi Syed,
Do the following simple steps for your requirement:
Set “Allow Message Breakup At Infix Root” to “Yes” by selecting “Schema”
Set “Max Occurs” to 1 by selecting the Record where you want to split.
Create a Receive pipeline with "Flat File Disassembler" in the Disassemble stage.
Deploy the above artifacts; Flat File Schema, Receive pipeline with Flat File Disassembler component.
Configure the Receive port with Receive pipeline and send port with filter for Receive port (BTS.ReceviePortName) or after debatching do whatever you want to do..
Obviously you have other ways like calling the Receivepipeline in orchestration if you have many message/records to be debatched and reduce the number of footprints in message-box db. But start
with the above steps and move on to other advanced solution based on your need.
You can follow the reference here..
How to Debatch (Split) a Flat File using Flat File Schema ?
Another reference from our friend Mahesh-
Debatching(Splitting) XML Message - BizTalk 2010
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

UTF-8 encoding vs ISO 8859-1 encoding

The iTunes tech specs call for UTF-8 encoding of the XML feed file; a friend of mine uses feed generator software through his blog that uses ISO 8859 encoding. Is there a way to convert the latter to UTF-8 so that iTunes tags may be successfully added?
When I tried editing his XML file, I got error messages when I submitted the file to RSS feed validator sites (such as http://feedvalidator.org/. Any help or knowledge is appreciated because I am not the least bit expert in this coding arena.

You don't need to convert iso 8859-1 (us-ascii) to utf-8 unless you have nonstandard characters. Basically, ascii is a subset of utf-8 and for English it will serve you just fine. You can have iTunes tags in the xml file even if the file itself is encoded in iso 8859-1.
The error you see at feedvalidator.org is most likely a warning.
Hope this helps!
- Andy Kim
Potion Factory
http://www.potionfactory.com

Transform the xml with ' and "

HI,
i am converting from one xml to anther xml using XSLT, in my output xml file ' values are replacing with ' symbols. i want ' values in my output xml file.
my input xml file is
<?xml version="1.0" encoding="UTF-8"?>
<ARTICLE>
<TITLE>A Sample Article123456'123456'</TITLE></ARTICLE>
my xslt file is
<?xml version="1.0" encoding="ISO-8859-1"?>
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="2.0">
<xsl:output method="xml"/>
<xsl:template match="/">
<Message>
<xsl:apply-templates/>
</Message>
</xsl:template>
<xsl:template match="/ARTICLE/TITLE">
<Sample><xsl:value-of select="/ARTICLE/TITLE" />
</Sample>
</xsl:template>
</xsl:stylesheet>
my java source code
public class MessageGeneration
public static void main(String []a)throws Exception
Reader xmlSourceReader;
Writer xmlResultWriter;
xmlSourceReader = new InputStreamReader(new FileInputStream(
"src/xml/message.xml"), "UTF-8");
xmlResultWriter = new OutputStreamWriter(new FileOutputStream(
"src/xml/outMessage.xml"), "UTF-8");
TransformerFactory tranFactory = TransformerFactory.newInstance();
Transformer transformer = tranFactory.newTransformer(source);
StreamSource xmlSource1 = new StreamSource(xmlSourceReader);
StreamResult xmlResult1 = new StreamResult(xmlResultWriter);
transformer.transform(xmlSource1, xmlResult1);
how can i get ' symbols in my out file.
Thanks
Dattu

It isn't necessary to escape the apostrophes and quotes in the example you showed, although it isn't wrong to escape them either. Both are well-formed XML and they are equivalent. So that means you don't need to ask for them to be escaped, and therefore the XML philosophy implies you aren't allowed to ask for them to be escaped. Is there a particular reason you have to have them escaped?

Converting Idoc flat file representation to XML

Hi ,
I went through the guide for How To Convert Between IDoc and XML in XI 3.0. I'm concerned with the second part of the guide which says convert from falt file representation of Idoc to XML. Can anyone tell me what are the other design and configuration objects to be created for this scenario ( message types,interfaces, mapping , etc )
Also which step of the pipeline does the converted XML goes to ?
The program also expects a filename, what if I want to pass the file name dynamically ? Any ideas on this one.
Hope someone replies this time.........:)
Thanks for you help and improving my knowledge
Thanks
Advait Gode.

Hi Advait,
Let me give you a small overview on how inbound IDOCs work before answering your question-
The control record is the key in identifying the routing of the IDOC. If you try to think IDOCs as normal mails(post), the control record is the envolope. It contains information like who the sender is and who the receiver should be and what the envelope contains (no different than receiving mails/letters by post).
Then the data records contain the actual data, in our example would be the actual letter. The status records contain the tracking information.
Traditionally SAP's IDOC interface (even before XI comes in picture) has utility programs to post incoming IDOCs in to SAP. One such program is RSEINB00 which basically takes the IDOC file name and the port as input. This program opens the file and posts the contents to the SAP IDOC interface (which is a set of function modules) via the port. The idea is to read the control record and determine the routing and further posting to application. Note that one information in the control record is the message type/idoc type which decides how the data records need to be parsed.
Now in XI scenario, what happens if we receive data as flat file? Normally, we use flat file adapter and in the file adapter we provide information on how to parse the file. But, if the incoming file is flat and in IDOC structure, why do we have to configure the file adapter, when the parsing capability is already available using RSEINB00/Standard IDOC interface.
This the reason, the guide suggests you to use RSEINB00. Now, your concern is what if you need to provide a dynamic filename. My idea is to write a wrapper program. This would be an ABAP program in your integration engine. This program will determine the file name (based on a logic which should be known to you) and then call program RSEINB00 using a SUBMIT/RETURN. You would then schedule this ABAP program in background to run in fixed schedules.
There are other ways of handling your scenario as well but from limited information from your request, I will stop with this now. Post me if you have any more queries.
KK

SQL (Injection) Vs Flat File TXT Vs XML (XPath Injection) For Database.

I will have to deal with robust login sessions so I need some advice on what type of database and language I will use.
PHP and MySQL is the choice but I hear that flat file TXT are more faster so I am thinking about Perl.
Perl is very flexiple and have many advantages but why do many folks use PHP.
SQL and XPath injection are becoming more frequent plus MD5 and SH512 have been cracked by some angry folks.
The Perl community is becoming very small so it will be difficult to receive support if I have a specific problem.

In our projects we are extracting SMS messages and
based on the
MISDN (Telephone number) of each SMS we are fetching
the corresponding
account information (server name and password) from
the database through (connecting through)
webservice.The data is stored in the DB which you are accessing through a webserivce and that's too slow and unreliable so you are caching the results in a text file...
That's horrible. The party responsible for the webservice should be fixing it or you should rethink the architecture. All this extra complexity and basically it's just causing problems for you. You'd be better off just accessing the DB directly. I assume this is possible since you know there is a database. In a good SOA architecture, you should not know or care about where the data is persisted.
This webservice connection is slow/unreliable so a
local copy of the
MISDN number and corresponding account information
are stored/updated in flat files tp prevent repeated
accessing through webservice.
My question is-which will be faster for accessing,
using txt file or xml or a different format.I don't think it's going to matter much at all for the numbers you site, unless you are running this on a 20 year old PC or something.
But I think you are addressing the wrong problem.

IDOC --- XI -- HTTP (via a flat file structure, not XML)

I am working on a senario in which we need to send a third party payroll service provider our HR Master Data records (Message type HROT_UM). The manual method is to create a flat file from an IDOC and place the file in a shared directory, then upload the flat file by logging on to the web server. We would like to automate this process using XI.
Is it possible to send a flat file structure to a webserver using a HTTP receiver adapter? If not, can you provide a basic view of how to accomplish this task. Please note that FTP is not an option for us.
Any suggestions or recommendations would be greatly appreciated.

hey
flat file over HTTP is not possible,it takes only XML.
have a look at the following thread
Send file through http
thanx
ahmad
PL:reward with points for helpful answers

Xsl transformation of xml with wrong namespace

I have xml with wrong namespace:
<PAMStartedNotification xmlns="some site">
<tUser>PLVUSER</tUser>
</PAMStartedNotification>I need to leave this namespace and transform it.
As a result of transformation now I get
<tUser></tUser>
...I.e. XPath is not calculated properly.
If I leave out that namespace then everything is ok.
But I want to leave that namespace as it is.
I use the following code to transform xml:
Templates stylesheet = transformerFactory.newTemplates(new StreamSource(new File(fileName)));
Transformer processor = stylesheet.newTransformer();
java.io.StringWriter resultWriter = new java.io.StringWriter();
StreamResult streamResult = new StreamResult(resultWriter);
processor.transform(new StreamSource(new StringReader(xmlData)), streamResult);
transformedXML = resultWriter.getBuffer().toString();Any ideas how to do that(transform xml with wrong namespace)?
Edited by: prng on Dec 15, 2008 6:43 AM
Edited by: prng on Dec 15, 2008 6:45 AM

prng wrote:
Sorry.
Here is XPath I use to select tUser:
/PAMStartedNotification/tUser
Right. To start out, that selects a PAMStartedNotification element which is in no namespace. But yours isn't. It's in the default namespace, which doesn't have a prefix. You could try this XPath expression:
/*[local-name() = 'PAMStartedNotification']/*[local-name() = 'tUser'](Untested, might have mis-typings and so on.)

Load data from flat file to target table with scheduling in loader

Hi All,
I have requirement as follows.
I need to load the data to the target table on every Saturday. My source file consists of dataof several sates.For every week i have to load one particular state data to target table.
If first week I loaded AP data, then second week on Saturday karnatak, etc.
can u plz provide code also how can i schedule the data load with every saturday with different state column values automatically.
Thanks & Regards,
Sekhar

The best solution would be:
get the flat file to the Database server
define an External Table pointing to that flat file
insert into destination table(s) as select * from external_table
Loading only single state data each Saturday might mean troubles, but assuming there are valid reasons to do so, you could:
create a job with a p_state parameter executing insert into destination table(s) as select * from external_table where state = p_state
create a Scheduler chain where each member runs on next Saturday executing the same job with a different p_stateparameter
Managing Tables
Oracle Scheduler Concepts
Regards
Etbin

Problem in Creating .wsdl file and mapping.xml with ant

hi
i am created my .wsdl file and mapping.xml file with wscompile tool but when i run this by ant tool it show a problem.
the command runs on command prompt but when run throught ant file it shows a following error :-
Execute failed: java.io.IOException: CreateProces: wscompile -define -mapping build\classes\META-INF\mapping.xml -d . -nd build\.................and so on
so if anybody have any idea then plz help me asap
thanx

The following Ant snippet is the way I've defined my wscompile task. I'm creating a web application and it looks like yours might be an EJB endpoint, but you can adjust where necessary:
<taskdef name="wscompile" classname="com.sun.xml.rpc.tools.ant.Wscompile">
     <classpath refid="compile.classpath" />
</taskdef>
<target name="init">
     <echo message="-------- ${appname} --------" />
</target>

     <target name="generate-server-from-WSDL" depends="init">
          <wscompile fork="yes"
                       keep="true"
                       base="${basedir}/WebContent/WEB-INF/classes"
                       import="true"
                       features="wsi"
                       xPrintStackTrace="true"
                       verbose="true"
                       mapping="${basedir}/WebContent/WEB-INF/jaxrpc-mapping.xml"
                       sourcebase="${basedir}/src"
                       config="${config.server.doclit.file}">
               <classpath>
                    <path refid="compile.classpath" />
               </classpath>
          </wscompile>
     </target>
     <target name="compile-server-from-WSDL" depends="generate-server-from-WSDL">
          <javac srcdir="${basedir}/src" destdir="${basedir}/WebContent/WEB-INF/classes" debug="${compile.debug}">
               <classpath refid="compile.classpath" />
          </javac>
     </target>Just make sure that the named destination directories exist before you run the script.
If you'd like more details on the wscompile Ant task, I found the following pages invaluable:
https://jax-rpc.dev.java.net/whitepaper/1.1/index-part1.html

Flat File to simple XML structure in Mail Sender Adapter

Hi,
I have a scenario, where I want to put the content of a flat file (text, no csv or similar), which is an attachement of an e-mail, into a simple XML structure: entire file content as content of one XML tag. E.g.:
file content:
"abcdefgh"
xml file:
<root>
<content>abcdefgh</content>
</root>
Do I need to use MessageTransformBean? Or is there an easiert way?
Thanks,
Torsten

Hi Dirk,
When we use MessageTransform, we can use ContentDisposition to specify, as to whether the payload has to go as an attachment or inline(as the mail itself.)
It could also be a text file. Right?
Just take a look at this..
http://help.sap.com/saphelp_nw2004s/helpdata/en/57/0b2c4142aef623e10000000a155106/frameset.htm
cheers,
Prashanth

After flat file what next - beggining with BI

Hi
I am sure my question might sound silly but I am just beginning my journey with SAP BI..
I have access to system, I can do in it whatever I want - just without messing too much..First steps- I went thru flat file upload.
i would like to start practicing data extraction from R/3 but as i know I might mess too much in the system
So my question is:
What impact can my messing have on the system in worst case??
Can you suggest something what I can practice on my own after FF??

Hi,
You can try creating generic extractors based on some 'Z' tables and then load data from it in BW. In generic extraction you can try different methods of extraction i.e. View, FM etc.
After extraction you can try reporting scenarios based on Virtual Provider and InfoProviders etc. For practise you can create everything of your own so it will not mess with existing objects in the system.
Regards,
Durgesh.

Upload a flat file to BPS layout with hierarchy: is it possible?

Hello, BPS people!
I used a known "HowTo...using SAPGUI" to load a flat file to BPS layout. Finally I need to use a predefined layout with several variables and hierarchical representation of characteristic values in the key field ( I can't use a special layout for file uploading!). The procedure works fine if I use a flat structure of characteristic in the key field (no hierarchy). But once I choose a hierarchical representation of key characteristic in the level (but nonhierarchical model in the first screen of layout builder!) the layout data after uploading is absolutely wrong!
1) whether is it possible to perform that without ABAP coding?
2) If not, how can I change the function modules to use hierarchy?
Thank you!
Yurij

Sorry again!
I have solved it.
Probably nobody understood my question. First, I have tried to attach file upload function (see "How To..load a flat file into BW-BPS using SAPGUI") to the same planning level where original planning layout with hierarchical structure in the key field already existed. But now I realized that it's impossible!
SOLUTION: It is necessary to build the file upload function at the separated planning level with the same structure as that in the uploaded file. No hierarchies allowed in the "Selection" tab of planning level !!
Such upload function operates perfectly in the planning folder where original layout with the hierarchical structure of key characteristic is presented. After the file upload you can perform all further activities in the planning folder (including that with uploaded data).
Thanks,
Yurij

Converting Flat File data into XML

Hi Experts,
Consider the message type of the SENDER system and flat file data
<dt_sender>
<root>
<header1>   0..1
    <f1>
    <f2>
    <f3>
<header2>   0..1
    <f4>
    <f5>
    <f6>
<item>        1..unbounded
    <f7>
    <f8>
    <f9>
    <f10>
    <f11>
    <f12>
</item>
abc     def     ghi     jkl     mno     pqr
123     123     123     123     123     123
456     456      456     456     456     456
how to convert the flat file data into following XML data. please note that each field value is separated by TAB delimeter...wht parameters shld b used
<root>
    <Header1>
        <f1>abc</f1>
        <f2>def</f2>
        <f3>ghi</f3>
    </Header1>
    <Header2>
        <f4>jkl</f4>
        <f5>mno</f5>
        <f6>pqr</f6>
    </Header1>
    <item>
        <f7>123</f7>
        <f8>123</f8>
        <f9>123</f9>
        <f10>123</f10>
        <f11>123</f11>
        <f12>123</f12>
        <f7>456</f7>
        <f8>456</f8>
        <f9>456</f9>
        <f10>456</f10>
        <f11>456</f11>
        <f12>456</f12>
    </item>
points will be given to the correct answers
Thanks in advance.
FAisal
Edited by: Abdul Faisal on Feb 29, 2008 5:53 AM

Faisal,
When you read the multiple recordset strucutre file then each record in txt file should have an header from which you can identiy which segment it should go.. and you identiy it by using the keyfiledValue in file adapter
<root>
<header1> 0..1
<f1>
<f2>
<f3>
<header2> 0..1
<f4>
<f5>
<f6>
<item> 1..unbounded
<f7>
<f8>
<f9>
<f10>
<f11>
<f12>
</item>
for this input file
abc def ghi jkl mno pqr
123 123 123 123 123 123
456 456 456 456 456 456
abc def ghi can be read using the file adater to header 1 usinfg key field value, but using the same file adapter you cannt put GHI into header2.
else you should read whole row abc def ghi jkl mno pqr in single filed and write an UDF to split data to header1 and Header 2
similarly you have to take care for item records also
if your inout file is something like this
abc def ghi
jkl mno pqr
123 123 123 123 123 123
456 456 456 456 456 456
abc identifies to Header 1
JKL for Header 2 so on...
read the whole line in single field and write UDF to Split to header 1 and header 2 similary for item.

Flat file data load failed with the below error

hi guys,
when the scheduling load(info package) from the flat file ,got below error..
Error 'The argument 'INR' cannot be interpreted as a number ' on assignment field /BI
thanks

Hi,
It seems that the flat file and data source are not in sync.... check your flat file format and prepare it in sync with your data source.
I guess you have an amount field followed by currency in your flat file, but in your data source currency field is not next to the amount KF or vice versa. It could also be that the KF you have defined is not of Amount type, and hence it doesn't expect the currency field.
Hope this helps
Godhuli

Flat file transformation to xml with encoding in iso-8859-1

Similar Messages

Maybe you are looking for