Flat-File MA accented character conversion

Hello, we are using FIM 2010 R2 SP1 (4.1.3599) with a flat file MA to import/sync a csv flat-file generated by a HR system. We are using UTF-8 code page. The HR system has many international people in it, so there are many accented or diacritic characters. 
We need to convert those to regular English non-accented equivalents.  I know we could write sync rule or rules extension code to do this. However, there is an option on the select attributes properties page, under advanced a checkbox that says "Replace
accented characters with non-accented variants", which looked like an easy way to fix this issue.  However, enabling that option does not seem to change anything during the import/sync process.  Has anyone had any success
using that option, and is there anything we are missing?

We tried multiple code pages in the HR ma, including multiple Latin variations (don't see anything specifically called ISO-8859-1).  However, none of them showed the various characters correctly except for UTF-8.  We were getting a lot of bad
conversion characters (like tm and copywright) using the other code pages.  The names are very global with multiple character sets involved (Middle Eastern, Asian and European).   

Similar Messages

  • In the Flat file generated after Content Conversion, In NFS AL11 Directries Not able to See complete file

    Hi All,
    My scenario is Proxy to File  scenario.
    I used content conversion for generating flatfile in receiver side.
    In FCC i used fieldFixed Lengths, The flatfile is generated. I gave the Target Directory as AL11 directory(NFS).
    In my scenario length of Header is 622 characters.
    But am getting the file Upto 512 characters. After That I am not getting any fields in the Header, Remaining fields are cut.
    Same I checked with SFTP server with same Content Conversion.It is working good  and I am getting complete Header with 622 characters.
    Can you please suggest what should I do to get the 622 character in NFS, It is accepting only 512 characters in NFS.
    Reagrds,
    Satish

    Satish,
    In addition to Amit,
    AL11 transaction is used to display all the SAP Directories.When you double click on a directory, you will able to see all the files in the directories. But you can not view the complete content of the file from AL11 as there are some restrcitions in it. Even if you download the file from AL11 itself, the actual file won't be downloaded and you will see the file name along with the path inside the downloaded file as same as you can see it in Al11. So if you need the complete and actual file, you need to download the file from the OS level. You can take help from your basis team to download the file.
    Thanks,
    A.B

  • Steps for performing Flat file to XML

    hey,
    does any one have steps for performing flat file (.csv) to XML conversion. how is the mapping in the design performed.
    kalyan.

    Kalyan,
    Consider my example, I have input file as csv structure and want it to convert into .xml file thats it.
    Input file
    J,24
    P,22
    I want the output file like
    <Emp_Details>
      <F1>J</F1>
      <F2>24</F2>
    </Emp_Details>
    <Emp_Details>
      <F1>P</F1>
      <F2>22</F2>
    </Emp_Details>
    I doesn't know whether the above matches exactly ur reqmt, but there is the option.
    Step 1 : Create Scenario & Business service
    http://www.flickr.com/photo_zoom.gne?id=699386732&size=o
    Step 2: Create sender & receiver comm.channel
    http://www.flickr.com/photo_zoom.gne?id=699386698&size=o
    http://www.flickr.com/photo_zoom.gne?id=699386664&size=o
    Step 3:Create all the objects in ID and cross verify below  whether u've created everything.
    http://www.flickr.com/photo_zoom.gne?id=699386690&size=o
    Step 4: Activate and run the interface.
    Your results :
    http://www.flickr.com/photo_zoom.gne?id=699386686&size=o
    Hope it helps!!!
    Best regards,
    raj.

  • Viewing the flat file in JMS Receiver???

    How can i see the Flat file generated  after content conversion by JMS Receiver channel in a in a  ECC->PI->JMS scenario.
    I have a JMS Receiver channel connecting to WMS system , how can i see the flat file produced just after the JMS adapter's content conversion. its like
    ECC ---> PI----->JMS----> (intermediate client MQ file cannot be viwed here it forwards the file to WMS MQ)------>(MQ)WMS
    i need to see the flat file produced just after the JMS channel content conversion..is there some logging option there should be. Please help

    Hello,
    I don't think there is any standard way to achieve ur req.
    But what u can do is, write a custom AM module to either write a file on PI file system (for ur monitoring) or display the text file in ur audit logs.
    Send File to Two Different Locations using Adapter Module
    Thanks
    Amit Srivastava

  • Flat File to IDOC Mapping requirement to generate Multiple Segments

    Hi Experts,
    I got a requirement were i have 2 records in a file and i need to generate 2 IDOCs  with  multiple segments in it.
    FILE :
    10/01/2010     101  KRNA     ic_quantity          30-0257     3526     1     1     ea     110000     10
    10/01/2010     101     KRNA     ic_quantity          90-0005     3526     1     2     ea     110000     10
    Idoc should generate 2 IDOCs with multiple segments as shown below
    I have imported the IDOC and changed the occurrence to " unbounded "
    The Basic  IDOC Type :  WMMBID02
    I need to generate Multiple segments of  E1MBXY1
    i.e..,  First IDOC should contain two  E1MBXY1 segments
             Second IDOC should contain Four  E1MBXY1 segments
    IDOC1 :   WMMBID02
    Segment :   E1MBXY1( 2 segments)                                                       
    10/01/2010     101     KRNA     ic_quantity          30-0257     3526     1     1     ea     110000     10
    10/01/2010     101     KRNA     ic_quantity          90-0005     3526     1     2     ea     110000     10
    IDOC2 : WMMBID02
    Segment :  E1MBXY1 ( 4 segments)                                                  
    10/01/2010     101     KRNA     ic_quantity          30-0257     3526     1     1     ea     110000     10
    10/01/2010     101     KRNA     ic_quantity          30-0257     3521     1     1     ea     110000     10
    10/01/2010     101     KRNA     ic_quantity          90-0005     3526     1     2     ea     110000     10
    10/01/2010     101     KRNA      ic_quantity          90-0005     3521     1     2     ea     110000     10
    Can anyone suggest me how to generate IDOCs with multiple segments
    what are multiple ways of generating it
    Whether it can be achieved using Multi-mapping or I need go for UDF
    If any one has done has done this type of requirement ,please share the points.
    Thanks
    Sai

    Basically you need to generate idoc per record in the flat file. During fcc conversion you convert flat file to xml structure at the sender side. In the mapping use xml file structure source and idoc as receiver structure. You just export idoc and update the idoc segment 1 to unbounded.  Please follow the michael blog for file to idoc multimapping without bpm. Yes without bpm it is possible.
    see this link... This will answer your requirement.
    https://wiki.sdn.sap.com/wiki/display/XI/File%20to%20Multiple%20IDOC%20Splitting%20without%20BPM
    >Whether it can be achieved using Multi-mapping or I need go for UDF
    you dont need udf for this.

  • Flat files formats

    Hi,
    required format of flat files for Sales Orders conversion using standard Bapi by COB.
    Kindly help me .
    Help is appreciated .
    Regards,
    Chowdary
    Moderator message : Search for available information. Thread locked.
    Edited by: Vinod Kumar on Jul 7, 2011 12:17 PM

    Hi,
    How to implement the following logic in OWB.
    LOAD DATA
    INFILE 'myfile.txt'
    BADFILE 'myfile.bad'
    DISCARDFILE 'myfile.dsc'
    APPEND
    Into TABLE_Awhen (1:1) = 'A'
    (Col1 Position(1:1) CHAR,
    Col2 Position(2:5) CHAR)
    Into TABLE_Bwhen (1:1) = 'B'
    (Col1 Position(1:1) CHAR,
    Col2 Position(2:20) EXTERNAL INTEGER)
    Into TABLE_C
    when (1:1) = 'C'
    (Col1 Position(1:1) CHAR,
    Col2 Position(2:20) EXTERNAL INTEGER)
    I am using 10g version of OWB.I tried using the splitter operator.
    I am getting the following error when i use the splitter.
    An invalid combination of operators prevents the generation of code in a single implementation language (PL/SQL code, or SQL*Loader code, or ABAP code). For example, you may have included a SQL*Loader only operator such as the Data Generator in a mapping with a PL/SQL implementation type. If you designed the mapping to generate PL/SQL code, an invalid combination or sequence of operators prevents the generation of PL/SQL code in any of the operating modes(set based, row based, row based target only). If the mapping contains an operator that generates only PL/SQL output, all downstream dataflow operators must also be implementable by PL/SQL. You can use SQL operators in such a mapping only after loading the PL/SQL output to a target. Detail is as follows:
    PL/SQL set based operating mode: Operator trailer_source_txt does not support SQL generation.
    PL/SQL row based operating mode: Operator trailer_source_txt does not support SQL and PL/SQL generation.
    PL/SQL row based (target only) operating mode: Operator trailer_source_txt does not support SQL and PL/SQL generation.
    Both SQL and PL/SQL handlers are not supported by trailer_source_txt as output
    SQL*Loader: Operator SPLIT does not support SQL*Loader generation.
    ABAP: Operator trailer_source_txt does not support ABAP generation.
    Thanks in advance,
    VInay

  • Creation flat file, metacols without quotes

    Hello,
    I created a flatfile by using flat file gg adapter. But in the flat file, all the character metacols are between quotes. I need a flat file without quotes.
    In the ffwriter.properties file
    dsvwriter.dsv.quotes.chars=
    dsvwriter.dsv.quotes.escaped.chars=
    With the modification above, I could remove quotes from table columns but not from metacols. Is there anybody who knows how to remove quotes from metacols?
    Thnx

    Hello,
    I created a flatfile by using flat file gg adapter. But in the flat file, all the character metacols are between quotes. I need a flat file without quotes.
    In the ffwriter.properties file
    dsvwriter.dsv.quotes.chars=
    dsvwriter.dsv.quotes.escaped.chars=
    With the modification above, I could remove quotes from table columns but not from metacols. Is there anybody who knows how to remove quotes from metacols?
    Thnx

  • Character conversion in File Adapter leads to Mapping Error

    Hello experts,
    I have a problem with file encoding on the file sender adapter. The scenario I'm using just reads a flat file and maps each line of this file to an Idoc field. Normally this works perfect but from time to time we get files contaning the character "'" (dec. 39 or hex 27) which then end up in a mapping exception. In the adapter configuration we use file content conversion, File Type is set to "text" and we haven't set any encoding.
    When I look at the generated XML then I can see that it created a UTF-8 encoding (default) and the "'" has been replaced by "&apos;".
    I tried to load this XML into the mapping in test mode and it faild as well. Only if I change the XML encoding to "ISO-8859-1" it goes through. If I set "ISO-8859-1" as encoding on the sender adapter, it doesn't make any difference.
    What am I doing wrong here and why is character dec 39 affected at all? From my understanding this is in the normal ASCII table between 1 and 128 and should not cause any problem! In the same file I can also see the "&" (dec 38 or hex 26) which is converted in the XML to "&amp;" and works perfect.
    I'd appreciate any helpful statements...
    Thanks in advance
    /Michael

    From your description I would guess that not the apostrophe causes the trouble, but there is any European letter in your source which is not part of ASCII like an German umlaut. Otherwise it should not make any difference whether you use UTF-8 or latin-1 for encoding.
    Could you send me the file that makes the trouble to my email address stefan dot sdn at gmail dot com?
    Regards
    Stefan

  • Flat file Error in conversion exit CONVERSION_EXIT_PERI6_INPUT

    Hello Experts!
    I´m trying to upload a flat file data to an infocube and appears an error which diagnosis is:an error ocurred in record 1 during execution of conversion exit CONVERSION_EXIT_PERI6_INPUT for field CALMONTH.
    Procedure: Check That the record where the error ocurred has the correct format , and correct it accordingly.
    The characteristics in this fields (CALMONTH) are:
    - Data Type: numc-character string with only digits.
    - Length: 6
    - Convers.rout. PERI6
    - Output Length 7
    I hope You can help me soon.
    Thank you!

    Hi Eduardo Vergara,
    You just have to make sure the 0CALMONTH format is exactly the same. We have to match the format in the both columns. So in DataSource/Trans.Structure File “CALMONTH” change the Type to “Numc” and length o “6” . This is our problem but the tip is to match the proprieties.
    Regards,
    Alberto.

  • File Content Conversion i.e Flat file 2 Flat file

    Hi guys,
       I am new 2 SAP XI
    and i am trying 2 do "Flat File To Flat File".
    Input File contains following data:
    Name:varun
    Surname:rajaraman
    Address:B-2
    Employee no:8204
    i.e Each Data is in separate Row.
    Output File Should contain the following data:
    I am varun rajaraman staying at B-2 bearing employee no. 8204.
           (name,surname)               (address)                        (Employee No.)
    i.e data should be in a single row.
    So, i have a problem of reading the data from input file i.e data from each row and transfering it into output file along with which i need 2 insert  "i am " ,"staying at", etc.
    pls tell me the procedure in detail.
    Thanks and regards
    santhosh rajaraman

    Hi,
    Check this links for file content convertion.
    File content conversion sites
    /people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
    /people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
    /people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
    /people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
    /people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
    /people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
    /people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
    /people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
    /people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
    /people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
    /people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
    /people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
    /people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
    /people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
    http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
    Regards,
    Phani
    Reward Points if Helpful

  • MessageTransformBean in sender JMS Adapter flat file to xml conversion

    Hi All,
    The scenario is MQ (Flat File )  --->PI -
    >Idoc
    The flat file structure is
    112233
    AABBCC
    The expected XML Structure after using MessageTransformBean in the sender JMS adapter  is
    <Record>
    <Row>
    <f1>11</f1>
    <f2>22</f2>
    <f3>33</f3>
    </Row>
    <Row>
    <f1>AA</f1>
    <f2>BB</f2>
    <f3>CC</f3>
    </Row>
    </Record>
    But I am getting 2 SEPARATE xml messages each with only one Row in it like the following
    1st XML:
    <Record>
    <Row>
    <f1>11</f1>
    <f2>22</f2>
    <f3>33</f3>
    </Row>
    </Record>
    2nd XML:
    <Record>
    <Row>
    <f1>AA</f1>
    <f2>BB</f2>
    <f3>CC</f3>
    </Row>
    </Record>
    I would like to have one xml message with all rows in it.It seems the MessageTransformBean is not recognizing the end of line in the flat file.Do i need to use endSeparator explicitly.
    I followed the "How to use Content Conversion in JMS Adapter " and configured the adapter,still no luck..
    Any Help greatly Appreciated
    Thanks,
    C

    Hi Chirag,
    The parameter name sequence changes alphabetically by itself when I save and activate it eventhough I enter as it is in the document.How to stop changing this sequence or put it the order as required in the Module Processor.
    Currently my sequence is
    Transform.Class
    Transform.ContentType
    xml.conversionType
    xml.documentName
    xml.documentNamespace
    xml.fieldFixedLengths
    xml.fieldNames
    xml.processFieldNames
    xml.structureTitle
    Let me know how to change the sequence ,if that is the issue.
    Thanks,
    C

  • Handling flat file conversion with spaces inbetween  at sender side

    Hi,
       I am facing some problem in configuring the sender JMS adapter file content conversion. Please find the structure of my file below
    010AG  07/17/2007 000130800 TOZ07/17/200710:48:46
    010AU  07/17/2007 006682800 TOZ07/17/200710:48:46
    010-Record key
    AG-Metal code
    07/17/2007 -price Date
    000130800 -pricevalue
    TOZ-Unitofmessure
    07/17/200710:48:46-Unitofmessure
    there are 2spaces inbeween 1and 2nd fields and one space beween 2nd and 3rd ,one space between 3rd and 4th fileds
    I declared my source data strucute like below
    <source_MT>
    <PriceData>
         <Metal code>
          <price Date>
          <pricevalue>
          <Unitofmessure>
           <shipDate>
    </priceData>
    </source_MT>
    I am using this PDF to configure my serder communication channel https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/50061bd9-e56e-2910-3495-c5faa652b7
    . but i got struck up in declaring these two fields as i need deal with spaces.
    xml.NameA.fieldNames
    xml.NameA.fieldFixedLengths
    It would be great if sombody tell me how ican decalre content conversion rules for the file
    Thanks
    sudheer

    Hi,
    Please check some links on FCC.
    Introduction to simple(File-XI-File)scenario and complete walk through for starters(Part1)
    Introduction to simple (File-XI-File)scenario and complete walk through for starters(Part2)
    File Receiver with Content Conversion
    Content Conversion (Pattern/Random content in input file)
    NAB the TAB (File Adapter)
    Introduction to simple(File-XI-File)scenario and complete walk through for starters(Part1)
    Introduction to simple (File-XI-File)scenario and complete walk through for starters(Part2)
    How to send a flat file with various field lengths and variable substructures to XI 3.0
    Content Conversion (Pattern/Random content in input file)
    NAB the TAB (File Adapter)
    File Content Conversion for Unequal Number of Columns
    Content Conversion ( The Key Field Problem )
    The specified item was not found.
    File Receiver with Content Conversion
    http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
    Regards,
    Phani

  • Urgent, Help on conversion: xml to flat file

    Dear experts,
    Here is the scenario, XML FILE ->XI-> JMS
    In JMS recevier side, we use localejbs/AF_Modules/MessageTransformBean to convert xml to flat file.
    Transform.Class: com.sap.aii.messaging.adapter.Conversion
    Transform.ContentType: text/plain;charset=utf-8
    xml.conversionType: SimpleXML2Plain
    xml.fieldFixedLengths: 5,20,5,8
    When input source xml file contents are non-unicode, it works fine.
    But when the contents contain unicode characters such as Chinese word,  it works but with wrong length in the output flat file. It seems xi treat one Chinese word length is 1. Actually, one chinese word should take 2 bytes.
    My question is how to make XI handle unicode characters  with correct lengths while conversing to flat file.
    Thanks in advance.

    Jai Shankar
    Thanks for your response.
    I am already using the standard adapter modules provided by SAP:
    localejbs/AF_Modules/MessageTransformBean
    Transform.Class: com.sap.aii.messaging.adapter.Conversion
    My input file's encoding is UTF-8
    "You need to change the encoding scheme according to your input file" , do you mean change the output file's encoding or else?
    I can't find the article you mentioned: "Encoding schemes in XI", Would you please give me the link?
    Thanks a lot.

  • J2SE XML to Flat File Content Conversion

    Hi
    I've currently got a scenario which sends a flat file to the integration server, it gets mapped and sent to a receiver adapter on a deployed j2se engine.
    I'm now trying to convert the xi-xml structured file to a flat file again on the j2se side (the same flat file format it originally had).
    My original flat file looks like this -
    477
    477=AA1
    My xml file looks like this -
    <?xml version="1.0" encoding="UTF-8"?>
    <ns0:ResultMessage xmlns:ns0="urn:xxxx-com:a_test_j2se_filetofile">
    <Item>
              <field1>477</field1>
    </Item>
    <Item>
              <field1>477</field1>
              <field2>AA1</field2>
    </Item>
    </ns0:ResultMessage>
    I am using these content conversion parameters:
    xml.addHeaderLine=0
    xml.fieldSeparator==
    xml.endSeparator='nl'
    I get this error on the integration engine (sxmb_moni):
    Error while sending by HTTP (error code: 500, error text: Internal Server Error:java.lang.NullPointerException) (See attachment HTMLError for details)
    and the j2se adpater log says this:
    17:16:32 (4120): Message "13b9d644-54c9-4ffb-0c40-db4c14458d77" of type "application/xml", kind "B" received
    17:16:32 (4124): Parsing XML message
    17:16:32 (4131): ERROR: Message processing failed with "java.lang.NullPointerException"
    What am i missing?

    So, now... I did a test configuration in XI and sent your test-payload...it worked.
    The J2SE adapter configuration:
    File adapter java class
    classname=com.sap.aii.messaging.adapter.ModuleXMB2File
    version=30
    mode=XMB2FILEWITHCONVERSION
    #Adress for XMB endpoint -
    XI.httpPort=8111
    XI.httpService=/file/receiver
    #File Adapter specific parameters -
    file.createDir=1
    file.targetDir=c:/transfer/inbound
    file.targetFilename=xmboutput.txt
    #file.writeMode=append
    #file.writeMode=overwrite
    file.writeMode=addCounter
    file.counterMode=immediately
    #file.counterMode=afterFirst
    file.counterSeparator=_
    file.counterFormat=00000
    file.counterStep=1
    #File Content Conversion specific parameters -
    xml.addHeaderLine=0
    xml.fieldSeparator==
    xml.endSeparator='nl'
    And here the configuration of the receiver communication channel in the integration directory:
    Adapter Type: XI
    Receiver
    Transport-Protocol: HTTP 1.0
    Message-Protocol: XI 3.0
    Adapter-Engine: Integration Server
    Adressing-Type: URL Address
    Target Host: <yourJ2SEip>
    Service Number: 8111
    Path Prefix:http://<yourJ2SEip>:8111/file/receiver
    Authentication Data
    Logon data for non-SAP systems
    User
    Password
    That's it... sent your payload and got the wished result:
    477
    477=AA1
    Regards,
    Heinrich

  • IDOC to flat File----Problem in File Content Conversion at receiver

    hi experts,
    I am doing a IDOC to flat file secnario.
    My requirment is IDOCXI-Flat file
    Format of flat file is like:--
    Every segment in the IDOC will be converted into a single line of file(without any delimiter). So number of lines in flat file will be equal to number of segments in IDOC.
    I am facing problem in File Content conversion. 
    Please help me out..
    Thanks
    Jaideep

    Check this doc...
    [How To...Convert an IDoc-XML structure to a flat file and vice versa in XI 3.0 |https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/46759682-0401-0010-1791-bd1972bc0b8a]

Maybe you are looking for