Special Charecters handling using BODS flat file

Hi All,
I have 2 sets of data one with no special charecters and one with Special Charecters in source. I have generated flat files(with UTF-8 code page bot hdata special charescters and no special chars) thruogh BODS in to a perticular path,  when I am copying file from one path to another path file behaviour is changing it is saving as ANSI (it is only ith the file does not have special charecters, special charecters file if capoying with UTF-8 code page)
And also I have faced the special chareter file with jumbling of data.
Like :  ID| Number |Name|Country
          1 |103|TejaIndia
          2|104|Vini|India
If observed above scenario, in th the 1st record country data concatenated with name.
I really appriciate, If any one help me to slove this issue.
Note: Special charecters are like: */„…Ÿ etc and also multilanguage data
Thanks,
Lavanya

Post sample data from your source file, if possible attach it to the post and let us know the expected result.

Similar Messages

  • VLD-6328 error : Use a flat file as Source in a mapping in OWB 10.2

    Dear all,
    I have created a simple mapping using a flat file in a remote server as a source and a simple table as a target.
    When I try to validate the mapping I get the following warning:
    "VLD-2398: No data file specified. Generated code will use the sampled file name and the file location xxx"
    I use the version 10.2 and I cannot find "Sources" or "Targets" when I use the "Configure" options.
    Any help will be appreciated

    Hi all,
    If you want to validate correctly this mapping you must to :
    1. Right click on the mapping, then Configure
    2. Right click on Sql Loader Data Files, then Create
    3. Verify that the location name is correct and complete the Data File Name
    4. OK
    The validation is now OK.
    I hope it will be help you
    Best Regards
    Samy

  • Hierarchy using a flat file for a master data load.

    Can anyone please tell me the steps involved in creating a hierarchy in BI 7.0.  and loading the data using a flat file into the created hierarchy? I have seen some posts and weblogs but they were not helpful and i have been getting some errors which i dont know how to resolve.
    Can someone please give a clear steps and procedure for this?
    Thanks a lot in advance.
    Naveen

    Hi,
    The flat file is generated in application server by executing an ABAP program in SE38.
    This ABAP program contains the logic to generate hierarchy.
    In our case we used a DSO to store employee & supervisors.
    This program generated a flat file in tmp folder in application server
    In our case, To load this flat file we  created an Infosource on our master data using direct update using RSA1old Tcode
    after Infosource is created right click on the InfoSource and click on Assign DataSource.
    Give the Source System name
    When you open this Info source you can select data source as YHIEROBJ_HIER and then activate the InfoSource.
    create an Info Package to load the Hierarchy. Right click on the PC Files (Source System) and click on u201CCreate InfoPackage".
    Under Extraction tab give the flat file name which is generated by the ABAP program in AL11.
    Select the hierarchy which you want to load. Also, you can rename the Hierarchy after loading it. The update method is selected as u201CFull Updateu201D.
    Logic for Generation of flat file & ABAP Program:
    Flat file structure:
    Node ID     InfoObject     NodeName     Parent ID     Date To      Date From     Language
    u2022     u201CNode IDu201D indicates the unique number which defines the Node.
    u2022     u201CInfoObject u201Cgives the name of the InfoObject which is assigned to this Node ID.
    u2022     u201CNodeNameu201D is the name you specify to that Node.
    u2022     u201CParent IDu201D is the Node ID to which the Current Node ID reports to.
    u2022     u201CDate Tou201D and u201CDate Fromu201D are taken for time references (You can set them constant).
    u2022      u201CLanguageu201C is set to English (E).
    The program Logic can be :
    Declare the hierarchy structure
    Get the data from DSO into internal table
    Read all the EMP values into NodeName Field of the table
    Build lookup table for Parent Node ID
    Fill Parent Node ID field
    Append this data to work area & then to another internal table
    You need to declare the selection parameter as SSFILE1
    & use following code to write back the file
      OPEN DATASET SSFILE1 FOR OUTPUT IN TEXT MODE ENCODING DEFAULT
         MESSAGE MSG.
      IF SY-SUBRC NE 0.
        MESSAGE E008(ZBW1) WITH MSG.
      ENDIF
    Populate the output from that internal table into final work area.
    Transfer this final work area to the ssfile1 which is the desired output file.
    and   CLOSE DATASET SSFILE1.
    When this program is executed, selection screen asks for the name of file
    Enter the desired file name & execute
    flat file would be generated in the Application server now.
    To view the File, Go to Transaction AL11. Search the directory /tmp. Double click on this directory.
    This opens the list of flat files under this directory. Double click on the file name.
    Hope this helps.
    Thanks,
    Rashmi.

  • Use of Flat Files

    Hello Everyone !
    What is the use of Flat files, how to use and test the same.
    Is there documentation available ?
    Thanks.

    Hi,
    A flat file is a file containing records that have no structured interrelationship. may be simple text file.
    Following are documents:
    [Advanced Flat File to MII XML Document Custom Action Blocks(v12.0)|http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/30472799-604b-2b10-d4bf-d7498b027674?quicklink=index&overridelayout=true]
    [Flat File Parcer|http://help.sap.com/saphelp_mii121/helpdata/EN/44/710b219ea03abee10000000a155369/content.htm]
    Hope this helps !!
    Regards,
    Manoj Bilthare

  • Is use of flat file in SRM-MDM catalog search UI possible ?

    Hello,
    When user looks for materials inside SRM-MDM catalog (using search user interface), search is done manually with free form or drill down search.
    Then, among the search result, user has to select items he wants to add to his shopping cart and finally transfer those items from his shopping cart overview inside SRM.
    Is it possible to automate this user selection using for exemple a flat file uploading (or any other way you could know) ?
    This flat file will have material number (or service), supplier code and quantity (no more information).
    The aim of the request is to help requester to not have to select each item one by one (in the search result) knowing that :
    -  SC will have more than a hundred items,
    - delivery time and price (for example) must be checked in MDM, being the master data reference
    - materials (or service) to order are received by requester via a flat file without any information about prices, so i cannot upload my flat file directly into SRM because file missing data must come from MDM.
    With this process, user should have only to transfer items automatically selected.
    Could you please share your advises ?
    We use SAP MDM 5.5.
    Regards.
    Laurent.

    Hello Masa,
    Masayuki Sekihara wrote:
    A vendor look at buyer stock information like VMI and fill stock weekly base. So the vendor sends material number and quantity information as flat file to buyer. Buyer should create SC from flat file and price information should fetch from catalog.
    Yes, your are correct: example you gave corresponds to process for my SC uploading.
    Regards.
    Laurent.

  • Error handling when loading flate files

    Hi
    We have a Process Chain loading flate files from a server into a ODS. We want to create a routine to avoid errors in the ODS when no files is found.
    The error we want to handle is
    Error 1 when loading external data
    Message no. RSAR234
    We want to handle this error message as OK to avoid red request in the ODS
    Please help
    Kind regards
    Ola Einar Langen

    Hi, and thanks for your hints.
    We ended up with the following codes. It's will mark the prosess chain red (but this is as wanted) but we have implemented that the prosess chain will proceed even with error in the loading process
    The code for the routine implemented in the infopackage in "External data" tab.
    p_filename = 'filename.txt.
    OPEN DATASET p_filename FOR INPUT IN BINARY MODE.
    If file could not be open
    IF SY-SUBRC NE 0.
        p_subrc = SY-SUBRC.
      delete the current request
        CALL FUNCTION 'RSSM_DELETE_REQUEST'.
    ENDIF.
    close the file if OK
    CLOSE DATASET p_filename.
    p_subrc = 0.
    The solution is no OK for us
    Kind regards
    Ola Einar Langen

  • Use of flat files in distributed architecture probs.

    Hi Guiess,
    I am working in a module in distributed environment.
    Its client is swing application.I have a one doubt and the doubt is -
    I am making some flow chart sort of thing at client side and saving this work in
    a flat file (java property file/xml file) at the server side.
    Could n e 1 suggest me that saving flat file at the server side would work,
    coz this file would share by multiple clients.And how locking facility j2e gives whilesomebody is modifing one file.
    Thnax in advance -
    Vikas Kumar

    Hi,
    side and saving this work in
    a flat file (java property file/xml file) at the
    server side.
    Could n e 1 suggest me that saving flat file at the
    server side would work,
    coz this file would share by multiple clients.And how
    locking facility j2e gives whilesomebody is modifing
    one file.Does "server side" mean EJBs? Is so, from the EJB 2.1 specs document, section 25.1.2 :
    "An enterprise bean must not use the java.io package to attempt to access files and directories in the file system.
    The file system APIs are not well-suited for business components to access data. Business components should use a resource manager API, such as JDBC, to store data."
    Just make sure you use a resource manager to access files.
    Kexkey

  • CR & LF characters at the end of records when using delimited flat file (CR is missing)

    Hi All,
    I have a requirement where data of SQL query needs to be loaded to a CSV file.
    The row delimiter of the CSV file has to be CR-LF.
    In the flat file connection manager, I have mentioned Header Row delimiter as "{CR}{LF}" and under columns section, row delimiter is specified as "{CR}{LF}".
    But when I open the detsnation CSV file using notepad++, I see only "LF" at the end of all rows.
    Can you please let me know how can I get both CR & LF at the end of each row
    Below is the screen shot of the flat file connection manager which I have used for CSV destination file:
    Raksha

    Hi Raksha,
    Just as Vaibhav said, I’m curious why you need use “CR & LF” as row delimiter in Flat File Connection Manage. Since you can use "CR" as row delimiter in Flat File Connection Manager and it worked fine, you can directly specify "CR"
    as row delimiter in Flat File Connection Manage.
    Besides, if you still want to replace “LF” with “CR & LF” in the text file, we can use Notepad++’s Find/Replace feature or Edit -> EOL Conversion to achieve the goal. Then we can specify "CR & LF" as row delimiter in Flat File
    Connection Manage.
    The following blog about conversion between “LF” and “CR & LF” row delimiter in Notepad++ is for your reference:
    http://sqlblog.com/blogs/jamie_thomson/archive/2012/08/07/replacing-crlf-with-lf-using-notepad.aspx
    Thanks,
    Katherine Xiong
    Katherine Xiong
    TechNet Community Support

  • Generate Sample data for the cube .- I don't want to use the flat file

    Hello BI Gurus,
    I know there is a sap sap standard program where you write records to the cube. I think first you change the cube from basisc to real time cube and then another program which displays a ALV layout- you can create,delete or change ther records.
    I don't want to create a flat file load for this. I want to create 5 records to check the layout.
    I forgot the program name.
    Can you please let me know the program name.
    Thanks
    Senthil

    A long time for a simple question, so here it is: the program name is CUBE_SAMPLE_CREATE.
    Please, mark this question as anweared.
    Regards,
    André

  • Special charecters handling while Converting XML string to DOM

    Hi,
    I am using the following approach for converting XML string to DOM, but due to Special characters like "&", I am getting Exceptions:
    String xmlString;
    DocumentBuilderFactory factory =
    DocumentBuilderFactory.newInstance();
    DocumentBuilder builder = factory.newDocumentBuilder();
    Document document = builder.parse(new InputSource(new StringReader(xmlString)));
    Can anyone please help me out on how to handle the Special characters in the above code.

    If the XML doesn't parse, then the XML must be invalid. Show a sample of such a special character in the XML data. Please use \ tags to post the actual XML content and any other code.                                                                                                                                                                                                                                                                                                                                                                                           

  • Special charecters handling

    Hi All,
    how to unhide abap codes that were hidden using a special string in the first line of the program:
    *@@$$@@SAP
    Any solutions ?
    Thanks!

    Even worse, question were also copied:
    >
    Letiere Moraes wrote:
    >  unhide abap codes that were hidden using a special string in the first line of the program:
    > *@#@@[SAP]
    >
    veni m wrote:
    > unhide abap codes that were hidden using a special string in the first line of the program:
    > *@@$$@@SAP

  • Program for uploading the PO data of known vendor in MM using the flat file

    hi friends,
                    I got problem while uploading PO data for a vendor.what are the possible ways of uploading data.
    Moderator message: please do your own research before asking.
    Edited by: Thomas Zloch on Jan 11, 2011 11:37 AM

    hi friends,
                    I got problem while uploading PO data for a vendor.what are the possible ways of uploading data.
    Moderator message: please do your own research before asking.
    Edited by: Thomas Zloch on Jan 11, 2011 11:37 AM

  • I can't build an xsd for a flat file (txt) to handle repeating records

    Hi - have looked at many posts around flat file schema and they don't seem to address my question.
    I have a flat file that is \n delimited
    the pattern of the data is simple:
    record1 - 90 characters
    record2 - 20 characters
    record3 - n 248 characters - each of these records is parsed into children by the positional method
    record n+1 10 characters
    record n+2 20 characters
    so I used the flat file schema generator to generate the schema and built a map mapping the flat file schema to another xml schema. The schema looks ok - record1, record2, record n+1, record n+2 are child elements of the root. the repeating record
    section is showing up as a node with the parsed children.
    The transform is only mapping the children of the repeating records. When I test the map only the first repeating record gets parsed. No repeating happens (the actual flat file has 400+ repeating records). When I run the map in debug mode, the input
    xml shows that record1 is read in correctly, record2 is read in correctly, record3 is read in and parsed and record4 is treated like record n+1 and record5 is treated like record n+2 and the map thinks it's all finished.
    the section of the repeat part of the schema is and you can see that I set the minOccurs=1 and maxOccurs=unbounded for the node (INVOICE) and the complexType but this is not an affective syntax. I have looked at how the EDI X12 schema look and how they handle
    looping and it is a lot different than what the Flat File schema wizard is doing. Is there a good set of rules published that would guide me though this? otherwise I will basically have to read in the lines from the file and parse them out with functoids -
    seems so inelegant. Thanks in advance.
    <xs:element minOccurs="1" maxOccurs="unbounded" name="INVOICE">
              <xs:annotation>
                <xs:appinfo>
                  <b:recordInfo structure="positional" sequence_number="3" preserve_delimiter_for_empty_data="true" suppress_trailing_delimiters="false"
    />
                </xs:appinfo>
              </xs:annotation>
              <xs:complexType>
                <xs:sequence minOccurs="1" maxOccurs="unbounded">
                  <xs:annotation>
                    <xs:appinfo>
                      <groupInfo sequence_number="0" xmlns="http://schemas.microsoft.com/BizTalk/2003"
    />
                    </xs:appinfo>
                  </xs:annotation>
                  <xs:element name="SegmentType" type="xs:string">
                    <xs:annotation>
                      <xs:appinfo>
                        <b:fieldInfo justification="left" pos_offset="0" pos_length="2" sequence_number="1" />
                      </xs:appinfo>
                    </xs:annotation>
                  </xs:element>....... more children elements
    Harold Rosenkrans

    Thanks for responding
    I gave up trying to parse the repeating record into fields. Instead I just loop through the repeating record section with an <xs:for-each> block in the xsl and use functoids to grab the fields.
    So that works for having the two, shorter header records (structure is positional) before the section of repeating records. Now I just have to figure out how to get the schema to handle the two, shorter trailer (or footer, whatever you prefer) records after
    the section of repeating records
    the error I get in VS when I test the map is [BTW I changed the element names in the schema which is why you don't see INVOICE in the error]
    When I declare the last element as being positional with a character length of 10 I get the error:
    Error 18 Native Parsing Error: Unexpected end of stream while looking for:
    '\r\n'
    The current definition being parsed is SAPARData. The stream offset where the error occured is 1359. The line number where the error occured is 9. The column where the error occured is 0. 
    so the first record is 77 char in length and the second is 16 char and then the repeating records (5 in the file) are 248 char and the last record is 10 char
    so an offset of 1359 puts it beyond the last record by 16 characters - so the stream reader is looking for the next repeating record.
    if I try to declare the last element as delimited I get the error:
    Error 14 Native Parsing Error: Unexpected data found while looking for:
    '\r\n'
    The current definition being parsed is SAPARData. The stream offset where the error occured is 597. The line number where the error occured is 5. The column where the error occured is 0. 
    so the first record is 77 char in length and the second is 16 char and then the repeating records are 248 char.
    a stream offset of 597 puts me 8 characters into the third repeating record - at this point I have only declared one trailer record in the  schema, 10 characters long.
    Why is stream reader stopping at such a weird spot?
    The bottom line is I still haven't discovered the correct schema to handle the trailer records. even if I set the maxOccurs="4" (for the repeat record declaration) it still gets the first error. How does it find an unexpected end of stream looking
    for \r\n when the maxOccurs for the repeat record declaration should have the stream pointer in the 5th repeat record.
    I unfortunately don't have any options concerning the file structure.
    I have read a lot of posts concerning the trailer issue. I have seen a couple that looked interesting. I guess I'll just have to give them a try. The other option is to create a custom pipeline that will only take file lines of 248 characters.
    That's just disgusting !
    Harold Rosenkrans

  • Object reference not set to an instance of an object error when generating a schema using flat file schema wizard.

    I have a csv file that I need to generate a schema for. I am trying to generate a schema using flat file schema wizard but I keep getting "Object reference not set to an instance of an object." error when I am clicking on the Next button after
    specifying properties of the child elements on the wizard. At the end I get schema file generated but it contains an empty root record with no child elements.
    I thought may be this is because I didn't have my project checked out from the Visual SourceSafe db first but I tried again with the project checked out and got the same error.
    I also tried creating a brand new project and generating a schema for it but got the same error.
    I am not sure what is causing Null Reference exception to be thrown and there is nothing in the Windows event log that would tell me more about the problem.
    I am using Visual Studio 2008 for my BizTalk development.
    I would appreciate if some has any insides on this issue.

    Hi,
    To test your environment, create a new BizTalk project outside of source control.
    Create a simple csv file on the file system.
    Name,City,State
    Bob,New York,NY
    Use the Flat file schema Wizard to create the flat file schema from your simple csv instance.
    Validate the schema.
    Test the schema using your csv instance.
    This will help you determine if everything is ok with you environment.
    Thanks,
    William

  • Deleting master data after loading transactional data using flat file

    Dear All,
    I have loaded transaction data  into an infocube using a flat file . While loading DTP i have checked the  option "load  transactional data with out master data exists" . So transactional data is loaded even if no master data is there in BW.
    While loading the flat file, I made a mistake for DIVISION Characteristic  where original master data value is '04000' , but i loaded the transactional data with value '4000' .Then i later realized after seeing the data from the infocube and deleted the request. then i reloaded data with value '04000'. Till now every thing is fine.
    But when I see the master data for DIVISION , i can see a new entry  with value '4000'.
    My question is how to delete the entry value '4000' from DIVISION. I tried deleting manually this entry from 'maintaining masterdata' , but it is not allowing me to do so .
    I have also checked if any transactional data exists for that value '4000' , as i said earlier I have deleted the transactional data with that values. even tried to delete the entries from the master data table, but i donot see a option to delete entries there.
    Please suggest me on this.
    Regards,
    Veera

    Hi,
    Goto RSA1 right click on the Info object and select Delete Master data. This will delete the master data unused existing in the table.
    If this master data is not used any where else just delete the master data completely with SID option.
    If even this doesnt work you can delete the complete table entire in SE14. But this will wipe out the entire table. Be sure if you wanna do this.
    Hope this helps
    Akhan.

Maybe you are looking for

  • My sim is stuck in simtray and simtray is not coming out.What should i do?

    My sim is stuck in sim tray and it is not coming out.What should i do?

  • Javascript on report load

    Hi to all, i have a problem with a prompt. I need to launch a Javascript at the same time a report load. In practice this javascript function must reset my selection in the prompt linked to this report. Thanks for replies. p.s.:I hope i was clear,sor

  • Mail server not found

    I have set up a enterpirse email account but I get the server is not found.

  • Can't get rid of the itunes icon error

    i have a problem, i tried to update my ipod to the newer versiom but i cant get rid of the "itunes and usb icon" in the ipod. i tried to reset the ipod and its useless. Now my pc dosent recognize the ipod. Its an ipod touch Please i really need help.

  • Care button and finger print reader for 3000 N200 not working

    I have bought Lenovo 3000 N200 model. THe Care button and finger print reader not working. I have loaded the hot key driver as well as finger print reader driver. I have XP OS on my notebook. The software for finger print reader for XP (64 bit) which