Problem with flat file loading/Special characters

Hi, All,
We just migrated from Version 3.0B to BI7.0, and I've a problem which I can't handle for the moment. We are in Unicode, current codepage of the server is 4103 and codepage of frontend is 4110 (from SNL1 Transaction).
I'm loading czech texts in my material, via CSV files. The CSV file is correct on my PC, I see the special characters.
The problem is on my loading, whatever Character set I choose in the Infopackage (I choose Standard or Character Set Setting User-dependant), I cannot see the good characters.
Does any one of you already encounter this kind of problem, and, if yes, how did you solve it ?
Thanks

hi,
check out with your flat file letter's type, if it's in lower case letter's change them in
upper case letter's. or otherwise change the infobject's type as-- select check box
corresponding to lower case letter's in infoobject.
if helpful provide points
regards
harikrishna.N

Similar Messages

  • Issue with flat file loading timing out

    Hello
    I have a scenario, where I am loading a flat file with 65k records into a cube. The problem is, in the loading process, I have to look up the 0Material table which has a million records.
    I do have an internal table in the program, where I select a subset of the Material table ie around 20k to 30k records. But my extraction process takes more than 1 1/2 hrs and is failing (timed out).
    How can i address this issue? I tried building indexes on the Material table and its not helping.
    Thanks,
    Srinivas.

    Unfortunately, this is BW 3.5, so there is no END routine option here. And I tried both .csv and notepad file methods, and both are creating problems for us.
    This is the total code, do you guyz see any potential issues:
    Start Routine (main code)
    refresh i_oldmats.
    refresh ZI_MATL.
    data: wa_datapak type transfer_structure.
    loop at datapak into wa_datapak. (** I collect all the old material numbers from my flat file into an internal table i_oldmats**)
       i_oldmats-/BIC/ZZOLDMATL = wa_datapak-/BIC/ZZOLDMATL.
       collect i_oldmats.
    endloop.
    sort i_oldmats.
      SELECT /BIC/ZZOLDMATL MATERIAL (** ZI_MATL only has recs. where old materials exist, this gets about 300k records out of 1M**)
             FROM /BI0/PMATERIAL
             INTO ZI_MATL FOR ALL
             ENTRIES in i_oldmats WHERE
              /BIC/ZZOLDMATL = i_oldmats-/BIC/ZZOLDMATL .
                collect    ZI_MATL.
      Endselect.
      Sort ZI_MATL.
    Transfer rule routine (main code)
    IF TRAN_STRUCTURE-MATERIAL = 'NA'.
        READ TABLE ZI_MATL INTO ZW_MATL
        WITH KEY /BIC/ZZOLDMATL = TRAN_STRUCTURE-/BIC/ZZOLDMATL
        BINARY SEARCH.
        IF SY-SUBRC = 0.
          RESULT = ZW_MATL-MATERIAL.
        ENDIF.
      ELSE.
        RESULT = TRAN_STRUCTURE-MATERIAL.
      ENDIF.
    Regards,
    Srinivas.

  • Problem with flat-file to oracle

    Hi all,
    Flat-file has 7 columns , all are varchar
    SALE_2007
    C1 VARCHAR2(255),
    C2 VARCHAR2(255),
    C3 VARCHAR2(255),
    C4 VARCHAR2(255),
    C5 VARCHAR2(255),
    C6 VARCHAR2(255),
    C7 VARCHAR2(255)
    target also has 7 columns , first four column were varchar and the last 3 columns were numeric(20,2).
    SALE
    TIMECODE VARCHAR2(255),
    CUSTCODE VARCHAR2(255),
    SALECODE VARCHAR2(255),
    PRODUCTCODE VARCHAR2(255),
    AMOUNT NUMERIC(20,2),
    COST NUMERIC(20,2),
    SALEAMOUNT NUMERIC(20,2)
    I have mapping the transformation on the staging with these function (ordering by order as above)
    SALE_2007.C1
    SALE_2007.C2
    SALE_2007.C3
    SALE_2007.C4
    TO_NUMBER(REPLACE(SALE_2007.C5,',',''))
    TO_NUMBER(REPLACE(SALE_2007.C6,',',''))
    TO_NUMBER(REPLACE(SALE_2007.C7,',',''))
    I have to use replace function because in the text file there is a comma in the data eg. 1,400.35
    and the ODI will error in the step insert into flow table with error
    +1722 : 42000 : java.sql.SQLException: ORA-01722: invalid number+
    java.sql.SQLException: ORA-01722: invalid number*
    Please advise
    Thank you all

    Hi-
    It seems like there is non-numeric characters present in your C5-C7 columns. Please check your source data for these columns.
    Thanks,
    Saravanan Rajavel

  • Issue with flat file load

    Hello,
    I am trying to load data via flat file. we have entries in a field which starts with 0s are skipped when we load in CSV format.
    like i have an entry  00657, is being loaded as 657 .
    How can i prevent this?
    Thanks.
    Praveen

    Hi Praveen,
    It is of lenghth 5. but when i upload CSV file it is not considering 00 infront. But i want those. I am loading hierarchy from flatfile.
    Suggest me, if we can also load from text ?.
    Thanks.
    Praveen

  • Problem in flat file loading(bulk data)

    Hi,
    I am populating a flat file with 3lac records. I am getting error due to buffer space problem.
    "Error during target file write "
    around 2 lac records are getting inserted after that the above error is coming..
    Now temporarily I am populating 1.5 lac and 1.5 lac in two times.
    Could anyone please tell me how to solve this issue .
    Thanks in Advance.

    I am using owb 10.2 version.
    In the map source is a Oracle table, Target is a flat file.
    Source table contains 3lac records.
    I executed the map. During execution it is throwing the following error .
    "Error during target file write "
    But it has inserted 2lac records in the target file.

  • Problem with applet file loading

    I have a problem with loading files into a java applet. import java.applet.*;
    import java.awt.*;
    import java.io.*;
    import java.util.*;
    import java.net.*;
    public class main extends Applet {
         private static ArrayList<String> SGM;
         public void init() {
              SGM = new ArrayList<String>();
              String gameDir = getParameter("game_dir");
              try {
                   File fHandle = new File(gameDir+"game.sgm");
                   Scanner fScanner = new Scanner(fHandle);
                   while(fScanner.hasNextLine()) {
                        SGM.add(fScanner.nextLine());
                   //System.out.println(SGM.get(0));
              } catch(Exception e) {
                   System.out.println("Applet threw error: "+e);
    ...The problem is with File fHandle = new File(gameDir+"game.sgm"); I tried putting File(gameDir+"/game.sgm"); and appending / to the folder in the <PARAM> tag, but it still changes it to \, which means I can only run it locally, and in Windows. Why is it doing this, and how can I fix it?

    This file you were hoping to load: it's on the server, right? Not on the computer where the applet is running in a browser?
    (At least that's a common mistake made by people when they write their first applet.)
    If that's the case then you can't use a File object to access a file on a different computer. To access a file on the server, first you will have to put the file in a place on the server where it can be downloaded. Then in your applet you need to get a URL for the file. (The getDocumentBase() method can be used to prevent you from having to hard-code the full URL for the file.) Next, "this.getClass().getResourceAsStream(URL)" gets you an InputStream from which you can read the data from the file.

  • Problem with flat file upload with ASCII file

    Hi All,
    I am trying to load data into an ODS object via PSA using a text file (tab delimited). I have the following settings in my InfoPackage
    External Data tab: ASCII File
    Seperator for thousands:
    Character for decimal point:
    Currency Conversion:
    Number of Header rows to be ignored: 1
    Processing tab: Only PSA and Update into data targets subsequently
    When I do a preview the data is not showing up in the right format....the tab seperation does not work and data is garbled with extra hexadecimal characters too.
    The same file contents in .csv format is loading the data in the right format and preview is fine too.
    I need help trying to convert this csv file to .txt format.
    Any clues are highly appreciated
    Thank you

    Hi,
    If in the infopackage you click on a File Type ASCII-file (CR delimiter) radiobutton and then F1, you’ll see the help:
    “With an ASCII file as a data source, the data has to be available as a string in the format of the transfer structure. There are no data separators, empty characters are not ignored.”
    This means that:
    -     you shouldn’t use any delimiters among the record fields
    -     all fields should have the length the system expects (length of the appropriate infoobject in transfer structure)
    -     each record should be separated from the next by carriage return CR.
    Since I think the program that converts file from Excel format into CR-delimited would be very useful, I created such program in VBA.
    So, open your Excel file (if you have csv-file you can open it using Excel).
    The program assumes that the first row of the file contain field names. Data itself begin from the 2nd row. Insert as the 1st and 2nd rows the new, blank rows.
    Into A1 cell insert number of the last row with data, into B1 – number of the last column. Certainly, it may be determined in the program, but I have not done it – if someone wants it, s/he can try it.
    Into fields of the 2nd row insert expected length of the field.
    Make sure that “Visual Bacis” toolbar is seen. (If not – tick in menu path: View/Toolbars/Visual Basic).
    In this toolbar click on a ‘Design Node’ icon.
    Drag from the toolbar and drop into worksheet a ‘Command button’ element.
    Double click on the button. In the open window for “Private Sub CommandButton1_Click()” subroutine insert the following code:
    Dim ws1 As Worksheet
    Dim J As Long, I As Long, L As Long
    Dim FileName As String, Out As String, formatOut As String
    Dim LenCell As Long
    Set ws1 = ThisWorkbook.Worksheets("SHEET1")
    FileName = ThisWorkbook.Path & "\" & Left(ThisWorkbook.Name, Len(ThisWorkbook.Name) - 3) & "txt"
    Open FileName For Output As #1
    For J = 4 To ws1.Cells(1, 1)
        Out = ""
        For I = 1 To ws1.Cells(1, 2)
            formatOut = (ws1.Cells(J, I))
            L = Len(formatOut)
            LenCell = Val(ws1.Cells(2, I))
            If L > LenCell Then
                formatOut = Left(formatOut, LenCell)
            Else
                Do While L < LenCell
                    formatOut = formatOut & " "
                    L = L + 1
                Loop
            End If
            Out = Out & formatOut
        Next
            Print #1, Out
    Next
    Close #1
    Set ws1 = Nothing
    MsgBox "File transformation finished!", vbOKOnly
    Now return to Excel sheet, click again ‘Design Node’ icon switching into run mode.
    When you press on this button now, the ASCII program will be created. It will have the same name as an input file (and in the same directory), but with TXT extention.
    Remarks:
    -     The program works with the current worksheet named as “SHEET1”.
    -     Fields that are shorter than those expected by the system are padded by spaces from the right. It should not be the problem, since in transfer structure you can check symbols only flag.
    -     Longer fields are truncated to the length expected.
    Best regards,
    Eugene
    Message was edited by: Eugene Khusainov

  • Problem with jar file & loading manifest file

    Hi Friends
    i developing one application using java Swing
    i deploying the whole application using the jar Utility.
    but while installing & deploying this application on my machine & on the another machine error occured
    which showing that failed to load manifestfile from main module Or Main class.
    why this is happen? any other Java settings OR changing in java settings of the machine required while deploying this application on the other machine
    please guide me.

    Show the contents of the manifest file,
    and what command you used to run the program,
    and what directory you ran the command from.
    and what's the current classpath setting (if any).

  • Flat-File Loading problem

    Hi Friends,
    I am struggling with flat-file loading problem. I am trying to load a .csv file into data target. I took all pre-cautions while loading data. I look into preview and simulate the data. Everything is ok, but when i schedule the data, i found 0 records in the monitor. The following is the STATUS message of the above problem:
       No data available
    Diagnosis
    The data request was a full update.
    In this case, the corresponding table in the source system does not
    contain any data.
    System response
    Info IDoc received with status 8.
    Procedure
    Check the data basis in the source system.
             Can anybody help me what is the problem and procdure to resolve it?
    Regards,
    Mahesh

    Hi Eugene,
    Thanks for the quick reply. The following screen-shot tells you the messages of detail tab;
    OVER ALL STATUS MISSING WITH MESSAGES OR WARNINGS
    REQUEST: MISSING MESSAGES
    EXTRACTION
    EVERYTHING IS OK
    DATA REQUEST RECEIVED
    NO DATA AVAILABLE DATA ELECTION ENDED.
    PROCESSING
    NO DATA
               The above message was shown in details tab. Pls guide me to locate the problem.
    Regards,
    Mahesh

  • Flat File loading Initialize with out Data transfer is disabled in BI 7.0

    Hi experts,
              When loading through flat file in BI 7.0 for Info Package Level Initialization Delta Process with data Transfer is coming by default,but when i want to select Initialization Delta Process without Data transfer is disabled. (in the creation of Data Source (flat file) in the Extraction Tab Delta Process is changed to FIL1 Delta Data (Delta Images).
    please provide me Solution.
    regards
    Subba reddy.

    Hi Shubha,
    For flat file load please go throught he following link:
    http://help.sap.com/saphelp_nw70/helpdata/EN/43/03450525ee517be10000000a1553f6/frameset.htm
    This will help.
    Regards,
    Mahesh

  • Urgent: Flat file load issue

    Hi Guru's,
    Doing loading in data target ODS via flat file, problem is that flat files shows date field values correct of 8 characters but when we do preview it shows 7 characters and loading is not going through.
    Anyone knows where the problem is why in the preview screen it shows 7 characters of date when flat file has 8 characters.
    Thanks
    MK

    Hi Bhanu,
    How do i check if conversion is specified or not and another thing is it is not just one field we have 6 date fields and all of them are showing 7 characters in PSA after loading where as flat file have 8 characters in all of the 6 date fields.
    In PSA I checked the error message it shows 2 error messages:
    First Error message:
    The value '1# ' from field /BIC/ZACTDAYS is not convertible into the    
    DDIC data type QUAN of the InfoObject in data record 7 . The field      
    content could not be transferred into the communication structure       
    format.                                                                               
    em Response                                                                               
    The data to be loaded has a data error or field /BIC/ZACTDAYS in the    
    transfer structure is not mapped to a suitable InfoObject.                                                                               
    The conversion of the transfer structure to the communication structure 
    was terminated. The processing of data records with errors was continued
    in accordance with the settings in error handling for the InfoPackage   
    (tab page: Update Parameters).                                                                               
    Check the data conformity of your data source in the source system.                                                                               
    On the 'Assignment IOBJ - Field' tab page in the transfer rules, check    
    the InfoObject-field assignment for transfer-structure field              
    /BIC/ZACTDAYS .                                                                               
    If the data was temporarily saved in the PSA, you can also check the      
    received data for consistency in the PSA.                                                                               
    If the data is available and is correct in the source system and in the   
    PSA, you can activate debugging in the transfer rules by using update     
    simulation on the Detail   tab page in the monitor. This enables you to   
    perform an error analysis for the transfer rules. You need experience of  
    ABAP to do this.                                                                               
    2nd Error Message:
    Diagnosis                                                                               
    The transfer program attempted to execute an invalid arithmetic          
        operation.                                                                               
    System Response                                                                               
    Processing was terminated, and indicated as incorrect. You can carry out 
        the update again any time you choose.                                                                               
    Procedure                                                                               
    1.  Check that the data is accurate.                                                                               
    -   In particular, check that the data types, and lengths of the     
                transferred data, agree with the definitions of the InfoSource,  
                and that fixed values and routines defined in the transfer rules                                                                               
    -   The error may have arisen because you didn't specify the      
             existing headers.                                                                               
    2.  If necessary, correct the data error and start processing again.  
    Thanks
    MK

  • Flat File Loading

    Hi Experts,
    I am loading data from Flat File to DSO.I got the following error while activating Data in DSO.
    "No SID found for value '      0500136A' of characteristic 0MAT_SALES"
    I have checked in Material sales master data  I have the value 0500136A in .If you see above error it showing some space in front of 0500136A.I am not seeing that space in master data.I was edidted again and loaded to DSO and activated Then I got same error.Is it problem with Excel File formatting related.Pls through some light onthe issue.
    Thanks,
    Suryam.

    Hi All,
    Thank you.
    Khaja,
    I got the data upto PSA is fine and I am able to load the data in to DSO but I got the error while activating DSO
    Ashok,
    I loaded master data before loading Transactional data.May be it problem with file format.How can I check these format issues.
    Brian,
    We are using Transformation in BI7.0.I tried put conversion in DataSource level i.e Alpha for the field.But still I am getting same error.
    Pls advice me on the above issue.
    Thanks,
    Suryam.

  • How to built a hierarchy with flat file?

    Hi Experts,
    for a better representation of the report, i need to built a hierarchy with flat file.
    The Data load is via Flat file.
    Do you have some documentation about that?
    Thanks
    Cheers
    Gilo

    Hi Gilo,
       Check these docs...
    <a href="https://www.sdn.sap.comhttp://www.sdn.sap.comhttp://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/0403a990-0201-0010-38b3-e1fc442848cb">How to… Download a Hierarchy to a Flat File</a>
    <a href="http://help.sap.com/saphelp_nw04/helpdata/en/fa/e92637c2cbf357e10000009b38f936/content.htm">Uploading Hierarchies from Flat Files</a>
    <a href="http://sapbwneelam.blogspot.com">More Docs...</a>
    Hope it Helps
    Srini

  • Transformation not generating-Flat file loading

    Hello guys, I hope you can help me with this little confusion I have on BI7 Flat file loading.
    I got a File (CSV) on my workstation. I am trying to load Master Data. Here is the example of my file and issues:
    Lets say, I have CSV file named "CarModel.CSV" on my PC.
    This excel file has 10 Records and No atributes for this Field.
    So the records should show like this and it is showing correctly in PSA level, DS level.
    A
    B
    C
    D
    E
    F
    My goal is to load Flat file data to InfoObject (inserted in Infoprovider)
    I created Source system, DS, all thats stuffs.
    I am now on Display DS screen under Proposal Tab. I am putting 10 Records to show and hitting Load example data....it works fine by showing all 10 records. However in the bottom part of this screen, what should show as a Field ?In my case , First it was showing the First Record ("A")...i didnt think it was correct but i prceeded anyways. Transformation could not be generated.
    I tried by deleting "1" from the field "No. of header rows to be ignored" and its the same result ..No transformations.. I mean i know its very simple to load this data but i am not sure what i am doing wrong..My question is:
    1) What should show under Field/propasal tab in my case?am i supposed to create this Field?
    2) Should the system to propse the field which is from my flat file header ?in my case i dont have any header..should i have include header in my csv file like "car model"? i am confused please give me some info thanks
    dk

    Hi,
    In filed tab, u have to enter ur infoobject names in an order...and press enter it'll automatically give the description and its other factors...
    i guess u shuld have some header in the sense eg: customer,cust ID like this..this only u have to enter as fields...in proposal tab...try that
    rgds,

  • Flat File loading into Hierarchy

    Dear Gurus,
    I am trying to load a hierarchy from a flat file.  I am not able to do it successfully.
    I have a small doubt.  Do we need to load the master data into the master data table before loading the hierarchy?
      Explanation:
    I have an info object zcountry  and i had added zzone and zstate as external characteristics in hierarchy.  the hierarchy structure should be  country with 2 nodes zone1,zone2 and zone one should have 2 states under it as nodes.  In this case do I need to maintain the master data in the infoobjects before loading the hierarchies with flat file.?
    <b>Node ID     InfoObject     Node Name     Link     Parent ID     Language     Short-Txt     Medium-Txt     Long-Txt</b>
    1;     zcountry;     CountryNode;          0;     en;     CountryNode;     CountryNode;     CountryNode;
    2;     zzone1;     SouthZone;          1;     en;     SouthZoneNode;     SouthZoneNode;     SouthZoneNode;
    3;     zstate;     AndhraPradesh;          2;     en;     AndhraPradesh;     AndhraPradesh;     AndhraPradesh;
    4     zstate     Karnataka          2     en     Karnataka     Karnataka     Karnataka
    5     zzone1     NorthZone          1     en     NorthZoneNode     NorthZoneNode     NorthZoneNode
    6     zstate     Haryana          5     en     Haryana     Haryana     Haryana
    7     zstate     Rajastan          5     en     Rajastan     Rajastan     Rajastan
    This is how the flat file looks like.
    Kindly give me a solution.
    Regards
    Mohan Kumar.
    Message was edited by:
            mohan kumar
    Message was edited by:
            mohan kumar

    Dear Gurus,
    I also followed the same weblog  but still i am not able to do that.  That is the reason why I asked the question in that detail (with the data I am trying to load).
    Regards
    Mohan Kumar

Maybe you are looking for

  • Autoconfig -patch error

    Hai frnds , iam getting the eroor when i run autoconfig =========================[AutoConfig Error Report] The following report lists errors AutoConfig encountered during each phase of its execution. Errors are grouped by directory and phase. The rep

  • Yosemite crashes with Logitech bluetooth touchpad

    Mac Mini late 2012 with OSX Yosemite crashes and reboots constantly when there is Logitech bluetooth touchpad connected. However if I turn touchpad power off after few hour use, everything keeps working fine. Keeping touchpad powered all the time cra

  • Issue in Partner Function

    Hi all, I have an issue. I have created a customer say 'A' and a ship to party say 'B' and 'C'. In customer master of 'A', I have assigned ship to party 'B'. At the time of order creation for 'A', system shows me 'B' as possible option for ship to pa

  • Unable to open PageMaker7

    I have been using Pagemaker 7 for a few years now. Three days ago for the first time i have problems. I cannot open any of the files, when I try and open the PM I get thsi message:           "Cannot find PageMaker's resource file pm70.rsl" can any on

  • Set width of a decorative box

    I have a decorative box and inside that I am showing a text. Now the decorative box is stretched to the entire width of the Screen, but I want it to stretch only as much as the text its containing. I have set the "dimensionsForm" property to "childre