Error Loading Data into a flat file

I am recieving the following error when loading data into a flat file from a flat file. SQL 2005 is my back end DB. If I cut the file iin half approx 500K rows my ODI interface works fine. Not sure what to look at.. I rebuit the interface which before was just dying giving no error and now I am getting this.
Thanks
java.lang.Exception
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
     at com.sunopsis.dwg.cmd.e.i(e.java)
     at com.sunopsis.dwg.cmd.g.y(g.java)
     at com.sunopsis.dwg.cmd.e.run(e.java)
     at java.lang.Thread.run(Unknown Source)

Figured it out, found similar post that stated changing the HEAP size
Increase the page size in odiparams.bat in the bin folder and restart Designer.
For eg:
set ODI_INIT_HEAP=128m
set ODI_MAX_HEAP=1024m

Similar Messages

  • Step by Step details on how to load data from a flat file

    hi can anyone explain how to load data from a flat file. Pls giv me step by step details. thnx

    hi sonam.
    it is very easy to load data from flat file. whn compared with other extrations methods...
    here r the step to load transation data from a flat file.......
    step:1 create a Flat File.
    step:2 log on to sap bw (t.code : rsa1 or rsa13).
    and observe the flat file source system icon. i.e pc icon.
    step:3 create required info objects.
    3.1: create infoarea
         (infoObjects Under Modeling > infoObjects (root node)-> context menu -
    > create infoarea).
    3.2:  create char /keyfig infoObject Catalog.(select infoArea ---.context menu --->create infoObject catalog).
    3.3:   create char.. infoObj and keyFig infoObjects accourding to ur requirement and activate them.
    step:4 create infoSource for transaction data and create transfer structure and maintain communication structure...
        4.1: first create a application component.(select InfoSources Under modeling-->infosources<root node>>context menu-->create  applic...component)
       4.2: create infoSource  for transation data(select appl..comp--.context menu-->create infosource)
    >select O flexible update and give info source name..
    >continue..
    4.4: *IMp* ASSIGN DATASOURCE..
      (EXPAND APPLIC ..COMP..>EXPAND YOUR INFOSOURCE>CONTEXT MENU>ASSIGN DATASOURCE.)
    >* DATASOURCE *
    >O SOURCE SYSTEM: <BROWSE AND CHOOSE YOUR FLAT FILE SOURCE SYSTEM>.(EX:PC ICON).
    >CONTINUE.
    4.5: DEFINE DATASOURCE/TRANSFER STRUCTURE  FOR IN FOSOURCE..
    > SELECT TRANSFER STRUCTURE TAB.
    >FILL THE INFOOBJECT FILLED WITH THE NECESSARY  INFOOBJ IN THE ORDER OR SEQUENCE OF FLAT FILE STRUCTURE.
    4.6: ASSIGN TRANSFER RULES.
    ---> NOW SELECT TRANSFER RULES TAB. AND SELECT PROPOSE TRANSFER RULES SPINDLE LIKE ICON.
    (IF DATA TARGET IS ODS -
    INCLUDE 0RECORDMODE IN COMMUNICATION STRUCTURE.)
    --->ACTIVATE...
    STEP:5  CREATE DATATARGET.(INFOCUBE/ODS OBJECT).
    5.1: CREATE INFO CUBE.
    -->SELECT YOUR INFOAREA>CONTEXT MENU>CREATE INFOCUBE.
    5.2: CREATE INFOCUBE STRUCTURE.
    ---> FILL THE STRUCTURE PANE WILL REQUIRE INFOOBJECTS...(SELECT INFOSOURCE ICON>FIND UR INFOSOURCE >DOUBLE CLICK > SELECT "YES" FOR INFOOBJECT ASSIGNMENT ).
    >MAINTAIN ATLEAST  ON TIME CHAR.......(EX; 0CALDAY).
    5.3:DEFINE AND ASSIGN DIMENSIONS FOR YOUR CHARACTERISTICS..
    >ACTIVATE..
    STEP:6 CREATE UPDATE RULES FOR INFOCUDE USING INFOSOURCE .
    >SELECT UR INFOCUBE >CONTEXT MENU> CREATE UPDATE RULES.
    > DATASOURCE
    > O INFOSOURCE : _________(U R INFOSOURCE). AND PRESS ENTER KEY.......
    >ACTIVATE.....UR UPDATE RULES....
    >>>>SEE THE DATA FLOW <<<<<<<<----
    STEP:7  SCHEDULE / LOAD DATA..
    7.1 CREATE INFOPACKAGE.
    --->SELECT INFOSOURCE UNDER MODELING> EXPAND UR APPLIC.. COMP..> EXPAND UR INFOSOURCE..> SELECT UR DATASOURCE ASSIGN MENT ICON....>CONTEXT MENU> CREAE INFOPACKAGE..
    >GIVE INFOPACKAGE DISCREPTION............_________
    >SELECT YOUR DATA SOURCE.-------> AND PRESS CONTINUE .....
    >SELECT EXTERNAL DATA TAB...
    > SELECT *CLIENT WORKSTATION oR APPLI SERVER  >GIVE FILE NAME > FILE TYPE> DATA SAPARATER>
    >SELECT PROCESSING TAB
    > PSA AND THEN INTO DATATARGETS....
    >DATATARGET TAB.
    >O SELECT DATA TARGETS
    [ ] UPDATE DATATARGET CHECK BOX.....
    --->UPDATE TAB.
    O FULL UPDATE...
    >SCHEDULE TAB..
    >SELECT O START DATA LOAD IMMEDIATELY...
    AND SELECT  "START" BUTTON........
    >>>>>>>>>>
    STEP:8 MONITOR DATA
    > CHECK DATA IN PSA
    CHECK DATA IN DATA TARGETS.....
    >>>>>>>>>>> <<<<<<<<<----
    I HOPE THIS LL HELP YOU.....

  • How to load data from a  flat file which is there in the application server

    HI All,
              how to load data from a  flat file which is there in the application server..

    Hi,
    Firstly you will need to place the file(s) in the AL11 path. Then in your infopackage in "Extraction" tab you need to select "Application Server" option. Then you need to specify the path as well as the exact file you want to load by using the browsing button.
    If your file name keeps changing on a daily basis i.e. name_ddmmyyyy.csv, then in the Extraction tab you have the option to write an ABAP routine that generates the file name. Here you will need to append sy-datum to "name" and then append ".csv" to generate complete filename.
    Please let me know if this is helpful or if you need any more inputs.
    Thanks & Regards,
    Nishant Tatkar.

  • Loading data from two flat files into one table

    Hi All,
    I want to load few fields from one file and few fields from another file and load the data into one table in the database.
    For Ex: I have two flat files file1.csv and file2.csv and file1.csv containes 25 columns and file2.csv containes 12 columns, i want to load 20 columns from file1.csv and 7 columns from file2.csv into the table
    how to combine the columns from both the files and load them into one table at a time?
    Any help is appriciated
    Thanks
    R.G

    Use external tables.
    If using Oracle9 or higher connect both your csv with database as separate external tables and load the requited fields in new/requited table.

  • Loading data from remote flat file

    I want to load data from flat file present on Solaris Sparc into Oracle table present on AIX platform. Both machines are on the network.
    According to my research, i can use the following methods.
    1-SQL Loader
    2-Mount drive on Oracle Machine and then use External table.
    Is there any other way of loading table from flat file which is suitable in this scenario.

    While I'm sure we could come up with alternatives, SQL*Loader and external tables would certainly tend to be the most appropriate/ conventional approaches. Is there something about these approaches that does not meet your requirements?
    Justin

  • Error loading data into ODS object

    Hi,
    I am trying to load some data into an ODS object, which actually does not seem very difficult. I got the InfoObjects  and structure of the ODS object all set up. Transfer rules are defined and I succeed in loading the data into PSA.
    From there i trigger the forwarding into the ODS object. And this is what i get (I use the BI in German, so maybe the translations are not 100% correct):
    message missing: tranfer rules finished.
    seems like the system does not get a esponse as to whether the transfer rules are worked through yet. this results in a timeout because nothing happens.
    i'm sorry i cant give any more detailed information. maybe someone can give me a direcion in which to search for mistakes.  irebuilt the transfer rules and compared with others, and found nothing. still the same problem...
    cheers,
    stefan

    Oh yeah, that error message i've been talking about was actually a note in the details of the monitor.
    you can see it here:
    http://www.fape.info/files/data_transfer_monitor_details.bmp
    let me give you some translation.
    - status: some error occured.
    -- data request, ok
    -- extraction, some error
    -- transfer
    ****data packet 1: received in bw, data not processed yet
    ****data packet 2: ...
    ****data packet 3: ...
    -- processing
    --- data packet 1:
    ++++ transfer into PSA, no problem
    transfer rules: error
    ******processing started
    ******missing response: transfer rules complete
    i hope this gives an idea.
    i couldn't come up with any solution so far. don't know why this response is missing after the processing of the data started.

  • How to to load data from a flat file in selection screen in portal .

    Dear All,
    I have a question to share : In BEX analyzer i know how i can upload multiple data in selection screen through a flat file , for example if i have to load 200 materials at one go in the selection screen, i can do that in BEX Analyzer . But if i run the same report through portal i am not able to find the upload option through flat file ..... Am i missing some option here ?
    Thanks & Regards,
    Ashutosh Singh

    You will not be able to load through the portal directly. it is possible to load if you can create Visual composer model. that also you will not be able to upload in bulk.

  • Error writing data in a flat file using UTL_FILE feature

    Hi All,
    I have written a package which fetches data from four different cursors and inserts into a temporary table.
    Now this temporary table is used to write data in a file using the UTL_FILE feature.
    fhandler :=
    UTL_FILE.fopen (l_path,'Demand_Transactions_'
    || TO_CHAR (SYSDATE, 'YYYYMMDDHH24MI')
    || '.txt',
    'w',
    max_linesize => 32767
    This table has 62593 records and when it starts writing data into the file from the table it errors out after writing 30045 records with the error - ORA-01722: invalid number.
    Can anyome please advise me is it because of the max_linesize => 32767. If not then what can be the possible reason.
    Any help in this would be highly appreciated.
    Regards,
    Shruti

    891330 wrote:
    Hi All,
    I have written a package which fetches data from four different cursors and inserts into a temporary table.
    Now this temporary table is used to write data in a file using the UTL_FILE feature.
    fhandler :=
    UTL_FILE.fopen (l_path,'Demand_Transactions_'
    || TO_CHAR (SYSDATE, 'YYYYMMDDHH24MI')
    || '.txt',
    'w',
    max_linesize => 32767
    This table has 62593 records and when it starts writing data into the file from the table it errors out after writing 30045 records with the error - ORA-01722: invalid number.
    Can anyome please advise me is it because of the max_linesize => 32767. If not then what can be the possible reason.Max linesize is the number of characters in a line before a newline has to be issued, not the number of rows written.
    The error would indicate that you have a character to number conversion going on somewhere but the characters are not numeric so it's failing that conversion.
    This doesn't sound like a UTL_FILE issue, but more to do with how you are building up your strings to output to the file.
    You would need to show us your code that builds up the lines you are writing out, with details of the datatypes of any of the columns/variables included in that.

  • Error in Data upload through Flat files in SAP BPC

    Hi,
    we are trying to upload data from flat files in SAP BPC  but an error is coming viz Object reference not set to an instance of an object .

    Hi,
    Can you please cross check the file structure and the transfer structure.
    Cheers,
    Malli....

  • Error loading data into Essbase from the SQL Server

    Hello experts!
    I've got another urgent and confusing issue. I am loading data from an SQL Server view into Essbase (which is reversed with multiple data columns) using ODI 11.1.1.5 and I get the following error at +"3-Loading -SrcSet0-Load Data"+ step:
    ODI-1227: Task SrcSet0 (Loading) fails on the source MICROSOFT_SQL_SERVER connection.
    +Caused By: java.sql.SQLException: [FMWGEN][SQLServer JDBC Driver][SQLServer]Incorrect syntax near the keyword 'View'+
    where "View" is the name of the dimension (non-data) column in the SQL view.
    Please help me with any hints! Thank you so much!

    John, thank you so much!
    Your answer is exactly correct!
    "View" is an object name in SQL Server so this word cannot be used as a column name in SQL Server tables. Once the name of the colunm changed from "View" to another, the interface runs without errors!

  • Loading Date fields from flat file to Oracle tables

    Hi,
    I have a flat file with a few date columns. I have given the format for the date field while creating the data store for the flat file. The format I used is 'YYYY-MM-DD'.
    But I get an error when I execute it after associating the module with LKM & IKM.
    The error message is as follows:
    org.apache.bsf.BSFException: exception from Jython: Traceback (innermost last):
    File "<string>", line 3, in ?
    OS command has signalled errors
    Can anyone help me out.
    Thanks

    At the time of DataStore creation. You take that date field as string.
    After this, in interface, when you map this date field with table field. You should use CONVERT(<field name>,DATE) in expression editor.

  • Error Loading data into ODS from ODS

    I have a loading problem wen trying to load data fro an ODS to another which has a start routine in the Update rules.
    the errors are as follows.
    ERROE 7 when sending IDOC
    &INCLUDE INCL_INSTALLATION ERROR
    &INCLUDE INCL_INSTALLATION ERROR 7
    &INCLUDE INCL_INSTALLATION ERROR 2
    &INCLUDE INCL_INSTALLATION ERROR 5
    Connection Closed (no data) 4
    Connection Closed (no data)
    Connection Closed (no data) 6
    Error in Source System.
    But there are lot of data in the loading ODS
    Please help me

    Hi,
    Please check the following OSS notes.
    Note 610938 - Error 7 during transfer of an IDoc into BW
    Note 610246 - Error 7 when sending an IDoc
    Regards.

  • Error loading data into PSA (Exception in SM58)

    Hello,
    I have a problem to load data from a SAP ERP 6.0 into a (new) SAP BI 7.3 System. I created a DataSource in the ERP system and try to load the data into a PSA. Now, when I start the data load of my InfoPackage, I get following result:
    After that nothing further happens. Then I checked SM58:
    Does this error look familiar to anybody? I'm wondering why the "Target System" column is empty. Maybe there are some basic settings missing?
    Thanks in advance!
    Regards
    Václav

    Hi Raman,
    The requests are marked as successful in SM37.
    RequestId from InfoPackage Monitor:
    And the corresponding job in SM37 (ECC system):
    So this part seems to be fine. What else can I check?
    Thanks & regards
    Václav

  • How to load data from a flat file to two different tables at a time.

    I am not aware of Sql Loader so Please any body suggest me that is there any way to load data from excel sheet to two different tables at a time its very urgent.
    with regards,
    Srinivas.R

    Read Utilities Guide from the Oracle Documentation Library. See
    <br>
    Oracle Database FAQs
    </br>

  • Extracting data into different flat files

    I am using oracle 10g.
    I've to run a very complex query that will extract/spool around 300 million records. It is so expensive to run the query multiple times. I want to run the query once but spool all the jobs into chunks of different files
    so for 300 million records, I want to split the records into 10 different files of 30 million records each. Is it possible to do so??
    Thanks

    Hello,
    Technically it doesn't make any sense and make it poor solution over spooling a file and then splitting. But if O/P comes back and says table is partitioned, now I can use 2 different solution (utl_file or spooling using sqlplus). I will then rely on shell script which will lauch query based on partition and spool a file, once done it close the file and opens a new one for next partition and so on.
    Regards.

Maybe you are looking for