Validation of loaded data

I am loading fixed width flat-files into Oracle tables using OWB (SQL*Loader). What's the best way by which I can test the validity/correctness of data i.e. match apples-to-apples ?
Do you use any test scripts ? If so, then could you please elaborate ?
Uptil now, I have been only checking for count validations but not actual data validation.
Your inputs will be invaluable.
Thanks
John.

Hi,
I validate using a set of functions in a package that return substitute values. On the basis of these substitue values records are accepted or rejected. The set contains functions for validation of date & number fields.
So, in short. Write function to validate numbers or dates. Insert known substitue values for erroneous data and validate in the next step on these substitute values.
Hope this is what you're looking for.
Cheers,
Rob

Similar Messages

Unable to load data from DSO to Cube

Good morning all,
I was trying to load data from DSO to Cube for validation. Before loading the new data, I deleted all from DSO and Cube. They contain no request at all. Cube has "Delta Update". First DSO was loaded 138,300 records successfully. Then Activated the DSO. The last when I clicked Exectue (DSO --> Cube), it loaded 0 record. I was able to load the data yesterday. What might be the reasons for this situation?
Thank you so much!

Hi BI User,
For loading delta upload into the data target, there should be an initialization request in the data target with same selection criteria.
So..first do the initialization and perform delta upload into the cube.
Regards,
Subhashini.

Getting error While loading data from ERP integrator to HFM

Hello,
We are getting the following error while loading the data from ERPI to HFM.
2013-12-31 22:44:54,133 INFO [AIF]: ERPI Process Start, Process ID: 300
2013-12-31 22:44:54,137 INFO [AIF]: ERPI Logging Level: DEBUG (5)
2013-12-31 22:44:54,139 INFO [AIF]: ERPI Log File: C:\Windows\TEMP\/aif_501_300.log
2013-12-31 22:44:54,141 INFO [AIF]: Jython Version: 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Java HotSpot(TM) 64-Bit Server VM (Oracle Corporation)]
2013-12-31 22:44:54,143 INFO [AIF]: Java Platform: java1.7.0_25
2013-12-31 22:44:56,821 INFO [AIF]: COMM Process Periods - Insert Periods - START
2013-12-31 22:44:56,828 DEBUG [AIF]:
        SELECT l.SOURCE_LEDGER_ID
        ,l.SOURCE_LEDGER_NAME
        ,l.SOURCE_COA_ID
        ,l.CALENDAR_ID
        ,'0' SETID
        ,l.PERIOD_TYPE
        ,NULL LEDGER_TABLE_NAME
        FROM AIF_BALANCE_RULES br
        ,AIF_COA_LEDGERS l
        WHERE br.RULE_ID = 27
        AND l.SOURCE_SYSTEM_ID = br.SOURCE_SYSTEM_ID
        AND l.SOURCE_LEDGER_ID = br.SOURCE_LEDGER_ID
2013-12-31 22:44:56,834 DEBUG [AIF]:
    INSERT INTO AIF_PROCESS_PERIODS (
      PROCESS_ID
      ,PERIODKEY
      ,PERIOD_ID
      ,ADJUSTMENT_PERIOD_FLAG
      ,GL_PERIOD_YEAR
      ,GL_PERIOD_NUM
      ,GL_PERIOD_NAME
      ,GL_PERIOD_CODE
      ,GL_EFFECTIVE_PERIOD_NUM
      ,YEARTARGET
      ,PERIODTARGET
      ,IMP_ENTITY_TYPE
      ,IMP_ENTITY_ID
      ,IMP_ENTITY_NAME
      ,TRANS_ENTITY_TYPE
      ,TRANS_ENTITY_ID
      ,TRANS_ENTITY_NAME
      ,PRIOR_PERIOD_FLAG
      ,SOURCE_LEDGER_ID
            SELECT DISTINCT brl.LOADID PROCESS_ID
            ,pp.PERIODKEY PERIODKEY
            ,prd.PERIOD_ID
            ,COALESCE(prd.ADJUSTMENT_PERIOD_FLAG, 'N') ADJUSTMENT_PERIOD_FLAG
            ,COALESCE(prd.YEAR,0) GL_PERIOD_YEAR
            ,COALESCE(prd.PERIOD_NUM,0) GL_PERIOD_NUM
            ,prd.PERIOD_NAME GL_PERIOD_NAME
            ,COALESCE(prd.PERIOD_CODE, CAST(COALESCE(prd.PERIOD_NUM,0) AS VARCHAR(38))) GL_PERIOD_CODE
            ,(COALESCE(prd.YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM,0)) GL_EFFECTIVE_PERIOD_NUM
            ,COALESCE(ppa.YEARTARGET, pp.YEARTARGET) YEARTARGET
            ,COALESCE(ppa.PERIODTARGET, pp.PERIODTARGET) PERIODTARGET
            ,'PROCESS_BAL_IMP' IMP_ENTITY_TYPE
            ,(COALESCE(prd.YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM,0)) IMP_ENTITY_ID
            ,prd.PERIOD_NAME IMP_ENTITY_NAME
            ,'PROCESS_BAL_TRANS' TRANS_ENTITY_TYPE
            ,(COALESCE(prd.YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM,0)) TRANS_ENTITY_ID
            ,pp.PERIODDESC TRANS_ENTITY_NAME
            ,'N' PRIOR_PERIOD_FLAG
            ,1 SOURCE_LEDGER_ID
            FROM (
              AIF_BAL_RULE_LOADS brl
              INNER JOIN TPOVCATEGORY pc
                ON pc.CATKEY = brl.CATKEY
              INNER JOIN TPOVPERIOD_FLAT_V pp
                ON pp.PERIODFREQ = pc.CATFREQ
                AND pp.PERIODKEY >= brl.START_PERIODKEY
                AND pp.PERIODKEY <= brl.END_PERIODKEY
              LEFT OUTER JOIN TPOVPERIODADAPTOR_FLAT_V ppa
                ON ppa.PERIODKEY = pp.PERIODKEY
                AND ppa.PERIODFREQ = pp.PERIODFREQ
                AND ppa.INTSYSTEMKEY = 'FMTEST2'
            INNER JOIN AIF_GL_PERIODS_STG prd
              ON prd.SOURCE_SYSTEM_ID = 3
              AND prd.CALENDAR_ID IN ('10000')
      AND prd.SETID = '0'
      AND prd.PERIOD_TYPE = 'Month'
              AND prd.ADJUSTMENT_PERIOD_FLAG = 'N'
              AND prd.START_DATE > pp.PRIORPERIODKEY
              AND prd.START_DATE <= pp.PERIODKEY
            WHERE brl.LOADID = 300
            ORDER BY pp.PERIODKEY
            ,GL_EFFECTIVE_PERIOD_NUM
2013-12-31 22:44:56,915 INFO [AIF]: COMM Process Periods - Insert Periods - END
2013-12-31 22:44:56,945 INFO [AIF]: COMM Process Periods - Insert Process Details - START
2013-12-31 22:44:56,952 DEBUG [AIF]:
    INSERT INTO AIF_PROCESS_DETAILS (
      PROCESS_ID
      ,ENTITY_TYPE
      ,ENTITY_ID
      ,ENTITY_NAME
      ,ENTITY_NAME_ORDER
      ,TARGET_TABLE_NAME
      ,EXECUTION_START_TIME
      ,EXECUTION_END_TIME
      ,RECORDS_PROCESSED
      ,STATUS
      ,LAST_UPDATED_BY
      ,LAST_UPDATE_DATE
      SELECT PROCESS_ID
      ,ENTITY_TYPE
      ,ENTITY_ID
      ,ENTITY_NAME
      ,ENTITY_NAME_ORDER
      ,'AIF_EBS_GL_BALANCES_STG' TARGET_TABLE_NAME
      ,CURRENT_TIMESTAMP EXECUTION_START_TIME
      ,NULL EXECUTION_END_TIME
      ,0 RECORDS_PROCESSED
      ,'PENDING' STATUS
      ,'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER' LAST_UPDATED_BY
      ,CURRENT_TIMESTAMP LAST_UPDATE_DATE
      FROM (
        SELECT DISTINCT PROCESS_ID
        ,IMP_ENTITY_TYPE ENTITY_TYPE
        ,IMP_ENTITY_ID ENTITY_ID
        ,IMP_ENTITY_NAME ENTITY_NAME
        ,(COALESCE(SOURCE_LEDGER_ID,0) * 100000000 + GL_EFFECTIVE_PERIOD_NUM) ENTITY_NAME_ORDER
        FROM AIF_PROCESS_PERIODS
        WHERE PROCESS_ID = 300
      ) q
      ORDER BY ENTITY_NAME_ORDER
2013-12-31 22:44:56,963 DEBUG [AIF]:
    INSERT INTO AIF_PROCESS_DETAILS (
      PROCESS_ID
      ,ENTITY_TYPE
      ,ENTITY_ID
      ,ENTITY_NAME
      ,ENTITY_NAME_ORDER
      ,TARGET_TABLE_NAME
      ,EXECUTION_START_TIME
      ,EXECUTION_END_TIME
      ,RECORDS_PROCESSED
      ,STATUS
      ,LAST_UPDATED_BY
      ,LAST_UPDATE_DATE
      SELECT PROCESS_ID
      ,ENTITY_TYPE
      ,ENTITY_ID
      ,ENTITY_NAME
      ,ENTITY_NAME_ORDER
      ,'TDATASEG' TARGET_TABLE_NAME
      ,CURRENT_TIMESTAMP EXECUTION_START_TIME
      ,NULL EXECUTION_END_TIME
      ,0 RECORDS_PROCESSED
      ,'PENDING' STATUS
      ,'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER' LAST_UPDATED_BY
      ,CURRENT_TIMESTAMP LAST_UPDATE_DATE
      FROM (
        SELECT PROCESS_ID
        ,TRANS_ENTITY_TYPE ENTITY_TYPE
        ,MIN(TRANS_ENTITY_ID) ENTITY_ID
        ,TRANS_ENTITY_NAME ENTITY_NAME
        ,MIN(COALESCE(SOURCE_LEDGER_ID,0) * 100000000 + GL_EFFECTIVE_PERIOD_NUM) ENTITY_NAME_ORDER
        FROM AIF_PROCESS_PERIODS
        WHERE PROCESS_ID = 300
        AND PRIOR_PERIOD_FLAG = 'N'
        GROUP BY PROCESS_ID
        ,TRANS_ENTITY_TYPE
        ,TRANS_ENTITY_NAME
      ) q
      ORDER BY ENTITY_NAME_ORDER
2013-12-31 22:44:56,970 INFO [AIF]: COMM Process Periods - Insert Process Details - END
2013-12-31 22:44:57,407 DEBUG [AIF]: EBS/FS GL Balances Print Variables - Printing Variables - START
2013-12-31 22:44:57,408 DEBUG [AIF]:
p_process_id: 300
p_sql_db_type: ORACLE
p_partitionkey: 12
p_rule_id: 27
p_source_system_id: 3
p_application_id: 26
p_target_application_type: HFM
p_is_multi_currency: true
p_data_load_method: CLASSIC_VIA_EPMI
p_bal_balance_method_code: STANDARD
p_bal_ledger_group_code: SINGLE
p_bal_amount_type: MONETARY
p_prd_entity_name: JAN-13
p_prd_period_id: 135
p_prd_gl_period_name: JAN-13
p_prd_source_ledger_id: 1
p_prd_source_coa_id: 101
p_source_ledger_id: 1
p_source_coa_id: 101
p_bal_actual_flag: A
p_bal_seg_column_name: SEGMENT1
p_max_ccid_loaded_to_stg: 148137
2013-12-31 22:44:57,408 DEBUG [AIF]: EBS/FS GL Balances Print Variables - Printing Variables - END
2013-12-31 22:44:57,806 INFO [AIF]: LKM EBS/FS Extract Type - Load Audit AND Full Refresh - START
2013-12-31 22:44:57,817 DEBUG [AIF]:
    SELECT p.PROCESS_ID
    ,br.RULE_NAME
    ,l.SOURCE_LEDGER_NAME
    FROM AIF_GL_LOAD_AUDIT aud
    ,AIF_PROCESSES p
    ,AIF_BALANCE_RULES br
    ,AIF_COA_LEDGERS l
    WHERE aud.SOURCE_SYSTEM_ID = 3
    AND aud.SOURCE_LEDGER_ID = 1
    AND aud.GL_PERIOD_ID = 135
    AND aud.BALANCE_TYPE = 'A'
    AND p.PROCESS_ID = aud.LAST_LOADID
    AND p.STATUS = 'RUNNING'
    AND p.PROCESS_ID <> 300
    AND br.RULE_ID = p.RULE_ID
    AND l.SOURCE_SYSTEM_ID = aud.SOURCE_SYSTEM_ID
    AND l.SOURCE_LEDGER_ID = aud.SOURCE_LEDGER_ID
2013-12-31 22:44:57,826 DEBUG [AIF]:
        SELECT 'Y' VALID_FLAG
        FROM GL_PERIOD_STATUSES
        WHERE APPLICATION_ID = 101
        AND SET_OF_BOOKS_ID = 1
        AND PERIOD_NAME = 'JAN-13'
        AND CLOSING_STATUS IN ( 'O','C','P' )
2013-12-31 22:44:57,847 DEBUG [AIF]:
        SELECT 'Y' EXISTS_FLAG
        FROM GL_TRACK_DELTA_BALANCES
        WHERE SET_OF_BOOKS_ID = 1
        AND PROGRAM_CODE = 'FEM'
        AND PERIOD_NAME = 'JAN-13'
        AND ACTUAL_FLAG = 'A'
        AND EXTRACT_LEVEL_CODE = 'DTL'
        AND CURRENCY_TYPE_CODE = 'B'
        AND ENABLED_FLAG = 'Y'
2013-12-31 22:44:57,883 DEBUG [AIF]:
      SELECT MAX(DELTA_RUN_ID) MAX_DELTA_RUN_ID
      FROM GL_BALANCES_DELTA
      WHERE SET_OF_BOOKS_ID = 1
      AND PERIOD_NAME = 'JAN-13'
      AND ACTUAL_FLAG = 'A'
2013-12-31 22:44:57,898 DEBUG [AIF]:
    SELECT brl.EXECUTION_MODE
    ,( SELECT CASE COUNT(aud.DELTA_RUN_ID) WHEN 0 THEN 'N' ELSE 'Y' END
      FROM AIF_GL_LOAD_AUDIT aud
      WHERE aud.SOURCE_SYSTEM_ID = 3
      AND aud.SOURCE_LEDGER_ID = 1
      AND aud.GL_PERIOD_ID = 135
      AND aud.BALANCE_TYPE = 'A'
      AND aud.LAST_LOADID <> brl.LOADID
      AND COALESCE( aud.STATUS, 'SUCCESS' ) = 'SUCCESS'
     ) GL_LOAD_AUDIT_SUCCESS_FLAG
    ,( SELECT CASE COUNT(aud.DELTA_RUN_ID) WHEN 0 THEN 'N' ELSE 'Y' END
      FROM AIF_GL_LOAD_AUDIT aud
      WHERE aud.SOURCE_SYSTEM_ID = 3
      AND aud.SOURCE_LEDGER_ID = 1
      AND aud.GL_PERIOD_ID = 135
      AND aud.BALANCE_TYPE = 'A'
      AND aud.LAST_LOADID <> brl.LOADID
      AND aud.STATUS = 'RUNNING'
     ) GL_LOAD_AUDIT_RUNNING_FLAG
    FROM AIF_BAL_RULE_LOADS brl
    WHERE brl.LOADID = 300
2013-12-31 22:44:57,904 DEBUG [AIF]:
    INSERT INTO AIF_GL_LOAD_AUDIT ( LAST_LOADID
      ,DELTA_RUN_ID
      ,SOURCE_SYSTEM_ID
      ,SOURCE_LEDGER_ID
      ,GL_PERIOD_ID
      ,BALANCE_TYPE
      ,GL_EXTRACT_TYPE
      ,STATUS
     ) VALUES ( 300
      ,0
      ,3
      ,1
      ,135
      ,'A'
      ,'FULLREFRESH'
      ,'RUNNING'
2013-12-31 22:44:57,907 DEBUG [AIF]:
      DELETE FROM AIF_EBS_GL_BALANCES_STG
      WHERE SOURCE_SYSTEM_ID = 3
      AND SOURCE_COA_ID = 101
      AND SOURCE_LEDGER_ID = 1
      AND ACTUAL_FLAG = 'A'
      AND PERIOD_NAME = 'JAN-13'
2013-12-31 22:44:59,283 INFO [AIF]: LKM EBS/FS Extract Type - Load Audit AND Full Refresh - END
2013-12-31 22:45:06,507 INFO [AIF]: COMM End Process Detail - Update Process Detail - START
2013-12-31 22:45:06,514 DEBUG [AIF]:
    UPDATE AIF_PROCESS_DETAILS
    SET STATUS = 'SUCCESS'
    ,RECORDS_PROCESSED = CASE
      WHEN RECORDS_PROCESSED IS NULL THEN 0
      ELSE RECORDS_PROCESSED
    END + 57408
    ,EXECUTION_END_TIME = CURRENT_TIMESTAMP
    ,LAST_UPDATED_BY = CASE
      WHEN ('native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER' IS NULL) THEN LAST_UPDATED_BY
      ELSE 'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER'
    END
    ,LAST_UPDATE_DATE = CURRENT_TIMESTAMP
    WHERE PROCESS_ID = 300
    AND ENTITY_TYPE = 'PROCESS_BAL_IMP'
    AND ENTITY_NAME = 'JAN-13'
2013-12-31 22:45:06,519 INFO [AIF]: COMM End Process Detail - Update Process Detail - END
2013-12-31 22:45:07,106 INFO [AIF]: EBS/FS Load Data - Load TDATASEG_T - START
2013-12-31 22:45:07,112 INFO [AIF]:
Import Data from Source for Period 'January 2013'
2013-12-31 22:45:07,115 DEBUG [AIF]:
    SELECT brl.PARTITIONKEY
    ,brl.CATKEY
    ,brl.PLAN_TYPE
    ,CASE brl.PLAN_TYPE
      WHEN 'PLAN1' THEN 1
      WHEN 'PLAN2' THEN 2
      WHEN 'PLAN3' THEN 3
      WHEN 'PLAN4' THEN 4
      WHEN 'PLAN5' THEN 5
      ELSE 0
    END PLAN_NUMBER
    ,brl.EXECUTION_MODE
    ,br.AMOUNT_TYPE
    ,br.BALANCE_SELECTION
    ,br.CURRENCY_CODE
    ,br.INCL_ZERO_BALANCE_FLAG
    ,br.BAL_SEG_VALUE_OPTION_CODE
    ,COALESCE(br.BALANCE_AMOUNT_BS, 'YTD') BALANCE_AMOUNT_BS
    ,COALESCE(br.BALANCE_AMOUNT_IS, 'PERIODIC') BALANCE_AMOUNT_IS
    FROM AIF_BAL_RULE_LOADS brl
    ,AIF_TARGET_APPLICATIONS app
    ,AIF_BALANCE_RULES br
    WHERE brl.LOADID = 300
    AND app.APPLICATION_ID = brl.APPLICATION_ID
    AND br.RULE_ID = brl.RULE_ID
2013-12-31 22:45:07,120 DEBUG [AIF]:
      SELECT PERIODKEY
      FROM TPOVPERIOD
      WHERE PERIODDESC = 'January 2013'
2013-12-31 22:45:07,122 INFO [AIF]:
Import Data from Source for Ledger 'JWR Books'
2013-12-31 22:45:07,125 DEBUG [AIF]:
      SELECT COA_SEGMENT_NAME
      ,ACCOUNT_TYPE_FLAG
      ,BALANCE_TYPE_FLAG
      FROM AIF_COA_SEGMENTS
      WHERE SOURCE_SYSTEM_ID = 3
      AND SOURCE_COA_ID = '101'
      AND (
        ACCOUNT_TYPE_FLAG = 'Y'
        OR BALANCE_TYPE_FLAG = 'Y'
2013-12-31 22:45:07,127 DEBUG [AIF]:
      SELECT adim.BALANCE_COLUMN_NAME DIMNAME
      ,adim.DIMENSION_ID
      ,dim.TARGET_DIMENSION_CLASS_NAME
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID1
      ) COA_SEGMENT_NAME1
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID2
      ) COA_SEGMENT_NAME2
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID3
      ) COA_SEGMENT_NAME3
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID4
      ) COA_SEGMENT_NAME4
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID5
      ) COA_SEGMENT_NAME5
      ,(SELECT CASE mdd.ORPHAN_OPTION_CODE
          WHEN 'CHILD' THEN 'N'
          WHEN 'ROOT' THEN 'N'
          ELSE 'Y'
        END DIMENSION_FILTER_FLAG
        FROM AIF_MAP_DIM_DETAILS_V mdd
        ,AIF_MAPPING_RULES mr
        WHERE mr.PARTITIONKEY = tpp.PARTITIONKEY
        AND mdd.RULE_ID = mr.RULE_ID
        AND mdd.DIMENSION_ID = adim.DIMENSION_ID
      ) DIMENSION_FILTER_FLAG
      ,tiie.IMPCONCATCHAR
      FROM TPOVPARTITION tpp
      INNER JOIN AIF_TARGET_APPL_DIMENSIONS adim
        ON adim.APPLICATION_ID = 26
      INNER JOIN AIF_DIMENSIONS dim
        ON dim.DIMENSION_ID = adim.DIMENSION_ID
      LEFT OUTER JOIN TBHVIMPITEMERPI tiie
        ON tiie.IMPGROUPKEY = tpp.PARTIMPGROUP
        AND tiie.IMPFLDFIELDNAME = adim.BALANCE_COLUMN_NAME
        AND tiie.IMPMAPTYPE = 'ERP'
      WHERE tpp.PARTITIONKEY = 12
      AND adim.BALANCE_COLUMN_NAME IS NOT NULL
      ORDER BY adim.BALANCE_COLUMN_NAME
2013-12-31 22:45:07,154 DEBUG [AIF]:
        INSERT INTO TDATASEG_T (
      LOADID
      ,PARTITIONKEY
      ,CATKEY
      ,RULE_ID
      ,PERIODKEY
      ,VALID_FLAG
      ,CHANGESIGN
      ,CODE_COMBINATION_ID
      ,SOURCE_LEDGER_ID
      ,GL_PERIOD_YEAR
      ,GL_PERIOD_NUM
      ,YEAR
      ,PERIOD
      ,ATTR1
      ,ATTR2
      ,ATTR3
      ,ATTR4
      ,ATTR5
      ,ATTR6
      ,ATTR7
      ,ATTR8
      ,ATTR9
      ,ATTR10
      ,ATTR11
      ,ATTR12
      ,ATTR13
      ,ATTR14
        ,ACCOUNT
        ,ACCOUNTX
        ,ENTITY
        ,ENTITYX
        ,ICP
        ,ICPX
        ,UD1
        ,UD1X
        ,UD2
        ,UD2X
        ,UD3
        ,UD3X
        ,UD4
        ,UD4X
      ,DATAVIEW
          ,DATAKEY
          ,STAT_BALANCE_FLAG
          ,CURKEY
          ,AMOUNT_PTD
          ,AMOUNT_YTD
          ,AMOUNT
          ,AMOUNTX
      SELECT pprd.PROCESS_ID LOADID
      ,12 PARTITIONKEY
      ,4 CATKEY
      ,27 RULE_ID
      ,pprd.PERIODKEY
      ,'Y' VALID_FLAG
      ,0 CHANGESIGN
      ,ccid.CODE_COMBINATION_ID
      ,bal.SOURCE_LEDGER_ID
      ,pprd.GL_PERIOD_YEAR
      ,pprd.GL_PERIOD_NUM
      ,pprd.YEARTARGET YEAR
      ,pprd.PERIODTARGET PERIOD
      ,pprd.PROCESS_ID ATTR1
      ,bal.SOURCE_SYSTEM_ID ATTR2
      ,bal.SOURCE_LEDGER_ID ATTR3
      ,pprd.GL_PERIOD_YEAR ATTR4
      ,pprd.GL_PERIOD_NAME ATTR5
      ,bal.ACTUAL_FLAG ATTR6
      ,bal.BUDGET_VERSION_ID ATTR7
      ,bal.ENCUMBRANCE_TYPE_ID ATTR8
      ,ccid.ACCOUNT_TYPE ATTR9
      ,NULL ATTR10
      ,NULL ATTR11
      ,NULL ATTR12
      ,NULL ATTR13
      ,NULL ATTR14
        ,ccid.SEGMENT4 ACCOUNT
        ,NULL ACCOUNTX
        ,ccid.SEGMENT1 ENTITY
        ,NULL ENTITYX
        ,NULL ICP
        ,NULL ICPX
        ,ccid.SEGMENT5 UD1
        ,NULL UD1X
        ,ccid.SEGMENT3 UD2
        ,NULL UD2X
        ,ccid.SEGMENT6 UD3
        ,NULL UD3X
        ,ccid.SEGMENT2 UD4
        ,NULL UD4X
      ,( CASE WHEN ccid.ACCOUNT_TYPE IN ('R','E','D','C') THEN 'Periodic' ELSE 'YTD' END ) DATAVIEW
        ,TDATASEG_DATAKEY_S.NEXTVAL
        ,'N' STAT_BALANCE_FLAG
        ,bal.CURRENCY_CODE CURKEY
        ,( CASE WHEN ccid.ACCOUNT_TYPE IN ('A','E','D') THEN 1 ELSE -1 END ) * ( bal.PERIOD_NET_DR - bal.PERIOD_NET_CR ) AMOUNT_PTD
        ,( CASE WHEN ccid.ACCOUNT_TYPE IN ('A','E','D') THEN 1 ELSE -1 END ) * ( bal.BEGIN_BALANCE_DR - bal.BEGIN_BALANCE_CR + bal.PERIOD_NET_DR - bal.PERIOD_NET_CR ) AMOUNT_YTD
        ,( CASE WHEN ccid.ACCOUNT_TYPE IN ('A','E','D') THEN 1 ELSE -1 END ) *
        ( CASE
            WHEN ccid.ACCOUNT_TYPE IN ('R','E','D','C') THEN ( bal.PERIOD_NET_DR - bal.PERIOD_NET_CR )
            ELSE ( bal.BEGIN_BALANCE_DR - bal.BEGIN_BALANCE_CR + bal.PERIOD_NET_DR - bal.PERIOD_NET_CR )
          END
         AMOUNT
        ,( CASE WHEN ccid.ACCOUNT_TYPE IN ('A','E','D') THEN 1 ELSE -1 END ) *
        ( CASE
            WHEN ccid.ACCOUNT_TYPE IN ('R','E','D','C') THEN ( bal.PERIOD_NET_DR - bal.PERIOD_NET_CR )
            ELSE ( bal.BEGIN_BALANCE_DR - bal.BEGIN_BALANCE_CR + bal.PERIOD_NET_DR - bal.PERIOD_NET_CR )
          END
         AMOUNTX
      FROM AIF_EBS_GL_BALANCES_STG_V bal
      ,AIF_EBS_GL_CCID_STG ccid
      ,AIF_PROCESS_PERIODS pprd
      WHERE bal.SOURCE_SYSTEM_ID = 3
      AND bal.SOURCE_LEDGER_ID = 1
      AND bal.ACTUAL_FLAG = 'A'
      AND ccid.SOURCE_SYSTEM_ID = bal.SOURCE_SYSTEM_ID
      AND ccid.SOURCE_COA_ID = bal.SOURCE_COA_ID
      AND ccid.CODE_COMBINATION_ID = bal.CODE_COMBINATION_ID
      AND pprd.PROCESS_ID = 300
      AND pprd.PERIODKEY = '2013-01-01'
      AND pprd.SOURCE_LEDGER_ID = bal.SOURCE_LEDGER_ID
      AND pprd.GL_PERIOD_NAME = bal.PERIOD_NAME
        AND (
          bal.BEGIN_BALANCE_DR <> 0
          OR bal.BEGIN_BALANCE_CR <> 0
          OR bal.PERIOD_NET_DR <> 0
          OR bal.PERIOD_NET_CR <> 0
        AND bal.CURRENCY_CODE <> 'STAT'
          AND bal.TRANSLATED_FLAG IS NULL
2013-12-31 22:45:09,269 INFO [AIF]: Monetary Data Rows Imported from Source: 12590
2013-12-31 22:45:09,293 DEBUG [AIF]:
        INSERT INTO AIF_APPL_LOAD_AUDIT (
          LOADID
          ,TARGET_APPLICATION_TYPE
          ,TARGET_APPLICATION_NAME
          ,PLAN_TYPE
          ,SOURCE_LEDGER_ID
          ,EPM_YEAR
          ,EPM_PERIOD
          ,SNAPSHOT_FLAG
          ,PARTITIONKEY
          ,CATKEY
          ,RULE_ID
          ,PERIODKEY
          ,EXPORT_TO_TARGET_FLAG
        SELECT DISTINCT PROCESS_ID LOADID
        ,'HFM' TARGET_APPLICATION_TYPE
        ,'FMTEST2' TARGET_APPLICATION_NAME
        ,NULL PLAN_TYPE
        ,SOURCE_LEDGER_ID
        ,YEARTARGET EPM_YEAR
        ,PERIODTARGET EPM_PERIOD
        ,'Y' SNAPSHOT_FLAG
        ,12 PARTITIONKEY
        ,4 CATKEY
        ,27 RULE_ID
        ,PERIODKEY
        ,'N' EXPORT_TO_TARGET_FLAG
        FROM AIF_PROCESS_PERIODS
        WHERE PROCESS_ID = 300
        AND PERIODKEY = '2013-01-01'
        AND SOURCE_LEDGER_ID = 1
2013-12-31 22:45:09,297 DEBUG [AIF]:
        INSERT INTO AIF_APPL_LOAD_PRD_AUDIT (
          LOADID
          ,SOURCE_LEDGER_ID
          ,GL_PERIOD_ID
          ,DELTA_RUN_ID
          ,PARTITIONKEY
          ,CATKEY
          ,RULE_ID
          ,PERIODKEY
        SELECT DISTINCT pprd.PROCESS_ID LOADID
        ,pprd.SOURCE_LEDGER_ID
        ,pprd.PERIOD_ID GL_PERIOD_ID
        ,(SELECT MAX(gl.DELTA_RUN_ID)
          FROM AIF_GL_LOAD_AUDIT gl
          WHERE gl.SOURCE_SYSTEM_ID = 3
          AND gl.SOURCE_LEDGER_ID = pprd.SOURCE_LEDGER_ID
          AND gl.BALANCE_TYPE = 'A'
          AND gl.GL_PERIOD_ID = pprd.PERIOD_ID
        ) DELTA_RUN_ID
        ,12 PARTITIONKEY
        ,4 CATKEY
        ,27 RULE_ID
        ,pprd.PERIODKEY
        FROM AIF_PROCESS_PERIODS pprd
        WHERE pprd.PROCESS_ID = 300
        AND pprd.PERIODKEY = '2013-01-01'
        AND pprd.SOURCE_LEDGER_ID = 1
2013-12-31 22:45:09,302 INFO [AIF]:
Total Data Rows Imported from Source: 12590
2013-12-31 22:45:09,305 INFO [AIF]: EBS/FS Load Data - Load TDATASEG_T - END
2013-12-31 22:45:09,381 INFO [AIF]: COMM Update Data - Init DataLoadUtil - START
2013-12-31 22:45:09,385 INFO [AIF]: COMM Update Data - Init DataLoadUtil - END
2013-12-31 22:45:09,485 INFO [AIF]: COMM Update Data - Update TDATASEG_T/TDATASEGW - START
2013-12-31 22:45:09,491 DEBUG [AIF]:
      DELETE FROM TDATASEG_T
      WHERE LOADID = 300
      AND PARTITIONKEY = 12
      AND CATKEY = 4
      AND PERIODKEY = '2013-01-01'
      AND AMOUNT = 0
2013-12-31 22:45:09,559 WARN [AIF]:
Warning: Data rows with zero balances exist
2013-12-31 22:45:09,636 INFO [AIF]: Zero Balance Data Rows Deleted: 1879
2013-12-31 22:45:09,654 DEBUG [AIF]:
      SELECT DIMNAME
      ,CASE WHEN RULE_ID IS NULL THEN 'N' ELSE 'Y' END RULE_MAP_FLAG
      ,SRCKEY
      ,TARGKEY
      ,WHERECLAUSETYPE
      ,WHERECLAUSEVALUE
      ,CHANGESIGN
      ,SEQUENCE
      ,DATAKEY
      ,MAPPING_TYPE
      FROM (
        SELECT DISTINCT tdm.DIMNAME
        ,tdm.RULE_ID
        ,NULL SRCKEY
        ,NULL TARGKEY
        ,tdm.WHERECLAUSETYPE
        ,tdm.WHERECLAUSEVALUE
        ,NULL CHANGESIGN
        ,1 SEQUENCE
        ,COALESCE(tdm.SYSTEM_GENERATED_FLAG,'N') SYSTEM_GENERATED_FLAG
        ,NULL DATAKEY
        ,CASE
          WHEN tdm.WHERECLAUSETYPE IS NULL THEN 1
          ELSE 3
        END MAPPING_TYPE
        FROM TDATAMAP_T tdm
        WHERE tdm.LOADID = 300
        AND tdm.PARTITIONKEY = 12
        AND tdm.TDATAMAPTYPE = 'ERP'
        AND (tdm.RULE_ID IS NULL OR tdm.RULE_ID = 27)
        AND tdm.WHERECLAUSETYPE IS NULL
        UNION ALL
        SELECT tdm.DIMNAME
        ,tdm.RULE_ID
        ,tdm.SRCKEY
        ,tdm.TARGKEY
        ,tdm.WHERECLAUSETYPE
        ,tdm.WHERECLAUSEVALUE
        ,tdm.CHANGESIGN
        ,CASE tpp.PARTSEQMAP
          WHEN 0 THEN CASE
            WHEN (tdm.WHERECLAUSETYPE = 'MULTIDIM') THEN 2
            WHEN (tdm.WHERECLAUSETYPE = 'BETWEEN') THEN 3
            WHEN (tdm.WHERECLAUSETYPE = 'LIKE') THEN 4
            ELSE 0
          END
          ELSE tdm.SEQUENCE
        END SEQUENCE
        ,COALESCE(tdm.SYSTEM_GENERATED_FLAG,'N') SYSTEM_GENERATED_FLAG
        ,tdm.DATAKEY
        ,CASE
          WHEN tdm.WHERECLAUSETYPE IS NULL THEN 1
          ELSE 3
        END MAPPING_TYPE
        FROM TDATAMAP_T tdm
        INNER JOIN TPOVPARTITION tpp
          ON tpp.PARTITIONKEY = tdm.PARTITIONKEY
        WHERE tdm.LOADID = 300
        AND tdm.PARTITIONKEY = 12
        AND tdm.TDATAMAPTYPE = 'ERP'
        AND (tdm.RULE_ID IS NULL OR tdm.RULE_ID = 27)
        AND tdm.WHERECLAUSETYPE IN ('MULTIDIM','BETWEEN','LIKE')
      ) q
      ORDER BY DIMNAME
      ,RULE_ID
      ,SEQUENCE
      ,SYSTEM_GENERATED_FLAG
      ,SRCKEY
2013-12-31 22:45:09,672 INFO [AIF]:
Processing Mappings for Column 'ACCOUNT'
2013-12-31 22:45:09,677 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET ACCOUNTX = ACCOUNT
        ,ACCOUNTR = 121
        ,ACCOUNTF = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '*' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND ACCOUNTX IS NULL
        AND (1=1)
2013-12-31 22:45:10,044 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:10,053 INFO [AIF]:
Processing Mappings for Column 'ENTITY'
2013-12-31 22:45:10,057 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET ENTITYX = ENTITY
        ,ENTITYR = 122
        ,ENTITYF = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '*' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND ENTITYX IS NULL
        AND (1=1)
2013-12-31 22:45:10,426 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:10,435 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET ENTITYX = ENTITY
        ,ENTITYR = 132
        ,ENTITYF = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '*' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND ENTITYX IS NULL
        AND (1=1)
2013-12-31 22:45:10,446 INFO [AIF]: Data Rows Updated by Location Mapping 'DEFAULT' (LIKE): 0
2013-12-31 22:45:10,448 INFO [AIF]:
Processing Mappings for Column 'ICP'
2013-12-31 22:45:10,452 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET ICPX = '[ICP None]'
        ,ICPR = 130
        ,ICPF = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '[ICP None]' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND ICPX IS NULL
        AND (1=1)
2013-12-31 22:45:10,784 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:10,798 INFO [AIF]:
Processing Mappings for Column 'UD1'
2013-12-31 22:45:10,802 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET UD1X = '[None]'
        ,UD1R = 124
        ,UD1F = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '[None]' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND UD1X IS NULL
        AND (1=1)
2013-12-31 22:45:11,134 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:11,156 INFO [AIF]:
Processing Mappings for Column 'UD2'
2013-12-31 22:45:11,160 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET UD2X = '[None]'
        ,UD2R = 123
        ,UD2F = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '[None]' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND UD2X IS NULL
        AND (1=1)
2013-12-31 22:45:11,517 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:11,531 INFO [AIF]:
Processing Mappings for Column 'UD3'
2013-12-31 22:45:11,535 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET UD3X = '[None]'
        ,UD3R = 125
        ,UD3F = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '[None]' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND UD3X IS NULL
        AND (1=1)
2013-12-31 22:45:11,870 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:11,883 INFO [AIF]:
Processing Mappings for Column 'UD4'
2013-12-31 22:45:11,887 DEBUG [AIF]:
        UPDATE TDATASEG_T
        SET UD4X = '[None]'
        ,UD4R = 128
        ,UD4F = 3
        ,AMOUNTX = AMOUNTX * 1
        ,CHANGESIGN = CASE 1
          WHEN -1 THEN CASE CHANGESIGN
            WHEN 1 THEN 0
            WHEN 0 THEN 1
            ELSE CHANGESIGN
          END
          ELSE CHANGESIGN
        END
        ,VALID_FLAG = CASE '[None]' WHEN 'IGNORE' THEN 'I' ELSE VALID_FLAG END
        WHERE LOADID = 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND PERIODKEY = '2013-01-01'
        AND UD4X IS NULL
        AND (1=1)
2013-12-31 22:45:12,192 INFO [AIF]: Data Rows Updated by Location Mapping 'Like' (LIKE): 10711
2013-12-31 22:45:12,204 DEBUG [AIF]:
      UPDATE TDATASEG_T
      SET ATTR14 = DATAKEY
      WHERE LOADID = 300
      AND PARTITIONKEY = 12
      AND CATKEY = 4
      AND PERIODKEY = '2013-01-01'
2013-12-31 22:45:12,739 DEBUG [AIF]:
          UPDATE TDATASEG_T
          SET VALID_FLAG = 'N'
          WHERE 1=1
          AND (
            (1=0)
          OR TDATASEG_T.ACCOUNTX IS NULL
          OR TDATASEG_T.ENTITYX IS NULL
          OR TDATASEG_T.ICPX IS NULL
          OR TDATASEG_T.UD1X IS NULL
          OR TDATASEG_T.UD2X IS NULL
          OR TDATASEG_T.UD3X IS NULL
          OR TDATASEG_T.UD4X IS NULL
          AND LOADID = 300
          AND PARTITIONKEY = 12
          AND CATKEY = 4
          AND PERIODKEY = '2013-01-01'
          AND VALID_FLAG = 'Y'
2013-12-31 22:45:12,754 INFO [AIF]:
Total Data Rows available for Export to Target: 10711
2013-12-31 22:45:12,773 INFO [AIF]: COMM Update Data - Update TDATASEG_T/TDATASEGW - END
2013-12-31 22:45:12,808 INFO [AIF]: COMM End Process Detail - Update Process Detail - START
2013-12-31 22:45:12,823 DEBUG [AIF]:
    UPDATE AIF_PROCESS_DETAILS
    SET STATUS = 'SUCCESS'
    ,RECORDS_PROCESSED = CASE
      WHEN RECORDS_PROCESSED IS NULL THEN 0
      ELSE RECORDS_PROCESSED
    END + 10711
    ,EXECUTION_END_TIME = CURRENT_TIMESTAMP
    ,LAST_UPDATED_BY = CASE
      WHEN ('native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER' IS NULL) THEN LAST_UPDATED_BY
      ELSE 'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER'
    END
    ,LAST_UPDATE_DATE = CURRENT_TIMESTAMP
    WHERE PROCESS_ID = 300
    AND ENTITY_TYPE = 'PROCESS_BAL_TRANS'
    AND ENTITY_NAME = 'January 2013'
2013-12-31 22:45:12,829 INFO [AIF]: COMM End Process Detail - Update Process Detail - END
2013-12-31 22:45:12,987 INFO [AIF]: COMM Update YTD Amounts - Update YTD Amounts - START
2013-12-31 22:45:12,993 DEBUG [AIF]:
        SELECT brl.PARTITIONKEY
        ,brl.CATKEY
        ,pprd.YEARTARGET
        ,pprd.PERIODTARGET
        ,pprd.SOURCE_LEDGER_ID
        FROM AIF_BAL_RULE_LOADS brl
        ,AIF_PROCESS_PERIODS pprd
        WHERE brl.LOADID = 300
        AND pprd.PROCESS_ID = brl.LOADID
        GROUP BY brl.PARTITIONKEY
        ,brl.CATKEY
        ,pprd.YEARTARGET
        ,pprd.PERIODTARGET
        ,pprd.SOURCE_LEDGER_ID
        HAVING COUNT(*) > 1
2013-12-31 22:45:12,995 INFO [AIF]: COMM Update YTD Amounts - Update YTD Amounts - END
2013-12-31 22:45:13,052 INFO [AIF]: COMM Load TDATAMAPSEG/TDATASEG - Load TDATAMAPSEG/TDATASEG - START
2013-12-31 22:45:13,057 DEBUG [AIF]:
    SELECT brl.PARTITIONKEY
    ,brl.CATKEY
    ,brl.EXECUTION_MODE
    FROM AIF_BAL_RULE_LOADS brl
    WHERE brl.LOADID = 300
2013-12-31 22:45:13,059 DEBUG [AIF]:
    SELECT PERIODKEY
    FROM AIF_APPL_LOAD_AUDIT
    WHERE LOADID = 300
    AND PARTITIONKEY = 12
    AND CATKEY = 4
    AND RULE_ID = 27
    ORDER BY PERIODKEY
2013-12-31 22:45:13,061 INFO [AIF]:
Processing Data for PeriodKey '2013-01-01'
2013-12-31 22:45:13,065 DEBUG [AIF]:
    DELETE FROM TDATAMAPSEG
    WHERE PARTITIONKEY = 12
    AND CATKEY = 4
    AND PERIODKEY = '2013-01-01'
    AND (
      TDATAMAPTYPE = 'ERP'
      OR (
        TDATAMAPTYPE = 'MULTIDIM'
        AND EXISTS (
          SELECT 1
          FROM TDATAMAPSEG parent
          WHERE parent.PARTITIONKEY = TDATAMAPSEG.PARTITIONKEY
          AND parent.DATAKEY = TDATAMAPSEG.TARGKEY
          AND parent.CATKEY = TDATAMAPSEG.CATKEY
          AND parent.PERIODKEY = TDATAMAPSEG.PERIODKEY
          AND parent.TDATAMAPTYPE = 'ERP'
2013-12-31 22:45:13,074 INFO [AIF]: Number of Rows deleted from TDATAMAPSEG: 8
2013-12-31 22:45:13,077 DEBUG [AIF]:
    INSERT INTO TDATAMAPSEG (
      DATAKEY
      ,PARTITIONKEY
      ,CATKEY
      ,PERIODKEY
      ,DIMNAME
      ,SRCKEY
      ,SRCDESC
      ,TARGKEY
      ,WHERECLAUSETYPE
      ,WHERECLAUSEVALUE
      ,CHANGESIGN
      ,SEQUENCE
      ,VBSCRIPT
      ,TDATAMAPTYPE
      ,SYSTEM_GENERATED_FLAG
    SELECT DATAKEY
    ,PARTITIONKEY
    ,4
    ,'2013-01-01'
    ,DIMNAME
    ,SRCKEY
    ,SRCDESC
    ,TARGKEY
    ,WHERECLAUSETYPE
    ,WHERECLAUSEVALUE
    ,CHANGESIGN
    ,SEQUENCE
    ,VBSCRIPT
    ,TDATAMAPTYPE
    ,SYSTEM_GENERATED_FLAG
    FROM TDATAMAP_T
    WHERE LOADID = 300
2013-12-31 22:45:13,081 INFO [AIF]: Number of Rows inserted into TDATAMAPSEG: 8
2013-12-31 22:45:13,083 DEBUG [AIF]:
        DELETE FROM TDATASEG
        WHERE LOADID < 300
        AND PARTITIONKEY = 12
        AND CATKEY = 4
        AND RULE_ID = 27
        AND PERIODKEY = '2013-01-01'
2013-12-31 22:45:15,659 INFO [AIF]: Number of Rows deleted from TDATASEG: 10711
2013-12-31 22:45:15,728 DEBUG [AIF]:
      INSERT INTO TDATASEG (
      DATAKEY
      ,PARTITIONKEY
      ,CATKEY
      ,PERIODKEY
      ,CURKEY
      ,DATAVIEW
      ,CALCACCTTYPE
      ,CHANGESIGN
      ,JOURNALID
      ,AMOUNT
      ,AMOUNTX
      ,AMOUNT_PTD
      ,AMOUNT_YTD
      ,DESC1
      ,DESC2
      ,ACCOUNT
      ,ACCOUNTX
      ,ACCOUNTR
      ,ACCOUNTF
      ,ENTITY
      ,ENTITYX
      ,ENTITYR
      ,ENTITYF
      ,ICP
      ,ICPX
      ,ICPR
      ,ICPF
      ,UD1
      ,UD1X
      ,UD1R
      ,UD1F
      ,UD2
      ,UD2X
      ,UD2R
      ,UD2F
      ,UD3
      ,UD3X
      ,UD3R
      ,UD3F
      ,UD4
      ,UD4X
      ,UD4R
      ,UD4F
      ,UD5
      ,UD5X
      ,UD5R
      ,UD5F
      ,UD6
      ,UD6X
      ,UD6R
      ,UD6F
      ,UD7
      ,UD7X
      ,UD7R
      ,UD7F
      ,UD8
      ,UD8X
      ,UD8R
      ,UD8F
      ,UD9
      ,UD9X
      ,UD9R
      ,UD9F
      ,UD10
      ,UD10X
      ,UD10R
      ,UD10F
      ,UD11
      ,UD11X
      ,UD11R
      ,UD11F
      ,UD12
      ,UD12X
      ,UD12R
      ,UD12F
      ,UD13
      ,UD13X
      ,UD13R
      ,UD13F
      ,UD14
      ,UD14X
      ,UD14R
      ,UD14F
      ,UD15
      ,UD15X
      ,UD15R
      ,UD15F
      ,UD16
      ,UD16X
      ,UD16R
      ,UD16F
      ,UD17
      ,UD17X
      ,UD17R
      ,UD17F
      ,UD18
      ,UD18X
      ,UD18R
      ,UD18F
      ,UD19
      ,UD19X
      ,UD19R
      ,UD19F
      ,UD20
      ,UD20X
      ,UD20R
      ,UD20F
      ,ATTR1
      ,ATTR2
      ,ATTR3
      ,ATTR4
      ,ATTR5
      ,ATTR6
      ,ATTR7
      ,ATTR8
      ,ATTR9
      ,ATTR10
      ,ATTR11
      ,ATTR12
      ,ATTR13
      ,ATTR14
      ,ARCHIVEID
      ,HASMEMOITEM
      ,STATICDATAKEY
      ,LOADID
      ,RULE_ID,
      CODE_COMBINATION_ID
      ,STAT_BALANCE_FLAG
      ,VALID_FLAG
      SELECT
      DATAKEY
      ,PARTITIONKEY
      ,CATKEY
      ,PERIODKEY
      ,CURKEY
      ,DATAVIEW
      ,CALCACCTTYPE
      ,CHANGESIGN
      ,JOURNALID
      ,AMOUNT
      ,AMOUNTX
      ,AMOUNT_PTD
      ,AMOUNT_YTD
      ,DESC1
      ,DESC2
      ,ACCOUNT
      ,ACCOUNTX
      ,ACCOUNTR
      ,ACCOUNTF
      ,ENTITY
      ,ENTITYX
      ,ENTITYR
      ,ENTITYF
      ,ICP
      ,ICPX
      ,ICPR
      ,ICPF
      ,UD1
      ,UD1X
      ,UD1R
      ,UD1F
      ,UD2
      ,UD2X
      ,UD2R
      ,UD2F
      ,UD3
      ,UD3X
      ,UD3R
      ,UD3F
      ,UD4
      ,UD4X
      ,UD4R
      ,UD4F
      ,UD5
      ,UD5X
      ,UD5R
      ,UD5F
      ,UD6
      ,UD6X
      ,UD6R
      ,UD6F
      ,UD7
      ,UD7X
      ,UD7R
      ,UD7F
      ,UD8
      ,UD8X
      ,UD8R
      ,UD8F
      ,UD9
      ,UD9X
      ,UD9R
      ,UD9F
      ,UD10
      ,UD10X
      ,UD10R
      ,UD10F
      ,UD11
      ,UD11X
      ,UD11R
      ,UD11F
      ,UD12
      ,UD12X
      ,UD12R
      ,UD12F
      ,UD13
      ,UD13X
      ,UD13R
      ,UD13F
      ,UD14
      ,UD14X
      ,UD14R
      ,UD14F
      ,UD15
      ,UD15X
      ,UD15R
      ,UD15F
      ,UD16
      ,UD16X
      ,UD16R
      ,UD16F
      ,UD17
      ,UD17X
      ,UD17R
      ,UD17F
      ,UD18
      ,UD18X
      ,UD18R
      ,UD18F
      ,UD19
      ,UD19X
      ,UD19R
      ,UD19F
      ,UD20
      ,UD20X
      ,UD20R
      ,UD20F
      ,ATTR1
      ,ATTR2
      ,ATTR3
      ,ATTR4
      ,ATTR5
      ,ATTR6
      ,ATTR7
      ,ATTR8
      ,ATTR9
      ,ATTR10
      ,ATTR11
      ,ATTR12
      ,ATTR13
      ,ATTR14
      ,ARCHIVEID
      ,HASMEMOITEM
      ,STATICDATAKEY
      ,LOADID
      ,RULE_ID,
      CODE_COMBINATION_ID
      ,STAT_BALANCE_FLAG
      ,VALID_FLAG
      FROM TDATASEG_T
      WHERE LOADID = 300
      AND PARTITIONKEY = 12
      AND CATKEY = 4
      AND PERIODKEY = '2013-01-01'
2013-12-31 22:45:16,838 INFO [AIF]: Number of Rows inserted into TDATASEG: 10711
2013-12-31 22:45:16,858 DEBUG [AIF]:
    DELETE FROM TDATASEG_T
    WHERE LOADID = 300
    AND PARTITIONKEY = 12
    AND CATKEY = 4
    AND PERIODKEY = '2013-01-01'
2013-12-31 22:45:17,123 INFO [AIF]: Number of Rows deleted from TDATASEG_T: 10711
2013-12-31 22:45:17,153 DEBUG [AIF]:
    DELETE FROM TDATAMAP_T
    WHERE LOADID = 300
2013-12-31 22:45:17,156 INFO [AIF]: Number of Rows deleted from TDATAMAP_T: 8
2013-12-31 22:45:17,161 INFO [AIF]: COMM Load TDATAMAPSEG/TDATASEG - Load TDATAMAPSEG/TDATASEG - END
2013-12-31 22:45:17,993 DEBUG [AIF]:
SELECT CASE app.METADATA_LOAD_METHOD
    WHEN 'EPMA' THEN CASE dim.TARGET_DIMENSION_CLASS_NAME
      WHEN 'Generic' THEN dim.TARGET_DIMENSION_NAME
      ELSE dim.TARGET_DIMENSION_CLASS_NAME
    END
    ELSE dim.TARGET_DIMENSION_NAME
END TARGET_DIMENSION_NAME
,adim.BALANCE_COLUMN_NAME
FROM AIF_TARGET_APPLICATIONS app
,AIF_TARGET_APPL_DIMENSIONS adim
,AIF_DIMENSIONS dim
WHERE app.APPLICATION_ID = 26
AND adim.APPLICATION_ID = app.APPLICATION_ID
AND dim.DIMENSION_ID = adim.DIMENSION_ID
AND dim.TARGET_DIMENSION_CLASS_NAME IN ('Custom1','Custom2','Custom3','Custom4','Generic')
2013-12-31 22:45:17,997 DEBUG [AIF]:
SELECT SCENARIO "Scenario"
,YEAR "Year"
,PERIOD "Period"
,DATAVIEW "View"
,DATAVALUE "Value"
,ACCOUNT "Account"
,ENTITY "Entity"
,ICP "ICP"
    ,UD2 "Area"
    ,UD1 "Tail"
    ,UD3 "Special"
    ,UD4 "Facility"
,AMOUNT "DataValue"
FROM AIF_HS_BALANCES
WHERE LOADID = 300
2013-12-31 22:45:18,000 INFO [SimpleAsyncTaskExecutor-9]: ODI Hyperion Financial Management Adapter
2013-12-31 22:45:18,002 INFO [SimpleAsyncTaskExecutor-9]: Load task initialized.
2013-12-31 22:45:18,028 INFO [AIF]: LKM COMM Load Data into HFM - Load Data to HFM - START
2013-12-31 22:45:18,031 DEBUG [AIF]:
    INSERT INTO AIF_PROCESS_DETAILS (
      PROCESS_ID
      ,ENTITY_TYPE
      ,ENTITY_ID
      ,ENTITY_NAME
      ,ENTITY_NAME_ORDER
      ,TARGET_TABLE_NAME
      ,EXECUTION_START_TIME
      ,EXECUTION_END_TIME
      ,RECORDS_PROCESSED
      ,STATUS
      ,LAST_UPDATED_BY
      ,LAST_UPDATE_DATE
    ) VALUES (
      300
      ,'PROCESS_BAL_EXP_HFM'
      ,NULL
      ,'FMTEST2'
      ,NULL
      ,NULL
      ,CURRENT_TIMESTAMP
      ,NULL
      ,NULL
      ,'RUNNING'
      ,'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER'
      ,CURRENT_TIMESTAMP
2013-12-31 22:45:18,034 INFO [SimpleAsyncTaskExecutor-9]: Connecting to Financial Management application [FMTEST2] on [10.150.20.40] using user-name [admin].
2013-12-31 22:45:18,155 INFO [SimpleAsyncTaskExecutor-9]: Connected to Financial Management application.
2013-12-31 22:45:18,157 INFO [SimpleAsyncTaskExecutor-9]: HFM Version: 11.1.2.2.300.
2013-12-31 22:45:18,160 INFO [SimpleAsyncTaskExecutor-9]: Options for the Financial Management load task are:
<Options>
     <Option name=LOG_FILE_NAME value=C:\Windows\TEMP\/aif_501_300.log/>
     <Option name=IMPORT_MODE value=Replace/>
     <Option name=CONSOLIDATE_ONLY value=false/>
     <Option name=CONSOLIDATE_PARAMETERS value=""/>
     <Option name=LOG_ENABLED value=true/>
     <Option name=ACCUMULATE_WITHIN_FILE value=false/>
     <Option name=DEBUG_ENABLED value=true/>
     <Option name=CONSOLIDATE_AFTER_LOAD value=false/>
     <Option name=FILE_CONTAINS_SHARE_DATA value=false/>
</Options>
2013-12-31 22:45:18,168 INFO [SimpleAsyncTaskExecutor-9]: Load Options validated.
2013-12-31 22:45:18,176 ERROR [SimpleAsyncTaskExecutor-9]: Error occurred during load process ORA-00904: "DATAVALUE": invalid identifier
com.hyperion.odi.common.ODIHAppException: ORA-00904: "DATAVALUE": invalid identifier
at com.hyperion.odi.hfm.ODIHFMAppWriter.loadData(ODIHFMAppWriter.java:216)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.python.core.PyReflectedFunction.__call__(PyReflectedFunction.java:175)
at org.python.core.PyObject.__call__(PyObject.java:355)
at org.python.core.PyMethod.__call__(PyMethod.java:215)
at org.python.core.PyMethod.instancemethod___call__(PyMethod.java:221)
at org.python.core.PyMethod.__call__(PyMethod.java:206)
at org.python.core.PyObject.__call__(PyObject.java:397)
at org.python.core.PyObject.__call__(PyObject.java:401)
at org.python.pycode._pyx161.f$0(<string>:98)
at org.python.pycode._pyx161.call_function(<string>)
at org.python.core.PyTableCode.call(PyTableCode.java:165)
at org.python.core.PyCode.call(PyCode.java:18)
at org.python.core.Py.runCode(Py.java:1204)
at org.python.core.Py.exec(Py.java:1248)
at org.python.util.PythonInterpreter.exec(PythonInterpreter.java:172)
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:144)
at com.sunopsis.dwg.codeinterpretor.SnpScriptingInterpretor.execInBSFEngine(SnpScriptingInterpretor.java:322)
at com.sunopsis.dwg.codeinterpretor.SnpScriptingInterpretor.exec(SnpScriptingInterpretor.java:170)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java:2472)
at oracle.odi.runtime.agent.execution.cmd.ScriptingExecutor.execute(ScriptingExecutor.java:47)
at oracle.odi.runtime.agent.execution.cmd.ScriptingExecutor.execute(ScriptingExecutor.java:1)
at oracle.odi.runtime.agent.execution.TaskExecutionHandler.handleTask(TaskExecutionHandler.java:50)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.processTask(SnpSessTaskSql.java:2913)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java:2625)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatAttachedTasks(SnpSessStep.java:558)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java:464)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:2093)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java:1889)
at oracle.odi.runtime.agent.processor.impl.StartScenRequestProcessor$2.doAction(StartScenRequestProcessor.java:580)
at oracle.odi.core.persistence.dwgobject.DwgObjectTemplate.execute(DwgObjectTemplate.java:216)
at oracle.odi.runtime.agent.processor.impl.StartScenRequestProcessor.doProcessStartScenTask(StartScenRequestProcessor.java:513)
at oracle.odi.runtime.agent.processor.impl.StartScenRequestProcessor$StartScenTask.doExecute(StartScenRequestProcessor.java:1066)
at oracle.odi.runtime.agent.processor.task.AgentTask.execute(AgentTask.java:126)
at oracle.odi.runtime.agent.support.DefaultAgentTaskExecutor$2.run(DefaultAgentTaskExecutor.java:82)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.sql.SQLSyntaxErrorException: ORA-00904: "DATAVALUE": invalid identifier
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:462)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:405)
at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:931)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:481)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:205)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:548)
at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:202)
at oracle.jdbc.driver.T4CStatement.executeForDescribe(T4CStatement.java:942)
at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1283)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1441)
at oracle.jdbc.driver.OracleStatement.executeQuery(OracleStatement.java:1690)
at oracle.jdbc.driver.OracleStatementWrapper.executeQuery(OracleStatementWrapper.java:446)
at com.hyperion.odi.hfm.ODIHFMAppWriter.loadData(ODIHFMAppWriter.java:212)
... 38 more
2013-12-31 22:45:18,208 DEBUG [AIF]:
    UPDATE AIF_PROCESS_DETAILS
    SET STATUS = 'FAILED'
    ,RECORDS_PROCESSED = CASE
      WHEN RECORDS_PROCESSED IS NULL THEN 0
      ELSE RECORDS_PROCESSED
    END + 0
    ,EXECUTION_END_TIME = CURRENT_TIMESTAMP
    ,LAST_UPDATED_BY = CASE
      WHEN ('native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER' IS NULL) THEN LAST_UPDATED_BY
      ELSE 'native://DN=cn=911,ou=People,dc=css,dc=hyperion,dc=com?USER'
    END
    ,LAST_UPDATE_DATE = CURRENT_TIMESTAMP
    WHERE PROCESS_ID = 300
    AND ENTITY_TYPE = 'PROCESS_BAL_EXP_HFM'
    AND ENTITY_NAME = 'FMTEST2'
2013-12-31 22:45:18,210 FATAL [AIF]: Error in LKM C

The issue is that you are mapping "Data Value" to amount in the Target Application import format:
SELECT SCENARIO "Scenario"
,YEAR "Year"
,PERIOD "Period"
,DATAVIEW "View"
,DATAVALUE "Value"
,ACCOUNT "Account"
,ENTITY "Entity"
,ICP "ICP"
    ,UD2 "Area"
    ,UD1 "Tail"
    ,UD3 "Special"
    ,UD4 "Facility"
,AMOUNT "DataValue"
FROM AIF_HS_BALANCES
WHERE LOADID = 300
You need to map AMOUNT to "AMOUNT" in the HFM Application. Check that the dimension mapping is correct for the class in the target application and that your import format is going to the proper target dimension(Amount).

Loading data from .csv file into existing table

Hi,
I have taken a look at several threads which talk about loading data from .csv file into existing /new table. Also checked out Vikas's application regarding the same. I am trying to explain my requirement with an example.
I have a .csv file and I want the data to be loaded into an existing table. The timesheet table columns are -
timesheet_entry_id,time_worked,timesheet_date,project_key .
The csv columns are :
project,utilization,project_key,timesheet_category,employee,timesheet_date , hours_worked etc.
What I needed to know is that before the csv data is loaded into the timesheet table is there any way of validating the project key ( which is the primary key of the projects table) with the projects table . I need to perform similar validations with other columns like customer_id from customers table. Basically the loading should be done after validating if the data exists in the parent table. Has anyone done this kind of loading through the APEX utility-data load.Or is there another method of accomplishing the same.
Does Vikas's application do what the utility does ( i am assuming that the code being from 2005 the utility was not incorporated in APEX at that time). Any helpful advise is greatly appreciated.
Thanks,
Anjali

Hi Anjali,
Take a look at these threads which might outline different ways to do it -
File Browse, File Upload
Loading CSV file using external table
Loading a CSV file into a table
you can create hidden items in the page to validate previous records before insert data.
Hope this helps,
M Tajuddin
http://tajuddin.whitepagesbd.com

Error while Loading data Via Integrator

Hi,
I'm currently following the GettingStarted screencast series 3.0 in youtube.
In the 'loadData.grf', while i'm trying to load data's to data domain after configuring the 'Reformat' and 'ExHashJoin' I'm getting below error, can anyone kindly help me?
INFO [main] - *** CloverETL framework/transformation graph, (c) 2002-2013 Javlin a.s, released under GNU Lesser General Public License ***
INFO [main] - Running with CloverETL library version 3.3.0 build#036 compiled 12/02/2013 18:45:45
INFO [main] - Running on 4 CPU(s), OS Windows 7, architecture amd64, Java version 1.7.0_07, max available memory for JVM 668160 KB
INFO [main] - Loading default properties from: defaultProperties
INFO [main] - Graph definition file: graph/Copy of LoadData1.grf
INFO [main] - Graph revision: 1.17 Modified by: MANJU Modified: Tue Jul 23 08:08:54 IST 2013
INFO [main] - Checking graph configuration...
ERROR [main] - Graph configuration is invalid.
WARN [main] - [Join Dim on Facts:JOIN_DIM_ON_FACTS] - Input port 4 not defined or mapping has too many elements (number of input ports: 4)
ERROR [main] - [ResponseSurvey:RESPONSE_SURVEY] - At least 1 output port must be defined!
ERROR [main] - Error during graph initialization !
Element [1371098357416:LoadData]-Graph configuration is invalid.
at org.jetel.graph.runtime.EngineInitializer.initGraph(EngineInitializer.java:263)
at org.jetel.graph.runtime.EngineInitializer.initGraph(EngineInitializer.java:239)
at org.jetel.main.runGraph.runGraph(runGraph.java:377)
at org.jetel.main.runGraph.main(runGraph.java:341)
Caused by: org.jetel.exception.ConfigurationException: [ResponseSurvey:RESPONSE_SURVEY] - At least 1 output port must be defined!
at org.jetel.exception.ConfigurationProblem.toException(ConfigurationProblem.java:156)
at org.jetel.exception.ConfigurationStatus.toException(ConfigurationStatus.java:106)

Hi,
I've managed to recreate the graph.But stuck with other error on the "Getting started" application.
This time I'm adding "Geography Dim" and "Reseller Dim" through ExHash join to "Join Dims to Fact".
I've got the below error
INFO [main] - *** CloverETL framework/transformation graph, (c) 2002-2013 Javlin a.s, released under GNU Lesser General Public License ***
INFO [main] - Running with CloverETL library version 3.3.0 build#036 compiled 12/02/2013 18:45:45
INFO [main] - Running on 4 CPU(s), OS Windows 7, architecture amd64, Java version 1.7.0_07, max available memory for JVM 668160 KB
INFO [main] - Loading default properties from: defaultProperties
INFO [main] - Graph definition file: graph/LoadData.grf
INFO [main] - Graph revision: 1.26 Modified by: MANJU Modified: Thu Jul 25 23:54:02 IST 2013
INFO [main] - Checking graph configuration...
INFO [main] - Graph configuration is valid.
INFO [main] - Graph initialization (LoadData)
INFO [main] - [Clover] Initializing phase: 0
INFO [main] - [Clover] phase: 0 initialized successfully.
INFO [WatchDog] - Starting up all nodes in phase [0]
INFO [WatchDog] - Successfully started all nodes in phase!
ERROR [WatchDog] - Graph execution finished with error
ERROR [WatchDog] - Node GEOGRAPHY_DIM finished with status: ERROR caused by: Component pre-execute initialization failed.
ERROR [WatchDog] - Node GEOGRAPHY_DIM error details:
Element [GEOGRAPHY_DIM:Geography Dim]-Component pre-execute initialization failed.
at org.jetel.graph.Node.run(Node.java:458)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 10
at org.jetel.data.parser.AhoCorasick.isPattern(AhoCorasick.java:182)
at org.jetel.data.parser.CharByteDataParser$ByteRecordSkipper.skipInput(CharByteDataParser.java:1594)
at org.jetel.data.parser.CharByteDataParser.skip(CharByteDataParser.java:264)
at org.jetel.util.MultiFileReader.skip(MultiFileReader.java:341)
at org.jetel.util.MultiFileReader.nextSource(MultiFileReader.java:286)
at org.jetel.util.MultiFileReader.preExecute(MultiFileReader.java:498)
at org.jetel.component.DataReader.preExecute(DataReader.java:237)
at org.jetel.graph.Node.run(Node.java:456)
... 1 more
INFO [WatchDog] - [Clover] Post-execute phase finalization: 0
INFO [WatchDog] - [Clover] phase: 0 post-execute finalization successfully.
INFO [WatchDog] - Execution of phase [0] finished with error - elapsed time(sec): 0
ERROR [WatchDog] - !!! Phase finished with error - stopping graph run !!!
INFO [WatchDog] - -----------------------** Summary of Phases execution **---------------------
INFO [WatchDog] - Phase# Finished Status RunTime(sec) MemoryAllocation(KB)
INFO [WatchDog] - 0 ERROR 0 27979
INFO [WatchDog] - ------------------------------** End of Summary **---------------------------
INFO [WatchDog] - WatchDog thread finished - total execution time: 5 (sec)
INFO [main] - Freeing graph resources.
ERROR [main] - Execution of graph failed !
kindly help.

ERROR DURING LOADING DATA FROM PSA TO DSO IN "PRUEFMBKT"

Respected all
I am trying to load data through an r/3 field( pruefmbkt, char-40length) to infoobject. the data is coming correctly to psa but when i am loading it in to dso or infocube request is turning red giving following error message--
Value '010/12.05-112.15/hold on not operate' (hex.
'3031302F31322E30352D3131322E31352F686F6C64206F6E20') of characteristic
PRU_LSIL contains invalid characters
Message no. BRAIN060
Diagnosis
    Only the following standard characters are valid in characteristic
    values by default:
    !"%&''()*,-./:;<=>?_0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZ.+
    Furthermore, characteristic values that only consist of the character #
    or that begin with ! are not valid.
    You are trying to load the invalid characteristic value 1. (hexidecimal
    representation 3031302F31322E30352D3131322E31352F686F6C64206F6E20).
Procedure for System Administration
    Try to change the invalid characters to valid characters.
    If you want values that contain invalid characters to be admitted into
    the system, make the appropriate setting in BW Customizing. Refer to the
    documentation describing the requirements for special characters and the
    possible consequences.
    For more information on the problems involved with valid and invalid
    characters, click here.
kindly give me the solution how to deal with this problem.
thanks
abhay

HI Abhay,
please check if the infoobject corresponding to field PRU_LSIL in BW system has lower case checkbox enabled in the infoobject properties, as the value '010/12.05-112.15/hold on not operate' coming from R/3 has lower case alphabets.
Hope this helps.
Regards,
Umesh.

[Load data from excel file [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009. There may be error messa

Error
[Load data from excel file [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009. There
may be error message
I am using BIDS Microsoft Visual Studio 2008 and running the package to load the data from excel .
My machine has 32 bit excel hence have set property to RUN64BITRUNTIME AS FALSE.
But the error still occurs .
I checked on Google and many have used Delay validation property at Data flow task level to true but even using it at both excel connection manager and DFT level it doesnt work
Mudassar

Thats my connection string
Provider=Microsoft.ACE.OLEDB.12.0;Data Source=E:\SrcData\Feeds\Utilization.xlsx;Extended Properties="Excel 12.0;HDR=NO";
Excel 2010 installed and its 32 bit edition
Are you referring to install this component -AccessDatabaseEngine_x64.exe?
http://www.microsoft.com/en-us/download/details.aspx?id=13255
Mudassar
You can try an OLEDB provider in that case
see
http://dataintegrity.wordpress.com/2009/10/16/xlsx/
you might need to download and install ms access redistributable
http://www.microsoft.com/en-in/download/details.aspx?id=13255
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Binary Save of Loaded data

I load data in the database, do the requisite operations on it by executing the applications. Now i have to load a fresh set of data by deleting this one. Is there a way by which i can save the binary of it so that i don't have to load data again.

Hi,
I validate using a set of functions in a package that return substitute values. On the basis of these substitue values records are accepted or rejected. The set contains functions for validation of date & number fields.
So, in short. Write function to validate numbers or dates. Insert known substitue values for erroneous data and validate in the next step on these substitute values.
Hope this is what you're looking for.
Cheers,
Rob

Regarding Short Dump While loading data from DB Connect

Dear All,
We are having an issue of getting short dump while loading data from DB Connect to BW. We were able to load the data into BW Dev using the same data source without any problem. Whereas in Production, I am getting the following error:
Runtime Error PERFORM_CONFLICT_TAB_TYPE
Except. CX_SY_DYN_CALL_ILLEGAL_TYPE
What could be the reason for the error that I am getting

hi,
Refer Note 707986 - Writing in trans. InfoCubes: PERFORM_CONFLICT_TAB_TYPE
Summary
Symptom
When data is written to a transactional InfoCube, the termination PERFORM_CONFLICT_TAB_TYPE occurs. The short dump lists the following reasons for the termination:
("X") The row types of the two tables are incompatible.
("X") The table keys of the two tables do not correspond.
Other terms
transactional InfoCube, SEM, BPS, BPS0, APO
Reason and Prerequisites
The error is caused by an intensified type check in the ABAP runtime environment.
Solution
Workaround for BW 3.0B (SP16-19), BW 3.1 (SP10-13)
Apply the attached correction instructions.
BW 3.0B
Import Support Package 20 for 3.0B (BW3.0B Patch20 or SAPKW30B20) into your BW system. The Support Package is available oncenote 0647752 with the short text "SAPBWNews BW3.0B Support Package 20", which describes this Support Package in more detail, has been released for customers.
BW 3.10 Content
Import Support Package 14 for 3.10 (BW3. 10 Patch14 or SAPKW31014) into your BW system. The Support Package is available once note 0601051 with the short text "SAPBWNews BW 3.1 Content Support Package 14" has been released for customers.
BW3.50
Import Support Package 03 for 3.5 (BW3.50 Patch03 or SAPKW35003) into your BW system. The Support Package is available once note 0693363 with the short text "SAPBWNews BW 3.5 Support Package 03", which describes this Support Package in more detail, has been released for customers.
The notes specified may already be available to provide advance information before the Support Package is released. However, in this case, the short text still contains the term "Preliminary version" in this case.
Header Data
Release Status: Released for Customer
Released on: 18.02.2004 08:11:39
Priority: Correction with medium priority
Category: Program error
Primary Component: BW-BEX-OT-DBIF Interface to Database
Secondary Components: FIN-SEM-BPS Business Planning and Simulation
Releases
Software
Component Release From
Release To
Release And
subsequent
SAP_BW 30 30B 30B
SAP_BW 310 310 310
SAP_BW 35 350 350
Support Packages
Support
Packages Release Package
Name
SAP_BW_VIRTUAL_COMP 30B SAPK-30B20INVCBWTECH
Related Notes
693363 - SAPBWNews BW SP03 NW'04 Stack 03 RIN
647752 - SAPBWNews BW 3.0B Support Package 20
601051 - SAPBWNews BW 3.1 Content Support Package 14
Corrections Instructions
Correction
Instruction Valid
from Valid
to Software
Component Ref.
Correction Last
Modifcation
301776 30B 350 SAP_BW J19K013852 18.02.2004 08:03:33
Attributes
Attribute Value
weitere Komponenten 0000031199
Thanks
(Activate ODS/Cube and Transfer rules again..)

Oracle BPM 10gR3 Dashboards - Error in loading data

We have an issue with oracle bpm 10g dashboards. Chart component in the presentation displays "Error in loading data". There is no exception, the attached method returns valid x,y co-ordinates.If we enable 'user refresh" property of the chart component and click on refresh in the presention, it displays the chart. Any change in the presentation(change a drop down a value, etc) sets it again as "Error in loading data" and click on refresh brings back the chart.
Adding this.refreshGraphicImage(graphicId : "chart") in the code to refresh the chart also din't help.
please let me know if anybody has faced similar issue.
Thanks,
Gopi

You have to set "fuego.workspace.execution.ajax.enabled" property to FALSE in the workspace.properties, that is located in ...\webapps\workspace\WEB-INF
Hope it helps!

Invalid Number Error for Decimal Field While Loading Data

I am loading a delimited text file using the SQL* loader however I am reciving an error in my decimal fields. When a decimal field only has leading zeros before the decimal point I receive invalid number error. Below will clarify:
i.e.) 00000000.30 [*Invalid number*]
i.e.) 00046567.45 [*Valid number*]
i.e.) 00000001.00 [*Valid number*]
I've tried setting the precision/scale in the table, tried declaring it a decimal field instead of number, none of these methods fixed the issue. Any help I would really appreciate.
POLICY_NUMBER             NUMBER,
EFFECTIVE_DATE     DATE "YYYYMMDD"          NULLIF EFFECTIVE_DATE = '',
TRANSACTION_DATE     DATE "YYYYMMDD",
TRANSACTION_AMOUNT     DECIMAL EXTERNAL,   -- Tried TRANSACTION_AMOUNT DECIMAL EXTERNAL (10) & TRANSACTION_AMOUNT NUMBER
MF_TRX_CODE          NUMBER,
USER_ID          CHAR,
GROUP_NUMBER          NUMBER,
EXPIRATION_DATE     DATE "YYYYMMDD"          NULLIF EXPIRATION_DATE = '',
BILL_NUMBER          NUMBER,Any help is greatly appreciated. Thanks before hand.

Hi,
Connected to Oracle Database 10g Express Edition Release 10.2.0.1.0
Connected as hr
SQL> SELECT * FROM TEST;
TRANSACTION_AMOUNT
SQL> SELECT * FROM TEST;
TRANSACTION_AMOUNT
          11000,00
            293,37
           2000,00
           1134,32
              0,30
SQL>Between the selects I loaded the table with sql*loader using...
Load Data
INFILE *
APPEND
INTO TABLE TEST
FIELDS TERMINATED BY '|'
TRAILING NULLCOLS
TRANSACTION_AMOUNT     DECIMAL EXTERNAL
BEGINDATA
00011000.00
00000293.37
00002000.00
00001134.32
00000000.30The log is
SQL*Loader: Release 10.2.0.1.0 - Production on Tue Dec 23 17:23:47 2008
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Control File:   test.ctl
Data File:      test.ctl
Bad File:     test.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 50
Bind array:     64 rows, maximum of 256000 bytes
Continuation:    none specified
Path used:      Conventional
Table TEST, loaded from every logical record.
Insert option in effect for this table: APPEND
TRAILING NULLCOLS option in effect
   Column Name                  Position   Len Term Encl Datatype
TRANSACTION_AMOUNT                  FIRST     *   |       CHARACTER
Table TEST:
5 Rows successfully loaded.
0 Rows not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
Space allocated for bind array:                  16512 bytes(64 rows)
Read   buffer bytes: 1048576
Total logical records skipped:          0
Total logical records read:             5
Total logical records rejected:         0
Total logical records discarded:        0
Run began on Tue Dec 23 17:23:47 2008
Run ended on Tue Dec 23 17:23:50 2008
Elapsed time was:     00:00:02.86
CPU time was:         00:00:00.06Regards,

SQL LOADER DATA INSERT ISSUES

I tried inserting data into an empty table in my database but got the following error:
SQL*Loader: Release 11.1.0.6.0 - Production on Tue Jul 7 22:01:35 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
SQL*Loader-350: Syntax error at line 7.
Expecting "," or ")", found "VARCHAR2".
countryname VARCHAR2(25),
^
What is wrong what this please? Find below the contents of .CTL and .DAT files.
Content of load_country.CTL
LOAD DATA
infile '/D:/Data/Load/load_country.dat'
INTO TABLE ASSET.COUNTRY
INSERT
FIELDS TERMINATED BY ';'
(countrycode,
countryname VARCHAR2(25),
population NUMBER(10))
The content of the load_country.DAT file:
BEN;Benin;8791832
BFA;Burkina Faso;15746232
CPV;Cape Verde;503000
Thank you.
Ofonime Essien.

Hello,
After solving the Varchar2 problem, I received this error for the NUMBER data type:
SQL*Loader: Release 11.1.0.6.0 - Production on Wed Jul 8 11:47:16 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
SQL*Loader-350: Syntax error at line 8.
Expecting "," or ")", found "number".
population number(10))
^
I replaced the Number data type with Float but received this error:
SQL*Loader: Release 11.1.0.6.0 - Production on Wed Jul 8 11:52:27 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
SQL*Loader-350: Syntax error at line 8.
Expecting valid column specification, "," or ")", found "(".
population Float(10))
^
Replacing Number data type with Integer, I received this error:
SQL*Loader: Release 11.1.0.6.0 - Production on Wed Jul 8 12:17:11 2009
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Control File: D:\Data\Load\tsl.CTL
Data File: D:\Data\Load\c.dat
Bad File: D:\Data\Load\c.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 50
Bind array: 64 rows, maximum of 256000 bytes
Continuation: none specified
Path used: Conventional
Table C, loaded from every logical record.
Insert option in effect for this table: INSERT
Column Name Position Len Term Encl Datatype
COUNTRYCODE FIRST * ; CHARACTER
COUNTRYNAME NEXT 27 VARCHAR
POPULATION NEXT 10 INTEGER
SQL*Loader-941: Error during describe of table C
ORA-04043: object C does not exist
Thank you so much.
Ofonime.
Edited by: ofonime on Jul 8, 2009 7:09 PM

IFS-12635: SimpleXmlParser: Value(10/10/99) not valid for type (Date)

I am trying to uplaod an xml document sample which has an attribute of date datatype.
My sample is :
<?xml version="1.0" standalone="yes"?>
<document>
<name> test</name>
<createdate>1999/03/12</createdate>
</document>
I am getting this error:
IFS-12635: SimpleXmlParser: Value(10/10/99) not valid for type (Date).
If I input just the "name attribute" value, there is no problem. What is the date format, I should use?
Please suggest.
Thank you
null

Is there any way to specify the format in the custom type document itself. ? I do not want to specify the format in every document sample. Is there any way that it is possible. If I give the format in the document samples, as Matt said, there is no problem.
Now I tried to give the format in the type document itself.
I created a custom type document as follows:
<?xml version="1.0" standalone="yes"?>

<ClassObject>
<Name>myTestType</Name>
<Description> myTestType Document </Description>
<Superclass Reftype ="name">Document</Superclass>
<Attributes>
<Attribute>
<Name> Category </Name>
<DataType> String </DataType>
<DataLength> 80 </DataLength>
</Attribute>
<Attribute>
<Name> posted_date </Name>
<DataType format="mm-dd-yyyy"> date </DataType>
</Attribute>
</Attributes>
</ClassObject>
I could able to upload this to ifs. No problem at this time. But when I try to load the below sample, I am getting the same parse problem.(IFS-12635 SimpleXmlParser: Value(12-25-1992) not valid for type (Date.).
sample xml document
<?xml version="1.0" standalone="yes"?>
<myTestType>
<name> testing.myTestType</name>
<Category>Administration_4</Category>
<posted_date >12-25-1992</posted_date>
</myTestType>
Thank you.

Two Apps Suddenly Are Unable to Load Data

Hello,
This problem may or may not be from LightSwitch. I have two apps on Azure websites, with Azure DBs. One has been working great since deployment, about 10 months ago. The other has been working well since Nov. As of today, both
are unable to run their queries or load data.
Nothing has changed on our end and I am getting so many different error codes, but the gist is that they are unable to connect.
I've checked both databases and they are working.
I've noticed one error message that says the URI http://site.azurewebsites.net//ApplicationData.svc/etc is not valid because it is not based on http://site.azurewebsites.net/ApplicationData.svc/
Does anyone else have a production app this has happened to? Or know how to get those URIs matching again? Any help would be greatly appreciated!
Thanks,
C

Hi Chris
You'll notice below that David Ebbo has assisted in trying to get my site up and applied a work-around but it hasn't fixed my issue.
He's had to leave the office so I'm trying everything I can think of to get my site back up.
You can read the details in my discussion with him further down in this topic.
I'm just stabbing in the dark but my HTML client gives this error "Request failed with status code '400' and status text 'Bad Request'" and in the forum I find that someone also experienced the issue at this topic:
https://social.msdn.microsoft.com/Forums/vstudio/en-US/facf88ab-497a-432d-8c42-1caa0d3cdc0c/lightswitch-html-client-request-failed-with-status-code-400?forum=lightswitch
A proposed solution on the thread is:
"In my case after upgrading the project to the March 2004 Lightswitch format and getting this error I had to install this nuget package to make it work on the server:
https://www.nuget.org/packages/System.IdentityModel.Tokens.Jwt/"
Should I go down this path or is it a red herring?
Thanks, Mark.
PS: My SL client gives this error on loading the first screen:
"An error occurred while running the screen. Error details: Exception has been thrown by the target of an invocation."
Mark
Woo Hoo. I went to Cloud Cellar and recovered files only from my backup and now my HTML client works :-)
My SL client gets all the way past loading nearly all the initial screen data then comes up with this error:
"The metadata URI 'http://login.skemaz.net/ApplicationData.svc/$metadata#Chains' references the entity type with name 'LightSwitchApplication.Chain'; however, the name of the expected entity type is 'LightSwitchApplication.ChainsTemp' which is not compatible
with the entity type with name 'LightSwitchApplication.Chain'."
We seem to be getting somewhere.
Please assist with the above. Thanks, Mark.

Loading Data From File Through EM on Mac OS X

Has anyone been able to load data from a file through the Oracle Enterprise Manager on Mac OS X?
Specifically, I'm trying to follow the example in the 2-day DBA manual (Chp. 08 "Managing Schema Objects" --> "Loadng Data Into Tables").
When I enter the appropriate user name and password entries into the fields under the "Host Credentials" section, and I click the "Next" button, I run into a "Validation Error." The rest of the error message reads:
"Examine and corrent the following errors, then retry the operation: Error - RemoteOperationException: ERROR: command process interrupted before exit"
Has anyone else encountered the same error? If so, would you please share the solution? I'm also curious to know how to diagnose the problem (i.e., which logs can I reference to trace what's happening in the background?).
Thank you.

I used to get an error message stating that I entered the wrong password whether or not I actually entered the password correctly. Then, I modified the NetInfo entries for the local user account that I was using; I changed the "authentication_authority" property to ";basic;" and changed the "passwd" property a traditional unix hash password (using the 'openssl passwd <password>' command). All changes were done using the NetInfo Manager.
After I made the change, I got a little further, but only as far as the problem that I described at the start of this message thread.
Likewise, I hope someone from Oracle can actually provide some insight into this.

Validation of loaded data

Similar Messages

Maybe you are looking for