Staging Tables in AP

Hi
I am a newbie to Peoplesoft and am trying to understand all the staging tables that are used in AP.
Could somebody explain me the difference between VCHR_HDR_STG and VCHR_HDR_EC tables and when they will be used.
The environment i am using is Financials 9.0 and Peopletools 8.49
Thanks in advance
Sri

Years ago, it was announced the EDI Manager would be eliminated. It's still there in 9.0 so the funeral cortege is awaiting. Personally, I don't use it.
I have found it simpler to develop and support File Layouts. I read in the files and load a VOUCHER_BUILD message. When the message is published, delivered processes will handle placement into the staging tables.
I use an AE to handle the processing. I design criteria to select a File Layout from a key on the file or a value in a Run Control record. After which, it's a matter of opening the file, reading the rowset, loading the message rowset and publishing.
HTH
Steven E. Davies

Similar Messages

Problem during Data Warehouse Loading (from staging table to Cube)

Hi All,
I have created a staging Module in owb to load my flat files to my staging tables.I have created an Warehouse module to load my staging tables to Dimension and Cube that I have created.
My senario:
I have a temp_table_transaction which had loaded my flat files to it .This table had loaded with 168,271,269 milion record as through this flat file.
I have created a mapping in owb which loaded my temp_table_transaction which has join with other tables and some expression and convert function that these numbers fill to a new table called stg_tbl_transaction in my staging module.Running this mapping takes 3 hours and 45 minutes with this configue of my mapping:
Default operation mode in running parameter of Mapp config=Set based
My dimesion filled correctly but I have two problem when I want to transfer my staging table to my Cube:
#1 Problem:
i have created a cube is called transaction_cube with owb and it generated and deployed correctly.
i have created a map to fill my cube with 168,271,268 milon recodes in staging table was called stg_tbl_transaction and deployed it to server (my cube map operating mode is set based)
but after running this map it did not complete after 9 hour and I forced to cancel my running's map by kill its sessions .I want to know this time for loading this capacity of data is acceptable or for this capacity of data we should spend more time.Please let me know if anybody has any Issue.
#2 Problem
To test my map I have created a map with configure set based in operation modes and select my stg_tbl_transaction as source with 168,271,268 records in it and I have created another table to transfer and load my data in it.I wanted to test the time we should spend on this simple map but after 5 hours my data had not loaded in new table.I want to know where is my problem.Should I have set something in configue of map or anothe things.Please guide me about these problems.
CONFIGURATION OF MY SERVER:
i run owb on two socket xeon 5500 series with 192 GB ram and disks with RAID 10 Array
Regards,
Sahar

For all of you
It is possible to load from Infoset to Cube we did it, and it was ok.
Data are really loaded from Infoset (Cube + master dat) to cube.
When you create a transformation under a cube Infoset is proposed, and it works fine ....
Now the process is no more operationnal and i don't understand why .....
Load from infoset to cube is possible, i can send you screen shot if you want ....
Christophe

Unable to load data from FDMEE staging table to HFM tables

Hi,
We have installed EPM 11.1.2.3 with all latest related products (ODI/FDMEE) in our development environment
We are inprocess of loading data from EBS R12 to HFM using ERPI (Data Managemwnt in EPM 11.1.2.3). We could Import and validate the data but when we try to Export the data to HFM, the process continuously running hours (neither it gives any error nor it completes).
When we check the process details in ODI work repository, following processes are completed successfully
COMM_LOAD_BALANCES - Running .........(From past 1 day, still running)
EBS_GL_LOAD_BALANCES_DATA - Successful
COMM_LOAD_BALANCES - Successful
Whereas we could load data in staging table of FDMEE database schema and moreover we are even able to drill through to source system (EBS R12) from Data load workbench but not able to load the data into HFM application.
Log details from the process are below.
2013-11-05 17:04:59,747 INFO [AIF]: FDMEE Process Start, Process ID: 31
2013-11-05 17:04:59,747 INFO [AIF]: FDMEE Logging Level: 4
2013-11-05 17:04:59,748 INFO [AIF]: FDMEE Log File: C:\FDMEE\outbox\logs\OASIS_31.log
2013-11-05 17:04:59,748 INFO [AIF]: User:admin
2013-11-05 17:04:59,748 INFO [AIF]: Location:VisionLoc (Partitionkey:1)
2013-11-05 17:04:59,749 INFO [AIF]: Period Name:JAN (Period Key:1/1/12 12:00 AM)
2013-11-05 17:04:59,749 INFO [AIF]: Category Name:VisionCat (Category key:3)
2013-11-05 17:04:59,749 INFO [AIF]: Rule Name:VisionRule (Rule ID:2)
2013-11-05 17:05:00,844 INFO [AIF]: Jython Version: 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Oracle JRockit(R) (Oracle Corporation)]
2013-11-05 17:05:00,844 INFO [AIF]: Java Platform: java1.6.0_37
2013-11-05 17:05:02,910 INFO [AIF]: -------START IMPORT STEP-------
2013-11-05 17:05:02,953 INFO [AIF]: -------END IMPORT STEP-------
2013-11-05 17:05:03,030 INFO [AIF]: -------START EXPORT STEP-------
2013-11-05 17:05:03,108 INFO [AIF]:
Move Data for Period 'JAN'
Any help on above is much appreciated.
Thank you
Regards
Praneeth

Hi,
I have followed the steps 1 & 2 above. Noe the log shows something like below
2013-11-05 09:47:31,179 INFO [AIF]: FDMEE Process Start, Process ID: 22
2013-11-05 09:47:31,179 INFO [AIF]: FDMEE Logging Level: 4
2013-11-05 09:47:31,179 INFO [AIF]: FDMEE Log File: C:\FDMEE\outbox\logs\OASIS_22.log
2013-11-05 09:47:31,180 INFO [AIF]: User:admin
2013-11-05 09:47:31,180 INFO [AIF]: Location:VisionLoc (Partitionkey:1)
2013-11-05 09:47:31,180 INFO [AIF]: Period Name:JAN (Period Key:1/1/12 12:00 AM)
2013-11-05 09:47:31,180 INFO [AIF]: Category Name:VisionCat (Category key:3)
2013-11-05 09:47:31,181 INFO [AIF]: Rule Name:VisionRule (Rule ID:2)
2013-11-05 09:47:32,378 INFO [AIF]: Jython Version: 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Oracle JRockit(R) (Oracle Corporation)]
2013-11-05 09:47:32,378 INFO [AIF]: Java Platform: java1.6.0_37
2013-11-05 09:47:34,652 INFO [AIF]: -------START IMPORT STEP-------
2013-11-05 09:47:34,698 INFO [AIF]: -------END IMPORT STEP-------
2013-11-05 09:47:34,744 INFO [AIF]: -------START EXPORT STEP-------
2013-11-05 09:47:34,828 INFO [AIF]:
Move Data for Period 'JAN'
2013-11-08 11:49:10,478 INFO [AIF]: FDMEE Process Start, Process ID: 22
2013-11-08 11:49:10,493 INFO [AIF]: FDMEE Logging Level: 5
2013-11-08 11:49:10,493 INFO [AIF]: FDMEE Log File: C:\FDMEE\outbox\logs\OASIS_22.log
2013-11-08 11:49:10,494 INFO [AIF]: User:admin
2013-11-08 11:49:10,494 INFO [AIF]: Location:VISIONLOC (Partitionkey:1)
2013-11-08 11:49:10,494 INFO [AIF]: Period Name:JAN (Period Key:1/1/12 12:00 AM)
2013-11-08 11:49:10,495 INFO [AIF]: Category Name:VISIONCAT (Category key:1)
2013-11-08 11:49:10,495 INFO [AIF]: Rule Name:VISIONRULE (Rule ID:1)
2013-11-08 11:49:11,903 INFO [AIF]: Jython Version: 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Oracle JRockit(R) (Oracle Corporation)]
2013-11-08 11:49:11,909 INFO [AIF]: Java Platform: java1.6.0_37
2013-11-08 11:49:14,037 INFO [AIF]: -------START IMPORT STEP-------
2013-11-08 11:49:14,105 INFO [AIF]: -------END IMPORT STEP-------
2013-11-08 11:49:14,152 INFO [AIF]: -------START EXPORT STEP-------
2013-11-08 11:49:14,178 DEBUG [AIF]: CommData.exportData - START
2013-11-08 11:49:14,183 DEBUG [AIF]: CommData.getRuleInfo - START
2013-11-08 11:49:14,188 DEBUG [AIF]:
        SELECT brl.RULE_ID
        ,br.RULE_NAME
        ,brl.PARTITIONKEY
        ,brl.CATKEY
        ,part.PARTVALGROUP
        ,br.SOURCE_SYSTEM_ID
        ,ss.SOURCE_SYSTEM_TYPE
        ,CASE
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'EBS%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'PS%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'FUSION%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'FILE%' THEN 'N'
          ELSE 'Y'
        END SOURCE_ADAPTER_FLAG
        ,app.APPLICATION_ID
        ,app.TARGET_APPLICATION_NAME
        ,app.TARGET_APPLICATION_TYPE
        ,app.DATA_LOAD_METHOD
        ,brl.PLAN_TYPE
        ,CASE brl.PLAN_TYPE
          WHEN 'PLAN1' THEN 1
          WHEN 'PLAN2' THEN 2
          WHEN 'PLAN3' THEN 3
          WHEN 'PLAN4' THEN 4
          WHEN 'PLAN5' THEN 5
          ELSE 0
        END PLAN_NUMBER
        ,br.INCL_ZERO_BALANCE_FLAG
        ,br.PERIOD_MAPPING_TYPE
        ,br.INCLUDE_ADJ_PERIODS_FLAG
        ,br.BALANCE_TYPE ACTUAL_FLAG
        ,br.AMOUNT_TYPE
        ,br.BALANCE_SELECTION
        ,br.BALANCE_METHOD_CODE
        ,COALESCE(br.SIGNAGE_METHOD, 'ABSOLUTE') SIGNAGE_METHOD
        ,br.CURRENCY_CODE
        ,br.BAL_SEG_VALUE_OPTION_CODE
        ,brl.EXECUTION_MODE
        ,COALESCE(brl.IMPORT_FROM_SOURCE_FLAG, 'Y') IMPORT_FROM_SOURCE_FLAG
        ,COALESCE(brl.RECALCULATE_FLAG, 'N') RECALCULATE_FLAG
        ,COALESCE(brl.EXPORT_TO_TARGET_FLAG, 'N') EXPORT_TO_TARGET_FLAG
        ,CASE
          WHEN (br.LEDGER_GROUP_ID IS NOT NULL) THEN 'MULTI'
          WHEN (br.SOURCE_LEDGER_ID IS NOT NULL) THEN 'SINGLE'
          ELSE 'NONE'
        END LEDGER_GROUP_CODE
        ,COALESCE(br.BALANCE_AMOUNT_BS, 'YTD') BALANCE_AMOUNT_BS
        ,COALESCE(br.BALANCE_AMOUNT_IS, 'PERIODIC') BALANCE_AMOUNT_IS
        ,br.LEDGER_GROUP
        ,(SELECT brd.DETAIL_CODE
          FROM AIF_BAL_RULE_DETAILS brd
          WHERE brd.RULE_ID = br.RULE_ID
          AND brd.DETAIL_TYPE = 'LEDGER'
        ) PS_LEDGER
        ,CASE lg.LEDGER_TEMPLATE
          WHEN 'COMMITMENT' THEN 'Y'
          ELSE 'N'
        END KK_FLAG
        ,p.LAST_UPDATED_BY
        ,p.AIF_WEB_SERVICE_URL WEB_SERVICE_URL
        ,p.EPM_ORACLE_INSTANCE
        FROM AIF_PROCESSES p
        INNER JOIN AIF_BAL_RULE_LOADS brl
          ON brl.LOADID = p.PROCESS_ID
        INNER JOIN AIF_BALANCE_RULES br
          ON br.RULE_ID = brl.RULE_ID
        INNER JOIN AIF_SOURCE_SYSTEMS ss
          ON ss.SOURCE_SYSTEM_ID = br.SOURCE_SYSTEM_ID
        INNER JOIN AIF_TARGET_APPLICATIONS app
          ON app.APPLICATION_ID = brl.APPLICATION_ID
        INNER JOIN TPOVPARTITION part
          ON part.PARTITIONKEY = br.PARTITIONKEY
        INNER JOIN TBHVIMPGROUP imp
          ON imp.IMPGROUPKEY = part.PARTIMPGROUP
        LEFT OUTER JOIN AIF_COA_LEDGERS l
          ON l.SOURCE_SYSTEM_ID = p.SOURCE_SYSTEM_ID
          AND l.SOURCE_LEDGER_ID = COALESCE(br.SOURCE_LEDGER_ID,imp.IMPSOURCELEDGERID)
        LEFT OUTER JOIN AIF_PS_SET_CNTRL_REC_STG scr
          ON scr.SOURCE_SYSTEM_ID = l.SOURCE_SYSTEM_ID
          AND scr.SETCNTRLVALUE = l.SOURCE_LEDGER_NAME
          AND scr.RECNAME = 'LED_GRP_TBL'
        LEFT OUTER JOIN AIF_PS_LED_GRP_TBL_STG lg
          ON lg.SOURCE_SYSTEM_ID = scr.SOURCE_SYSTEM_ID
          AND lg.SETID = scr.SETID
          AND lg.LEDGER_GROUP = br.LEDGER_GROUP
        WHERE p.PROCESS_ID = 22
2013-11-08 11:49:14,195 DEBUG [AIF]:
      SELECT adim.BALANCE_COLUMN_NAME DIMNAME
      ,adim.DIMENSION_ID
      ,dim.TARGET_DIMENSION_CLASS_NAME
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID1
      ) COA_SEGMENT_NAME1
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID2
      ) COA_SEGMENT_NAME2
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID3
      ) COA_SEGMENT_NAME3
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID4
      ) COA_SEGMENT_NAME4
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID5
      ) COA_SEGMENT_NAME5
      ,(SELECT CASE mdd.ORPHAN_OPTION_CODE
          WHEN 'CHILD' THEN 'N'
          WHEN 'ROOT' THEN 'N'
          ELSE 'Y'
        END DIMENSION_FILTER_FLAG
        FROM AIF_MAP_DIM_DETAILS_V mdd
        ,AIF_MAPPING_RULES mr
        WHERE mr.PARTITIONKEY = tpp.PARTITIONKEY
        AND mdd.RULE_ID = mr.RULE_ID
        AND mdd.DIMENSION_ID = adim.DIMENSION_ID
      ) DIMENSION_FILTER_FLAG
      ,tiie.IMPCONCATCHAR
      FROM TPOVPARTITION tpp
      INNER JOIN AIF_TARGET_APPL_DIMENSIONS adim
        ON adim.APPLICATION_ID = 2
      INNER JOIN AIF_DIMENSIONS dim
        ON dim.DIMENSION_ID = adim.DIMENSION_ID
      LEFT OUTER JOIN TBHVIMPITEMERPI tiie
        ON tiie.IMPGROUPKEY = tpp.PARTIMPGROUP
        AND tiie.IMPFLDFIELDNAME = adim.BALANCE_COLUMN_NAME
        AND tiie.IMPMAPTYPE = 'ERP'
      WHERE tpp.PARTITIONKEY = 1
      AND adim.BALANCE_COLUMN_NAME IS NOT NULL
      ORDER BY adim.BALANCE_COLUMN_NAME
2013-11-08 11:49:14,197 DEBUG [AIF]: {'APPLICATION_ID': 2L, 'IMPORT_FROM_SOURCE_FLAG': u'N', 'PLAN_TYPE': None, 'RULE_NAME': u'VISIONRULE', 'ACTUAL_FLAG': u'A', 'IS_INCREMENTAL_LOAD': False, 'EPM_ORACLE_INSTANCE': u'C:\\Oracle\\Middleware\\user_projects\\epmsystem1', 'CATKEY': 1L, 'BAL_SEG_VALUE_OPTION_CODE': u'ALL', 'INCLUDE_ADJ_PERIODS_FLAG': u'N', 'PERIOD_MAPPING_TYPE': u'EXPLICIT', 'SOURCE_SYSTEM_TYPE': u'EBS_R12', 'LEDGER_GROUP': None, 'TARGET_APPLICATION_NAME': u'OASIS', 'RECALCULATE_FLAG': u'N', 'SOURCE_SYSTEM_ID': 2L, 'TEMP_DATA_TABLE_NAME': 'TDATASEG_T', 'KK_FLAG': u'N', 'AMOUNT_TYPE': u'MONETARY', 'EXPORT_TO_TARGET_FLAG': u'Y', 'DATA_TABLE_NAME': 'TDATASEG', 'DIMNAME_LIST': [u'ACCOUNT', u'ENTITY', u'ICP', u'UD1', u'UD2', u'UD3', u'UD4'], 'TDATAMAPTYPE': 'ERP', 'LAST_UPDATED_BY': u'admin', 'DIMNAME_MAP': {u'UD3': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT5', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD3', 'DIMENSION_ID': 9L}, u'ICP': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'ICP', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT7', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ICP', 'DIMENSION_ID': 8L}, u'ENTITY': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Entity', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT1', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ENTITY', 'DIMENSION_ID': 12L}, u'UD2': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT4', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD2', 'DIMENSION_ID': 11L}, u'UD4': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT6', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD4', 'DIMENSION_ID': 1L}, u'ACCOUNT': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Account', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT3', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ACCOUNT', 'DIMENSION_ID': 10L}, u'UD1': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT2', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD1', 'DIMENSION_ID': 7L}}, 'TARGET_APPLICATION_TYPE': u'HFM', 'PARTITIONKEY': 1L, 'PARTVALGROUP': u'[NONE]', 'LEDGER_GROUP_CODE': u'SINGLE', 'INCLUDE_ZERO_BALANCE_FLAG': u'N', 'EXECUTION_MODE': u'SNAPSHOT', 'PLAN_NUMBER': 0L, 'PS_LEDGER': None, 'BALANCE_SELECTION': u'FUNCTIONAL', 'BALANCE_AMOUNT_IS': u'PERIODIC', 'RULE_ID': 1L, 'BALANCE_AMOUNT_BS': u'YTD', 'CURRENCY_CODE': None, 'SOURCE_ADAPTER_FLAG': u'N', 'BALANCE_METHOD_CODE': u'STANDARD', 'SIGNAGE_METHOD': u'SAME', 'WEB_SERVICE_URL': u'http://localhost:9000/aif', 'DATA_LOAD_METHOD': u'CLASSIC_VIA_EPMI'}
2013-11-08 11:49:14,197 DEBUG [AIF]: CommData.getRuleInfo - END
2013-11-08 11:49:14,224 DEBUG [AIF]: CommData.insertPeriods - START
2013-11-08 11:49:14,228 DEBUG [AIF]: CommData.getLedgerListAndMap - START
2013-11-08 11:49:14,229 DEBUG [AIF]: CommData.getLedgerSQL - START
2013-11-08 11:49:14,229 DEBUG [AIF]: CommData.getLedgerSQL - END
2013-11-08 11:49:14,229 DEBUG [AIF]:
          SELECT l.SOURCE_LEDGER_ID
          ,l.SOURCE_LEDGER_NAME
          ,l.SOURCE_COA_ID
          ,l.CALENDAR_ID
          ,'0' SETID
          ,l.PERIOD_TYPE
          ,NULL LEDGER_TABLE_NAME
          FROM AIF_BALANCE_RULES br
          ,AIF_COA_LEDGERS l
          WHERE br.RULE_ID = 1
          AND l.SOURCE_SYSTEM_ID = br.SOURCE_SYSTEM_ID
          AND l.SOURCE_LEDGER_ID = br.SOURCE_LEDGER_ID
2013-11-08 11:49:14,230 DEBUG [AIF]: CommData.getLedgerListAndMap - END
2013-11-08 11:49:14,232 DEBUG [AIF]:
        INSERT INTO AIF_PROCESS_PERIODS (
          PROCESS_ID
          ,PERIODKEY
          ,PERIOD_ID
          ,ADJUSTMENT_PERIOD_FLAG
          ,GL_PERIOD_YEAR
          ,GL_PERIOD_NUM
          ,GL_PERIOD_NAME
          ,GL_PERIOD_CODE
          ,GL_EFFECTIVE_PERIOD_NUM
          ,YEARTARGET
          ,PERIODTARGET
          ,IMP_ENTITY_TYPE
          ,IMP_ENTITY_ID
          ,IMP_ENTITY_NAME
          ,TRANS_ENTITY_TYPE
          ,TRANS_ENTITY_ID
          ,TRANS_ENTITY_NAME
          ,PRIOR_PERIOD_FLAG
          ,SOURCE_LEDGER_ID
                SELECT DISTINCT brl.LOADID PROCESS_ID
                ,pp.PERIODKEY PERIODKEY
                ,prd.PERIOD_ID
                ,COALESCE(prd.ADJUSTMENT_PERIOD_FLAG, 'N') ADJUSTMENT_PERIOD_FLAG
                ,COALESCE(prd.YEAR, ppsrc.GL_PERIOD_YEAR,0) GL_PERIOD_YEAR
                ,COALESCE(prd.PERIOD_NUM, ppsrc.GL_PERIOD_NUM,0) GL_PERIOD_NUM
                ,COALESCE(prd.PERIOD_NAME, ppsrc.GL_PERIOD_NAME,'0') GL_PERIOD_NAME
                ,COALESCE(prd.PERIOD_CODE, CAST(COALESCE(prd.PERIOD_NUM, ppsrc.GL_PERIOD_NUM,0) AS VARCHAR(38)),'0') GL_PERIOD_CODE
                ,(COALESCE(prd.YEAR, ppsrc.GL_PERIOD_YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM, ppsrc.GL_PERIOD_NUM,0)) GL_EFFECTIVE_PERIOD_NUM
                ,COALESCE(ppa.YEARTARGET, pp.YEARTARGET) YEARTARGET
                ,COALESCE(ppa.PERIODTARGET, pp.PERIODTARGET) PERIODTARGET
                ,'PROCESS_BAL_IMP' IMP_ENTITY_TYPE
                ,(COALESCE(prd.YEAR, ppsrc.GL_PERIOD_YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM, ppsrc.GL_PERIOD_NUM,0)) IMP_ENTITY_ID
                ,COALESCE(prd.PERIOD_NAME, ppsrc.GL_PERIOD_NAME,'0') IMP_ENTITY_NAME
                ,'PROCESS_BAL_TRANS' TRANS_ENTITY_TYPE
                ,(COALESCE(prd.YEAR, ppsrc.GL_PERIOD_YEAR,0) * 10000 + COALESCE(prd.PERIOD_NUM, ppsrc.GL_PERIOD_NUM,0)) TRANS_ENTITY_ID
                ,pp.PERIODDESC TRANS_ENTITY_NAME
                ,'N' PRIOR_PERIOD_FLAG
                ,2202 SOURCE_LEDGER_ID
                FROM (
                  AIF_BAL_RULE_LOADS brl
                  INNER JOIN TPOVCATEGORY pc
                    ON pc.CATKEY = brl.CATKEY
                  INNER JOIN TPOVPERIOD_FLAT_V pp
                    ON pp.PERIODFREQ = pc.CATFREQ
                    AND pp.PERIODKEY >= brl.START_PERIODKEY
                    AND pp.PERIODKEY <= brl.END_PERIODKEY
                  LEFT OUTER JOIN TPOVPERIODADAPTOR_FLAT_V ppa
                    ON ppa.PERIODKEY = pp.PERIODKEY
                    AND ppa.PERIODFREQ = pp.PERIODFREQ
                    AND ppa.INTSYSTEMKEY = 'OASIS'
                INNER JOIN TPOVPERIODSOURCE ppsrc
                  ON ppsrc.PERIODKEY = pp.PERIODKEY
                  AND ppsrc.MAPPING_TYPE = 'EXPLICIT'
                  AND ppsrc.SOURCE_SYSTEM_ID = 2
                  AND ppsrc.CALENDAR_ID IN ('29067')
                LEFT OUTER JOIN AIF_GL_PERIODS_STG prd
                  ON prd.PERIOD_ID = ppsrc.PERIOD_ID
                  AND prd.SOURCE_SYSTEM_ID = ppsrc.SOURCE_SYSTEM_ID
                  AND prd.CALENDAR_ID = ppsrc.CALENDAR_ID
          AND prd.SETID = '0'
          AND prd.PERIOD_TYPE = '507'
                  AND prd.ADJUSTMENT_PERIOD_FLAG = 'N'
                WHERE brl.LOADID = 22
                ORDER BY pp.PERIODKEY
                ,GL_EFFECTIVE_PERIOD_NUM
2013-11-08 11:49:14,235 DEBUG [AIF]: CommData.insertPeriods - END
2013-11-08 11:49:14,240 DEBUG [AIF]: CommData.moveData - START
2013-11-08 11:49:14,242 DEBUG [AIF]: CommData.getPovList - START
2013-11-08 11:49:14,242 DEBUG [AIF]:
        SELECT PARTITIONKEY
        ,PARTNAME
        ,CATKEY
        ,CATNAME
        ,PERIODKEY
        ,COALESCE(PERIODDESC, TO_CHAR(PERIODKEY,'YYYY-MM-DD HH24:MI:SS')) PERIODDESC
        ,RULE_ID
        ,RULE_NAME
        FROM (
          SELECT DISTINCT brl.PARTITIONKEY
          ,part.PARTNAME
          ,brl.CATKEY
          ,cat.CATNAME
          ,pprd.PERIODKEY
          ,pp.PERIODDESC
          ,brl.RULE_ID
          ,br.RULE_NAME
          FROM AIF_BAL_RULE_LOADS brl
          INNER JOIN AIF_BALANCE_RULES br
            ON br.RULE_ID = brl.RULE_ID
          INNER JOIN TPOVPARTITION part
            ON part.PARTITIONKEY = brl.PARTITIONKEY
          INNER JOIN TPOVCATEGORY cat
            ON cat.CATKEY = brl.CATKEY
          INNER JOIN AIF_PROCESS_PERIODS pprd
            ON pprd.PROCESS_ID = brl.LOADID
          LEFT OUTER JOIN TPOVPERIOD pp
            ON pp.PERIODKEY = pprd.PERIODKEY
          WHERE brl.LOADID = 22
        ) q
        ORDER BY PARTITIONKEY
        ,CATKEY
        ,PERIODKEY
        ,RULE_ID
2013-11-08 11:49:14,244 DEBUG [AIF]: CommData.getPovList - END
2013-11-08 11:49:14,245 INFO [AIF]:
Move Data for Period 'JAN'
2013-11-08 11:49:14,246 DEBUG [AIF]:
          UPDATE TDATASEG
          SET LOADID = 22
          WHERE PARTITIONKEY = 1
          AND CATKEY = 1
          AND RULE_ID = 1
          AND LOADID < 22
            AND PERIODKEY = '2012-01-01'
2013-11-08 11:49:14,320 DEBUG [AIF]: Number of Rows updated on TDATASEG: 1842
2013-11-08 11:49:14,320 DEBUG [AIF]:
        INSERT INTO AIF_APPL_LOAD_AUDIT (
          LOADID
          ,TARGET_APPLICATION_TYPE
          ,TARGET_APPLICATION_NAME
          ,PLAN_TYPE
          ,SOURCE_LEDGER_ID
          ,EPM_YEAR
          ,EPM_PERIOD
          ,SNAPSHOT_FLAG
          ,SEGMENT_FILTER_FLAG
          ,PARTITIONKEY
          ,CATKEY
          ,RULE_ID
          ,PERIODKEY
          ,EXPORT_TO_TARGET_FLAG
        SELECT DISTINCT 22
        ,TARGET_APPLICATION_TYPE
        ,TARGET_APPLICATION_NAME
        ,PLAN_TYPE
        ,SOURCE_LEDGER_ID
        ,EPM_YEAR
        ,EPM_PERIOD
        ,SNAPSHOT_FLAG
        ,SEGMENT_FILTER_FLAG
        ,PARTITIONKEY
        ,CATKEY
        ,RULE_ID
        ,PERIODKEY
        ,'N'
        FROM AIF_APPL_LOAD_AUDIT
        WHERE PARTITIONKEY = 1
        AND CATKEY = 1
        AND RULE_ID = 1
        AND LOADID < 22
            AND PERIODKEY = '2012-01-01'
2013-11-08 11:49:14,321 DEBUG [AIF]: Number of Rows inserted into AIF_APPL_LOAD_AUDIT: 1
2013-11-08 11:49:14,322 DEBUG [AIF]:
        INSERT INTO AIF_APPL_LOAD_PRD_AUDIT (
          LOADID
          ,GL_PERIOD_ID
          ,GL_PERIOD_YEAR
          ,DELTA_RUN_ID
          ,PARTITIONKEY
          ,CATKEY
          ,RULE_ID
          ,PERIODKEY
        SELECT DISTINCT 22
        ,GL_PERIOD_ID
        ,GL_PERIOD_YEAR
        ,DELTA_RUN_ID
        ,PARTITIONKEY
        ,CATKEY
        ,RULE_ID
        ,PERIODKEY
        FROM AIF_APPL_LOAD_PRD_AUDIT
        WHERE PARTITIONKEY = 1
        AND CATKEY = 1
        AND RULE_ID = 1
        AND LOADID < 22
            AND PERIODKEY = '2012-01-01'
2013-11-08 11:49:14,323 DEBUG [AIF]: Number of Rows inserted into AIF_APPL_LOAD_PRD_AUDIT: 1
2013-11-08 11:49:14,325 DEBUG [AIF]: CommData.moveData - END
2013-11-08 11:49:14,332 DEBUG [AIF]: CommData.updateWorkflow - START
2013-11-08 11:49:14,332 DEBUG [AIF]:
    SELECT tlp.PROCESSSTATUS
    ,tlps.PROCESSSTATUSDESC
    ,CASE WHEN (tlp.INTLOCKSTATE = 60) THEN 'Y' ELSE 'N' END LOCK_FLAG
    FROM TLOGPROCESS tlp
    ,TLOGPROCESSSTATES tlps
    WHERE tlp.PARTITIONKEY = 1
    AND tlp.CATKEY = 1
    AND tlp.PERIODKEY = '2012-01-01'
    AND tlp.RULE_ID = 1
    AND tlps.PROCESSSTATUSKEY = tlp.PROCESSSTATUS
2013-11-08 11:49:14,336 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME = CURRENT_TIMESTAMP
        ,PROCESSSTATUS = 20
          ,PROCESSEXP = 0
          ,PROCESSENTLOAD = 0
          ,PROCESSENTVAL = 0
          ,PROCESSEXPNOTE = NULL
          ,PROCESSENTLOADNOTE = NULL
          ,PROCESSENTVALNOTE = NULL
        WHERE PARTITIONKEY = 1
        AND CATKEY = 1
        AND PERIODKEY = '2012-01-01'
        AND RULE_ID = 1
2013-11-08 11:49:14,338 DEBUG [AIF]: CommData.updateWorkflow - END
2013-11-08 11:49:14,339 DEBUG [AIF]: CommData.purgeInvalidRecordsTDATASEG - START
2013-11-08 11:49:14,341 DEBUG [AIF]:
        DELETE FROM TDATASEG
        WHERE LOADID = 22
          AND (
        PARTITIONKEY = 1
        AND CATKEY = 1
        AND PERIODKEY = '2012-01-01'
        AND RULE_ID = 1
        AND VALID_FLAG = 'N'
2013-11-08 11:49:14,342 DEBUG [AIF]: Number of Rows deleted from TDATASEG: 0
2013-11-08 11:49:14,342 DEBUG [AIF]: CommData.purgeInvalidRecordsTDATASEG - END
2013-11-08 11:49:14,344 DEBUG [AIF]: CommData.updateAppLoadAudit - START
2013-11-08 11:49:14,344 DEBUG [AIF]:
        UPDATE AIF_APPL_LOAD_AUDIT
        SET EXPORT_TO_TARGET_FLAG = 'Y'
        WHERE LOADID = 22
        AND PARTITIONKEY = 1
        AND CATKEY = 1
        AND PERIODKEY= '2012-01-01'
        AND RULE_ID = 1
2013-11-08 11:49:14,345 DEBUG [AIF]: Number of Rows updated on AIF_APPL_LOAD_AUDIT: 1
2013-11-08 11:49:14,345 DEBUG [AIF]: CommData.updateAppLoadAudit - END
2013-11-08 11:49:14,345 DEBUG [AIF]: CommData.updateWorkflow - START
2013-11-08 11:49:14,346 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME = CURRENT_TIMESTAMP
        ,PROCESSSTATUS = 21
          ,PROCESSEXP = 1
          ,PROCESSEXPNOTE = 'Export Successful'
        WHERE PARTITIONKEY = 1
        AND CATKEY = 1
        AND PERIODKEY = '2012-01-01'
        AND RULE_ID = 1
2013-11-08 11:49:14,347 DEBUG [AIF]: CommData.updateWorkflow - END
2013-11-08 11:49:14,347 DEBUG [AIF]: CommData.exportData - END
2013-11-08 11:49:14,404 DEBUG [AIF]: HfmData.loadData - START
2013-11-08 11:49:14,404 DEBUG [AIF]: CommData.getRuleInfo - START
2013-11-08 11:49:14,404 DEBUG [AIF]:
        SELECT brl.RULE_ID
        ,br.RULE_NAME
        ,brl.PARTITIONKEY
        ,brl.CATKEY
        ,part.PARTVALGROUP
        ,br.SOURCE_SYSTEM_ID
        ,ss.SOURCE_SYSTEM_TYPE
        ,CASE
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'EBS%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'PS%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'FUSION%' THEN 'N'
          WHEN ss.SOURCE_SYSTEM_TYPE LIKE 'FILE%' THEN 'N'
          ELSE 'Y'
        END SOURCE_ADAPTER_FLAG
        ,app.APPLICATION_ID
        ,app.TARGET_APPLICATION_NAME
        ,app.TARGET_APPLICATION_TYPE
        ,app.DATA_LOAD_METHOD
        ,brl.PLAN_TYPE
        ,CASE brl.PLAN_TYPE
          WHEN 'PLAN1' THEN 1
          WHEN 'PLAN2' THEN 2
          WHEN 'PLAN3' THEN 3
          WHEN 'PLAN4' THEN 4
          WHEN 'PLAN5' THEN 5
          ELSE 0
        END PLAN_NUMBER
        ,br.INCL_ZERO_BALANCE_FLAG
        ,br.PERIOD_MAPPING_TYPE
        ,br.INCLUDE_ADJ_PERIODS_FLAG
        ,br.BALANCE_TYPE ACTUAL_FLAG
        ,br.AMOUNT_TYPE
        ,br.BALANCE_SELECTION
        ,br.BALANCE_METHOD_CODE
        ,COALESCE(br.SIGNAGE_METHOD, 'ABSOLUTE') SIGNAGE_METHOD
        ,br.CURRENCY_CODE
        ,br.BAL_SEG_VALUE_OPTION_CODE
        ,brl.EXECUTION_MODE
        ,COALESCE(brl.IMPORT_FROM_SOURCE_FLAG, 'Y') IMPORT_FROM_SOURCE_FLAG
        ,COALESCE(brl.RECALCULATE_FLAG, 'N') RECALCULATE_FLAG
        ,COALESCE(brl.EXPORT_TO_TARGET_FLAG, 'N') EXPORT_TO_TARGET_FLAG
        ,CASE
          WHEN (br.LEDGER_GROUP_ID IS NOT NULL) THEN 'MULTI'
          WHEN (br.SOURCE_LEDGER_ID IS NOT NULL) THEN 'SINGLE'
          ELSE 'NONE'
        END LEDGER_GROUP_CODE
        ,COALESCE(br.BALANCE_AMOUNT_BS, 'YTD') BALANCE_AMOUNT_BS
        ,COALESCE(br.BALANCE_AMOUNT_IS, 'PERIODIC') BALANCE_AMOUNT_IS
        ,br.LEDGER_GROUP
        ,(SELECT brd.DETAIL_CODE
          FROM AIF_BAL_RULE_DETAILS brd
          WHERE brd.RULE_ID = br.RULE_ID
          AND brd.DETAIL_TYPE = 'LEDGER'
        ) PS_LEDGER
        ,CASE lg.LEDGER_TEMPLATE
          WHEN 'COMMITMENT' THEN 'Y'
          ELSE 'N'
        END KK_FLAG
        ,p.LAST_UPDATED_BY
        ,p.AIF_WEB_SERVICE_URL WEB_SERVICE_URL
        ,p.EPM_ORACLE_INSTANCE
        FROM AIF_PROCESSES p
        INNER JOIN AIF_BAL_RULE_LOADS brl
          ON brl.LOADID = p.PROCESS_ID
        INNER JOIN AIF_BALANCE_RULES br
          ON br.RULE_ID = brl.RULE_ID
        INNER JOIN AIF_SOURCE_SYSTEMS ss
          ON ss.SOURCE_SYSTEM_ID = br.SOURCE_SYSTEM_ID
        INNER JOIN AIF_TARGET_APPLICATIONS app
          ON app.APPLICATION_ID = brl.APPLICATION_ID
        INNER JOIN TPOVPARTITION part
          ON part.PARTITIONKEY = br.PARTITIONKEY
        INNER JOIN TBHVIMPGROUP imp
          ON imp.IMPGROUPKEY = part.PARTIMPGROUP
        LEFT OUTER JOIN AIF_COA_LEDGERS l
          ON l.SOURCE_SYSTEM_ID = p.SOURCE_SYSTEM_ID
          AND l.SOURCE_LEDGER_ID = COALESCE(br.SOURCE_LEDGER_ID,imp.IMPSOURCELEDGERID)
        LEFT OUTER JOIN AIF_PS_SET_CNTRL_REC_STG scr
          ON scr.SOURCE_SYSTEM_ID = l.SOURCE_SYSTEM_ID
          AND scr.SETCNTRLVALUE = l.SOURCE_LEDGER_NAME
          AND scr.RECNAME = 'LED_GRP_TBL'
        LEFT OUTER JOIN AIF_PS_LED_GRP_TBL_STG lg
          ON lg.SOURCE_SYSTEM_ID = scr.SOURCE_SYSTEM_ID
          AND lg.SETID = scr.SETID
          AND lg.LEDGER_GROUP = br.LEDGER_GROUP
        WHERE p.PROCESS_ID = 22
2013-11-08 11:49:14,406 DEBUG [AIF]:
      SELECT adim.BALANCE_COLUMN_NAME DIMNAME
      ,adim.DIMENSION_ID
      ,dim.TARGET_DIMENSION_CLASS_NAME
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID1
      ) COA_SEGMENT_NAME1
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID2
      ) COA_SEGMENT_NAME2
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID3
      ) COA_SEGMENT_NAME3
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID4
      ) COA_SEGMENT_NAME4
      ,(SELECT COA_SEGMENT_NAME
        FROM AIF_COA_SEGMENTS cs
        WHERE cs.COA_LINE_ID = tiie.IMPSOURCECOALINEID5
      ) COA_SEGMENT_NAME5
      ,(SELECT CASE mdd.ORPHAN_OPTION_CODE
          WHEN 'CHILD' THEN 'N'
          WHEN 'ROOT' THEN 'N'
          ELSE 'Y'
        END DIMENSION_FILTER_FLAG
        FROM AIF_MAP_DIM_DETAILS_V mdd
        ,AIF_MAPPING_RULES mr
        WHERE mr.PARTITIONKEY = tpp.PARTITIONKEY
        AND mdd.RULE_ID = mr.RULE_ID
        AND mdd.DIMENSION_ID = adim.DIMENSION_ID
      ) DIMENSION_FILTER_FLAG
      ,tiie.IMPCONCATCHAR
      FROM TPOVPARTITION tpp
      INNER JOIN AIF_TARGET_APPL_DIMENSIONS adim
        ON adim.APPLICATION_ID = 2
      INNER JOIN AIF_DIMENSIONS dim
        ON dim.DIMENSION_ID = adim.DIMENSION_ID
      LEFT OUTER JOIN TBHVIMPITEMERPI tiie
        ON tiie.IMPGROUPKEY = tpp.PARTIMPGROUP
        AND tiie.IMPFLDFIELDNAME = adim.BALANCE_COLUMN_NAME
        AND tiie.IMPMAPTYPE = 'ERP'
      WHERE tpp.PARTITIONKEY = 1
      AND adim.BALANCE_COLUMN_NAME IS NOT NULL
      ORDER BY adim.BALANCE_COLUMN_NAME
2013-11-08 11:49:14,407 DEBUG [AIF]: {'APPLICATION_ID': 2L, 'IMPORT_FROM_SOURCE_FLAG': u'N', 'PLAN_TYPE': None, 'RULE_NAME': u'VISIONRULE', 'ACTUAL_FLAG': u'A', 'IS_INCREMENTAL_LOAD': False, 'EPM_ORACLE_INSTANCE': u'C:\\Oracle\\Middleware\\user_projects\\epmsystem1', 'CATKEY': 1L, 'BAL_SEG_VALUE_OPTION_CODE': u'ALL', 'INCLUDE_ADJ_PERIODS_FLAG': u'N', 'PERIOD_MAPPING_TYPE': u'EXPLICIT', 'SOURCE_SYSTEM_TYPE': u'EBS_R12', 'LEDGER_GROUP': None, 'TARGET_APPLICATION_NAME': u'OASIS', 'RECALCULATE_FLAG': u'N', 'SOURCE_SYSTEM_ID': 2L, 'TEMP_DATA_TABLE_NAME': 'TDATASEG_T', 'KK_FLAG': u'N', 'AMOUNT_TYPE': u'MONETARY', 'EXPORT_TO_TARGET_FLAG': u'Y', 'DATA_TABLE_NAME': 'TDATASEG', 'DIMNAME_LIST': [u'ACCOUNT', u'ENTITY', u'ICP', u'UD1', u'UD2', u'UD3', u'UD4'], 'TDATAMAPTYPE': 'ERP', 'LAST_UPDATED_BY': u'admin', 'DIMNAME_MAP': {u'UD3': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT5', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD3', 'DIMENSION_ID': 9L}, u'ICP': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'ICP', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT7', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ICP', 'DIMENSION_ID': 8L}, u'ENTITY': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Entity', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT1', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ENTITY', 'DIMENSION_ID': 12L}, u'UD2': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT4', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD2', 'DIMENSION_ID': 11L}, u'UD4': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT6', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD4', 'DIMENSION_ID': 1L}, u'ACCOUNT': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Account', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT3', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'ACCOUNT', 'DIMENSION_ID': 10L}, u'UD1': {'IMPCONCATCHAR': None, 'TARGET_DIMENSION_CLASS_NAME': u'Generic', 'COA_SEGMENT_NAME5': None, 'COA_SEGMENT_NAME1': u'SEGMENT2', 'COA_SEGMENT_NAME2': None, 'COA_SEGMENT_NAME3': None, 'DIMENSION_FILTER_FLAG': None, 'COA_SEGMENT_NAME4': None, 'DIMNAME': u'UD1', 'DIMENSION_ID': 7L}}, 'TARGET_APPLICATION_TYPE': u'HFM', 'PARTITIONKEY': 1L, 'PARTVALGROUP': u'[NONE]', 'LEDGER_GROUP_CODE': u'SINGLE', 'INCLUDE_ZERO_BALANCE_FLAG': u'N', 'EXECUTION_MODE': u'SNAPSHOT', 'PLAN_NUMBER': 0L, 'PS_LEDGER': None, 'BALANCE_SELECTION': u'FUNCTIONAL', 'BALANCE_AMOUNT_IS': u'PERIODIC', 'RULE_ID': 1L, 'BALANCE_AMOUNT_BS': u'YTD', 'CURRENCY_CODE': None, 'SOURCE_ADAPTER_FLAG': u'N', 'BALANCE_METHOD_CODE': u'STANDARD', 'SIGNAGE_METHOD': u'SAME', 'WEB_SERVICE_URL': u'http://localhost:9000/aif', 'DATA_LOAD_METHOD': u'CLASSIC_VIA_EPMI'}
2013-11-08 11:49:14,407 DEBUG [AIF]: CommData.getRuleInfo - END
2013-11-08 11:49:14,407 DEBUG [AIF]: CommData.getPovList - START
2013-11-08 11:49:14,407 DEBUG [AIF]:
        SELECT PARTITIONKEY
        ,PARTNAME
        ,CATKEY
        ,CATNAME
        ,PERIODKEY
        ,COALESCE(PERIODDESC, TO_CHAR(PERIODKEY,'YYYY-MM-DD HH24:MI:SS')) PERIODDESC
        ,RULE_ID
        ,RULE_NAME
        FROM (
          SELECT DISTINCT brl.PARTITIONKEY
          ,part.PARTNAME
          ,brl.CATKEY
          ,cat.CATNAME
          ,pprd.PERIODKEY
          ,pp.PERIODDESC
          ,brl.RULE_ID
          ,br.RULE_NAME
          FROM AIF_BAL_RULE_LOADS brl
          INNER JOIN AIF_BALANCE_RULES br
            ON br.RULE_ID = brl.RULE_ID
          INNER JOIN TPOVPARTITION part
            ON part.PARTITIONKEY = brl.PARTITIONKEY
          INNER JOIN TPOVCATEGORY cat
            ON cat.CATKEY = brl.CATKEY
          INNER JOIN AIF_PROCESS_PERIODS pprd
            ON pprd.PROCESS_ID = brl.LOADID
          LEFT OUTER JOIN TPOVPERIOD pp
            ON pp.PERIODKEY = pprd.PERIODKEY
          WHERE brl.LOADID = 22
        ) q
        ORDER BY PARTITIONKEY
        ,CATKEY
        ,PERIODKEY
        ,RULE_ID
2013-11-08 11:49:14,409 DEBUG [AIF]: CommData.getPovList - END
2013-11-08 11:49:14,409 DEBUG [AIF]: CommData.updateWorkflow - START
2013-11-08 11:49:14,409 DEBUG [AIF]:
    SELECT tlp.PROCESSSTATUS
    ,tlps.PROCESSSTATUSDESC
    ,CASE WHEN (tlp.INTLOCKSTATE = 60) THEN 'Y' ELSE 'N' END LOCK_FLAG
    FROM TLOGPROCESS tlp
    ,TLOGPROCESSSTATES tlps
    WHERE tlp.PARTITIONKEY = 1
    AND tlp.CATKEY = 1
    AND tlp.PERIODKEY = '2012-01-01'
    AND tlp.RULE_ID = 1
    AND tlps.PROCESSSTATUSKEY = tlp.PROCESSSTATUS
2013-11-08 11:49:14,410 DEBUG [AIF]:
        UPDATE TLOGPROCESS
        SET PROCESSENDTIME = CURRENT_TIMESTAMP
        ,PROCESSSTATUS = 30
          ,PROCESSENTLOAD = 0
          ,PROCESSENTVAL = 0
          ,PROCESSENTLOADNOTE = NULL
          ,PROCESSENTVALNOTE = NULL
        WHERE PARTITIONKEY = 1
        AND CATKEY = 1
        AND PERIODKEY = '2012-01-01'
        AND RULE_ID = 1
2013-11-08 11:49:14,411 DEBUG [AIF]: CommData.updateWorkflow - END
2013-11-08 11:49:14,412 DEBUG [AIF]:
    SELECT COALESCE(usr.PROFILE_OPTION_VALUE, app.PROFILE_OPTION_VALUE, site.PROFILE_OPTION_VALUE) PROFILE_OPTION_VALUE
    FROM AIF_PROFILE_OPTIONS po
    LEFT OUTER JOIN AIF_PROFILE_OPTION_VALUES site
      ON site.PROFILE_OPTION_NAME = po.PROFILE_OPTION_NAME
      AND site.LEVEL_ID = 1000
      AND site.LEVEL_VALUE = 0
      AND site.LEVEL_ID <= po.MAX_LEVEL_ID
    LEFT OUTER JOIN AIF_PROFILE_OPTION_VALUES app
      ON app.PROFILE_OPTION_NAME = site.PROFILE_OPTION_NAME
      AND app.LEVEL_ID = 1005
      AND app.LEVEL_VALUE = NULL
      AND app.LEVEL_ID <= po.MAX_LEVEL_ID
    LEFT OUTER JOIN AIF_PROFILE_OPTION_VALUES usr
      ON usr.PROFILE_OPTION_NAME = usr.PROFILE_OPTION_NAME
      AND usr.LEVEL_ID = 1010
      AND usr.LEVEL_VALUE = NULL
      AND usr.LEVEL_ID <= po.MAX_LEVEL_ID
    WHERE po.PROFILE_OPTION_NAME = 'JAVA_HOME'
2013-11-08 11:49:14,413 DEBUG [AIF]: HFM Load command:
%EPM_ORACLE_HOME%/products/FinancialDataQuality/bin/HFM_LOAD.vbs "22" "a9E3uvSJNhkFhEQTmuUFFUElfdQgKJKHrb1EsjRsL6yZJlXsOFcVPbGWHhpOQzl9zvHoo3s%2Bdq6R4yJhp0GMNWIKMTcizp3%2F8HASkA7rVufXDWEpAKAK%2BvcFmj4zLTI3rtrKHlVEYrOLMY453J2lXk6Cy771mNSD8X114CqaWSdUKGbKTRGNpgE3BfRGlEd1wZ3cra4ee0jUbT2aTaiqSN26oVe6dyxM3zolc%2BOPkjiDNk1MqwNr43tT3JsZz4qEQGF9d39DRN3CDjUuZRPt4SEKSSL35upncRJiw2uBOtV%2FvSuGLNpZ2J79v1%2Ba1Oo9c4Xhig7SFYbE6Jwk1yXRJLTSw0DKFu%2FEpcdjpOnx%2F6YawMBNIa5iu5L637S91jT1Xd3EGmxZFq%2Bi6bHdCJAC8g%3D%3D" "C%3A%5COracle%5CMiddleware%5Cuser_projects%5Cepmsystem1" "%25EPM_ORACLE_HOME%25%2F..%2Fjdk160_35"
Is there anywhere we need to set EPM Home and also let me know what is PSU1 ?
Thanks in advance.
Praneeth

How to store data file name in one of the columns of staging table

My requirement is to load data from .dat file to oracle staging table. I have done following steps:
1. Created control file and stored in bin directory.
2. Created data file and stored in bin directory.
3. Registered a concurrent program with execution method as SQL*Loader.
4. Added the concurrent program to request group.
I am passing the file name as a parameter to concurrent program. When I am running the program, the data is getting loaded to the staging table correctly.
Now I want to store the filename (which is passed as a parameter) in one of the columns of staging table. I tried different ways found through Google, but none of them worked. I am using the below control file:
OPTIONS (SKIP = 1)
LOAD DATA
INFILE '&1'
APPEND INTO TABLE XXCISCO_SO_INTF_STG_TB
FIELDS TERMINATED BY ","
OPTIONALLY ENCLOSED BY '"'
TRAILING NULLCOLS
COUNTRY_NAME
,COUNTRY_CODE
,ORDER_CATEGORY
,ORDER_NUMBER
,RECORD_ID "XXCISCO_SO_INTF_STG_TB_S.NEXTVAL"
,FILE_NAME CONSTANT "&1"
,REQUEST_ID "fnd_global.conc_request_id"
,LAST_UPDATED_BY "FND_GLOBAL.USER_ID"
,LAST_UPDATE_DATE SYSDATE
,CREATED_BY "FND_GLOBAL.USER_ID"
,CREATION_DATE SYSDATE
,INTERFACE_STATUS CONSTANT "N"
,RECORD_STATUS CONSTANT "N"
I want to store file name in the column FILE_NAME stated above. I tried with and without constant using "$1", "&1", ":$1", ":&1", &1, $1..... but none of them worked. Please suggest me the solution for this.
Thanks,
Abhay

Pl post details of OS, database and EBS versions. There is no easy way to achieve this.
Pl see previous threads on this topic
SQL*Loader to insert data file name during load
Sql Loader with new column
HTH
Srini

Synchronizing Updates on a Staging Table

Please help me out with the resolving the following issue:
A load script is running for moving records from a data file to a staging table.
After this script completes, there is a code to update two fields of the staging table.
To do this the shell script runs a script (generate_ranges.sql). It takes a parameter of 5000000. It creates ranges based on this passed in number upto the total number of rows in the staging table. So say the staging table has 65,000,000 rows.
This script will create a file that looks like the following (when 5000000 is passed in):
1 | 5000000
5000001 | 10000000
10000001 | 15000000
15000001 | 20000000
20000001 | 25000000
25000001 | 30000000
30000001 | 35000000
35000001 | 40000000
40000001 | 45000000
45000001 | 50000000
50000001 | 55000000
55000001 | 60000000
60000001 | 65000000
The script goes on to read the data file for each row and it calls a shell script and passes in each range. So in this case there are 13 ranges. What is happening is there are 13 seperate updates on the staging table happening in the background.
The first update rows 1 - 5000000, the second rows 5000001 - 10000000 etc.
So there are 13 updates happenng behind the scenes.
The problem is that there is no way for the script to know that all updates are completed successfully before proceeding automatically. Right now I manually check to see that that all updates completed and then I restart the script at the next step. However we want to code to ensure that all the updates are done automatically and then move on in the script. So we need a way to count the number of candidate updates ( right now 13 but could be 14 or more in future) and know that all "x" updates completed, it may be the case that update (1-5000000) is taking 30 mins and the next update ( 5000001 - 10000000) is taking 35 mins, all updates iare running parallely, and only when after the 13 parallel updates are complete, the script can proceed with subsequent steps.
So please help me out with fixing this problem programmatically.
Thanks for your cooperation in advance.
Regards,
Ayan.

Ayan,
Are you really sure you want to update 65 million rows ?
Alternative: create table as select <columns with 2 columns updated> from staging table;
While using this approach, you probably don't need to split the update.
Regards,
Rob.

How to load the data from a staging table to interface table

Hi..
I have a staging table having these many columns
invoice_number,invoice_date,vendor_name,vendor_site_code,description,line-amount,line-description,segment1,segment2,segment3,segment4,segment5
I want to insert data into oracle interface tables
1st table is ap_invoices_interface which is primary
and 2nd is ap_invoice_lines_interfaces.
According to the invoice_id I have to insert the sum of amount in the amount column of primary table
can anyone plz give the codes .
any help appreciate

Hi,
you need to write pl/sql procedure or package for validiating the data and inserting.
first u need to know wat r the mandatory colums. and write the code igiving here a simple example
Create or replace procedure xxstg_po_vendors_int(errbuf out varchar2,retcode out number) IS
Cursor po_cur IS Select sno,VENDOR_NAME,SUMMARY_FLAG,ENABLED_FLAG From xxstg_po_vendor;
l_SUMMARY_FLAG Varchar(1);
l_ENABLED_FLAG varchar(1);
l_VENDOR_NAME varchar2(240);
l_err_msg varchar2(240);
l_flag varchar2(2);
l_err_flag varchar2(2);
Begin
Delete from Ap_suppliers_INT;
commit;
for rec_cur in po_cur loop
l_flag :='A';
l_err_flag:= 'A';
Begin
select summary_flag into l_SUMMARY_FLAG from po_vendors
where summary_flag = rec_cur.summary_flag;
Exception
when others then
l_summary_flag:= null;
l_flag:='E';
l_err_msg:= 'Summary_flag Does not Exist';
END;
FND_FILe.PUT_LINE(FND_FILE.LOG,'Inserting data into interface table'||l_flag);
Begin
Select enabled_flag into l_enabled_flag from po_vendors
where enabled_flag = rec_cur.enabled_flag;
exception
when others then
l_enabled_flag:=null;
l_flag :='E';
L_err_msg:='Enabled_flag Does not Exist';
End;
FND_FILE.PUT_LINE(FND_FILE.log,'Inserting data into interface table'||l_flag);
FND_FILE.PUT_LINE(FND_FILE.log,'Inserting data into interface table'||l_flag);
INSERT INTO AP_SUPPLIERS_INT
( VENDOR_INTERFACE_ID,VENDOR_NAME,SUMMARY_FLAG,ENABLED_FLAG )
values(rec_cur.sno,rec_cur.VENDOR_NAME,rec_cur.SUMMARY_FLAG,rec_cur.ENABLED_FLAG);
l_flag :=null;
l_err_msg:=null;
end loop;
commit;
end;
Regards
Goutham

How to move data from a staging table to three entity tables #2

Environment: SQL Server 2008 R2
I have a few questions:
How would I prevent duplicate records, when/ IF SSIS is executed many times?
How would I know that all huge volume of data being loaded in the entity tables?
In reference to "how to move data from a staging table to three entity tables ", since I am loading large volume of data, while using lookup transformation:
which of the merge components is best suited.
How to configure merge component correctly. (screen shot is preferred)
Please refer to the following link
http://social.msdn.microsoft.com/Forums/en-US/5f2128c8-3ddd-4455-9076-05fa1902a62a/how-to-move-data-from-a-staging-table-to-three-entity-tables?forum=sqlintegrationservices

You can use RowCount transformation in the path where you want to capture record details. Then inside rowcount transformation pass a integer variable to get count value inside
the event handler can be configured as below
Inside Execute SQL task add INSERT statement to add rowcount to your audit table
Can you also show me how to Check against destination table using key columns inside a lookup task and insert only non
matched records (No Match output)
This is explained clearly in below link which Arthur posted
http://www.sqlis.com/sqlis/post/Get-all-from-Table-A-that-isnt-in-Table-B.aspx
For large data I would prefer doing this in T-SQL. So what you could do is dump data to staging table and then apply
T-SQL MERGE between tables (or even a combination of INSERT/UPDATE statements)
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Injecting data into a star schema from a flat staging table

I'm trying to work out a best approach for getting data from a very flat staging table and then loading it into a star schema - I take a row from a table with for example 50 different attributes about a person and then load these into a host of different tables, including linking tables.
One of the attibutes in the staging table will be an instruction to either insert the person and their new data, or update a person and some component of their data or maybe even to terminate a persons records.
I plan to use PL/SQL but I'm not sure on the best approach.
The staging table data will be loaded every 10 minutes and will contain about 300 updates.
I'm not sure if I should just select the staging records into a cursor then insert into the various tables?
Has anyone got any working examples based on a similar experience?
I can provide a working example if required.

The database has some elements that make SQL a tad harder to use?
For example:
CREATE TABLE staging
(person_id NUMBER(10) NOT NULL ,
title VARCHAR2(15) NULL ,
initials VARCHAR2(5) NULL ,
forename VARCHAR2(30) NULL ,
middle_name VARCHAR2(30) NULL ,
surname VARCHAR2(50) NULL,
dial_number VARCHAR2(30) NULL,
Is_Contactable CHAR(1) NULL);
INSERT INTO staging
(person_id, title, initials, forename, middle_name, surname, dial_number)
VALUES ('12345', 'Mr', 'NULL', 'Joe', NULL, 'Bloggs', '0117512345','Y')
CREATE TABLE person
(person_id NUMBER(10) NOT NULL ,
title VARCHAR2(15) NULL ,
initials VARCHAR2(5) NULL ,
forename VARCHAR2(30) NULL ,
middle_name VARCHAR2(30) NULL ,
surname VARCHAR2(50) NULL);
CREATE UNIQUE INDEX XPKPerson ON Person
(Person_ID ASC);
ALTER TABLE Person
ADD CONSTRAINT XPKPerson PRIMARY KEY (Person_ID);
CREATE TABLE person_comm
(person_id NUMBER(10) NOT NULL ,
comm_type_id NUMBER(10) NOT NULL ,
comm_id NUMBER(10) NOT NULL );
CREATE UNIQUE INDEX XPKPerson_Comm ON Person_Comm
(Person_ID ASC,Comm_Type_ID ASC,Comm_ID ASC);
ALTER TABLE Person_Comm
ADD CONSTRAINT XPKPerson_Comm PRIMARY KEY (Person_ID,Comm_Type_ID,Comm_ID);
CREATE TABLE person_comm_preference
(person_id NUMBER(10) NOT NULL ,
comm_type_id NUMBER(10) NOT NULL
Is_Contactable CHAR(1) NULL);
CREATE UNIQUE INDEX XPKPerson_Comm_Preference ON Person_Comm_Preference
(Person_ID ASC,Comm_Type_ID ASC);
ALTER TABLE Person_Comm_Preference
ADD CONSTRAINT XPKPerson_Comm_Preference PRIMARY KEY (Person_ID,Comm_Type_ID);
CREATE TABLE comm_type
comm_type_id NUMBER(10) NOT NULL ,
NAME VARCHAR2(25) NULL ,
description VARCHAR2(100) NULL ,
comm_table_name VARCHAR2(50) NULL);
CREATE UNIQUE INDEX XPKComm_Type ON Comm_Type
(Comm_Type_ID ASC);
ALTER TABLE Comm_Type
ADD CONSTRAINT XPKComm_Type PRIMARY KEY (Comm_Type_ID);
insert into comm_type (comm_type_id, NAME, description, comm_table_name) values ('23456','HOME PHONE','Home Phone Number','PHONE');
CREATE TABLE phone
(phone_id NUMBER(10) NOT NULL ,
dial_number VARCHAR2(30) NULL);
Take the record from Staging then update:
'person'
'Person_Comm_Preference' Based on a comm_type of 'HOME_PHONE'
'person_comm' Derived from 'Person' and 'Person_Comm_Preference'
Then update 'Phone' with the number based on a link derived from 'Phone' which is made up of Person_Comm Primary_Key where 'Comm_ID' (part of that composite key)
relates to the Phone table Primary_Key which is Phone_ID.
Does you head hurt as much as mine?

Error while loading metadata in HPCM application using Import Staging table

Hello All,
I was loading metadata in HPCM using Import Staging table. I successfully uploaded Driver Definition metadata.
However while loading "Driver Exception" metadata, I am not able to load it successfully. I have checked the HPCM logs but found nothing. I then checked the "Import Exception" table and found the following error message.
ERROR_POPULATED_DIM_COLUMNS_DO_NOT_MATCH_STAGE_DEFINITIONCan anyone please help me with this.
Regards,
-SM

It is a bug and there is a patch available.
Oracle Support - "Bug 12905298 : INTERFACE FAILS TO INTEGRATE ON STEP "LOAD DATA INTO PLANNING"
Patch = 12905298: INTERFACE FAILS TO INTEGRATE ON STEP "LOAD DATA INTO PLANNING"
Cheers
John
http://john-goodwin.blogspot.com/

Sliding window sanario in PTF vs Availability of recently loaded data in the staging table for reporting purpose

Hello everybody, I am a SQL server DBA and I am planning to implement table partitioning on some of our large tables in our data warehouse. I
am thinking to design it using the sliding window scenario. I do have one concern though; I think the staging tables we use for new data loading and for switching out the old partition are going to be non-partitioned, right?? Well, I don't have an issue with
the second staging table that is used for switching out the old partition. My concern is on the first staging table that we use it for switch in purpose, since this table is non-partitioned and holding the new data, HOW ARE WE GOING TO USE/access THIS DATA
FOR REPORTING PURPOSE before we switch in to our target partitioned table????? say, this staging table is holding a one month worth of data and we will be switching it at the end of the month. Correct me if I am wrong okay, one way I can think of accessing
this non-portioned staging table is by creating views, which we don’t want to change our codes.
Do you guys share us your thoughts, experiences???
We really appreciate your help.

Hi BG516,
According to your description, you need to implement table partitioning on some of our large tables in our data warehouse, the problem is that you need the partition table only hold a month data, please correct me if I have anything misunderstanding.
In this case, you can create non-partitioned table, import the records which age is more than one month into the new created table. Leave the records which age is less than one month on the table in your data warehouse Then you need to create job to
copy the data from partition table into non-partitioned table at the last day of each month. In this case, the partition table only contain the data for current month. Please refer to the link below to see the details.
http://blog.sqlauthority.com/2007/08/15/sql-server-insert-data-from-one-table-to-another-table-insert-into-select-select-into-table/
https://msdn.microsoft.com/en-us/library/ms190268.aspx?f=255&MSPPError=-2147217396
If this is not what you want, please provide us more information, so that we can make further analysis.
Regards,
Charlie Liao
TechNet Community Support

Front End not reflecting previously deleted entry while entering into Staging table

Lets say I have table named 'Sales' as my Source. It contains columns Sal_ID and Sal_DESC
There is Front End Entity created as Master Sales in Model Project. According staging table in database is ' stg.Sales_Leaf '.
Now, I have entered data into stg.Sales_Leaf from Sales table for 'CODE' and 'NAME' value as Sal_ID and Sal_DESC, and my ImportType is '0'.
As Sales table contains 23 rows, these are imported to stg.Sales_Leaf with ImportType '0'.
I am able to see it in Front End also.
Problem starts now. I delete some rows from Front END directly which contains CODE value as 22 and 23.
These gets deleted from Front End View, but now again I load Same 23 rows to stg.Sales_Leaf with same data (after truncating it).
I should be able to see 23 records in Front End, but it is showing only 21 records.
Two records with CODE value as 22 and 23 are not reflecting in Fornt End.
I think it is because 'mdm.<table_code>' table associated with stg.Sales_Leaf, is reflecting Status_ID as 2.
Please provide the way, how can I get data reflected in Front End.

All error numbers between -20000 and -20999 are not Oracle errors but rather application errors coded by whoever wrote your software.
As previously suggested ... see your DBA or manager.

Reading Xml file from clob column in the staging table

Hi,
I am trying to poll the staging table with the database adapter which has CLOB column type containing XML file. How do I extract the XML file from CLOB and map the fields to the another variable with definite schema.
Thanks,
Edited by: chaitu123 on Sep 20, 2009 8:16 AM

1) when you create DBAdapter on a table which having the clob column watch closely the created xsd for the DBAdapter the clob cloumn element should be a String data type
2) create xsd for Xml File and create variable for the xsd element
3) use ora:parseEscapedXML("yourDBAdapterclobElement") to XmlFileVarilable
Krishna

Creation of staging table - quickest way.

Hi,
I need to create a staging table with roughly 370 fields. The sources' specs are not clear and some of the staging table's fields, too. So effectively, first of all I need to understand the staging fields and the source fields. The end user has been given some target date with some generic guess-work (not by me).
I would like to know the best approach to complete the activity quicker - at least, document all the staging fields and source fields. What I have now is one Excel file with four columns - Staging Field, Source table and field, Staging Field Type and Staging Field Length. Out of the total 370 staging fields, I have just completed 50% and the target date is approaching faster - I have not touched developing Oracle package yet.
This could be a generic question, but in order to meet deadline, could you please throw some light on the quickest way/tips to complete the mapping documentation (or creating the staging table)?
Thanks in advance,
Manoj.

MDixit wrote:
Hi,
I need to create a staging table with roughly 370 fields. The sources' specs are not clear and some of the staging table's fields, too. So effectively, first of all I need to understand the staging fields and the source fields. The end user has been given some target date with some generic guess-work (not by me).
I would like to know the best approach to complete the activity quicker - at least, document all the staging fields and source fields. What I have now is one Excel file with four columns - Staging Field, Source table and field, Staging Field Type and Staging Field Length. Out of the total 370 staging fields, I have just completed 50% and the target date is approaching faster - I have not touched developing Oracle package yet.
This could be a generic question, but in order to meet deadline, could you please throw some light on the quickest way/tips to complete the mapping documentation (or creating the staging table)?
Thanks in advance,
Manoj.The first thing that comes to mind is the unclear specifications. (actually the first thing that came to my mind was that tables have columns not fields, but anyway......)
you need to clarify what is coming from the source system before you will be able to intelligently map that to your target system. you may have to push back on your client and tell them that the deadline can't be met unless they provide more information about their source system.
how have they chosen those 370 columns? how did they know these needed to be part of whatever process you are completing? if they know that these need to be moved to a target system then they should be able to tell you why.

Help needed in Loading excel data to staging table from OAF Page

Hi All,
We have a requirement from the client on loading of a excel sheet data into staging table using OAF page.
We were able to load a CSV file into staging table via OAF. The approach we used is we created a item of style 'messageFileUpload', which would pick the CSV file from desktop and we wrote the logic on the controller to place the file into server and then sumit a concurrent program to load the data into the staging table.
But client wants data from the excel file to be loaded into staging table. Is there any way(approach) by which we can convert the excel file data into .CSV file using OAF?
Any help or pointers on this will be highly apperciated.
Thanks,
Chethana

Hi,
Read through this :
Need to upload a CSV/Excel to a table in OAF page
Thanks,
Gaurav

How can I INSERT INTO from Staging Table to Production Table

I’ve got a Bulk Load process which works fine, but I’m having major problems downstream.
Almost everything is Varchar(100), and this works fine.
Except for these fields:
INDEX SHARES, INDEX MARKET CAP, INDEX WEIGHT, DAILY PRICE RETURN, and DAILY TOTAL RETURN
These four fields must be some kind of numeric, because I need to perform sums on these guys.
Here’s my SQL:
CREATE
TABLE [dbo].[S&P_Global_BMI_(US_Dollar)]
[CHANGE]
VARCHAR(100),
[EFFECTIVE DATE]
VARCHAR(100),
[COMPANY]
VARCHAR(100),
[RIC]
VARCHAR(100),
Etc.
[INDEX SHARES]
NUMERIC(18, 12),
[INDEX MARKET CAP]
NUMERIC(18, 12),
[INDEX WEIGHT]
NUMERIC(18, 12),
[DAILY PRICE RETURN]
NUMERIC(18, 12),
[DAILY TOTAL RETURN]
NUMERIC(18, 12),
From the main staging table, I’m writing data to 4 production tables.
CREATE
TABLE [dbo].[S&P_Global_Ex-U.S._LargeMidCap_(US_Dollar)]
[CHANGE]
VARCHAR(100),
[EFFECTIVE DATE]
VARCHAR(100),
[COMPANY]
VARCHAR(100),
[RIC]
VARCHAR(100),
Etc.
[INDEX SHARES]
FLOAT(20),
[INDEX MARKET CAP]
FLOAT(20),
[INDEX WEIGHT] FLOAT(20),
[DAILY PRICE RETURN]
FLOAT(20),
[DAILY TOTAL RETURN]
FLOAT(20),,
INSERT
INTO [dbo].[S&P_Global_Ex-U.S._LargeMidCap_(US_Dollar)]
SELECT
[CHANGE],
Etc.
[DAILY TOTAL RETURN]
FROM
[dbo].[S&P_Global_BMI_(US_Dollar)]
WHERE
isnumeric([Effective Date])
= 1
AND
[CHANGE] is
null
AND
[COUNTRY] <>
'US'
AND ([SIZE] =
'L' OR [SIZE]
= 'M')
The Bulk Load is throwing errors like this (unless I make everything Varchar):
Bulk load data conversion error (truncation) for row 7, column 23 (INDEX SHARES).
Msg 4863, Level 16, State 1, Line 1
When I try to load data from the staging table to the production table, I get this.
Msg 8115, Level 16, State 8, Line 1
Arithmetic overflow error converting varchar to data type numeric.
The statement has been terminated.
There must be an easy way to overcome this, right.
Please advise!
Thanks!!
Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

Nothing is returned. Everything is VARCHAR(100). the problem is this.
If I use FLOAT(18) or REAL, I get exponential numbers, which is useless to me.
If I use DECIMAL(18,12) or NUMERIC(18,12), I get errors.
Msg 4863, Level 16, State 1, Line 41
Bulk load data conversion error (truncation) for row 7, column 23 (INDEX SHARES).
Msg 4863, Level 16, State 1, Line 41
Bulk load data conversion error (truncation) for row 8, column 23 (INDEX SHARES).
Msg 4863, Level 16, State 1, Line 41
Bulk load data conversion error (truncation) for row 9, column 23 (INDEX SHARES).
There must be some data type that fits this!
Here's a sample of what I'm dealing with.
-0.900900901
9.302325581
-2.648171501
-1.402805723
-2.911830584
-2.220960866
2.897762349
-0.219640074
-5.458448607
-0.076626094
6.710940231
0.287200186
0.131682908
0.124276221
0.790818723
0.420505119
Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

Read data from E$ table and insert into staging table

Hi all,
I am a new to ODI. I want your help in understanding how to read data from an "E$" table and insert into a staging table.
Scenario:
Two columns in a flat file, employee id and employee name, needs to be loaded into a datastore EMP+. A check constraint is added to allow data with employee names in upper case only to be loaded into the datastore. Check control is set to flow and static. Right click on the datastore, select control and then check. The rows that have violated the check constraint are kept in E$_EMP+ table.
Problem:
Issue is that I want to read the data from the E$_EMP+ table and transform the employee name into uppercase and move the corrected data from E$_EMP+ into EMP+. Please advise me on how to automatically handle "soft" exceptions in ODI.
Thank you

Hi Himanshu,
I have tried the approach you suggested already. That works. However, the scenario I described was very basic. Based on the error logged into the E$_EMP table, I will have to design the interface to apply more business logic before the data is actually merged into the target table.
Before the business logic is applied, I need to read each row from the E$EMP table first and I do not know how to read from E$EMP table.

Staging Tables in AP

Similar Messages

Maybe you are looking for