How do I consolidate in FDM AFTER all files load to target?

Question

Hi,
We are using FDM to import and export out to HFM forecasting data. The files are sent via ETL to the OpenBatch folder and then I am using parallel processing to import, validate, and consolidate the files to the target system, which is HFM. The problem is the performance. As each file is loaded using the batch loader script, it loads and consolidates each file as each file processes. I would like to find a way to load and export all files FIRST to HFM - and then when the last file is encountered (the 12th file), I would like to run a consolidate on the file to HFM so that the consolidation will consolidate all at once and help save some time. Here are the steps I would like to accomplish:
1. Import, Validate, and Export the first 11 files to HFM
2. Import, Validate, Export, and Consolidate the 12th file to HFM - the idea is that all previous 11 files will consolidate atone time instead of the out of the box way using the standard BatchLoader script.
Does anyone know HOW I can make this happen? Out of the box this is not possible without some major script customization. Could someone please give me some sort of idea where I can make this happen? I really appreciate the help. Below is the standard Batch Loader script I am using and I would like to somehow customize:
Sub webBatchStdParallel()
'Oracle Hyperion FDM CUSTOM Script:
'Parallel Processing
'STANDARD Batch Parallel Processing
'Declare Local Variables
Dim lngProcessLevel
Dim strDelimiter
Dim blnAutoMapCorrect
Dim lngParallelProcessCount
Dim strLoadBalanceServerName
Dim BATCHENG
Set BATCHENG = CreateObject("upsWBatchLoaderDM.clsBatchLoader")
BATCHENG.mInitialize API, SCRIPTENG
'Initialize variables Variables
lngProcessLevel = 10                     'Up-To-Consolidate
strDelimiter = "_"                         'File Name Delimiter
blnAutoMapCorrect = True                    'Auto Map Correction is On
lngParallelProcessCount = 2                    'Number of Parallel Processes (Should equal # of Processors)
strLoadBalanceServerName = "Everest0555"     'Load balance server for parallel process
'Create the file collection
Set BATCHENG.PcolFiles = BATCHENG.fFileCollectionCreate(CStr(strDelimiter))
'Execute a Standard Parallel batch
BATCHENG.mFileCollectionProcessParallel BATCHENG.PcolFiles, CLng(lngProcessLevel), CLng(lngParallelProcessCount), CStr(strLoadBalanceServerName), , CBool(blnAutoMapCorrect)
End Sub

Answer 1

Hi,
Thanks for all the input so far, I really appreciate it. I have made a lot of progress and added code to the batch loader script.
Again, What I am trying to do is load 12 forecasting files (Periodic) for each month through FDM and then load to HFM. After the load, I want to kick off the consolidation process to the target system (HFM) AFTER the data has been loaded through FDM to help speed up time by running the consolidation all at once in HFM instead of by each file one by one in FDM. Here is some more info:
1. I have 12 files loaded to the OpenBatch Folder - Each file is a monthly file.
2. The 12 files (Starting from November 2010 - Oct 2011) are exported and loaded to HFM. No consolidation takes place.
3. I want to add a procedure AFTER the load to run consolidation on the last file loaded (Oct. 2011) in HFM so the consolidation will kick off in HFM and consolidate the remaining months in HFM instead of in FDM. I tested manually and the time is increased 10-fold.
4. I have potentially identified the "ActConsolidate" Method could be used to run the consolidation in the target system. In my code you can see that I have added the ActConsolidate call AFTER the batch load. I was hoping this would run the consolidation directly in HFM by calling the consolidation in HFM. However, when I run the script I keep getting the following error:
"91 - Object variable or With block variable not set At Line: 52" Apparently I am not calling or setting the object up correctly. Am I missing something? I sincerely appreciate everyones help and will promise to give big kudos to anyone who can help me along. I am almost there. THis is very difficult for me and I know it's a tough scenario because no one seems to have a solution posted anywhere on this forum.
Below is my code:
Sub webBatchStdParallelFcst()
'Oracle Hyperion FDM Custom Script:
'Created By:     
'Date Created:     10/4/2010 9:27:32 AM
'Purpose:
'STANDARD Batch Parallel Processing and consolidation - Foresacting
'Declare Local Variables for Batch Processing
Dim lngProcessLevel
Dim strDelimiter
Dim blnAutoMapCorrect
Dim lngParallelProcessCount
Dim strLoadBalanceServerName
Dim BATCHENG
Set BATCHENG = CreateObject("upsWBatchLoaderDM.clsBatchLoader")
BATCHENG.mInitialize API, SCRIPTENG
'Declare Local Variables for consolidation
Dim strLoc
Dim strCat
Dim strStartPer
Dim strEndPer
Dim CONSOLENG
Set CONSOLENG = CreateObject("upsWBlockProcessorDM.clsBlockProcessor")
'Initialize variables for Batch Processing
lngProcessLevel = 8                     'Up-To-Load
strDelimiter = "_"                    'File Name Delimiter
blnAutoMapCorrect = True               'Auto Map Correction is On
lngParallelProcessCount = 2               'Number of Parallel Processes (Should equal # of Processors)
strLoadBalanceServerName = "everest3105"     'Load balance server for parallel process
'Initialize ActConsolidate Variables
strLoc = "FORECAST"
strCat = "FDMPLAN"
strStartPer = "Oct - 2011"
strEndPer = "Nov - 2011"
'Create the file collection
Set BATCHENG.PcolFiles = BATCHENG.fFileCollectionCreate(CStr(strDelimiter))
'Execute a Standard Parallel batch
BATCHENG.mFileCollectionProcessParallel BATCHENG.PcolFiles, CLng(lngProcessLevel), CLng(lngParallelProcessCount), CStr(strLoadBalanceServerName), , CBool(blnAutoMapCorrect)
'Execute Consolidation on Target System
CONSOLENG.ActConsolidate strLoc, strCat, strStartPer, strEndPer
End Sub
However, I am getting the following error: "91 - Object variable or With block variable not set At Line: 52" I don't understand, the objects appear to be set up properly.