How to tune data loading time in BSO using 14 rules files ?
Hello there,
I'm using Hyperion-Essbase-Admin-Services v11.1.1.2 and the BSO Option.
In a nightly process using MAXL i load new data into one Essbase-cube.
In this nightly update process 14 account-members are updated by running 14 rules files one after another.
These rules files connect 14 times by sql-connection to the same oracle database and the same table.
I use this procedure because i cannot load 2 or more data fields using one rules file.
It takes a long time to load up 14 accounts one after other.
Now my Question: How can I minimise this data loading time ?
This is what I found on Oracle Homepage:
What's New
Oracle Essbase V.11.1.1 Release Highlights
Parallel SQL Data Loads- Supports up to 8 rules files via temporary load buffers.
In an Older Thread John said:
As it is version 11 why not use parallel sql loading, you can specify up to 8 load rules to load data in parallel.
Example:
import database AsoSamp.Sample data
connect as TBC identified by 'password'
using multiple rules_file 'rule1','rule2'
to load_buffer_block starting with buffer_id 100
on error write to "error.txt";
But this is for ASO Option only.
Can I use it in my MAXL also for BSO ?? Is there a sample ?
What else is possible to tune up nightly update time ??
Thanks in advance for every tip,
Zeljko
Thanks a lot for your support. I’m just a little confused.
I will use an example to illustrate my problem a bit more clearly.
This is the basic table, in my case a view, which is queried by all 14 rules files:
column1 --- column2 --- column3 --- column4 --- ... ---column n
dim 1 --- dim 2 --- dim 3 --- data1 --- data2 --- data3 --- ... --- data 14
Region -- ID --- Product --- sales --- cogs ---- discounts --- ... --- amount
West --- D1 --- Coffee --- 11001 --- 1,322 --- 10789 --- ... --- 548
West --- D2 --- Tea10 --- 12011 --- 1,325 --- 10548 --- ... --- 589
West --- S1 --- Tea10 --- 14115 --- 1,699 --- 10145 --- ... --- 852
West --- C3 --- Tea10 --- 21053 --- 1,588 --- 10998 --- ... --- 981
East ---- S2 --- Coffee --- 15563 --- 1,458 --- 10991 --- ... --- 876
East ---- D1 --- Tea10 --- 15894 --- 1,664 --- 11615 --- ... --- 156
East ---- D3 --- Coffee --- 19689 --- 1,989 --- 15615 --- ... --- 986
East ---- C1 --- Coffee --- 18897 --- 1,988 --- 11898 --- ... --- 256
East ---- C3 --- Tea10 --- 11699 --- 1,328 --- 12156 --- ... --- 9896
Following 3 out of 14 (load-) rules files to load the data columns into the cube:
Rules File1:
dim 1 --- dim 2 --- dim 3 --- sales --- ignore --- ignore --- ... --- ignore
Rules File2:
dim 1 --- dim 2 --- dim 3 --- ignore --- cogs --- ignore --- ... --- ignore
Rules File14:
dim 1 --- dim 2 --- dim 3 --- ignore --- ignore --- ignore --- ... --- amount
Is the upper table design what GlennS mentioned as a "Data" column concept which only allows a single numeric data value ?
In this case I cant tag two or more columns as “Data fields”. I just can tag one column as “Data field”. Other data fields I have to tag as “ignore fields during data load”. Otherwise, when I validate the rules file, an Error occurs “only one field can contain the Data Field attribute”.
Or may I skip this error massage and just try to tag all 14 fields as “Data fields” and “load data” ?
Please advise.
Am I right that the other way is to reconstruct the table/view (and the rules files) like follows to load all of the data in one pass:
dim 0 --- dim 1 --- dim 2 --- dim 3 --- data
Account --- Region -- ID --- Product --- data
sales --- West --- D1 --- Coffee --- 11001
sales --- West --- D2 --- Tea10 --- 12011
sales --- West --- S1 --- Tea10 --- 14115
sales --- West --- C3 --- Tea10 --- 21053
sales --- East ---- S2 --- Coffee --- 15563
sales --- East ---- D1 --- Tea10 --- 15894
sales --- East ---- D3 --- Coffee --- 19689
sales --- East ---- C1 --- Coffee --- 18897
sales --- East ---- C3 --- Tea10 --- 11699
cogs --- West --- D1 --- Coffee --- 1,322
cogs --- West --- D2 --- Tea10 --- 1,325
cogs --- West --- S1 --- Tea10 --- 1,699
cogs --- West --- C3 --- Tea10 --- 1,588
cogs --- East ---- S2 --- Coffee --- 1,458
cogs --- East ---- D1 --- Tea10 --- 1,664
cogs --- East ---- D3 --- Coffee --- 1,989
cogs --- East ---- C1 --- Coffee --- 1,988
cogs --- East ---- C3 --- Tea10 --- 1,328
discounts --- West --- D1 --- Coffee --- 10789
discounts --- West --- D2 --- Tea10 --- 10548
discounts --- West --- S1 --- Tea10 --- 10145
discounts --- West --- C3 --- Tea10 --- 10998
discounts --- East ---- S2 --- Coffee --- 10991
discounts --- East ---- D1 --- Tea10 --- 11615
discounts --- East ---- D3 --- Coffee --- 15615
discounts --- East ---- C1 --- Coffee --- 11898
discounts --- East ---- C3 --- Tea10 --- 12156
amount --- West --- D1 --- Coffee --- 548
amount --- West --- D2 --- Tea10 --- 589
amount --- West --- S1 --- Tea10 --- 852
amount --- West --- C3 --- Tea10 --- 981
amount --- East ---- S2 --- Coffee --- 876
amount --- East ---- D1 --- Tea10 --- 156
amount --- East ---- D3 --- Coffee --- 986
amount --- East ---- C1 --- Coffee --- 256
amount --- East ---- C3 --- Tea10 --- 9896
And the third way is to adjust the essbase.cfg parameters DLTHREADSPREPARE and DLTHREADSWRITE (and DLSINGLETHREADPERSTAGE)
I just want to be sure that I understand your suggestions.
Many thanks for awesome help,
Zeljko
Similar Messages
-
Building BSO using ASO Rules file
Hi All,
We are building a new application where in we want to have both ASO and BSO. Eventually we wanted to do partition between these two cubes.
We already have a fully functional ASO with data loaded into it. This ASO also has bunch of rules files using which the ASO cube was built.
We need to build a new BSO and it should have same outline as ASO and in order to achieve this as used the same rules file that are in ASO. I already built the BSO usinng ASO rules files
My issue is with the dimension which are deifned as Multiplw Heirarchy and I would appreciate if some one can help me how do i define them in BSO. Also if some one canhelp me understand what are additional changes that needs to be taken care when I am building BSO using ASO rules files
I am trying to apply a caluclation which is in ASO and I am getting following error -- Error(1200337) - Error compiling formula for [Feb YTD] (line 1): [)] without [(]. As part of my research i found that error code is very generic. I checked the caluclation for missing ) or ( but everything looks good
Any help is greatly appreciated
Thanks
SatishYour ASO formulas will not work in BSO cube. ASO uses MDX formulas and BSO uses Essbase calc script language. There is a guide in the technical reference that helps convert from one to the other.
As far as multiple hierarchies, BSO does not have this concept. You should be able to load the hierarchies as is with perhaps a few changes to the load rule to address how to handle shared members.
You will not have a direct one to one from BSO to ASO. They are a different architecture and as such have variances that are not 1 to 1 compatible. -
How to find Data load time ?
Hi,
Where do i look for the Total data load time ? from data source to PSA ?Hi Honar,
1) Goto monitor of IP, in header tab you can find the runtime of IP.
2) So you are loading data from source to BW.In IP header tab copy the req number, goto the source systems from which data is loading.
goto SM37 give the request number with BI as pre-fix, you will find the total run time of job with job log.
Hope this helps. -
How to tune/ decrease loading time of jsff.
Hi All,
I'm using adf 11g.
In my application , one of my transaction scree is taking too much time to load .
In VOimpl i worte / override some method like
executeQuery() to excute the VO query on authorization login base .
and
createRowFromResultSet(Object qc,ResultSet resultSet) to populate the transiet variables on load . 7 -10 parameters are there .
The VO query is running fine and fast when executing in toad.
I have task flow which have search page jsff , default it fetchs records. i have dragged the taskflow to jsf as region.
Please let me know how tune the performance . i have followed this link .
http://www.gebs.ro/blog/oracle/adf-view-object-performance-tuning-analysis/
But this will effect when page load and to retrieve data records.Me getting issue on loading the page itself
Thanks in advance .Hi,
Before call the page write init method to executeEmptyRowSet() or write customized criteria(ViewCriteria) -
How to control data load in Info-Package using ABAP?
Hello Gurus:
I am trying to resolve couple of issues.
1. I need to load data DAILY Full Load into a Planning cube. I have the 0NETDUEDATE for selection in the
Info-package. I am getting data from anothe base A/R cube. I want to Load Daily ONLY those records
for which the "0NETDUEDATE" is Greater than "System Date". I think the logic would be IF 0NETDUEDAT
.GT. SYS-DATUM, bruing the record. What should be the statement in 'Result' for keeping the record?
(I don't know ABAP, so need help here...!)
2. Similalry, before loading the data above, I want to delete all the existing records from Planning cube where
0NETDUEDATE is GT System date (records loaded the previosu day need to be deleted as the amounts may
have changed). How can I achieve this selective deletion automatically in PC??
Appreciate your feedback very much.
Thanks... SMaaHi Shruti,
1) If i understand your requirement correctly you need to load only data which has 0NETDATE greater then sydatum.
So you can do this in infopackage .Infopackage>Data selection->0NETDATE(field)-->type(colum).here you can selecy ABAP type(6).Now you create ABAP code in this.
Here in ABAP code you need to specify high and low range ,Also the relation character like GT or BT(between).
i guess some how ur code will look like this
$$ begin of global - insert your declaration only below this line -
TABLES: ...
DATA: ...
$$ end of global - insert your declaration only before this line -
InfoObject = 0NETDUEDATE
Fieldname = NETDUEDATE
data type = NUMC
length = 0000010
convexit = PERI6
form compute_NETDUEDATE
tables l_t_range structure rssdlrange
changing p_subrc like sy-subrc.
Insert source code to current selection field
$$ begin of routine - insert your code only below this line -
data: l_idx like sy-tabix.
l_idx = sy-tabix.
l_t_range-low = sy-datum.
l_t_range-option = 'GT'.
modify l_t_range index l_idx.
p_subrc = 0.
$$ end of routine - insert your code only before this line -
endform.
i am not sure about coding but you can surely do it it is like specifying the ranges dynamically(you need to try it out)
(also as mentioned by others you can do this in traansformation routines)but infopackage routine you can directly write in PROD system.
2) And regarding the Selective deletion you donu2019t have nay process type in Process chain which does this
But there is function module u201C rsdri_infoprov_delete " which can be used to develop a program( I guess you must be having a existing ZProgram in ur system already available because this is used commonly.
Other wise you need to develop a ZProgram for this.
Thanks and Regards
Arun -
How can data load time can be optimized using routine
Hi,
Data laod is taking too much time . How can data load time can be optimized using routine
Regards,
VivekHi Vivek,
If you have code wirtten, please try to post the same, so that i cna help you in optimising it and give it you...
General Guideleines.
1. Dont use select statement inside the loop.
2. where possibel try to use Read statement with Binary Search Option and avoid using loop statement.
3. Try to avaoid joins if you are using any, isntead use For alll entries.
4. Try When u use for all entries try to make sure that your internal tbale is not initial.
5. Try to Sort and delete adjacent duplicates from internal tables wherever needed.
6. Use clear statement whererver required.
Regards,
Nanda.S -
how can I restore my back up files from my laptop? i want to see the dates and time that I backed up my files. is it posssible?
What backed up files?
Available backups for an iOS device can be found in Edit > Preferences > Devices. -
How do you date and time stamp iCal entries? We share an event calendar and need to know when a new event was entered into iCal.
BKBK,
Thank you for your response. That does adequately cover the
client-originated sessions, but still leaves the ability I am
looking for unavailable.
It did serve to definitively answer my most pressing
question, however, with this statement:
Note: ColdFusion cannot create a session if an initiator
application uses a SendGatewayMessage method to start an
interaction with a client, such as an SMS user. In this case, the
sending code must keep track (for example, in a database) of the
messages it sends and their destinations. When a response event
arrives, it can look up the origniatorID to determine whether it
was in response to an outgoing message.
I will play around with the Application scope to see if there
might be a workable solution there.
RLS -
How to compare date and time together
Hi,
How to compare Date and Time together?
For example in a database table there are two fields rundate and runtime. I want to compare these two with perticular date and time in the program. Like, I want to pull all the records where the records's date and time are less than a perticular date and time in the program.
Hope the question is clear...
Thanks.
KavitaHi Kavita
There is no as such Date and Time Comparision FM in Standard SAP But You can define your own like this
<b>FUNCTION ZAV4_COMPAREDATETIME.
""Lokale Schnittstelle:
*" IMPORTING
*" REFERENCE(DATE1) TYPE DATS
*" REFERENCE(TIME1) TYPE TIMS
*" REFERENCE(DATE2) TYPE DATS
*" REFERENCE(TIME2) TYPE TIMS
*" EXPORTING
*" VALUE(TWOISMORETOPICAL) TYPE C
twoismoretopical = ''.
if date2 > date1.
twoismoretopical = 'X'.
else.
if date2 = date1 and time2 > time1.
twoismoretopical = 'X'.
endif.
endif.
ENDFUNCTION.</b>
Regards
Mithlesh -
How to display date and time on jsf page
Hi,
how to display date and time on jsf page
we are using 11.2.0.0 jdeveloper on windows.
thanks
Edited by: user12187801 on 26-Jul-2012 01:42Your question is certainly lacking some information.
If you want a constantly updating date/time - then JavaScript is your best bet, and Google would find you examples like [url http://www.webestools.com/scripts_tutorials-code-source-7-display-date-and-time-in-javascript-real-time-clock-javascript-date-time.html]this
If you meant something else, then it's back to you to explain. -
How to set date and time on apple tv
how to set date and time on apple tv
Assuming this is not the first time you have used your Apple TV
1. You might try restarting the Apple TV by removing ALL the cables for 30 seconds.
2. Also try restarting the router.
3. If the problem persists, try a restore, you may want to try the previous procedures several times before doing this.
If this is a new Apple TV, it may also be that your network router is not allowing access to the timeserver, check that your router allows access over port 123. -
How to find date and time on iphone's photo taken?
in iPhoto no matter the source of the photo you see the information about th ephoto by selecting the photo and showing info (the get info button may be in a different location depending on the version of iPhoto you have)
If you are not aking an iPhoto question but are asking an iPhone question instead then repost in the iPhone forum - iPhoto has no association with the iPhone
LN -
I have 12 files which are similar in size. When they were loaded on one server, the load time is pretty consistent. For example, it takes about 100 seconds for loading each of the 12 files. On the other server, however, the data load time increases dramatically when loading later files, i.e., 100s, 120s, 180s....The essbase version are the same on both servers (window 2000). What could cause this problem? Is this something to do with server settings or essbase settings? Thanks for your response.Lin
Hi,Can you please specify the version of Essbase server and development tool (app manager, admin services)?Have you checked the dense/sparce configuration?Grofaty
-
How to delete data off time capsule and restart
how to delete data off time capsule and restart
Open Finder > Applications > Utilities > AirPort Utility
Click on the Time Capsule, then click Edit in the smaller window that appears
Click the Disks tab at the top of the screen
Click Erase Disk
Choose the Quick Erase option
Click Erase
The procedure will take a minute or two. The Time Capsule is now ready for a new backup -
How to exctract data from a report to use it in a process
Hi! I would like to know how to exctract data from a report to use it in a process. Let's say that I have a report which have following fields: id_person, name_person. And then, I want to make a process which introduce the id_person (from report) into an associative tabel. How can I reffer to the fields from my report?
I was thinking about something like that( this should be the code from my process)
insert into associative_table(id_person)
values(id_person) or
insert into associative_table(id_person)
values(Report_name.id_person) but it doesn't work....
Thank you very much.Another option, use collections.
Create an on load process that loads all the rows you would have in your report into a collection:
begin
HTMLDB_COLLECTION.CREATE_OR_TRUNCATE_COLLECTION(
p_collection_name => 'ASSIGNED_CALENDAR_CONTACTS' );
for x in (SELECT CONTACT_ID, CONTACT_FNAME, CONTACT_LNAME
FROM CONTACT
WHERE InStr( pkg_CalendarMgr.f_FetchContactIDsForDay( TO_DATE( :P3_CALENDAR_DT, 'YYYYMMDD' ), 'OF' ), CONTACT_ID ) > 0 )
loop
htmldb_collection.add_member(p_collection_name => 'ASSIGNED_CALENDAR_CONTACTS',
p_c001 => x.CONTACT_ID,
p_c002 => x.CONTACT_FNAME,
p_c003 => x.CONTACT_LNAME);
end loop;
end;
Then, instead of your report selecting from the table, have it select from the collection, this way your display will match what's in the collection:
SELECT c001, c002 || Chr(32) || c003 CONTACT_NAME, 'Remove' remove
FROM htmldb_collections
WHERE collection_name = 'ASSIGNED_CALENDAR_CONTACTS'
ORDER BY c003, c002
Then you can have a button on the form that steps through the collection, one element at a time and does whatever you want it to.
Maybe you are looking for
-
Get a Report crashed error while running report using the mode character
Hello, I'am getting an "Enable to run report - Report as crashde" issue only when I'am running reports using the mode character. The same report with desformat pdf never has any problems. I have changed the englife (set to one) increase the cachesize
-
How to unredeem an iTunes gift card to put it on another account
I put my iTunes gift card on my dads account,but then I made my own account and want to transfer it but people used almost all of it is there a way to reset what they used and put it back on the gift card????
-
How to activate debugger in sapscript?
hi friends, i am new to sapscript. i cant see the option of 'activate debugger' in se71->utilities i am using ecc5.0 is there any other option to activate debugger? also can i write a select query in a form? thanks in advance... regards, aj
-
PO Release for Account assignment category is K(Cost centre)
HI Experts I need to set up release procedure for PO when account assignment categeory which is being maintained at Item level so suggest suitable method Regard Srinivasan
-
I am trying to activate imessage but it tells me my password is incorrect however i know both email and password is correct someone help please ?