Column Format - Rule File
Greetings,
I'm doing a level zero column export of data and my goal is to replace '0' with '#Mi'. In the export file, years are represented in columns and data for Yr2013 begins somewhere at row 100. When I try to load the file into data prep editor for creating a rule file, the last column(Yr2013) does not show up and I'm not sure what delimiter to use. Right now, I'm using "All Spaces". I tried with .csv extension and comma delimiter too but same result.
Any inputs here?
Hi ,
In case you want to remove all the unnecessary block which gets created because of '0' value.
you can write one small script which will replace all 0 value with #Mi
like "Version" = "Version" * "Version"/"Version"; (Select your version)
then Clearblock empty;
Note: But take data backup before you play with you data.
hope this will help;
Regards,
Similar Messages
-
We want to modify the Rule-Files (Data Load and Dimension Build) automatically depending on our metadata.For this we need a documentation of the format of the rule-files.Can anyone help us?ThanksMichael
I seriously doubt that you will be able to pull this off. What is it that you need to do that requires modifying a load rule? Can you achieve the same result by programatically writing and running calc scripts, or by scrubbing the data prior to loading into Essbase?
-
How to format quotes in a rule file
Hello,
I have been looking in the dbag but can't seem to find any help. When I pull my data using SQL, my member name is "I" ON, but in my rule file is delimits because of the quote to read ION. How do I get "I" ON in my rule file?As a matter of convenience, I prefer a slightly different approach than to use the load rule to convert the "normal char" back into a "special char", in your case, I would set up a "Loader" alias table entry with the ["I" On] member having an alias of [~I~ On] in that table. The users won't use it, but it will load in fine and if you ever wanted to validate the file it becomes a little easier to spot by just making the loader alias table active.
This isn't always possible, but in addition to saving troubleshooting time it can also help overcome the conversion limitations of a load rule (if you have a lot of conversions, this becomes the defacto solution, so I tend to use it as a systemic answer to load rule conversions). -
EAS data export in column format question
I am trying to export data in column format and import back to replace 0 with #Missing. I want to see if it will reduce any blocks. When I export I am getting data header members from a different dimension other that Period. It is getting tricky to map these many data rows in rule file as oppose to 12 from Period.
What determines this behavior. I know I have tried in the past (different app) and Period came through as data header record.
Any help is appreciated.You can't directly control which dimension is selected (at least, not without changing your cube) in a native export.
However, for what you are doing, you do not need a load rule - you could just find-and-replace in the file.
You can also try converting zero to #Missing with a calc script (see Re: BSO Level 0 Block Analysis Advice) although it's going to be slow and you'd need to defrag with a dense restructure afterward. -
Hi,
I am trying to create a rule file in one essbase cube using the level 0 export (extract in column format) from another cube of a different application. Level0 data file is saved in the local machine from where I am running Essbase. While creating the rule file, trying to open the data file, error message comes like "Invalid blank character in name". Can anyone please let me know what the error can be?
Thanks.I had a similar issue in the past,
Even if the file is placed on Desktop at times EAS was picking it, but always failed with MaxL may be because of it's syntax and the way it can read the path. Maybe there are other factors as well.
But it's always better to put the file in a path without spaces and it'll work fine always. :) -
Hi,
Can i create rules file like below , unable to define for more than one level 0 member from the same dimension. (can define by taking all the level 0 values in column , but dont want like that)
Level 0,Time Alias 0,Time Level 0,Time Alias 0,Time --- ---
Jan-08 January Feb-08 February --- ---Hi,
generally, you have cubes ,with dimension ,along with hundreds members ( much more than that too , in few cases).All these members ,majority are of level 0. You can make rules files across the column picks.your format of horizantal way is not possible .
May i know ,what exactly you are trying to achieve out of this .
rather , pick your data source file and make changes to suit to the needs of essbase rule file
Sandeep Reddy Enti
HCC
http://analytiks.blogspot.com -
Hi Guys
I ve been trying to modify a rule file by adding an extra column, should I be using create using text ? IF so it is not taking the values of the particular dimension member provided in the data file ?
Is there an alternative?
ThanksHi,
Can you tell me what you are trying to do.. that is why do you have to add 20 odd text fields in the rule file. If you are loading data from a file which is not loadable format, then use the rule file to provide the information so that your data will get loaded. May be you might have to ignore few columns in your data file and provide the dimensional information in the header definition or add few text columns representing dimension members in the rule file.
If you can provide some more info on what you are trying to achieve, may be i can help you a bit more on this...
Thanks,
Sourabh -
How to tune data loading time in BSO using 14 rules files ?
Hello there,
I'm using Hyperion-Essbase-Admin-Services v11.1.1.2 and the BSO Option.
In a nightly process using MAXL i load new data into one Essbase-cube.
In this nightly update process 14 account-members are updated by running 14 rules files one after another.
These rules files connect 14 times by sql-connection to the same oracle database and the same table.
I use this procedure because i cannot load 2 or more data fields using one rules file.
It takes a long time to load up 14 accounts one after other.
Now my Question: How can I minimise this data loading time ?
This is what I found on Oracle Homepage:
What's New
Oracle Essbase V.11.1.1 Release Highlights
Parallel SQL Data Loads- Supports up to 8 rules files via temporary load buffers.
In an Older Thread John said:
As it is version 11 why not use parallel sql loading, you can specify up to 8 load rules to load data in parallel.
Example:
import database AsoSamp.Sample data
connect as TBC identified by 'password'
using multiple rules_file 'rule1','rule2'
to load_buffer_block starting with buffer_id 100
on error write to "error.txt";
But this is for ASO Option only.
Can I use it in my MAXL also for BSO ?? Is there a sample ?
What else is possible to tune up nightly update time ??
Thanks in advance for every tip,
ZeljkoThanks a lot for your support. I’m just a little confused.
I will use an example to illustrate my problem a bit more clearly.
This is the basic table, in my case a view, which is queried by all 14 rules files:
column1 --- column2 --- column3 --- column4 --- ... ---column n
dim 1 --- dim 2 --- dim 3 --- data1 --- data2 --- data3 --- ... --- data 14
Region -- ID --- Product --- sales --- cogs ---- discounts --- ... --- amount
West --- D1 --- Coffee --- 11001 --- 1,322 --- 10789 --- ... --- 548
West --- D2 --- Tea10 --- 12011 --- 1,325 --- 10548 --- ... --- 589
West --- S1 --- Tea10 --- 14115 --- 1,699 --- 10145 --- ... --- 852
West --- C3 --- Tea10 --- 21053 --- 1,588 --- 10998 --- ... --- 981
East ---- S2 --- Coffee --- 15563 --- 1,458 --- 10991 --- ... --- 876
East ---- D1 --- Tea10 --- 15894 --- 1,664 --- 11615 --- ... --- 156
East ---- D3 --- Coffee --- 19689 --- 1,989 --- 15615 --- ... --- 986
East ---- C1 --- Coffee --- 18897 --- 1,988 --- 11898 --- ... --- 256
East ---- C3 --- Tea10 --- 11699 --- 1,328 --- 12156 --- ... --- 9896
Following 3 out of 14 (load-) rules files to load the data columns into the cube:
Rules File1:
dim 1 --- dim 2 --- dim 3 --- sales --- ignore --- ignore --- ... --- ignore
Rules File2:
dim 1 --- dim 2 --- dim 3 --- ignore --- cogs --- ignore --- ... --- ignore
Rules File14:
dim 1 --- dim 2 --- dim 3 --- ignore --- ignore --- ignore --- ... --- amount
Is the upper table design what GlennS mentioned as a "Data" column concept which only allows a single numeric data value ?
In this case I cant tag two or more columns as “Data fields”. I just can tag one column as “Data field”. Other data fields I have to tag as “ignore fields during data load”. Otherwise, when I validate the rules file, an Error occurs “only one field can contain the Data Field attribute”.
Or may I skip this error massage and just try to tag all 14 fields as “Data fields” and “load data” ?
Please advise.
Am I right that the other way is to reconstruct the table/view (and the rules files) like follows to load all of the data in one pass:
dim 0 --- dim 1 --- dim 2 --- dim 3 --- data
Account --- Region -- ID --- Product --- data
sales --- West --- D1 --- Coffee --- 11001
sales --- West --- D2 --- Tea10 --- 12011
sales --- West --- S1 --- Tea10 --- 14115
sales --- West --- C3 --- Tea10 --- 21053
sales --- East ---- S2 --- Coffee --- 15563
sales --- East ---- D1 --- Tea10 --- 15894
sales --- East ---- D3 --- Coffee --- 19689
sales --- East ---- C1 --- Coffee --- 18897
sales --- East ---- C3 --- Tea10 --- 11699
cogs --- West --- D1 --- Coffee --- 1,322
cogs --- West --- D2 --- Tea10 --- 1,325
cogs --- West --- S1 --- Tea10 --- 1,699
cogs --- West --- C3 --- Tea10 --- 1,588
cogs --- East ---- S2 --- Coffee --- 1,458
cogs --- East ---- D1 --- Tea10 --- 1,664
cogs --- East ---- D3 --- Coffee --- 1,989
cogs --- East ---- C1 --- Coffee --- 1,988
cogs --- East ---- C3 --- Tea10 --- 1,328
discounts --- West --- D1 --- Coffee --- 10789
discounts --- West --- D2 --- Tea10 --- 10548
discounts --- West --- S1 --- Tea10 --- 10145
discounts --- West --- C3 --- Tea10 --- 10998
discounts --- East ---- S2 --- Coffee --- 10991
discounts --- East ---- D1 --- Tea10 --- 11615
discounts --- East ---- D3 --- Coffee --- 15615
discounts --- East ---- C1 --- Coffee --- 11898
discounts --- East ---- C3 --- Tea10 --- 12156
amount --- West --- D1 --- Coffee --- 548
amount --- West --- D2 --- Tea10 --- 589
amount --- West --- S1 --- Tea10 --- 852
amount --- West --- C3 --- Tea10 --- 981
amount --- East ---- S2 --- Coffee --- 876
amount --- East ---- D1 --- Tea10 --- 156
amount --- East ---- D3 --- Coffee --- 986
amount --- East ---- C1 --- Coffee --- 256
amount --- East ---- C3 --- Tea10 --- 9896
And the third way is to adjust the essbase.cfg parameters DLTHREADSPREPARE and DLTHREADSWRITE (and DLSINGLETHREADPERSTAGE)
I just want to be sure that I understand your suggestions.
Many thanks for awesome help,
Zeljko -
Issue with rule file and Substitution variable
Hi All,
I am using Essbase 9.3.3
I created a rule file with 5 dimensions in which 3 dimensions I defined in columns and two dimensions I gave it as header in data column with comma seperated.
Among those two dimension members, one is an account member with "/" in it within quotes and other is a substitution variable.
The member assigned for that Substitution variable has a space in between and is updated within quotes in variables list.
When I try loading data, I am getting an error saying that two members are not valid.
Eg: "Tax/Unit",&Scenario is not valid.
&Scenario - "Budget Q1"
Can some one please suggest on the issue.
I am not facing any problem in calc scripts or reports scripts using the substition variable.
Thanks in advanceMark,
Modifying the default files is dangerous and ill advised. You could always just add a style sheet (inline or linked) to your application that overrides that one setting while you wait on the permanent fix.
Regards,
Dan
http://danielmcghan.us
http://sourceforge.net/projects/tapigen -
Substitution variable using in rules file
Hi,
I have a requirement to load the data only for the current month. But, my source file is having data for all the months till current month.
ex: I have to load data for MAY. But, source file is having data from JAN to MAY
Its a monthly process and it should load the data only for the current month using substitution variable.
Means next month I will be having JAN to JUN data. But, I should load only JUN data.
Could any one help in building rules file for this requirement.
Thanks
SriIs the data coming from SQL or a flat file? And is JAN through MAY represented in multiple columns or multiple rows?
As Evgeniy says if it's a SQL source, you can use a subvar in the SQL statement. If it's a flat file (and your periods appear as multiple rows) you can use a subvar in a SELECT/REJECT criteria.
Honestly though, if a feeding system is producing a flat file for you, I would try and arrange to have the flat file contain only the data that is actually required. Parsing a file that is up to 12 times larger than necessary is inefficient. -
Rule file design need to reject some members in the same field
Hi,
I'm working on Essbase vrsn11.1.1.3.I'm building dimensions through rules file. I have a .dim file with parent child reference that have 5 fields(parent-child-alias1-alias2-property).
The requirement is as such that the fourth field (alias2) is to be needed only for some members,Let say i have four members to load(A,B,C,D)Alias1 is required for all four members but alias2 is to be loaded only for B & D members.
Is there any possibility to full fill this requirement, if so then kindly let me know
thanks in advance
Edited by: hyperion on Jan 12, 2012 4:01 PMcreate second rule file and load alias2 only with your select/reject criteria.
Essbase rule file will reject entire record if at least one column matches up reject condition. -
the file record have 4 field and storing the records in string[]
record=bufferedReader.readLine();
String[] str = record.split(" ");
System.out.println(str[2]);These code will print the 3 column of the file but if we want to read each element of str[2]; then how to do thatWhen you call split, everything from the start to the delimiter is stored in the array. Then delimiter itself is not. So, :
public static void main(String[] args) {
String test = "\"Larry\",\"Moe\",\"Curly\"\t1234,5432,97854";
String [] arr = test.split("\t"); //Split the test string at any tab
for(String s : arr)
System.out.println(s);
String [][] arr2 = new String[arr.length][];
for(int i = 0; i< arr.length; i++){
arr2[i] = arr.split(","); //loop thru the array created by the first split, and split it at any comma
for(int j = 0; j<arr2[i].length; j++)
System.out.println("\t" + arr2[i][j]);
Of course, this will only work if you know the format of the data, but since you need the format to start with, then you should easily be able to figure it out.
~Tim -
Dear Gurus,
What if i check the option export in column format while export the database?
Thanks,
SekharHi,
Adding to the John comments,
If you export the database in the column format the size of the export file will be much more than the data in the cubes.
I had an experience where I used to export the data in column format which results in a file which was
twice the size of the file without the column format.
If you have a lot of data in essbase cubes, I advice you to export data in non columnar format in order to save the disk space.
Thanks,
Sourabh -
How to set the field size in rule file.
i have to map total 30 fields in a rule file while by default it allows only 20 fields. so how can we set the fields as per our need?
Hi Dharmendra Ojha,
Essbase rule file does not constrain you with only 20 fileds.
When you click on 'create a rule file', by default it ll show you 20 fileds .But , when you open a data file ( in your case , you data file has 30 columns i.e 30 fields) in the data prep editor , you ll see all 30 fileds .
So ,you have to do nothing to increase the filed count , rule file will automatically show all fields .
Revert back for further clarity
Sandeep Reddy Enti
HCC
http://analytiks.blogspot.com -
Spacing at the end of each column in 3 column format
I am copying text with footnotes from a word file into Pages. When the text is pasted into the three column format some of the columns are really short. They don't even make it half way to the start of the foot notes on the bottom of the page. How can I make the columns extend to the start of the foot notes on all of the pages? Please Help. Thank you.
No luck there- I had actually already tried that. The only thing that has worked so far, after many attempts, is to erase the footnotes and reinsert them. (So I'm guessing all the issues stem from pasting over from Word.) If there's an easier way, I'd love to find it since this is a rather long paper with lots of footnotes. (And I can't just leave the document in Word...based on my formatting tries and research, it's not even really capable of doing the footnotes the way I'd like them to be.)
Maybe you are looking for
-
I can not convert a PDF file to a doc file. I have an older computer program and need to do this in order to make changes to a form. I just signed up for ADOBE about an hour ago. I keep getting a error message.
-
I deleted my Recovery partition Lion and I need it to repair my hard drive.
I am running the newest Lion and I need to repair my hard drive by booting into recovery option+r at boot. I deleted the partition I believe so any way i can get it back? Just so you know I can't partition my hard drive for boot camp because i cant r
-
I deleted an app with was 15 gb deleted it and i havent got memory back
some help. is there a way you can reset get memory back or is it like that
-
Animation after Splash Screen?
When an application starts, I supply a Default.png which is displayed immediately, configure the main view in awakeFromNib, and my view with its subviews then suddenly appears replacing the default "splash" screen. My questions is, how can I animate
-
Stacks not working on Elements 12 install
Installed new Elements 12 (not upgrade) and converted Elements 9 catalog (no problem indicated on conversion). Stacks and Version stack does not work in converted catalog. Get error "Create Stack Failed" and when creating version from edit save, ne