Understanding the data storage
Hello,
In order to understand very well what happens regarding the data in the cube and in the relational database, here is a little scenario.
Clould you please tell me whether my understanding is correct or not. Further precisions are welcome :
If I send an amount (10 for example) in a based members intersection, the number 10 will be in the WB fact table (supposing that the table was empty just before) and in the WB partition.
Now supposing, I change the amount, in the same intersection, I send the number 20. Thus, there will be 2 entries in the wb table with the same SIGNEDDATA to 10.
Are there also 2 entries in the WB partition in the cube or only one to 20 ?
After that, I run a lite optimization, now both the entries are in the FAC2 tables.
Now If I send the amount 5 (still in the same intersection), there will be the amount -15 in the WB table. is it exact ?
At this moment, what is the situation regarding the OLAP WB and FAC2 partitions ?
If I retrieve the amount through a report, I asume that there will be a merger between the two fact tables in order to retrieve the right amount (ie 5 : 10 +10 -15), but I'm not sure.
Also, as long as the data intersection concerned a based member, the retrieve is made from the relational database, Right ? The OLAP partitions are used when the data we want to retrieve concerned parent members? The retrieve will be made through MDX queries ?
So, there is also a merger between the OLAP partitions in order to retrieve the right data ?
Best regards,
Lionel
I think it is question regarding Microsoft OLAP database. I am not sure about the other OLAP database's behavior.
Simple answers:
If you send 10 and 20 to make it 20, you have 2 entries in WB table. Each entry has 10 for their own intersection.
If you do lite optimize, your WB tables will be empty. And exact records will be moved to FAC2 table.
If you send 5, your WB table will have 1 entry that has -15. Total number of record for that intersection is 3.
However, number of records will not changed no matter what. Only exception is compress data during full optimize.
That value, 5 from cube is by merge of three partitions - FACT, FAC2 and FACTWB. Normally, you do not need to care about table itself. SSAS will do it based on partition scheme.
Data from relational database tables are correct in some cases such as WB partition. But if your WB partition is empty, data is from OLAP partition no matter it is base level or parent level.
We are using some different way to lookup relational tables to get data faster and faster in BPC. But it is your own risk if you try to make something to lookup that tables directly.
Similar Messages
-
iTunes shows that there are no songs on my iphone but there are 274 songs there. The data storage shows up as "other" on iTunes. I just want to clear the music on my phone but I can't seem to do so. Is there any way to do this? You used to be able to swipe and delete a song straight from your phone but I can't seem to do that anymore.
That is stealing.
-
HP 34401A-When I run the Read Meas.vi, it has error if I do not turn off the data storage
When I run the Read Meas.vi, it has error if I do not turn off the data storage. The same thing happen when I run the App. Example. vi. Anyone knows how to solve this problem? Thanks alot.
KLLoganS wrote:
Hi KL,
The Read Meas.vi is one of the subvi's in the App. Example.vi, so this problem is most likely the same problem in each case. From the help for Read Meas.vi:
Data Storage instructs the device to store the data to be sent to either the internal or external buffer. If TRUE (default), the VI stores data in the on mode. If FALSE, the VI does not retain data in the off mode. Use the off mode only with the average min/max operation when you do not need to retrieve data. You cannot configure the meter for external buffering in the off mode.
So the question is, are you trying to retrieve any data? If so, then as indicated in the above paragraph, you cannot retrieve data and have the data storage turned off. Good luck!
Logan S.
Yes, I need to retrieve data. So due to that problem, I cannot really get any data. I am not sure is that problem is due to the USB GPIB or not. But once I click on the click arrow, everying goes fine from initialise, measurment... once it comes to Read measurment, it has error (say somthing like: VISA Wait on Event for RQS.vi->HP34401A Read Meas.vi->Untitled 1) I have no idea like what it shows up.
KL -
Understanding the data transfer from source system to PSA
hi experts,
i an new to BI. i have created a transactional data source for VBAK table and replicated that to BI. Created transformations and info package for uploading the data into PSA. i just want to know the sequence of steps that the system executes when we run the infopackage. i know that it makes a rfc call to source and brings the data back to BI. i want to where that RFC call happens and what is the RFC FM name etc.,. I tried to debug the process using /h, but as you know, it is very difficult to debug the whole standard code. it is very complex. i got lost some where in the middle. if anybody has any idea / or done any research on this ,please share your findings.
thanksHi,
Once you click on Start buton in Infopackage,
1. BW system wil send on erequest to ECC along with DataSource details.
2. Based on BW request ECC will respond and it will send message OK and starts extraction.
3. Based on InfoPackage selection the Data will executes in ECC and picks the data in Packets.
4. And ECC will send the data in teh form of Datapackets to BW (Idocs)
5. Once the selection creatiro is over the Job will finish.
6. You can see the data in BW
Thanks
Reddy -
i'm looking for new ideas about how to save an stl has map into the disk..
You could use a Berkeley DB database to store the data from an STL hash_map.
Berkeley DB btree and hash databases store key/data pairs. These can contain variable length key and/or data items.
It should be fairly straight forward to iterate through a hash_map and store each item in a database.
The best places to start learning how to use Berkeley DB are the Getting Started Guide:
http://www.oracle.com/technology/documentation/berkeley-db/db/gsg/CXX/index.html
Or the examples distributed with the source code.
Please let us know if you have more specific questions.
Regards,
Alex -
Understanding the Data Source 0CO_PC_01
I received a query from a user who was running a query on the cube 0PC_C01. The actual quantity value for a particular cost centre is doubled. The cube is loaded using the data source 0CO_PC_01
I tracked the problem to a particular production order and then ran the extractor checker on the source system for that production order and selected only actuals (value type 10) and one currency type (020). When I look at the cost centre I see that there seems to be a line which has the total expected value for actual quantity, but also 2 lines which have the break down of that value. All 3 lines have value type 10. So when the user selects the cost centre, he sees the total of all 3 lines?
There also 2 other line which nett of the values correctly but these lines do not have the cost centre. They have a different cost assignment and refer to the production order line rather than the cost centre. So the total is correct, but when the user selecst the cost cente the total is inflated.
Is there a filter I should apply to avoid the duplication?In this example there are 5 lines. One line has the correct (expected) actual qty of 16 HRS. This line has the cost centre. Then there are 2 lines which are negative -12 and -4 and these lines have a value of 0OIT in the field 0PIOBJ instead of cost centre these lines have the production order. The next 2 lines are postive +12 and +4. These lines have a valueof 0ACTY in 0PIOBJ and they have the cost centre.
When the user selects by cost centre, he loses the negative lines and gets the 3 positive lines 16, 12 and 4. So he sees an actual quantity of 32 instead of 16. All these lines have the same partner object value of 0ACTY. All have the same cost centre value, all have the currency code 020 and value type of 10.
To get the query to give the result of 32 for the cost centre, I need to find a way to put the cost centre onto the 0OIT lines which are negative or I must find a way to exlcude the first line which seems to be a total line? -
The data storage function on the Zen Mi
I have just bought a Micro Zen and I'm waiting to receive it... One of the reason I went for the Micro Zen is that it also allows me to store data on it. But talking to a friend who has one, I realized something : she tells me the Zen Micro is all fine and good to transfer data between computers like you would with any USB key but the thing with the ZM is that you need to install a software on both computers before being able to transfer any file? My USB key works on any computer without installing anything, which is what makes it so practical... what's the use of the storage data function if you can't, for example, use it to bring back home files you've worked on at work / college (the problem being you can't install anything on a public access computer...), or even at a friend's?
ThanksThanks a lot!!
And don't worry I've paid and bought the Creative Zen Micro, it's not to go buy an Ipod now... but the micro zen'd better li've up to my expectations!! -
hi,i use logic pro 9 and cubase to record,produce and master audio recordings and have bought a mac as recommended.have upgraded to 8gig memory (which i was told was the maximum you could upgrade a macbook pro)and still my recordin is slightley behind plauback.i need to replace my hard drive with a solid state drive to solve the problem.i have seen on youtube how to replace the hard drive but have noticed on the disk partition information that there is a 500gig harddrive for the system(booting up ect)and a 500gig harddrive for data storage,are these the same unit?i need to be sure im upgrading what the system uses to an ssd as well as the data storage or the problem wont be solved.i have an external hard drive so i have been looking at a smaller,faster ssd. hope you can help!
DaisyMay wrote:
Firewire 400/USB 2.0/1.1
I would recommend not settling for less then USB 3 or hold out for Thunderbolt, if your machine is capable. Firewire 800 minimum.
MacBook Pro, Mac OS X (10.7), 2.4GHz IntelCore i5 320 HD 8GB RAM ParallelsDesktop6.0 -
Hi!
I'm trying to have an analog square wave input determine where data gathered from a second analog input channel is stored. I want data to be stored to one array during the high signal period of the square wave and data to be store to another array during the low signal period of the square wave. The square wave I'm using is of constant frequency (8.3 Hz). I believe I need to use an analog input wave as opposed to a onboard clock or other timing mechanism because my square wave is also being used to modify the input going into my experimental setup. Thus the data storage needs to be correlated to the timing of the data modification in the experiment. I tried to use the retriggerable property node function, but receive error 200452, which I think means that my PXI card (6115) can't support this retriggerable function. So I'm looking for other ways to accomplish alternating data storage in response to an incoming analog square wave. Any help would be GREATLY appreciated... Thanks! (I'm also quite new with LabView so toddler-type explanations would probably be most useful )
-Shari
(LabView version 8.6)
Attachments:
Pulsed_Acq_Switch_Simplified.vi 47 KBHello Shari,
I am looking at your situation and it seems very intriguing. after downloading your file I have a couple questions to ask if you don't mind answering.
Currently in your program you are only taking one sample of data at a time, this could lead to uneven sampling. Would you like to sample at a consistent rate (say 10 Kilosamples of data a second?) if so what type of card are you using?
Also, Do you want your data to be in a 2-D array of data?
Best Wishes,
Daniel -
I have 2 different iCloud accounts and would like to delete the account where I have paid for extra iCloud data storage. Can I transfer the data storage over to my other account? I am trying to get my iCloud and Apple account with same user name.
You'll have to contact Apple about that.
Their iCloud support page indicates you cannot merge or transfer iCloud accounts.
What do you mean by, I am trying to get my iCloud and Apple account with same user name. -
Data storage format by berkeley DB
Hi,
I have a few questions regarding how data storage is achieved by Berkeley db.
I created a Berkeley DB database called 'BDB' by inserting 1million <key,value> pairs. The environment name was set to 'BENV'; that means, I had to create a directory named 'BENV' in the current working directory before executing the program.
After invoking the program and completing the insertions, I saw a file 'BDB' in the 'BENV' directory. The size of 'BDB' is 56Mb. Further, there are 4 more files: __db.001 ... __db.004. Sizes of these files are 4Kb, 320Kb, 1.9Mb and 608Kb.
I should mention that I didn't enable logging when I created the database and environment.
My question is: why are there so many files and what are their purpose? I have a feeling that the files '__db.00x' (where x=1 to 4) also store data. Coz, I created two more databases with 10million and 200million records.. and they have these files too, just that their sizes have increased quite a bit.
I am trying to understand more details about the data storage layout of Berkeley DB and I would appreciate any help regarding this.
Thanks.
AndorAre you using the STL interface? We have code that uses the raw C++ interface and this does not create those files starting with '__'. Whereas the code that uses STL interface creates such files. I have not bothered much now as I need those files during the process lifecycle. My use of Berkeley DB here is more like a disk backed set rather than a true persistent database.
I would try running a checkpoint() to see if they get into a single file before closing the DBEnv. Let me try as I have a sample code using DB STL interface. -
How to store the data coming from network analyser into a text or excel file
Hii everyone
I'm using Agilent 8719ET network analyser and wish to store the data coming from netowrk analyser into a text file/ excel file.
Presently I'm able to get the data on Labview graph using GPIB . Can anyone suggest how to go ahead after collect data sub vi. How can the data be stored into a file apart from showing on the graph?
Attached is the vi for kind consideration...
Looking for help
Regards
Rohit
Attachments:
Agilent 87XX Series Exceed Max Meas.vi 43 KBFirst let me say that your code really looks pretty good. The data handling could be made more efficient by calculating the number of datapoints that are going to be in the completed dataset and preallocating the entire array -- but depending upon your answer to my questions, the logic in the lower shift register may be going away - so we won't worry about that right now.
The thing I need to know before addressing the data storage question is: Each time you call "Collect and Display Data.vi", how many element are in the array? Are you reading single data points, or a group of data? (BTW: if the answer to that question is obvious based on the way the other VIs are setup, I don't have the drivers so I can't tell what the setup values are.) Second, how fast does the loop iterate? Are we talking msec per loop?, seconds? fortnights?
The issues here are two-fold: how much data? and how fast is it coming? The answer to these will tell you how to save the data.
Mike...
Certified Professional Instructor
Certified LabVIEW Architect
LabVIEW Champion
"... after all, He's not a tame lion..."
Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps -
Append value with Data Storage Vis
Dear,
I would like to use the Data Storage VIs to collect my data but I can't achieve my target.
I'm acquiring 1000 samples at 1kHz (N samples on demand) and I make the mean value of the samples. At the end of this proces I have a scalar value and the initial time at wich I have acquired the data. With this two I build a waveform and then I use the Write Data Storage Vi (TDMS) with "append" write mode to save my data.
When I read the Data Storage all the value have lost the time information. They start from 1.00.00,000 01/01/1904 and are equal spaced in time.
How can I keep the time information?
ThanksSorry totaly misread what you were doing.
You need to create ensure that waverform that is saved has the correct values for X0 and dx when you save it. Use the build waveform function to acheive this.
edit:
the default value for X0 is timestamp 0 (1904), use get datetimestamp at the very start of the cycle to get the correct value.
James
Message Edited by James W on 04-21-2010 01:06 PM -
Trouble with Data Storage VI's
I am new to LabView Data Storage, I wrote a very basic program to write data to a data base and to read the data. for some reason I am unable to read the data. I am attaching the VI's, Please can any one tell me what I am doing wrong in the VI's.
Thank you,
Mudda.
Attachments:
Read DataBase.vi 156 KBMudda,
I modified your code and I'll attach it here for you to look at. First of all, you need to tell the data storage open what function to perform (e.g. Open, creat, or replace). Then, you need to make sure the file you're writing to is a .tdm file. Finally, you need to remove the "Signals" terminal from your read and write vi's. To do this, double click on the vi and uncheck the box for "Show terminals for data channel". If this is checked and the "signals" terminal is visible, then the refnum will not pass any info on the file unless a signal is actually connected. So take a look at the code and see if you have any questions.
Tyler S.
Attachments:
write.vi 108 KB -
Windows 7 64bit Raid 1 Data Storage setup with UEFI and 6TB drives
i just bought a GigaByte MB with UEFI bios, 1 SSD 128GB drive for the OS (boot up), and 2 6TB drives for use in a raid 1 setup for the data storage.
I have been able to install win 7 64bit using the UEFI dvd drive. I have been able to define the 6TB mirror via the bios (under the Intel Rapid Storage Technology option) . But when ever i go into windows, and check under Disk Management, i don't
see the raid 1, i see two drives listed for the data, each at 1492 GB. I should be seeing 1 drive at 5.4TB.
note: I have tried re-installing win7 64bit many times to see if i have missed something. When i run setup off uefi dvd drive, i see that drive 1 (of what should be part of the mirror) and drive 2 are listed there at the reported 1492 GB size each.
So it seems that win7 doesn't see that mirror that i created via the bios. So is this a bios setting problem somewhere? i presume on this screen i should see the correct mirror size already.
Also, do i need to install win7 via the uefi dvd if i don't want to boot off those large drives (i just want to boot off the ssd. But when i did try that using a legacy mode, i couldn't later try to create a single large drive for the mirror using
GPT formatting. it just wasn't an option. although the mirror was recognized as 1 drive, but broken into 2TB and 3TB.)
what could i possibly be doing wrong??
Thanks for any helpThank You Roger. I did call Gigabyte. This is how i solved it with the gigabyte support team.
1. Don't try installing Win7 64bit sp1 and setup RAID at the same time. (even go ahead and unplug those raid drives if you have it plugged in). The OS should be installed first on the boot drive, but make sure the BIOS is already set
to RAID (not AHCI. If you already installed OS under AHCI, you need to reinstall OS. i find this crazy because what if you decide to install raid down the road.. to an existing machine.. you can't do that because of this). Make sure
to install OS with the UEFI dvd drive option (i had done this).
2. Once the OS is installed, install all drivers that come for the Motherboard... That should include intel Raid drivers. (note gigabyte support didn't tell me to do this, but i didn't want to take a chance to have to reinstall OS again or have more problems,
but it makes sense.)
3. Now i have the GA-H97-Gaming 3 mother board, it had Bios F3. I upgraded it to F5 as per support tech.
4. turn off machine, and replug in the two 6TB drives.
5. after reboot, i find out that i no longer see Intel RAPID Storage Technology. (this should have displayed when i set the SATA Mode Selection to RAID before i started all this business... it did under bios F3, but not under F5.. bug?? i think so,
so i plan on letting gigabyte know about this). This is a problem. In Intel RAPID Storage Technology is where you define the RAID in the first place. OK, well after several reboots.. i tried to use CTRL-I to get to intel's interface
rather than that of the gigabyte bios. Voila... i define the Mirror...
6. I am able to boot into OS. I got to Drive Management. I now see 1 6TB drive. I initialize it of course using GPT. Format it. All all looks good now.
Hope this helps someone.. took me enough tries to get it right. I really am bothered about requiring the OS installed in the correct SATA mode just to get RAID working. As i mentioned, you can't change your mind afterwards without reinstalling
OS. Also i couldn't even get the OS setup to start when i had those raid drives plugged in.. so make sure to unplug them.
Best Regards.
Maybe you are looking for
-
How to get a title view at run time
I want to insert a title for a report which shows title "The Monitor name selected is ------" and whatever selected in the prompt should be displayed along with the static title... I have done with formula @{parameter} and iam getting the desired res
-
G3 won't start from HDD (CD-Rom OK, Flashing ? & Mac Logo)
Hi All, I recently purchased a 2nd had Power Macintosh G3 (Blue & White) from the local school who were using it as their server. When I got it home and plugged the monitor, keyboard, mouse and power in I fired it up. All I get is a "?" inside a fold
-
Find available space in buffer cache
Hi. I want to find available space from buffer cache. First thought was to make it 8i-9i comp, by not using v$bh to calculate sum of memory and available space. I have the following pl/sql block to calculate the values: declare num_free_blck integer;
-
How do I change incorrect locations in Photo Stream and Map?
Have updated to iOS 7 and some photos, taken on the same day, and in the same location are said to be in another town. Clicking on the area name in Moments brings up a map, and the photos are shown in two different areas, three hours apart! Can I cor
-
Hi All, I have added a select field under the identity tab of the 'Tabbed User Form'. Once a value is selected i want that value to be displayed under the 'attributes' tab. I added the field (xxx) in 'Default user library' and referenced it in 'User