Trickle-feed Mapping

Hi gurus,
Do you have any experience on developing a trickle-feed mapping in OWB 11gR2?
It'd be appreciated if you could kindly share it!
Iman

From the Essbase 9.3.1 readme:
The aggregate storage database model has been enhanced with the following features:
- An aggregate storage database can contain multiple slices of data.
- Incremental data loads complete in a length of time that is proportional to the size of the
incremental data.
- You can merge all incremental data slices into the main database slice or merge all
incremental data slices into a single data slice while leaving the main database slice
unchanged.
- Multiple data load buffers can exist on a single aggregate storage database. To save time, you
can load data into multiple data load buffers at the same time.
- You can atomically replace the contents of a database or the contents of all incremental data
slices.
- You can control the share of resources that a load buffer is allowed to use and set properties
that determine how missing and zero values, and duplicate values, in the data sources are
processed.
See the Hyperion Essbase - System 9 Database Administrator's Guide, the Essbase Technical
Reference, and the Essbase Administration Services Online Help.

Similar Messages

ASO Trickle feed

Good morning
I see in the ORACLE literature concerning ASO cubes that it refers to sending slices of data to the cube as "trickle feed". Is this because the send function for the ASO cubes is not nearly as robust as Block storage? If not, what is trickle feed and how is it different from sending data?

Trickle feed is the (I think) old marketing name for ASO slices. Check out the DBAG, Tech Ref for more about it. Also, Angie Wilcox presented on slices at ODTUG's Kscope12 -- you can download the presentation for free from odtug.com's Technical Resources.
I believe at one time ASO databases could not have incremental data -- additional data forced clears and full loads. Slices are just a way to load additional data to an already populated ASO cube -- it's an incremental data load.
There's nothing less robust about ASO sends (which, btw, is a itsy-bitsy slice), but they are different than BSO lock-and-sends. Again, the docs will explain.
Regards,
Cameron Lackpour

ASO trickle feed option

Hi All
Can someone please explain me what is Essbase's trickle feed option in details and how can one use it?
I'm looking for the ways to build near real-time cubes and heard that potentially 'trickle feed' option introduced in Essbase 9.3.1 could help, but unfortunately there is no any word in manuals regarding this..
Thanks,
Dmitry

I have attempted this in the pass. I'm not sure about the term "trickle feed".
But the technique that I had the most success with was:
import database sample.basic data
from data_string
'"Sales" "COGS" "Marketing" "Payroll" "Misc" "Opening Inventory" "Additions"
"Ending Inventory" "100-10" "New York" "Jan" "Actual"
678 271 94 51 0 2101 644 2067'
on error abort;
Your automation process can build this string in real-time. You might want to setup committed access to a BSO cube, just in case you need to have rollback capabilities.
Brian Chow

Trickle Feed

Hi All Gurus,
Can anyone please explain me how Trickle feeds work in ASO ?
As per my knowledge, it means the data is loaded into slices (buffers) and at the same time the old data is available to users. then we can merge all the slices and load the data to the cube. But my question is , can the users access the data even when the data will be loaded to cube from slices ? I tried looking for this answer on DBAG but was unable to find it.
Thanks

There have been a few posts on this subject in the past, these should give you more information
"trickle-feed" ASO Essbase
ASO trickle feed option
Re: is the essbase suit for near real time data analysis?
The user does not see the slice and will retrieve as normal.
Cheers
John
http://john-goodwin.blogspot.com/

"trickle-feed" ASO Essbase

Hi all,
What is "trickle-feed" ASO Essbase...
Thanks

From the Essbase 9.3.1 readme:
The aggregate storage database model has been enhanced with the following features:
- An aggregate storage database can contain multiple slices of data.
- Incremental data loads complete in a length of time that is proportional to the size of the
incremental data.
- You can merge all incremental data slices into the main database slice or merge all
incremental data slices into a single data slice while leaving the main database slice
unchanged.
- Multiple data load buffers can exist on a single aggregate storage database. To save time, you
can load data into multiple data load buffers at the same time.
- You can atomically replace the contents of a database or the contents of all incremental data
slices.
- You can control the share of resources that a load buffer is allowed to use and set properties
that determine how missing and zero values, and duplicate values, in the data sources are
processed.
See the Hyperion Essbase - System 9 Database Administrator's Guide, the Essbase Technical
Reference, and the Essbase Administration Services Online Help.

OWB Trickle Feed Mode

Just attempting to replicate some de-que functionality currently encoded in PL/SQL using Oracle Object Types as the transport mechanism for the AQ.
Following David Allans blog reveals a few issues:
http://blogs.oracle.com/warehousebuilder/2009/09/owb_11gr2_trickle_feed_data_acquisition_and_delivery.html
The first is that the Single Subscriber Queues are not being imported by OWB but the Multi Subscriber Queue is, the second issue is that the mapping will not compile using the Multi Q and an error is returned:
VLD-4257: The real-time driver queue RECON_Q is not a streams queue
Select a streams queue as the real-time driver queue
Any ideas? I know this is 11.2 frontier stuff.
Edited by: NSNO on May 5, 2010 11:10 AM

Hi Paul
These are some odds and ends I have found behind the reasoning. There are several limitations using a single consumer queue. Some of them are
* You cannot add subscriptions (or subscribers) to single-consumer queues.
* To be able to add recipient and subscriber , the queue must reside in a queue table that is created with the multiple consumer option. Remember that the recipient list over rides the subscriber list and allows producers to control message dissemination.
* You can propagate messages from a multi consumer queue to a single-consumer queue. The reverse is not possible (as far as I know at least until 11gR1).
* Consumers of a message in multi consumer queues can be local or remote.
* Multicast and broadcast models not feasible with single consumer queue.
* In 10g and later (I think) , Queue monitor removes messages from multiconsumer queues. This allows dequeuers to complete the dequeue operation by not locking the message in the queue table. This got rid of the only sore point for multi consumer queues.
Single consumer queues are cookie cutter solutions between two applications that exclusively talk to each other and have no use beyond that. The multi consumer queues are more versatile.
Cheers
David

CDC in OWB 11.2

Hi guys,
2 question regarding setting up Change Data Capture (CDC).
1. In OWB 11.2, is using CT Mapping the only way to perform CDC?
2. Is CCA (Control Ctr Agent) required if I am in all Oracle Environment (CT mappings)? (Source: Ora 10.1, Target 11.2)
I would like to avoid using CCA if it's not needed.
Thank you.

Hi
As well as the CDC template mapping, there are a bunch of options for CDC including anything from Streams to replicate environments (also OWB supports trickle feed maps for AQs in 11gR2), or you can use your own replication technology such as Oracle Golden gate and simply work off of the replicated tables.
If you are in an all Oracle environment, code template mappings are not essential, proof being all previous releases did not have them - they do bring a lot of alternatives to the table which let you do more and faster than before.
Cheers
David

Example iTunes U Atom feed?

Hi
We’re making arrangements to set up an iTunesU store for our university. We're also building a sql database which will publish our media content through to our CMS and build the web feeds. So I need to ensure the web feeds are compliant with iTunes U.
I understand that iTunesU will accept rss and atom feeds but that atom is the preferred format because it affords the publisher the option of specifying multiple media types in a single feed item. i.e. in an atom feed you could specify multiple mp3's or an mp3, mp4, m4v etc in a single feed item. Is that correct?
Also, can you point me to examples of well formed iTunes U atom and rss feeds? Perhaps you have some example feeds on the Apple website?
Thanks

As always, standard disclaimers apply, I defer to Duncan for an official reply.
I would not say that RSS is preferred to Atom necessarily. Rather, the basic consideration for the iTunes U admin is what each of those feeds "maps" to within iTunes U. In iTunes U, an RSS feed can be made to map to a group (that is, a tab within a course). An Atom feed, on the other hand, maps to a whole course and creates groups (tabs) as required by the feed. Often, within a course, you create tabs to match media types ("Video", "Audio", "PDF", etc.). But in principle, and so far as I know, the course-to-Atom feed mapping can be anything that is logical…that "makes sense"…for your site.
In effect, Atom gives the iTunes U admin a very simple way to automate the creation of a course and link it to a single (Atom) feed. In the past, an admin would first have to create the course, then tabs, then link each tab to a separate RSS feed.

SAP BW 3.52 and POS DM: Architecture Best Practise

We are retail/wholesale company that are two different business units. Currently we are running SAP BW 3.0 that is integrated with SAP R/3 and APO for reporting purposes. We are now in the early stages of implementing SAP Retail along with SAP POS DM to support the Retail business. We have a question re the architecture and the best practices. We were told that POS DM is integral part of SAP BW 3.52 i.e. a function within BW application. We would like to run the retail instance of SAP BW on a separate box and separate the POS DM onto another box. The reason being, POS DM processes all the store POS transactions through either to IS-Retail or SAP BW. We believe the transaction processing that occurs in POS DM should be separated from SAP BW, in order maintain efficiencies. Can anyone share their perspective and experience on what the best practice would be? Also, is it possible to do what we would like to do i.e. POS DM and BW running on different boxes?
Please advise.
Thanks
Satish Seshayya

Information about POS DM should come within the next time as a Update of the Solution Manager.
Some Remarks :
The best way to get some information is to contact SAP-Sales The most of my customers run POS DM on the same Box as BW.
A typical process will look like this :
POS System is mapped via Converter (e.g. XI) to the BAPI of the PIPE (/posdw/bapi_postr_create). Also you could feed the PIPE via IDOCS or via direct input (Proxy).
You've got some internal tasks running for validation of the data (sequencing, duplicate...) and you can schedule other tasks to supply the R/3 with IDOCs and to write Data to the DeltaQueues where BW can take the Data.
You can plan everything time-based. Thats meaning as long you don't have a huge amount of data (e.g. >12.000.000 LineItems/day) you should get no big problems with the right hardware.
Also you're able to do "trickle feed", that's more or less an immediatley processing of the data (e.g. directly or every 2 hours)
wish u much luck

Loading data using send function in Excel to aggregate storage cube

Hi there
just got version 9.3.1. installed. Can finally load to aggregate storage database using excel essbase send. however, very slow, especially when loading many lines of data. Block storage much much faster. Is there any way you can speed up loading to aggreagate storage data base? Or is this an architectural issue and therefore not much can be done?

As far as I know, it is an architectural issue.. Further, I would expect it to slow down even further if you have numerous people writing back simultaneously because, as I understand it, they are throttling the update process on the server side so a single user is actually 'writing' at a time. At least this is better than earlier versions where other users couldn't even do a read when the database was being loaded; I believe that restriction has been lifted as part of the 'trickle-feed' support (although I haven't tested it)..
Tim Tow
Applied OLAP, Inc

Best way to keep Essbase data available at all time

Hi all,
We are trying to find out the most suitable way of designing our Essbase cubes so that the data is available to user all the time even during data replication and aggregation.
We may have aggregate the cubes every one hour and cubes will both ASO and BSO.
Can someone give some direction on this? Can we use trickle feed for ASO and or clustering is a better option? Also what kind of clustering will be best suited for this?
Any other tip wlll be really helpful.
Many thanks.

U do not need aggreate ASO
becouse all agregates calc automaticaly with user retrive process . But u may have to use material view for store most popular report on storage.
Please provide more details
1) What you decision - Budgeting or only Reporting
2) How many interactive concurent users
3) How many members in mesures, count of dimensions, count members in dimensions,levels in dimensions
What are reporting tool u using ?

Mytracks & mapmyride gps apps failing

Hi
Having issues using mytracks and mapmyride apps. Both apps are failing to plot my route & calculate pace and/or distance.
Found similar issues on other droid boards but no solutions.
Let me know if you need any more info... here's a log snippet.
Thanks in advance!
Log Collector version: 1.1.0
Device model: ADR6350
Firmware version: 2.3.3
Kernel version: 2.6.35.9-g6760582
htc-kernel@and18-2 )
#1 PREEMPT Fri Jun 3 13:17:05 CST 2011
08-08 20:05:48.389 V/LocationManagerService( 1461): requestLocationUpdatesLocked: updateProvidersLocked
08-08 20:05:43.354 I/ActivityManager( 1461): Starting activity: Intent { act=android.intent.action.MAIN cat=[android.intent.category.HOME] flg=0x10200000 cmp=com.htc.launcher/.Launcher } from pid 1461
08-08 20:05:43.614 W/InputManagerService( 1461): [unbindCurrentClientLocked] Disable input method client.
08-08 20:05:43.614 W/InputManagerService( 1461): [startInputLocked] Enable input method client.
08-08 20:05:46.998 I/ActivityManager( 1461): Starting activity: Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] flg=0x10200000 cmp=com.google.android.maps.mytracks/com.google.android.apps.mytracks.MyTracks bnds=[240,234][357,352] } from pid 8666
08-08 20:05:47.058 I/ActivityManager( 1461): Start proc com.google.android.maps.mytracks for activity com.google.android.maps.mytracks/com.google.android.apps.mytracks.MyTracks: pid=14993 uid=10113 gids={3003, 3002, 3001, 1015}
08-08 20:05:48.379 V/LocationManagerService( 1461): requestLocationUpdates
08-08 20:06:34.924 D/RPC ( 1461): read RPC packet
08-08 20:06:34.634 E/MyTracks(14993): Got auth token.
08-08 20:06:34.644 D/MyTracks(14993): Loggin success for local!
08-08 20:06:34.644 D/MyTracks(14993): MyTracks.onActivityResult
08-08 20:06:34.654 D/MyTracks(14993): Sending to MyMaps: trackId = 10
08-08 20:06:34.654 I/MyTracks(14993): Build query: SELECT * FROM tracks WHERE (_id=10) ORDER BY _id
08-08 20:06:34.704 D/SurfaceFlinger( 1461): layer=0x13ab878 is not in the purgatory list
08-08 20:06:34.744 D/MapsApi (14993): Creating a new map.
08-08 20:06:34.754 D/MapsApi (14993): Map feed is http://maps.google.com/maps/feeds/maps/default/full?v=2.0
08-08 20:06:34.754 D/MapsApi (14993): Title: 2011-08-08 20:05
08-08 20:06:35.415 D/MyTracks(14993): SendToMyMaps: Done: false
08-08 20:06:35.395 D/MapsApi (14993): New map id is: 203121111332841933753.0004aa07555812d66d5db
08-08 20:06:35.405 I/MyTracks(14993): Build query: SELECT * FROM trackpoints WHERE (trackid=10 AND _id>=0) ORDER BY _id ASC
08-08 20:06:35.415 W/MyTracks(14993): Unable to get any points to upload

Thanks for the link but still no luck with my gps apps...
Tried the following tips:
1) Installed GPS Status. Reset AGPS -> restarted phone -> DL new AGPS
2) After clearing this data, you will want to turn the phone off and then back on again.
We'll, first, want to make sure that location services are enabled. To enable Location, go to Home > Menu > Settings > Location.
On this screen, you will see a check-box for allowing Wi-fi or Data connection (Use Wireless Networks) to detect Location, and also a check-box for GPS Satelittes being able to detect your Location. For Location to detect properly, either one of the two data sources needs to be turned ON (this is not optional, as all data needs to be passed through a Google server), and the check box for allowing data connection to detect your Location needs to be checked.
If Location is enabled, there may be a setting such as Auto-Sync or Background data that is not that does not allow the Weather/GPS to update itself. To ensure that this is working properly, go to Home > Menu > Settings > Accounts & Sync. Check the boxes for Auto-Sync and Background data.
You will also want to make sure that a development option called "Mock location" is turned off. Go to Menu > Settings > Applications > Development > Uncheck "Allow Mock Locations". Having this checked will not allow the phone to accurately pinpoint your Location.
Also, if you're using Advanced Task Killer, or similiar application, this could be disabling the process for detecting GPS. Try removing any 3rd party task management software.
This could be the result of the phone using only cached data. You can also clear the Application data for Weather & maps, forcing the phone to download all new information. To do this, navigate to:
Menu > Settings > Applications > Manage Applications > Weather. Clear Data/Cache.
Menu > Settings > Applications > Manage Applications > Maps. Clear Data/Cache.

How to replicate data between Oracle db and SQL server dbs in real time?

Hello,
Anyone has idea that what tool we can use to do data replication in real time between Oracle and SQL sever or Oracle and Sybase or Sql server and Sybase?
This is topic is brought by a project manager?
I only know Oracle to Oracle dbs by streams or GoldenGate.
Thanks
Jerry

Since GoldenGate's bread and butter was (and is) replicating data between heterogeneous data sources, and since Oracle has purchased GoldenGate, that would seem like a natural place to start.
Beyond that, it depends on the architecture you want and how you define "real time." Just about any ETL tool on the market, whether Oracle's ODI or OWB or any number of third party products (Informatica, DataStage, etc) can handle "trickle feeds" from various data sources to a database target of your choosing. Different tools will have different sorts of integration with the source database, many will require that a bunch of triggers are created to track changes on the source systems.
If you want Oracle to control the replication process (which doesn't really make sense if we're talking about replication from a non-Oracle database to another non-Oracle database), you can use the Oracle Transparent Gateway products to create database links from Oracle to the non-Oracle databases and query data on the source database periodically.
Justin

What about data warehousing?

I have attended the 10g launch, perused the CD I got there and listened to a couple of online seminars. I can easily envision how 10g benefits OLTP applications, but data warehousing seems to be ignored in the presentations.
Does 10g offer anything over 9i for data warehousing, which has quite different resource demands? Is there any published information I could read?

DATA WAREHOUSING
Oracle Database 10g has also enhanced its data warehouse and business intelligence capabilities, which results in
further reduction of the total cost of ownership while enabling customers to derive more value from their data and
supporting real time data feeds.
Consolidation and integration of traditionally disparate business intelligence systems into a single integrated engine is
further enhanced in Oracle Database 10g. Database size limits have been raised to millions of terabytes. Business
Intelligence applications can be consolidated alongside transactional applications using Real Application Clusters
automatic service provisioning to manage resource allocation. This consolidation means analysis can be performed
directly against operational data and resource utilization can be maximized by reallocating servers to workloads as the
business needs change. The value of data is increased with the ability to perform even more diverse analytic
operations against core data with enhanced OLAP analytics, a data mining GUI and a new SQL model feature. The
SQL model cause allows query results to be treated as sets of multidimensional arrays upon which sophisticated
interdependent formulas are built. These formulas can be used in complex number-crunching applications such as
budgets and forecasts without the need to extract the data to a spreadsheet or perform complex joins and unions.
Real Time Warehousing is enabled either by consolidating business intelligence with operational applications, or by
new change data capture capabilities based on Oracle Streams which produce low or zero latency trickle feeds with
integrated ETL processing.
Joel P�rez

ODI DEF

Hi ,
Oracle Data Integrator is a comprehensive data integration platform that covers all data integration requirements: from high-volume, high-performance batch loadss, to event-driven, trickle-feed integration processes, to SOA-enabled data services.
What is batch loads ?
What is event driven?
What is trickle-feed integration?
What is SOA-enabled data services?
Please explain me as iam new to the ODI environment
Thanks in advance!

What is batch loads ?You have data coming in bulk from a system maybe in form of nightly batch of files. These maybe millions of records which are integrated into the system as a batch.
ODI has support for batch loads of data.
What is event driven?ODI Wait components can wait for events to happen and then trigger an integration process. Eg. OdiFileWait component can keep scanning a directory for a file and when the file arrives, it can start the integration process. Similarly, odiWatForData can ping a table to see if the number of records have been inserted into it and then initiate an integration process.
What is trickle-feed integration?ODI has support for Messaging Queues like MQ. More theory can be found [ here| http://technology.amis.nl/blog/2409/the-trickle-feed-integration-pattern ]
What is SOA-enabled data services?Webservices can be used to perform data integration tasks.
HTH

Trickle-feed Mapping

Similar Messages

Maybe you are looking for