OWB in real time data warehousing?

Does anyone have used OWB in a real time data warehousing environment (i.e. no batch processing)?
What limits are there in data throughput?
Any hints are welcome
Mirko

OWB does not currently support real time data warehousing. Currently what you can do is to use the advance queue operator in a mapping as a source/target and run the mappings as frequently as needed for your particular situation. Note that the mappings will still run in bulk mode (i.e. the messages will accumulate in the queue until the mapping is run and will be dequeued in bulk when the mapping is executed).
By creatively (=often) scheduling this mapping you can simulate a RTDW behavior, but this is still a far cry from a real RTDW system.
The next major release (in November) will have extensive support for RTDW.
Regards:
Igor

Similar Messages

Build a message driven (HL7) real time data warehousing

How far is practical to build a message driven (HL7) real time datawarehouse on a EAI,which can be used for BI , considering the issues of data cleansing, integrity that are relevent in Healthcare instead of a traditional datawarehouse ?

Hi A.Lal,
Since you have mentioned ECC5.0,Assuming that the client is generating the following reports in ECC,already:
The Production report (ZPRD)
Wastage Report (YWR)
A Charge Register Report
then brainstorm the PP functional consultant and try to pick the R3 Fields from the reports.Then its all about mapping them to the BW Info objects.
If these reports are not maintained at ECC ,then you need to have sessions with the users/PP Consultant to decide whether u can go ahead with BC or get some customizing done..
Goodluck

Error "cannot load request real time data targets" for new cube in BI 7.

Hi All,
WE have recently upgarded our SCM system from 4.1 to SCM 7.0 which incorporated BI 7.0.
I am using BI 7.0 for first time and ahve the following issue:
I ceated a new infocube and data source of flat file and succesfully created transformation, and Data Transfer Process. Everything looked fine. I added flat file and checked preview and could see data. Now when I start job to load data in infocube the follwing error is shown "cannot load request real time data targets".
I checked cube type in setting in infcune is shows as Standard. When I doube clicked on error the following message showed up
You are trying to load data into a real-time InfoCube using a DTP.
This is only possible if the correct load settings have been defined for the InfoCube.
Procedure
In the object tree of the Data Warehousing Workbench, call Load Behavior of Real-Time InfoCube from the context menu of the InfoCube. Switch load behavior to Transactional InfoCube can be loaded; planning not allowed.
I did not understand what it is meant and how to set changes. Can someone advice and follow me through.
Thanks
KV

Hi Kverma,
Real-time InfoCubes can be filled with data using two different methods: using the transaction for entering planning data, and using BI staging, whereby planning data cannot be loaded simultaneously. With Real time cube you can select the method you want to use for update as
Real Time data Target can be loaded With Data; Planning not allowed &
Real Time data Target can be Planned; Data loading not allowed
You can change this behaviour by right clicking on cube and selecting Change real time load behaviour and select first option. You will be able to load the data then
Regards,
Kams

Display real time data on a plot in a sub VI and main VI

I am building a program to measure and plot real time data. Program has several steps so I build few Sub VIs to make it simple. My problem is I am plotting real time data in my SUB VI(it works fine), but in my main program when I try to get the same plot its not real time data plot. Plots appear at the end of the program. All tips and help would be greatly appreciated. Thanks
I have attached my main VI and Sub VI
Solved!
Go to Solution.
Attachments:
main VI.jpg ‏116 KB
Sub VI.jpg ‏242 KB

LabVIEW program is based on DATA FLOW, now, until the subVI will finish execution (while loop will be stopped), the execution in Main VI will not proceed any further.
If you can pass the reference of 'XY Graph' inside the subVI, you'll be able to update the plot (placed on MAIN VI) from within subVI.
Find attached example for your reference.
I am not allergic to Kudos, in fact I love Kudos.
Make your LabVIEW experience more CONVENIENT.
Attachments:
Example [LV 90].zip ‏26 KB

How to count occurences of a certain string in incoming real-time data? Also displaying RTC data. Current VI included

I use LabView student Express 7 on a Windows XP system.
Time-frame: we are doing final integrations for our balloon experiment today. We just got told that the press wants to view real-time data, which we haven't programmed for. I need help to get a working VI at the latest by 25.02.2004 before 0800(morning) (GMT+1).
Note on license
It is a student balloon flight, and the data will not be used in scientific work, so the I am not breaking any license agreements (I hope).
Problem synopsis:
The balloon continually transmits data at 9600baud. The data is a semi-repeating header followed by a constant lenght data-package arranged like this:
BEXUS[h][m][s]BEXUS[h][m][s]
[Raw binary data, 7channels*8sub-channels*8bits]
What the groundstation is doing right now:
Take all incomming data and save (append) the data to a file without any data-handling. (We figured we would go post-processing).
What I need to change in less than 24 hours:
- Add a "package" counter
- Add a display of the clock data (RTC)
How I planned to implement the changes:
-RTC display:
The RTC data is in BCD format, since that means that if you look at the data as hex numbers, you get the hours and minutes and seconds out in "clear text". That is 12 hours is 0x12hex. I figured that I can do a match pattern BEXUS and pass the "after substring" to another match pattern BEXUS from which I feed the "before substring" to a type-cast VI (casting string to u8) and displaying that, which should give me a display of "123000" for the time 12:30:00... I couldn't get it to work at all when I tried out the supplied "beta" vi.
- Package counter:
Counting how many BEXUS that gets detected and dividing by 2. I don't know how to do this. I've looked on the forum (a good thread on the problem: "how do I count the number of *'s in a string") but these use either loops or arrays... and I'm not sure how this works when I'm getting the data in at realtime. I cant make an array and then count it, since then the array would grow fast and possibly interfere with saving of the data??? Saving the data is critical.. without that file we cant do post-processing.
Since my time is so limited (I'm not even supposed to do the groundstation software but they called on me in the last minute because no-one else had time/wanted too/could do it) I hope that you could make an exception and provide me with working VI's (based on the one I have attached) so that I can show something to the press! (Free comercial for NI!! Since the student version shows the National Instruments water-mark on all VI's!!! Possible TV time!!)
Thanks!
PS: even if you are to late (after 25) post anyway!
Why:
-I can learn from it
-the launch might be delayed due to weather conditions
-others might find it amusing!
Thanks again!
Attachments:
BexusII_groundstation.vi ‏46 KB

I have a valid example data file attached to this thread.
If you open BEXTEST.bin in a hex-editor of your choice, you'll see the BEXUS as 42 45 58 55 53 and then the time as 00 28 09 etc.
I couldn't get Joe Guo's VI to work. It doesn't count packages correctly, and the time is not displayed correctly either.
The file was saved using a straight save to file VI.
The data is from actual launching area tests performed a few mintues ago. The time displayed is "On time" e.g. how long the gondola has been powered up.
I have a spare T-junction, so I can hook into the balloon real-time data as we fly, in case anyone care to see if they can figure out why the latest version of Joe Guo's program is not displaying correctly.
I will monitor this
thread during and after flight to see if anyone can make it in time!
Thanks for the great effort!!
Attachments:
bextest.bin ‏53 KB

Error when activating Real Time Data Source

Hi..
I created a generic datasource in R/3 system via RSO2, with the Real-time check box enabled in the settings for Generic Delta. I saved the datasource. Replicated it into BW System.
I tried to activate this Real time Data Source in BW, it says "Error when activating Data Source".
I am on BI 7.0, with PI_BASIS: 2005_1_700.
Please let me know if you need any further information.
Thanks,
Sai.

Hi sai,
Can you specify from where you have created your geneic data source like by using DB tabl/view/infoset query.
am

Creation of Daemon for the DTO for the real time data aquisition

Hi i need help how to create a daemon for the DTP in the real time data aquisition.i'm learning now Sap and practicing a lot to be professional but i need a bit of hel.Can you please give me some details how to create it?
I have to access the RSRDA T-code and what i need to do after?

Hi First of all you need to create a real time DTP once that is done go to RSRDA T-code and click on the Create Daemon
and right click assign DTP , here you can assign the DTP once that is done save and execute . your Daemon will run
Thanks
Santosh

Need Suggestion On Real Time Data Accees

Hi,
Our application (let say A) runs on * 8.1.7.4.0*
Another Application (let say B) runs on *10.2.0.4.0*
Both the application A and B exchange data through DB links.
Both the application A and B perform select and DML on other tables.
Application A has views (approx. 10 views) on application B 's table through DB links.
Application B also has views (approx. 50 views) on application A 's table through DB links.
Application A has store procedure (approx 10 SPs) through which it does insert/update on two of application B 's table approx 15K call of that procedure per day.
Application B also calls some of the application A 's procedure to insert/update data in application A 's table.
Currently both the application's data center are at the same place. But, there is a proposal/need to move application B's data center far away from the current location. Because of these we are in a assumption that DB Link over WAN will create performance issue and searching of probable replacement.
After of couple of discussion we have identified approx five application A 's tables which are frequently accessed by application B and expect real time data.
Similarly, Application A expect real time data from two application B 's table.
'Golden Gate' mechanism came in our discussion, butt it's expensive,
Can we replace this store procedure code/dml with web service call or so ??
Can anyone suggest ... what kind of approach we should take here ?

Views which are residing in application A 's side use many internal tables and one or two application B s table.
I don't have idea on 'multi-master replication ' ... is it two way replication ..? ... you aware of any documentation I can refer ..? How costly it is (if you can give an idea) ?
Also, among many tables we need near real time (2 mins interval) replication on 5 tables.
MVs again have dependencies on DB link, which exactly what are trying to replace (assuming performance issue)
With fast refresh (let say 2 minutes interval) method on MVs do you think it could cause performance issue specially when data center are at different location ?

BI 7.0 Question on RDA (Real Time Data Acquisition)

Those who have all implemented RDA (real Time Data Acquisition) in BI 7.0, could you please tell me if this is limited to only a few of the extractors or available to all the business content extractors. Reason I ask this question is I read that if you have PI_BASIS 2005.1 then RDA is possible, but when I go into ROOSOURCE table in R/3 I do not see the Real time flag checked for any of the transactional Businees content extractors!!
Also does this mean that we need to set this flag manually and if so is this supported by SAP? please throw in expert your responses...
Ram

Dinesh, thank you...after going throught the posts I am still more confsued and not sure if SAP supports any Business content data sources as RDA Capable yet...also if someone has successfully implemented RDA for any of the following applications please do reply back, thank you...
1. Plant maintenance
2. GL
3. EC-PCA
thank you

Real-time data acquisition for HR datasources

Dear Experts,
I have a couple of questions on real-time data acquisition...
a) Can you tell me if any standard HR datasources support real-time data acquisition?
b) Can we apply real-time data acquisition for generic datasources? If yes, is there any difference in the process compared to working with business content datasources when using real-time data acquisition?
Hope you can provide some answers...as always, points will be awarded for answers that effectively address the questions.
Thanks a bunch.
K

Hi Karthik,
a)The decision to go for SAP remote cube depends on the volume of data and the frequency of queries. It is advicible not to use the SAP remote cube if the data volume is high and also, the query frequency is high. Which module in HR are yuo implementing? In HR, the data volume is generally high. So, if you go for loading the data from R/3 every 3 hours, you are asfe as long as the loading volumes are less. For example, for implementing Time management, I would not advice frequent loads as it is time consuming process. So, make a decision based on the above mentioned lines. If the data volume is not high, I would prefer the SAP ermote cube as it will reduce managing the loads.
b)I mentioned FM extractor just for the sake of control of data selection. You can even go for view/table extractor.
Hope this helps.
Thanks and Regards
Subray Hegde

Call web service from OBI dashboard to show real-time data alongside data from DW

Hello,
OBI = 11.1.1.7.0
We have a requirement to pull in real-time data from an external, secure web service (WS) into an OBI report. The OBI report also contains data from the data warehouse (DW) along with a calculation that is derived from multiplying the DW and WS data . In theory, the behavior that were looking for is similar to the Action Link "Invoking a web service" whereby the call is made to the web service for each row of data. How would it be possible to achieve this result on an OBI report?
Desired Result of OBI Report
Product.......Qty.........Price........Potential Revenue
TV..............100...........$500..........$50000
VCR.............22............$75...........$1650
DVD..........2500............$20..........$50000
Breakdown of the data source for each column on the OBI report
Product.......Qty.........Price........Potential Revenue
DW............WS...........DW..........Calculated_on_the_fly_(qty*price)
DW............WS...........DW..........Calculated_on_the_fly_(qty*price)
DW............WS...........DW..........Calculated_on_the_fly_(qty*price)
Thank you,
Mike

Does anyone know if it's possible to call a webservice from an OBI report to populate a column's value? Thank you for your input.

RDA(real time data aquasation)

can anyone pl. tel me how the process goes in RDA(real time data Aquasation) means no steps internally.

Hi,
Real-Time Data Acquisition u2013BI 2004
Real-time data acquisition supports tactical decision-making. It also supports operational reporting by allowing you to send data to the delta queue or PSA table in real-time.
You might be having complex reports in your BI System, which helps in making decisions on the basis of data of your transactional system. Sometimes (quarter closure, month end, year ending...) single change in the transactional data can change your decision, and its very important to consider each record of transactional data of the company at the same time in BI system as it gets updated in the transactional system.
Using new functionality of Real-time Data Acquisition (RDA) with the Net Weaver BI 2004s system we can now load transactional data into SAP BI system every single minute. If your business is demanding real-time data in SAP BI, you should start exploring RDA.
The source system for RDA could be SAP System or it could be any non-SAP system. SAP is providing most of the Standard Data Sources as real-time enabled.
The other alternative for RDA is Web Services, even though Web Services are referred for non-SAP systems, but for testing purpose here I am implementing Web Service (RFC) in SAP source system.
Eg will be a production line where business wants information regarding defective products in the real time so that production can be stopped before more defective goods are produced.
In the source system, the BI Service API has at least the version Plug-In-Basis 2005.1 or for 4.6C source systems Plug-In 2004.1 SP10.
Refer:
Real-Time Data Acquisition -BI@2004s
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
http://help.sap.com/saphelp_nw2004s/helpdata/en/42/f80a3f6a983ee4e10000000a1553f7/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3db14666-0901-0010-99bd-c14a93493e9c
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3cf6a212-0b01-0010-8e8b-fc3dc8e0f5f7
http://help.sap.com/saphelp_nw04s/helpdata/en/52/777e403566c65de10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/webinar?rid=/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
Regards
Tg

How to Integrate real time data between 2 database servers

How to Integrate real time data between 2 database servers
May 31, 2006 2:45 AM
I have a scenario where the data base (DB2 400) is maintained by AS 400 application and my new website application based on j2ee platform access the same database also but the performance is very low. So we have thought of introducing new oracle data base which will be accessed by j2ee application and all the data from db 400 database will be replicate to oracle data base. In that scenario the only problem is of real time data exchange between 2 databases. How do we achieve that considering both the application As400 and j2ee website application are running in parallel and accessing the same information lying on DB2 400 database. We have to look at transaction management also.
Thanks
Panky
DrClap
Posts:25,835
Registered: 4/30/99 Re: How to Integrate real time data between 2 database servers
May 31, 2006 11:16 AM (reply 1 of 2)
You certainly wouldn't use XML for this.
The process you're looking for is called "replication". Ask your database experts about it.
I predict that after you spend all the money to install Oracle and hire consultants to make it replicate the DB2/400 database, your performance problem will be worse.
panks
Posts:1
Registered: 5/31/06 Re: How to Integrate real time data between 2 database servers
May 31, 2006 11:55 PM (reply 2 of 2)
Yeajh I now that its not a XML solution.
Replication is one of the option but AS400 application which uses DB2/400 DB is highly loaded and proposed website also uses the same database for retrieval and updation purpose.All the inventory is maintained in the DB2/400 database so I have thought of introducing new oracle database which will be accessed by new website and it will have all the relevant tables structure along with data from DB2/400 application. Now whenever there is a order placement from new website then first it should update the oracle database and then this data shuold also migrate to db2/400 application at real time so that the main inventory which is lying on db2/400 should be updated on real time basis because order placement is aslo possible from As400 application. So the user from As400 application should not get the wrong data.
Is it possible to use MQ products??
-Panky

Hi,
the answer to your question is not easy. Synchronization or integration or replication data between 2 (or more) database servers is very complicated task, even though it doesn't look like.
Firstly I would recommend to create good analysis regarding data flow.
Important things are:
1) what is primary side for data creation. In other words on which side - DB2 or Oracle - are primary data (they are created here) and on which side are secondary data (just copies)
2) on which side are data changed - only in DB2 side or only on Oracle side or on both sides
3) Are there data which are changed on both side concurrently? If so how should be conflicts solved?
4) What does it mean "real time"? Is it up to 1 ms or 1s or 1 min or 1 hour?
5) What should be done when replication will not work? I mean replication crash etc.
BTW. The word "change" above means INSERT, UPDATE, DELETE commands.
Analysis should be done for every column in every table. When analysis is ready you can select the best system for your solution (Oracle replication, Sybase replication server, MQ, EJB or your proprietary solution). Without analysis it will be IMHO gunshot into the dark.

Handling sequences in real time data transfer.

Hi,
We are merging two databases (real time data transfer).
One is oracle 8i and other is 9i.
Both databases are having some tables with same structure.
We want to transfer data from table in one database to table in other database.
We are implementing this functionality by using Adevanced Queueing.
Both side tables are using different sequences for generating primary key values and currently contains large volume of data.
The problem in inserting is, when we will be transferring any record from one table to other, the primary key value (sequence value) generated in both tables will be different.
So, if any particular record is updated in one table, How can we update the same record in other table ?
(As the primary key value would be different).
Thanks,
Shailesh

There must be some common data in the two tables, that identifies the record. That is, ignorng the sequence generated PK, how would you tell that two records referred to the same thing? You need to ignore the PK values, since they are meaningless surrogate keys, and use the natural key in the data to match the two talbes.
HTH
John

TDMS database and treat its values as real time data.

Hi,
I'm newbie in using labview. Actually I wanna import data from TDMS database and treat it as real time data. Although I have done the first part which is importing the data inside the program by reading TDMS and selecting channels and groups, I couldn't find way for second part which is treating data as real time one. I tried Build Waveform, but it didnt work. Would you please help me to solve this problem ? I appreciate your helps.

reza_amin,
I don't understand your word "build waveform". If you write waveform data to a tdms file, you will read waveform data directly from the tdms file.
If you are using LabVIEW 2012 (download from http://www.ni.com/trylabview), you could find a tdms example VI in "C:\Program Files\National Instruments\LabVIEW 2012\examples\file\plat-tdms.llb\TDMS - Concurrent File Access.vi". This example VI demonstrates how to write Sine Waveform into a tdms file and read the Sine Waveform from the tdms file.
Hope this helps and enjoy your LabVIEW journey. :-)
Best Regards,
Bo Xie

OWB in real time data warehousing?

Similar Messages

Maybe you are looking for