System performance VS Real-time Data Acquistition

How the ECC & BI system will be affected by Real-time Data Acquistition?
If it affects performance, Is there any way to maintain the same system performance as without RDA?
Need inputs on BI side, Basis and R3 side......

Hi,
Check the below link
http://help.sap.com/saphelp_nw04/helpdata/en/52/777e403566c65de10000000a155106/frameset.htm
Good Blog.
/people/kamaljeet.kharbanda/blog/2006/11/13/real-time-data-acquisition-bi2004s
/message/1921395#1921395 [original link is broken]
Regards,
Malar

Similar Messages

How to count occurences of a certain string in incoming real-time data? Also displaying RTC data. Current VI included

I use LabView student Express 7 on a Windows XP system.
Time-frame: we are doing final integrations for our balloon experiment today. We just got told that the press wants to view real-time data, which we haven't programmed for. I need help to get a working VI at the latest by 25.02.2004 before 0800(morning) (GMT+1).
Note on license
It is a student balloon flight, and the data will not be used in scientific work, so the I am not breaking any license agreements (I hope).
Problem synopsis:
The balloon continually transmits data at 9600baud. The data is a semi-repeating header followed by a constant lenght data-package arranged like this:
BEXUS[h][m][s]BEXUS[h][m][s]
[Raw binary data, 7channels*8sub-channels*8bits]
What the groundstation is doing right now:
Take all incomming data and save (append) the data to a file without any data-handling. (We figured we would go post-processing).
What I need to change in less than 24 hours:
- Add a "package" counter
- Add a display of the clock data (RTC)
How I planned to implement the changes:
-RTC display:
The RTC data is in BCD format, since that means that if you look at the data as hex numbers, you get the hours and minutes and seconds out in "clear text". That is 12 hours is 0x12hex. I figured that I can do a match pattern BEXUS and pass the "after substring" to another match pattern BEXUS from which I feed the "before substring" to a type-cast VI (casting string to u8) and displaying that, which should give me a display of "123000" for the time 12:30:00... I couldn't get it to work at all when I tried out the supplied "beta" vi.
- Package counter:
Counting how many BEXUS that gets detected and dividing by 2. I don't know how to do this. I've looked on the forum (a good thread on the problem: "how do I count the number of *'s in a string") but these use either loops or arrays... and I'm not sure how this works when I'm getting the data in at realtime. I cant make an array and then count it, since then the array would grow fast and possibly interfere with saving of the data??? Saving the data is critical.. without that file we cant do post-processing.
Since my time is so limited (I'm not even supposed to do the groundstation software but they called on me in the last minute because no-one else had time/wanted too/could do it) I hope that you could make an exception and provide me with working VI's (based on the one I have attached) so that I can show something to the press! (Free comercial for NI!! Since the student version shows the National Instruments water-mark on all VI's!!! Possible TV time!!)
Thanks!
PS: even if you are to late (after 25) post anyway!
Why:
-I can learn from it
-the launch might be delayed due to weather conditions
-others might find it amusing!
Thanks again!
Attachments:
BexusII_groundstation.vi ‏46 KB

I have a valid example data file attached to this thread.
If you open BEXTEST.bin in a hex-editor of your choice, you'll see the BEXUS as 42 45 58 55 53 and then the time as 00 28 09 etc.
I couldn't get Joe Guo's VI to work. It doesn't count packages correctly, and the time is not displayed correctly either.
The file was saved using a straight save to file VI.
The data is from actual launching area tests performed a few mintues ago. The time displayed is "On time" e.g. how long the gondola has been powered up.
I have a spare T-junction, so I can hook into the balloon real-time data as we fly, in case anyone care to see if they can figure out why the latest version of Joe Guo's program is not displaying correctly.
I will monitor this
thread during and after flight to see if anyone can make it in time!
Thanks for the great effort!!
Attachments:
bextest.bin ‏53 KB

How to Integrate real time data between 2 database servers

How to Integrate real time data between 2 database servers
May 31, 2006 2:45 AM
I have a scenario where the data base (DB2 400) is maintained by AS 400 application and my new website application based on j2ee platform access the same database also but the performance is very low. So we have thought of introducing new oracle data base which will be accessed by j2ee application and all the data from db 400 database will be replicate to oracle data base. In that scenario the only problem is of real time data exchange between 2 databases. How do we achieve that considering both the application As400 and j2ee website application are running in parallel and accessing the same information lying on DB2 400 database. We have to look at transaction management also.
Thanks
Panky
DrClap
Posts:25,835
Registered: 4/30/99 Re: How to Integrate real time data between 2 database servers
May 31, 2006 11:16 AM (reply 1 of 2)
You certainly wouldn't use XML for this.
The process you're looking for is called "replication". Ask your database experts about it.
I predict that after you spend all the money to install Oracle and hire consultants to make it replicate the DB2/400 database, your performance problem will be worse.
panks
Posts:1
Registered: 5/31/06 Re: How to Integrate real time data between 2 database servers
May 31, 2006 11:55 PM (reply 2 of 2)
Yeajh I now that its not a XML solution.
Replication is one of the option but AS400 application which uses DB2/400 DB is highly loaded and proposed website also uses the same database for retrieval and updation purpose.All the inventory is maintained in the DB2/400 database so I have thought of introducing new oracle database which will be accessed by new website and it will have all the relevant tables structure along with data from DB2/400 application. Now whenever there is a order placement from new website then first it should update the oracle database and then this data shuold also migrate to db2/400 application at real time so that the main inventory which is lying on db2/400 should be updated on real time basis because order placement is aslo possible from As400 application. So the user from As400 application should not get the wrong data.
Is it possible to use MQ products??
-Panky

Hi,
the answer to your question is not easy. Synchronization or integration or replication data between 2 (or more) database servers is very complicated task, even though it doesn't look like.
Firstly I would recommend to create good analysis regarding data flow.
Important things are:
1) what is primary side for data creation. In other words on which side - DB2 or Oracle - are primary data (they are created here) and on which side are secondary data (just copies)
2) on which side are data changed - only in DB2 side or only on Oracle side or on both sides
3) Are there data which are changed on both side concurrently? If so how should be conflicts solved?
4) What does it mean "real time"? Is it up to 1 ms or 1s or 1 min or 1 hour?
5) What should be done when replication will not work? I mean replication crash etc.
BTW. The word "change" above means INSERT, UPDATE, DELETE commands.
Analysis should be done for every column in every table. When analysis is ready you can select the best system for your solution (Oracle replication, Sybase replication server, MQ, EJB or your proprietary solution). Without analysis it will be IMHO gunshot into the dark.

B2MML with real time data

Hi All
I want some B2mml files with real time data.
So exact( maintenance infromation and Production) B2MML that is coming from MIS.
So if anyone have some information regarding this please tell me.
Thanks in Advance
Ramshanker

Hi, Ramshanker.
In the cases where the plant system is directly delivering B2MML documents (such as with certain products from Wonderware, Siemens, and some others), using the data in xMII is quite straightforward.
1) If the B2MML message is not "standard" B2MML (be aware that very few plant vendors use the baseline standard - most have a number of specific extensions), you can add the vendors' schemas or B2MML example documents to xMII by adding them to a ReferenceDocument folder on the server.
2) In xMII BLS, create a transaction (let's assume you called it B2MMLHandler) with one input parameter, of type "XML" (let's assume you called it "B2MMLDocument"). Add a "ReferenceSchema" or "ReferenceDocument" action, and configure it to load the vendor's B2MML format. Use the "assign reference document" menu option to assign this format to the transaction input.
3) You can now use the B2MML document to perform analytics or to map from the B2MML document into any RFC or BAPI calls or ESA service calls from within BLS.
4) The plant system system should "post" the XML data to an xMII transaction using the "Runner" URL as in:
http://<yourserver>/Lighthammer/Runner?Transaction=B2MMLHandler&InputParameter=B2MMLDocument
Of course, if the MES system isn't capable of posting the documents and they are available on the file system, you can use the xMII file actions (or remote file access via FTP) to access and load the B2MML documents, perhaps at a scheduled interval.
Hope this helps get you started in the right direction.
Best regards,
Rick Bullotta

Error "cannot load request real time data targets" for new cube in BI 7.

Hi All,
WE have recently upgarded our SCM system from 4.1 to SCM 7.0 which incorporated BI 7.0.
I am using BI 7.0 for first time and ahve the following issue:
I ceated a new infocube and data source of flat file and succesfully created transformation, and Data Transfer Process. Everything looked fine. I added flat file and checked preview and could see data. Now when I start job to load data in infocube the follwing error is shown "cannot load request real time data targets".
I checked cube type in setting in infcune is shows as Standard. When I doube clicked on error the following message showed up
You are trying to load data into a real-time InfoCube using a DTP.
This is only possible if the correct load settings have been defined for the InfoCube.
Procedure
In the object tree of the Data Warehousing Workbench, call Load Behavior of Real-Time InfoCube from the context menu of the InfoCube. Switch load behavior to Transactional InfoCube can be loaded; planning not allowed.
I did not understand what it is meant and how to set changes. Can someone advice and follow me through.
Thanks
KV

Hi Kverma,
Real-time InfoCubes can be filled with data using two different methods: using the transaction for entering planning data, and using BI staging, whereby planning data cannot be loaded simultaneously. With Real time cube you can select the method you want to use for update as
Real Time data Target can be loaded With Data; Planning not allowed &
Real Time data Target can be Planned; Data loading not allowed
You can change this behaviour by right clicking on cube and selecting Change real time load behaviour and select first option. You will be able to load the data then
Regards,
Kams

Error when activating Real Time Data Source

Hi..
I created a generic datasource in R/3 system via RSO2, with the Real-time check box enabled in the settings for Generic Delta. I saved the datasource. Replicated it into BW System.
I tried to activate this Real time Data Source in BW, it says "Error when activating Data Source".
I am on BI 7.0, with PI_BASIS: 2005_1_700.
Please let me know if you need any further information.
Thanks,
Sai.

Hi sai,
Can you specify from where you have created your geneic data source like by using DB tabl/view/infoset query.
am

Need Suggestion On Real Time Data Accees

Hi,
Our application (let say A) runs on * 8.1.7.4.0*
Another Application (let say B) runs on *10.2.0.4.0*
Both the application A and B exchange data through DB links.
Both the application A and B perform select and DML on other tables.
Application A has views (approx. 10 views) on application B 's table through DB links.
Application B also has views (approx. 50 views) on application A 's table through DB links.
Application A has store procedure (approx 10 SPs) through which it does insert/update on two of application B 's table approx 15K call of that procedure per day.
Application B also calls some of the application A 's procedure to insert/update data in application A 's table.
Currently both the application's data center are at the same place. But, there is a proposal/need to move application B's data center far away from the current location. Because of these we are in a assumption that DB Link over WAN will create performance issue and searching of probable replacement.
After of couple of discussion we have identified approx five application A 's tables which are frequently accessed by application B and expect real time data.
Similarly, Application A expect real time data from two application B 's table.
'Golden Gate' mechanism came in our discussion, butt it's expensive,
Can we replace this store procedure code/dml with web service call or so ??
Can anyone suggest ... what kind of approach we should take here ?

Views which are residing in application A 's side use many internal tables and one or two application B s table.
I don't have idea on 'multi-master replication ' ... is it two way replication ..? ... you aware of any documentation I can refer ..? How costly it is (if you can give an idea) ?
Also, among many tables we need near real time (2 mins interval) replication on 5 tables.
MVs again have dependencies on DB link, which exactly what are trying to replace (assuming performance issue)
With fast refresh (let say 2 minutes interval) method on MVs do you think it could cause performance issue specially when data center are at different location ?

RDA(real time data aquasation)

can anyone pl. tel me how the process goes in RDA(real time data Aquasation) means no steps internally.

Hi,
Real-Time Data Acquisition u2013BI 2004
Real-time data acquisition supports tactical decision-making. It also supports operational reporting by allowing you to send data to the delta queue or PSA table in real-time.
You might be having complex reports in your BI System, which helps in making decisions on the basis of data of your transactional system. Sometimes (quarter closure, month end, year ending...) single change in the transactional data can change your decision, and its very important to consider each record of transactional data of the company at the same time in BI system as it gets updated in the transactional system.
Using new functionality of Real-time Data Acquisition (RDA) with the Net Weaver BI 2004s system we can now load transactional data into SAP BI system every single minute. If your business is demanding real-time data in SAP BI, you should start exploring RDA.
The source system for RDA could be SAP System or it could be any non-SAP system. SAP is providing most of the Standard Data Sources as real-time enabled.
The other alternative for RDA is Web Services, even though Web Services are referred for non-SAP systems, but for testing purpose here I am implementing Web Service (RFC) in SAP source system.
Eg will be a production line where business wants information regarding defective products in the real time so that production can be stopped before more defective goods are produced.
In the source system, the BI Service API has at least the version Plug-In-Basis 2005.1 or for 4.6C source systems Plug-In 2004.1 SP10.
Refer:
Real-Time Data Acquisition -BI@2004s
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
http://help.sap.com/saphelp_nw2004s/helpdata/en/42/f80a3f6a983ee4e10000000a1553f7/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3db14666-0901-0010-99bd-c14a93493e9c
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3cf6a212-0b01-0010-8e8b-fc3dc8e0f5f7
http://help.sap.com/saphelp_nw04s/helpdata/en/52/777e403566c65de10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/webinar?rid=/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
Regards
Tg

Problem with Real Time Data Acquisition

Hello,
I tried to built a RDA data flow according to the SAP-Help and this blog (/people/kamaljeet.kharbanda/blog/2006/11/13/real-time-data-acquisition-bi2004s), but I ran into a problem. Everything seems to be fine, but even though the daemon is running no new data is added to the DSO. I'll explain in detail what steps I took and hope someone can pinpoint my error(s).
System is BW4 on SPS 17. My datasource as well as my DSObject are in the same system
1.) Created a transparent table with a timestamp-field for generic delta as a local object.
2.) Created a generic datasource from view/table (used the above table), marked it as realtime-enabled and used timestamp as delta-specific field.
3.) Replicated the metadata for my datasource and activated it.
4.) Created a Data Storage Object with infoobjects corresponding to the table fields
5.) Created a transformation between DataSource and DSO
6.) Created a DTP from Data Source to DSO. The type is realtime-DTP.
7.) Created an InfoPackage for Delta-Initial Load. Update mode: Initialize Delta Process -> Initialization with Data Transfer.
8.) Then I changed my DTP (step 6) to "normal DTP" and executed it. Then activated the data in the DSO. The datasets from the table (which i filled with an ABAP-program) were successfully loaded and activated. So now my DSO contains 5 datasets.
9.) Changed the DTP back to "realtime DTP"
10.) Created an InfoPackage for RDA. Adapter is set to "Realtime extraction from SAP System"
11.) Created a daemon, assigned the IP for RDA and the DTP to the daemon and started it up.
12.) Executed my ABAP program to added 3 datasets to the table which is used as a datasource.
So now in my source table there are 8 datasets, but the daemon won't load them. In my RDA-Monitor (trx rsrda) it shows my daemon, the assigned IP and the assigned DTP (status green). Under the IP there's one yellow request (that should be right according to the help), but unlike the picture in the blog (link see above) there's no request under the DTP.
Job overview (sm37) shows an active batch job and some jobs that are ready (every 10minutes a new batch starts and the old one is closed). the job log shows, that the daemon runs, but loads no data...
i think it might be a problem with the delta extraction somewhere, because the intial load works fine and there are no errors anywhere.
Edit: perhaps my settings in the data source unter tab: extraction are wrong?
Delta process: AIE After Images By Extractor (can't change that)
Direct Access: Allowd
real Time: Real-Time DA Supported
Adapter: realtime data extraction (also tried Access to SAP Data through Service API which seems senseless)
Data Format: Fixed Lenght
Anyone can explain what those fileds mean and which one i should use?
Edited by: Christoph Jender on Apr 10, 2008 2:48 PM
Edited by: Christoph Jender on Apr 10, 2008 3:33 PM

Hi again, another thing i'd like to try is to just active a business content datasource which is realtime-enabled and has the ability to dynamically add some values so that i can test if it works. but i have no idea what business content would be applicable here, any ideas on that perhaps?

OWB in real time data warehousing?

Does anyone have used OWB in a real time data warehousing environment (i.e. no batch processing)?
What limits are there in data throughput?
Any hints are welcome
Mirko

OWB does not currently support real time data warehousing. Currently what you can do is to use the advance queue operator in a mapping as a source/target and run the mappings as frequently as needed for your particular situation. Note that the mappings will still run in bulk mode (i.e. the messages will accumulate in the queue until the mapping is run and will be dequeued in bulk when the mapping is executed).
By creatively (=often) scheduling this mapping you can simulate a RTDW behavior, but this is still a far cry from a real RTDW system.
The next major release (in November) will have extensive support for RTDW.
Regards:
Igor

How to get the real-time data from a CCD camera in labview?

I am going to setup a monitor system and need to acquire the intensity of each pixel at each second from a CCD camera. Also, I need to to some simple calculations with these real-time data at every moment to get my finanl output in this monitor system.
How may I do this using Labview?
Thank you very much.
Kai

We don't have special powers, so we can't guess if you have Imaq Vision or not, if your camera comes with a LabVIEW driver, if it has an USB interface, or firewire, or a dedicated NI card, if you just want to detect a move, or a change in intensity, etc...
So, try to be more specific with your question, that will helps a lot
Chilly Charly (aka CC)
E-List Master - Kudos glutton - Press the yellow button on the left...

Real-Time Data Acquisition

WHAT IS REAL-TIME DATA ACQUISITION AND
WHAT ARE REAL TIME QUERIES AND
DEAMON UPDATE AND HOW DO WE EXTRACT AND LOAD DATA
Please Explain in detail.....
regards
GURU

Hi,
Real-Time Data Acquisition BI 2004s
Real-time data acquisition supports tactical decision-making. It also supports operational reporting by allowing you to send data to the delta queue or PSA table in real-time.
You might be having complex reports in your BI System, which helps in making decisions on the basis of data of your transactional system. Sometimes (quarter closure, month end, year ending...) single change in the transactional data can change your decision, and its very important to consider each record of transactional data of the company at the same time in BI system as it gets updated in the transactional system.
Using new functionality of Real-time Data Acquisition (RDA) with the Net Weaver BI 2004s system we can now load transactional data into SAP BI system every single minute. If your business is demanding real-time data in SAP BI, you should start exploring RDA.
The source system for RDA could be SAP System or it could be any non-SAP system. SAP is providing most of the Standard Data Sources as real-time enabled.
The other alternative for RDA is Web Services, even though Web Services are referred for non-SAP systems, but for testing purpose here I am implementing Web Service (RFC) in SAP source system.
Eg will be a production line where business wants information regarding defective products in the real time so that production can be stopped before more defective goods are produced.
In the source system, the BI Service API has at least the version Plug-In-Basis 2005.1 or for 4.6C source systems Plug-In 2004.1 SP10.
Real-Time Data Acquisition -BI@2004s
http://help.sap.com/saphelp_nw2004s/helpdata/en/42/f80a3f6a983ee4e10000000a1553f7/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3db14666-0901-0010-99bd-c14a93493e9c
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3cf6a212-0b01-0010-8e8b-fc3dc8e0f5f7
http://help.sap.com/saphelp_nw04s/helpdata/en/52/777e403566c65de10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/webinar?rid=/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
Thanks,
JituK

Would MobiLink be the appropriate tool for syncing servers which collect near real-time data?

I have a situation which appears to be similar to the some MobiLink configurations, but with only a few large clients.In my case, there would be 5 to 10 remote clients (each with SQL Anywhere) and a central database. Administration and configuration would be done mostly from the central database, but each client also includes a near real time data collection application. The customer would like to have that data available in the consolidated database. In the worst case, there could be about 50MB of data received from each client in a burst each 15 minutes. Fortunately the consolidated site doesn't have a tight time constraint, its data could be up to 15-30 minutes behind. The clients don't need (or want) to see each other's collected data.
I would like to know if MobiLink would be a good choice for this situation. The only other viable alternative I've found so for is the keep the collected data at the remote clients and access it only on demand. And naturally, there's no money in the project for an enterprise level solution.
FYI: My company has on OEM license for SQL Anywhere. We usually just have an application with SQL Anywhere at each site to collect data from the local equipment. This project is for a Fortune 500 company that want's to be able to monitor everything from the corporate office.
John

Hi John,
You should start writing down a few numbers including network speed and hardware specifications of client and server machines. In the worst scenario, you would have 15 clients synchronizing concurrently 750 MB of data in 15 minutes. And on top, there is your real time data collection application that could work while the synchronization is in progress.
You should also workout, how many connections to the consolidated database you will have in addition to Mobilink server and if these connections can create contentions.
The key factors influencing Mobilink performance are listed here DocCommentXchange
and you can tune the performance (more details in the link below)
DocCommentXchange
DocCommentXchange
Mirco

Display real time data on a plot in a sub VI and main VI

I am building a program to measure and plot real time data. Program has several steps so I build few Sub VIs to make it simple. My problem is I am plotting real time data in my SUB VI(it works fine), but in my main program when I try to get the same plot its not real time data plot. Plots appear at the end of the program. All tips and help would be greatly appreciated. Thanks
I have attached my main VI and Sub VI
Solved!
Go to Solution.
Attachments:
main VI.jpg ‏116 KB
Sub VI.jpg ‏242 KB

LabVIEW program is based on DATA FLOW, now, until the subVI will finish execution (while loop will be stopped), the execution in Main VI will not proceed any further.
If you can pass the reference of 'XY Graph' inside the subVI, you'll be able to update the plot (placed on MAIN VI) from within subVI.
Find attached example for your reference.
I am not allergic to Kudos, in fact I love Kudos.
Make your LabVIEW experience more CONVENIENT.
Attachments:
Example [LV 90].zip ‏26 KB

Creation of Daemon for the DTO for the real time data aquisition

Hi i need help how to create a daemon for the DTP in the real time data aquisition.i'm learning now Sap and practicing a lot to be professional but i need a bit of hel.Can you please give me some details how to create it?
I have to access the RSRDA T-code and what i need to do after?

Hi First of all you need to create a real time DTP once that is done go to RSRDA T-code and click on the Create Daemon
and right click assign DTP , here you can assign the DTP once that is done save and execute . your Daemon will run
Thanks
Santosh

System performance VS Real-time Data Acquistition

Similar Messages

Maybe you are looking for