Parrallel Processing in xMII

Hello All.
I am designing a large scale Real Time Reporting solution using regional xMII servers to source data that is then fed into NetWeaver BI Virtual InfoProviders for reporting.
My current problem is that I can't figure out how to make xMII do two tasks in parallel. Let me explain why I want to do this.
Suppose I need data for a report from multiple source applications that are connected to a regional xMII server. I can have Net Weaver BI make a call to the xMII server for the data, and then xMII needs to collect the data from each of the sources. At the moment, xMII makes a request to the first source, waits for the response, then makes a request to the next source and waits for the response, and then the next...etc
Ideally, I need to have xMII initiate each of the requests from the source systems and run the queries in parallel. When the last query has finished, then post the entire result set back to Netweaver BI.
How do I spawn Multiple queries in parallel in xMII?
Geoff.

Hi, Geoffrey.
I suspect that there is significant potential performance that can be gained from "intermediate content caching". There is probably some overlap between subsequent user requests that could share a previous resultset.
xMII's business logic service engine was designed such that multiple actions within a sequence could run in parallel (I designed it. ) , but this capability was not enabled for a number of reasons related to scaleability when the product ran on IIS (version 11.5 and older).
I would suggest pushing this is an enhancement request - the infrastructure to do this would not be too substantial and would be useful if used carefully.
Alternatively, it would be rather easy to write a standalone app/servlet that invoked xMII transactions in parallel (via calls the the Runner servlet) to make the data requests (and persist the results to disk temporarily), then invoked the aggregrator/calculation transaction. Not a perfect solution, but would work.
Best regards,
Rick

Similar Messages

How do you run a Process Chain using parrallel processing group

Does anyone know the answer to the above question please?
The problem i am getting is that currently the Process chain is running on the client server and is timing out!
is there a config setting or some other setting that is needed to stop it from timing out?

Hi Jas Matharu,
Hope the following links will give u a clear idea about process chains and clear ur doubts.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/events/sap-teched-03/using%20process%20chains%20in%20sap%20business%20information%20warehouse
Business Intelligence Old Forum (Read Only Archive)
http://help.sap.com/saphelp_nw2004s/helpdata/en/8f/c08b3baaa59649e10000000a11402f/frameset.htm
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/8da0cd90-0201-0010-2d9a-abab69f10045
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/19683495-0501-0010-4381-b31db6ece1e9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/36693695-0501-0010-698a-a015c6aac9e1
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/9936e790-0201-0010-f185-89d0377639db
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3507aa90-0201-0010-6891-d7df8c4722f7
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/263de690-0201-0010-bc9f-b65b3e7ba11c
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
Siggi's weblogs for data load error and how to restart process chain
/people/siegfried.szameitat/blog/2005/07/28/data-load-errors--basic-checks
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
****Assign Points If Helpful****
Regards,
Ravikanth.

Parrallel Processing in SSAS Cube

Hello All,
I am having cube processing issue last night .
We process our cube through SSIS . last night when job started and cube come to processing it failed due to the following meassage .Though we have set the processing option in ssis let the SSAS server decide
Internal error: The operation terminated unsuccessfully.Internal error: The operation terminated unsuccessfully.OLE DB error: OLE DB or ODBC error: The query processor could
not start the necessary thread resources for parallel query execution.; 42000.Errors in the OLAP storage engine
but when we process the same measure group through XMLA script it completed succesfully .
I did'nt find any reason and solution to this prob. why parrllel processing failed. when we process through script or manully then server also decide the parrllel processing
blog:My Blog/
Hope this will help you !!!
Sanjeewan

This is an OLEDB error meaning it is in the SQL Server relational database engine. I suspect if you look at the SQL Server max degree of parallelism setting it will be 0 which means to use as much parallelism as the query optimizer decides makes sense.
Lets say you have 10 fact tables and a 16 core SQL Server. SSAS will run 10 SQL queries in parallel and each query may have a highly parallel query plan using 16 threads per query. 10 queries x 16 threads = 160 threads. Quickly you can run out of SQL Server
threads. So I would suggest you lower the max degree of parallelism server setting in SQL Server to something like 4 or 8. You may even test programmatically changing the MAXDOP before cube processing to 1 and then changing it back after cube processing. Or
if you don't want to change it for the whole server (which is risky without testing) then consider using Resource Governor to limit just the cube processing connections' max degree of parallelism.
http://artisconsulting.com/Blogs/GregGalloway

Parallel process define for batch job

Hi,
I would like to run a batch job with a few processes run parallel together. May I know where can i define it ? T-code ?
Regards
Lauran

Hi Lauren,
First of all there is no transaction code as such.
First of all the report that needs to be run in background should enable you to do parrallel processing. For that code has to be written accordingly.
Check this link:
http://help.sap.com/saphelp_nw2004s/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm
It gives details of function modules needed for this purpose.
After this you need to create a variant for the report and schedule it to run in background using either SE38 (dirrectly) or by creating a job explicitily- SM36.
A standard report that has parallel processing feature available is RBDAPP01.
Also check transactions like BD18. They also make use of parallel processing.
Regards.
Ruchit.

Completing the block step for parallel processing

Hello ,
I"m using a ParForEach block   .
It works fine and 2   approves get their decision task respectively ,
I want to end all parrallel processes if one of the   approvers select the reject option .
I thought it could be done using the End condition Option .
I have defined an end condition    in the tab Parallel Procesing , the condition is an element wf_result is set to REJECT
was defined.
But   nothing resulted and althogh i check the container and the element is correctly   assigned after one of the approvers
rejects the other is still sitting there.
i ran the condiion evalate button on this step with no   success .
Please Advise

Hi Rina
In EHP4, there is the following workflows for Compensation:
04000022 ECM_SUBMIT
04000024 ECM_REJECT
04000025 ECM_CREATE
together with class CL_HRECM00_WORKFLOW_EVENT.
There, the parallel processing is used.
Best Regards
Raquel

Parallel Processing (RSEINB00)

Hi,
I am trying to achieve parrallel processing for the below scenario:
I am trying to create a child job for processing each file.
Suppose if i have 5 files, in this case i will have one Main Job & 5 child Jobs. Apprecaite if anyone has come across such scenario.
Each file can have two types of data. One set of data for trasferring to application server & another set for posting idocs.
LOOP AT t_files_to_proc INTO wl_files_to_proc.
*-- This perform builds two sets of data [ Data Set-1 for transferring file onto App Server
*--                                                                 Data Set-2 for posting idocs using RSEINB00     ]
   PERFORM build_table_data.
*-- Data Set-1 for transferring file onto App Server
PERFORM transfer_data_to_appserver.
*-- Data Set-2 for posting idocs using RSEINB00
PERFORM submit_rseinb00.
ENDLOOP.

Hi rao,
here is a sample, adapt to your needs:
[Easily implement parallel processing in online and batch processing |https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing]
Regards,
Clemens

Request Illuminator concept in xMII

Dear all:
Could you please any one explain me about illuminator process in xMII. For which purpose we are using Illuminator services in xMII. what is the benefits we are getting from that.
Regards,
Gopal.

And for a brief history lesson on SAP MII, the Illuminator servlet you see in various places is the main java servlet for processing requests. Illuminator was the name of the core Lighthammer product for many years.
The benefits of using the 'Illuminator' services can be found at many customer locations all over the globe in all industries.
Regards,
Jeremy

Empty lines being transfered with RSCRM_BAPI

Hi guys,
I have to transfer the result f one query to a table. For this requirement Iu2019m using transaction RSCRM_BAPI transaction.
The problem is that my query is gigantic and it has a structure in rows with 150 selections visible and 250 that are not visible, but are used in calculations. Besides this big structure I have 7 InfoObjects in columns.
Iu2019m being able to feed my table, but I noticed that more than half of the lines have all values empty, i.e., zero.
I tried to place a condition in query, but it gets ignored.
Do you know a way to skip the lines that have all values zero?
Thanks in advance.
Points will be awarded of course.
João Arvanas,

Hi Joao,
This is actually a common problem. Conditions and row suppression does not work for RSCRM_BAPI. The underlying function module is WREX_GETDATA.
I've tackled this two ways.
1) Write a program using WREX_GETDATA and modify the empty entries in memory before writing to table.
2) Use the Query in an APD to extract the data and remove the entries via a filter or ABAP process.
Tips on solution 2
Make sure you unhide all your keyfigures.
Turn on Parrallel Processing
Regards,
Dae Jin

SAP-ISU consultant details

Hi friends, can any halp me to know SAP-ISU consultant details,
what are all things i have in that SAP-ISU, whether it's having any programming part like ABAP,

Hi ARUNKUMAR´,
gas, water, elelctricity:
All a mass business: Big numbers of customers, much bigger numbers of document items.
Main focus is on (sub-module) FI-CA AKA RMCA, means contract acounting. Here you have an interesting kind of userexits: There are hundreds of pre-defined (and well documented) events. You can assign own FUNCTIONS to the events to enrich, change or check data.
Billing, dunning and payment procedures processed in parralel; quite complex organization of the parrallel processing transactions.
Alvaro is talking of the PRINT WORKBENCH which integrates the (SAPSCRIPT) forms handling and programming, but you can do a lot more with it.
Also important/interesting is the customer master data organized using the SAP BUSINESS PARTNER model.
This is ISU in short.
Note: The main functions of IS-U are also used in Telecommunications (IS-T) and Media (IS-M).
Regards,
Clemens

CPU load unbalanced and too low in multi-processor computers

I have a rather large test system 5-6000 VIs and we have noted some peculiar behaviour.
On a single processor system the application can take up to 100% of the available resources.
On a two processor system the application can take up to 50% of the available resources.
On a four processor system the application can take up to 25% of the available resources.
On an eight processor system the application can take up to 12-13% of the available resources.
I think you guys can get the gist of what I stated above (I didn't get pictures for 1 and 2 CPUs but I have observed the behaviour, personally)
We haven't done any specific multithreading code (we do lauch many parrallel processing loops dynamically = should be a good thing)
Why is the application behaving this way? Does anyone have a similar problem? Any tips?
Thanks for any help you can offer.
//David

You really don't provide enough information.
Is there really always something to do to keep a core busy at all times? Unless there is serious computations involved for solving a math problem, a typical VI should not be using a lot of CPU. (For example if it needs a full core today, it would not have been possible to even run the test a couple of years ago. That would be hard to believe). Don't overestimate how much a modern computer can do using only 5% of the CPU at any given time. I still run an acquisition system on a 120MHz Pentium 1 and LabVIEW 4. There are no performance problems even though the hardware is orders of magnitude slower than even a modern Atom processor on a netbook.
How many things can really occur at the same time? If you make your code overly sequential by lining everything up along error wires or by overuse of sequence structures, the code cannot be efficiently parallelized, no matter how hard the compiler tries.
How many of the 6000 VIs are called concurrently? How many require full CPU? If this is a test system, I assume that there is interaction with a device under test? Are the tests sequential or parallel? How many devices are tested at the same time? How much is post-processing compared to waiting for results? Are the tests really CPU limited??? Really???
Have you done any profiling? Did you identify the part that is most demanding? Could it be that a single greedy loop is consuming most of the CPU doing nothing?
Except for lengthy simulations or complex data processing, a typical application should never be CPU limited. The timings should be fully software controlled such that the code runs the same, independent of the power of the computer.
All that said, LabVIEW can easily keep all CPU cores busy if really needed and if programmed correctly and with parallel processing in mind. I have a complicated lengthy fitting code where I was able to keep 64 cores at near 100% (4 AMD 6274 CPUs with 16 cores each). As a more typical example, and compared to sequential execution, the parallelized code is 4.5x faster on a quad core I7 (if I disable hyperthreading in the bios, I get a 3.8x speed increase), so not only can it keep all four cores at 100%, it can even get a measurable boost from hyperthreading. On a six core I7, I get a 6.9x speedup, also keeping all cores busy.
I am not going to look at a project with 6000 VIs, but please show us some profiling data. Find the VI that carries most of the load and attach it if you want.
LabVIEW Champion . Do more with less code and in less time .

Evaluate the performance of EHP4 upgrade

Hello All,
We are upgrading our ERP 6 Systems to EHP4.
The process is going on smoothly in our landscape.
I want to know the tools/ utilitys/ support available to evaluate and analyse how did the upgrade went off? Was it perfromed as per the SAP' s best practices, was there any lapses in the upgrade process.
Any directions/ pointers welcome.
Thanks,
Antar

ENHp4 has been imporved much since it was released. EHP Installer is constantly updated to improve performance and fix any errors in the previous version of the installer.
If you really want to analyze this, test it on different system with different settings such as number of parrallel processes, tp process etc.,
You performance will also be determined by the version of R3trans you use.
Thanks!

Event Log / ServiceNow

Greetings,
Recently the company started using the ServiceNow application for tracking IT incidents and request. A new process in xMII BLS 14 is being requested that should create incidents in ServiceNow as they occur.
The current process to make this happen is for the application to put an entry into the event log and then have MS System Center Operation Manager populate the ServiceNow Incident. I know this sounds round about but it is what it is...
Can xMII BLS 14 create event log entries and if so, HOW?
Thank you,
Dennis W

If your talking about service.now It looks like they do have some web services available for integration.
SOAP Web Service - ServiceNow Wiki
Regards,
Christian

ISU details

Hi,
One of our customer wanted to implement ISU. And they are asking about cost details.
What is the cost implications for to implement this? I think in ECC6 this addon is inbuilt right ?
What about cost factor ?
Please let me know if you have any thoughts.
Thanks
Kristene

Hi ARUNKUMAR´,
gas, water, elelctricity:
All a mass business: Big numbers of customers, much bigger numbers of document items.
Main focus is on (sub-module) FI-CA AKA RMCA, means contract acounting. Here you have an interesting kind of userexits: There are hundreds of pre-defined (and well documented) events. You can assign own FUNCTIONS to the events to enrich, change or check data.
Billing, dunning and payment procedures processed in parralel; quite complex organization of the parrallel processing transactions.
Alvaro is talking of the PRINT WORKBENCH which integrates the (SAPSCRIPT) forms handling and programming, but you can do a lot more with it.
Also important/interesting is the customer master data organized using the SAP BUSINESS PARTNER model.
This is ISU in short.
Note: The main functions of IS-U are also used in Telecommunications (IS-T) and Media (IS-M).
Regards,
Clemens

GPU assisted editing.

AMD Ships ATI Radeon HD 5800 Series DirectX 11-Compliant Graphics Cards
The future of NLEs is here!
At least, what should be the future of NLEs - GPU assisted video tasks using OpenCL. While the new 5800 series of ATI cards is very impressive from a gaming standpoint, something most regular Premiere users will recognize as overkill, they are also OpenCL 1.0 compliant. This means software programmers can take full advantage of the parrallel processing power of that card (and that power is massive!) to assist with whatever tasks they program it for. This can not only mean things like faster H.264 exports, like that currently offered by nVidia's CUDA technology, but it can also mean render free HD editing with multiple streams and effects; faster encoding to several formats, not just H.264; and render free scaling, motion and opacity.
All we need is for Adobe to move past the limited* CUDA support and adopt the more open standard of OpenCL, which works on both nVidia and ATI enabled cards.
*and limiting, as many people prefer ATI

Impressive.
Maybe something that I'll need to consider for the new workstation. By the time I get around to shopping for hardware, the could well be implementation in PrPro - or maybe not.
Thanks,
Hunt
PS - though I have had zero issues with my nVidia cards, far too many have.

How to restrict the second PO for the same PR

Hi All,
My requirement is if the two users are simultaneously creating PO using ME57 T.code,
For the second user it is giving error message as u201CPR is processing by first useru201D
Even it is raising error message; it is allowing creating PO second user also.
I.e. for one PR it is creating 2 Pou2019s with one duplicate PO
Here my concern is even it error raised as u201CIt is processing by first useru201D why it is allowing to create PO for the second user.
CALL FUNCTION 'ENQUEUE_EMEBANE'
This function module is giving sy-subrc = 2.
What may be the cause to avoid the error message?
Is there any config related thing to avoid this type of error?
How can I restrict to create the PO for second user?
Please help me in this.
Thanks in Advance
Rambabu.A

In general you can restrict that a requisition is converted multiple times to a PO by setting some messages to error.
in trans SPRO
MM...Purchasing....Enviromental data....define attributes for system messages.
Add as ERROR message
06076 "Materials of requisition & item & alr. ordered in full"
But this usually will not solve the problem of parrallel processing.

Parrallel Processing in xMII

Similar Messages

Maybe you are looking for