Parallel & sequential processing

Hi Experts,
i have little bit confusion regarding sequential and parallel processing ,when to go for sequential and parallel processing,what is the advantage ?
please help me,i am new to odi.
Regards
ksbabu

ksbabu wrote:
Hi Experts,
i have little bit confusion regarding sequential and parallel processing ,when to go for sequential and parallel processing,what is the advantage ?
please help me,i am new to odi.
Regards
ksbabu
The advantage ? In simple terms, say you have 3 steps that take 10 minutes, in serial :
Step 1 -> Step 2 -> step 3
10 + 10 + 10 = 30 Minutes to complete.
Now lets say you can run these steps in Parallel at the same time
10
10
10
They will all be finished in 10 minutes, you have saved 20 minutes running in Parallel compared to Serial. In a data warehouse, we can commonly load Dimensions in parallel (providing there are no dependancies) , then we might load the fact tables in parallel also (again , assuming no dependancies).
Load Plans allow you to orchestrate Parallel / Serial calls to interfaces and Package scenarios, you can also run steps in Parallel in Packages using asynchronous scenario calls.
Hope this helps.

Similar Messages

Best way to modify Sequential Process Model for report generation.

I am using the Sequential Process Model in my application and the TestStand Reference Manual, (Figure A-1), clearly shows the following processing sequence:
...<part removed>
Call the Test Sequence
Display the UUT results
Generate a Report
Log Result to a Database
...<more removed>
I want to generate the report BEFORE displaying the results to the operator, or at a minimum, I want to generate the report in parallel with displaying the results to the operator. Currently, the problem I have is that when the test is done I have some automated scripts that take the data file and do some statistical processing on it, but the way the Sequential Process Model is set up, the test might finish but until the operator acknowledges the PASS/FAIL results display, the resulting file is never created. It could be overnight, over the weekend, or several days before an operator comes back and says, "Oh that last test finished, I guess I can press the OK button!", but until they do, I get no data. So I want the report generated no matter what, and right after the test finishes.
Any ideas as to how that might be best accomplished?
Thanks a billion - Ski (noob)

Ray,
Is that new in 4.2 that the engine won't call a callback with nothing in it? I just did it and it seemed to work fine. I'm using 4.1.1 though.
Ski,
Maybe there is a better solution for what you want. Are you using the SequentialModel? What version of TS do you use? Why does the report have to be written before the pass/fail banner displays? The pass/fail banner gets displayed in the PostUUT callback. Like Ray said if you just put that in your client sequence you won't see the banners. However, I'm assuming there is more to this than just that. I'm assuming you want to see the report because of your external analyzer that is gathering the statistical data. And then based on that data you want to allow the user other options. Is this correct?
If so then I would override the PostUUT callback and then use a different callback (possible the ProcessCleanup callback) to displaly the banners. You could even do this without modifying the process model (which I always try to avoid). Just override both the PostUUT and ProcessCleanup callbacks. And then put code in the ProcessCleanup to behave like you need.
Or if you want you can modify the process model and create a new callback lower in the process model. Then have that new one do the post report analysis.
Just some thoughts.
jigg
CTA, CLA
teststandhelp.com
~Will work for kudos and/or BBQ~

Sequential Processing in XI

Hi Experts,
I have to execute a scenario which involves sequentially processing of files coming from legacy and sending data to R/3 via proxy.We have files coming in for different insp lots.Each insp lot has 1 or more results files.
My requirement is :
all the files pertaining to same lot must be sequentialy processed.If one of the file fails all other must be blocked.But Xi should not block files of other onsp lot.
Options that I have tried:
1) Setting EOIO in channel and giving queue names.But this works fine for a particular batch lot,but even blocks files of other batchlot.
2) I tried configuring rules on R/3 moni to break the Qos and make it Eo and let R/3 code handle the sequence.
3) Tried BPM with option of "Mulitple queues(Content specific)" and using corelation on Insp lot.Did all the settings in SWF_INB_CONF.But the I cannot see separate queues as per the correlation.
Can anyone help in solving this.Is this possible in XI?
Thanks in advance.
Pragati

Ur third option seems to be the most logical option. There could be some config problem in BPM. U will find multiple queues only if ur correlation instantiate multiple integration processes in parallel. Also make sure that u have only One correlation in ur scenario.
Regards,
Prateek

First JavaFX application with long sequential processes

Hi all,
I'm working on my first JavaFX application. I have UI elements (view) in place, I have a controller that works properly (with the exception I'll mention below), and I have an model that runs correctly (processes the data properly), but the model code was not originally written to run under a UI.
What I want to happen is the following. When the "Run" button is clicked, the input of the user is passed to the model via the controller and the data is processed. It's a do-once kind of thing where the input is transformed into the output and that's the end of it. The UI can be reset and new input provided, and the whole thing happens again with the click of the Run button. Here's the problem: The processing has several steps that need to happen sequentially, but some can take a long time. I want to provide feedback via a message (what's being done), and overall progress via a progress bar (both elements in the current UI). The problem is I'm still very confused about how to accomplish the user feedback.
The UI was built in SceneBuilder, and I've assigned the onMouseClicked event to call the runButtonClicked() method in the controller.
The runButtonClicked() method calls private methods that execute the processing steps (I'm going to do something more intelligent with the exceptions - please ignore that for the time being)...
    public void runButtonClicked() {
        runButton.setDisable(true);
        sdfFileBrowseButton.setDisable(true);
        outputFileBrowseButton.setDisable(true);
        try {
            prepareSDFFile();
            prepareModels();
            collectDescriptors();
            makeSamples();
            evaluateSamples();
            writeResultsToTextFile(results, outputFile);
        } catch (IOException exception) {
            System.out.println("Caught IOException: " + exception.getMessage());
        } catch (JAXBException exception) {
            System.out.println("Caught JAXBException: " + exception.getMessage());
Each of the calls in the try-catch are tasks that need to occur sequentially in the order shown. A few can take a long time (e.g. collectDescriptors(), evaluateSamples(), and writeResultsToTextFile(). The actual work isn't done in the controller. The controller creates instances of the classes that do the actual work (this seems to be a departure from most of the tutorials I've seen - it seems the model and the controller are mixed in the tutorials).
I want to alert the user about what step is executing (by way of a message in the UI) and what stage the whole process is in (by way of a progress bar). It would be nice if the progress bar could reflect the progress of each individual step (returning to 0 at the beginning of the next step), but having the bar just reflect the over all progress (e.g., how many of the six steps have been finished) would be sufficient.
I also want to be able to handle a Cancel button event and just stop the whole process and reset the application (losing whatever work has been done is OK).
So - I really can't tell what the best approach should be. None of the examples in several tutorials I've gone over have really touched on this type of sequential process. I'd appreciate suggestions.
Thanks,
Dave.

Suggested Approach
What you describe is an absolutely classic case for using the javafx.concurrent utilities (Task and Service).
Your application is a perfect fit for using these services, which will provide you:
1. a concurrent execution thread to run your log running processes
2. a threadsafe feedback mechanism for progress that you can bind to a ProgressBar for interactive progress feedback.
3. a threadsafe feedback mechanism for messages that you can bind to a Label for interactive status feedback.
4. sample code that demonstrates the ability to cancel and restart processes.
5, a success callback method setter that can be set to provide a result and take action on success.
6. a failure callback method setter that can be set to provide an exception and take action on failure.
Task and Service Samples
There are many examples of Task usage if you search for JavaFX Task.
There is also great documentation in the Task and Service javadoc.
Here is an example of using a JavaFX service. The example is a little old and uses doesn't use some new API features such as setOnSucceeded or setOnFailed, it also uses the now-deprecated Builder patterns, however, the bulk of it should still be relevant to what you want.
Here is another more complicated sample to Render 300 charts off screen and save them to files in JavaFX, though I doubt your task needs to be that complicated, and likely a single controlling service is all you need, so don't pay too much attention to the more complicated example unless you must have that kind of functionality.
Here is another simpler example for Re: Creating multiple parallel tasks by a single service, that actually demonstrates sequential and parallel demonstration of step tasks within a service.
The progress can be reset between steps, so that the message indicates the step being performed and the progress indicates the progress of the step rather than overall progress. You could expose separate mechanisms for feeding back overall progress in addition to step progress.
For further help
If you are still having issues, I'm sure somebody on the forum could easily mock up a sample application stub that demonstrates the techniques based on the info you provided in your question, just ask if you would like that...

Sequential Processing for MDBs of Cluster.

Dear All,
I am facing a strange problem with MDBs. I am deploying the MDB on cluster. I also specify that there is only one instance to be available. the following description was put in the deployment descriptor.
<pool>
<max-beans-in-free-pool>1</max-beans-in-free-pool>
<initial-beans-in-free-pool>0</initial-beans-in-free-pool>
</pool>When I tried to deploy I was having 2 instances, i.e., there was one instance per node on the cluster. So the message processing was done parallely.
My requirement was to do sequential processing for a set of beans and parallel processing for other set of beans. I want to have a realtime system where I cannot have a batch program that does sequential processing for me.
Any help is welcomed!

Hey I have got a poor solution that is working.
I have made the MQ Queue that is configured for my MDS as not sharable.
If any one has a better solution kindly let me know.

Sequential processing DTP

Hi,
To have my global variable values in the routines available in the processing of all the data-packages I need to set the DTP to sequential processing.
Is this still possible in 7.0? (in 3.5 it was done by setting infopackage update mode to PSA only)

under settings

Is parallel measuregroup processing supported in Business Intelligence (BI) edition?

Hi all,
I know that parallel measuregroup processing is not supported in Standard Edition of SQL Server Analysis Services. But what about Business Intelligence Edition?
I can't find this in the
feature comparison matrix for SQL Server 2014. I think the entry shown in the picture is for the relational engine only. I haven't found any other entry which would describe this feature.
It is also not mentioned in
Processing Options and Settings (Analysis Services).
Thank you for your help.
Best regards,
Gerald

Hi Gerald,
According to your description, you need to know if parallel processing is supported in Business Intelligence Edition of SQL Server Analysis Service, right?
In SSAS, engine can process and query OLAP partitions in parallel, leading to potentially better performance and scalability. However, not all the edition is support this feature. Parallel query processing on partitioned tables and indices is only support
on Enterprise edition. Please refer to the link below.
http://msdn.microsoft.com/en-us/library/cc645993.aspx#SSAS
If you have any concern about this feature, you can submit a feedback at
http://connect.microsoft.com/SQLServer/Feedback and hope it is released in the next release of service pack or product. Your feedback enables Microsoft to make software and services the best that they can be, Microsoft might consider to add this feature
in the following release after official confirmation.
Regards,
Charlie Liao
TechNet Community Support

Synchronizing multiple threads = sequential processing ???

Hi !
I am trying to solicit some comments and views.
I tested a program which updates an account with two amounts each of 1000, via two different threads.
I can see thread-1 kicks up , waits for some resource (e.g. from the db server ) while thread-2 kicks in and grab the cpu.
Without sychronisation, they overwrote each other so that at the end I have only one amount credited to the account (plus the original balance).
Now I simply add the directive "synchronized" and both amounts are added to the balance correctly !
However, I can also see (via much use of PrintWriter) that thread-1 completes the synchronised block of java-code first (along with a palpable delay) before thread-2 kicks in.
In the sychronized case, the cpu was idle while thread-1 waits for an I/O and idle again while thread-2 waits for an I/O.
Isn't this simple sequential processing ?
Is this an optimal model for concurrency ?
I do not see any significant advantages !

I know the book: Zukovski Java 2 from Sybex.
Two threads are fighting for single resource. In such case synchronization does not defeat the purpose of concurrent programming. It just introduces the order: not too much of a good thing. Sure, you are better off with only one thread in your account, but think that they can service several diffrent accounts at once not just one.

Problems while enabling Failover with Parallel Concurrent Processing (PCP)

Hi,
I followed the following Note , to configure PCP :
From Note 743716.1 - How to Setup and Test Failover of PCP on Non-RAC Environments
Concurrent Managers configured :
ERPCON1
ERPCON2
On those 2 Nodes :
- APPLDCP is 'ON'
- s_cp_reviver is 'enabled' (See Note 466752.1 - What is FNDREVIVER and How Is It Set?)
-> Concurrent Managers have been started with REVIVER_PROCESS="enabled"
The following Patches have been applied :
- One-off Patch 6495206
- Patch 9074947
- One-off Patch 7295684 (See Note 727127.1)
Manager Setup :
Assuming the 2 CP nodes defined on the environment are Primary ERPCON1(CP,Admin)
and Secondary ERPCON2(CP)
the below table gives a snapshot of few of the Manager definitions used for the failover testing.
Manager Name : Internal Manager (ICM)
Primary Node : ERPCON1
Secondary Node : ERPCON2
Manager Name : Internal Monitor_ERPCON1
Primary Node : ERPCON1
Secondary Node : ERPCON2
Manager Name : Internal Monitor_ERPCON2
Primary Node : ERPCON2
Secondary Node : ERPCON1
Manager Name : Standard Manager
Primary Node : ERPCON1
Secondary Node : ERPCON2
Manager Name : Conflict Resolution Manager(CRM)
Primary Node : ERPCON1
Secondary Node : ERPCON2
Manager Name : Scheduler/Prereleaser Manager)
Primary Node : ERPCON1
Secondary Node : ERPCON2
Failover Tests :
- Shutdown Concurrent Managers , Listener on ERPCON1
-> No Failover on ERPCON2 !!!
No Concurrent Managers are starting on ERPCON2
Regards,
Harry

Hi Harry;
Is there any error message on CM logs? Please also see below note:
How to Activate Parallel Concurrent Processing - More Facts [ID 602899.1]
Regard
Helios

Parallel concurrent processing

Hi All,
I need some information about parallel concurrent processing.
Anybody please help me and share your information and also give some links, documents and metalink note id regarding this.
Regards,
Ganesh
Trainee DBA

I need some information about parallel concurrent processing.
Anybody please help me and share your information and also give some links, documents and metalink note id regarding this.We had this discussion many times in the forum before; please see old threads for details.
PCP
https://forums.oracle.com/forums/search.jspa?threadID=&q=PCP&objID=c3&dateRange=all&userID=&numResults=15&rankBy=10001
Parallel Concurrent Processing
https://forums.oracle.com/forums/search.jspa?threadID=&q=Parallel+AND+Concurrent+AND+Processing&objID=c3&dateRange=all&userID=&numResults=15&rankBy=10001
Thanks,
Hussein

Reuirements to setup parallel concurren processing in r12

Dear All,
Can anyone please tell me what are the requirements to setting up parallel concurrent processing in R12?
Thanks in advance.
-Regards,
Senthil

Senthil,
Please refer to chapter "Defining Concurrent Managers" section "Overview of Parallel Concurrent Processing" in "Oracle Applications System Administrator's Guide - Configuration" manual.
Oracle Applications System Administrator's Guide - Configuration
http://download.oracle.com/docs/cd/B40089_10/current/acrobat/120sacg.pdf
Note: 384248.1 - Sharing The Application Tier File System in Oracle E-Business Suite Release 12
https://metalink2.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=384248.1

Number of parallel recovery processes in standby

Hi,
How to find the number of parallel recovery processes that the standby is started with..MRP parallel???

user13179227 wrote:
Hi,
How to find the number of parallel recovery processes
that the standby is started with..MRP parallel???what is "MRP parallel"?

Parallel IDoc Processing

Hi all,
I want to know about Parallel Processing in IDoc.
ie., what is parallel idoc processing
      what is the advantage,
      how to use,
      how it differs from mass data processing in IDoc,
whether we need to have in configure or by coding we need to have parallel idoc processing......
I got this <a class="jive-link-external" href="http://help.sap.com/saphelp_nw04/helpdata/en/0b/2a662d507d11d18ee90000e8366fc2/frameset.htm" target="_newWindow">link</a> but as im new to idoc i could able to understand
Thanks,
Vichu

http://help.sap.com/saphelp_nw04/helpdata/en/0b/2a662d507d11d18ee90000e8366fc2/content.htm

Sequential processing of messages with bpm process

hi,
i have a bpm process that i want to process my messages sequential. for this i initially have played around with crerating my own queue but that didn t work. then i mocved to use the collect pattern and then process the messages. this works only for around 150 messages and the others are staying stuck in the queue for the bpm process the queue is in status stop. if a drop in another file then the queue get cleared and the new messages are placed in it and it still stays in stop and i need to delete queu and start again. Is there a solutio for this that the queue will collect the messages and when the bpm proces is finished it will start again ?
i have tried to avoid using the collect pattern and worked with my bpm process to let it use a specific queue but that also didn t work. i can process 1 message and then the rest stays in the queue? any help would be welcome

Hey
is there any reason specific reason for using BPM?
you can use EOIO to transfer your files sequentially.
thanx
ahmad

Load Distribution Versus Parallel Jobs processing

Hello,
I would request feedback.
In Industry Solutions - PS, for mass activity - Automatic Clearing run, there is an Technical Settings tab.
This tab has Load distribution settings and an value that can be defined for Number of Jobs.
If I put an value greater than 1, so many number of jobs gets executed in the background.
I would request clarification on the following :
1. What is its use / benefits of putting defining an automatic load distribution ?
2. Does this setting equals the Config settings for IMG - Finnancial Accounting- Contract AR - Technical Settings - Prepare Mass.
In here, we can set parallel jobs that can be initiated by providing an maximum number of jobs under the job control panel.
Does this setting override Load distribution settings or vice-versa OR IS this an different setting ?
3. What is the difference between Load distribution versus parallel Jobs ?
Any feedback, most welcome and appreciated.
I am functional consultant and hence unable to distinguish between the two.
I am not sure if this query needs to be posted here, but I have also posted the same in IS fourm too.
Regards
Bala
email : [email protected]

Hi Bala,
In any Mass Activity you will find Technical Settings tab. There you will find Parallel Processing Object and Load Distribution. In Parallel Processing Object, you can select object according to Input depending upon which you will able to divide the job. For example, GPART is used when job have to divide depending upon Business partner. In Maintain Variants you have to create Variants.You have to give Variant name and value in either Interval length or Number of Intervals. Interval length will decide what is the maximum number of object will be processed in a single part. Number of Interval is the number which tells job will be divided in how many parallel process.
For example, let you r running a parallel process for 1000 Business Partner.You choose GPART as object.Now if you put 200 in interval length it will divide job in 5 parallel process.If you put 10 in number of interval it will divide the job in 10 parallel process each of 100 Business partner.
After creating variant, you use it in technical setting.
Let u already define variants which divide the job in 30 but you want maximum number of parallel process will be executed at a time is 6.Then put 6 in Number of jobs field in automatic load distribution.
Hope this can able to clear your question. Still if have any doubt feel free to ask me.
Thanks and regards,
Jyotishankar Dutta

Parallel & sequential processing

Similar Messages

Maybe you are looking for