Sequential processing DTP

Hi,
To have my global variable values in the routines available in the processing of all the data-packages I need to set the DTP to sequential processing.
Is this still possible in 7.0? (in 3.5 it was done by setting infopackage update mode to PSA only)

under settings

Similar Messages

Best way to modify Sequential Process Model for report generation.

I am using the Sequential Process Model in my application and the TestStand Reference Manual, (Figure A-1), clearly shows the following processing sequence:
...<part removed>
Call the Test Sequence
Display the UUT results
Generate a Report
Log Result to a Database
...<more removed>
I want to generate the report BEFORE displaying the results to the operator, or at a minimum, I want to generate the report in parallel with displaying the results to the operator. Currently, the problem I have is that when the test is done I have some automated scripts that take the data file and do some statistical processing on it, but the way the Sequential Process Model is set up, the test might finish but until the operator acknowledges the PASS/FAIL results display, the resulting file is never created. It could be overnight, over the weekend, or several days before an operator comes back and says, "Oh that last test finished, I guess I can press the OK button!", but until they do, I get no data. So I want the report generated no matter what, and right after the test finishes.
Any ideas as to how that might be best accomplished?
Thanks a billion - Ski (noob)

Ray,
Is that new in 4.2 that the engine won't call a callback with nothing in it? I just did it and it seemed to work fine. I'm using 4.1.1 though.
Ski,
Maybe there is a better solution for what you want. Are you using the SequentialModel? What version of TS do you use? Why does the report have to be written before the pass/fail banner displays? The pass/fail banner gets displayed in the PostUUT callback. Like Ray said if you just put that in your client sequence you won't see the banners. However, I'm assuming there is more to this than just that. I'm assuming you want to see the report because of your external analyzer that is gathering the statistical data. And then based on that data you want to allow the user other options. Is this correct?
If so then I would override the PostUUT callback and then use a different callback (possible the ProcessCleanup callback) to displaly the banners. You could even do this without modifying the process model (which I always try to avoid). Just override both the PostUUT and ProcessCleanup callbacks. And then put code in the ProcessCleanup to behave like you need.
Or if you want you can modify the process model and create a new callback lower in the process model. Then have that new one do the post report analysis.
Just some thoughts.
jigg
CTA, CLA
teststandhelp.com
~Will work for kudos and/or BBQ~

Error in Data Transfer Process (DTP) Urgent!

Hi,
ive encountered an error in uploading data from R3 using DTP in a specific cube and it says "Exceptions in Subset: Load and Generation" and "Dump: ABAP/4 processor: MESSAGE_TYPE_X", how can i fix this problem? is there any problem with the upgrade process of our system or in KERNEL? and what is KERNEL? Please help me guys.....
Thanks,
nips

Please do not post the same question twice.
Error in Data Transfer Process (DTP) Urgent!

Sequential Processing in XI

Hi Experts,
I have to execute a scenario which involves sequentially processing of files coming from legacy and sending data to R/3 via proxy.We have files coming in for different insp lots.Each insp lot has 1 or more results files.
My requirement is :
all the files pertaining to same lot must be sequentialy processed.If one of the file fails all other must be blocked.But Xi should not block files of other onsp lot.
Options that I have tried:
1) Setting EOIO in channel and giving queue names.But this works fine for a particular batch lot,but even blocks files of other batchlot.
2) I tried configuring rules on R/3 moni to break the Qos and make it Eo and let R/3 code handle the sequence.
3) Tried BPM with option of "Mulitple queues(Content specific)" and using corelation on Insp lot.Did all the settings in SWF_INB_CONF.But the I cannot see separate queues as per the correlation.
Can anyone help in solving this.Is this possible in XI?
Thanks in advance.
Pragati

Ur third option seems to be the most logical option. There could be some config problem in BPM. U will find multiple queues only if ur correlation instantiate multiple integration processes in parallel. Also make sure that u have only One correlation in ur scenario.
Regards,
Prateek

First JavaFX application with long sequential processes

Hi all,
I'm working on my first JavaFX application. I have UI elements (view) in place, I have a controller that works properly (with the exception I'll mention below), and I have an model that runs correctly (processes the data properly), but the model code was not originally written to run under a UI.
What I want to happen is the following. When the "Run" button is clicked, the input of the user is passed to the model via the controller and the data is processed. It's a do-once kind of thing where the input is transformed into the output and that's the end of it. The UI can be reset and new input provided, and the whole thing happens again with the click of the Run button. Here's the problem: The processing has several steps that need to happen sequentially, but some can take a long time. I want to provide feedback via a message (what's being done), and overall progress via a progress bar (both elements in the current UI). The problem is I'm still very confused about how to accomplish the user feedback.
The UI was built in SceneBuilder, and I've assigned the onMouseClicked event to call the runButtonClicked() method in the controller.
The runButtonClicked() method calls private methods that execute the processing steps (I'm going to do something more intelligent with the exceptions - please ignore that for the time being)...
    public void runButtonClicked() {
        runButton.setDisable(true);
        sdfFileBrowseButton.setDisable(true);
        outputFileBrowseButton.setDisable(true);
        try {
            prepareSDFFile();
            prepareModels();
            collectDescriptors();
            makeSamples();
            evaluateSamples();
            writeResultsToTextFile(results, outputFile);
        } catch (IOException exception) {
            System.out.println("Caught IOException: " + exception.getMessage());
        } catch (JAXBException exception) {
            System.out.println("Caught JAXBException: " + exception.getMessage());
Each of the calls in the try-catch are tasks that need to occur sequentially in the order shown. A few can take a long time (e.g. collectDescriptors(), evaluateSamples(), and writeResultsToTextFile(). The actual work isn't done in the controller. The controller creates instances of the classes that do the actual work (this seems to be a departure from most of the tutorials I've seen - it seems the model and the controller are mixed in the tutorials).
I want to alert the user about what step is executing (by way of a message in the UI) and what stage the whole process is in (by way of a progress bar). It would be nice if the progress bar could reflect the progress of each individual step (returning to 0 at the beginning of the next step), but having the bar just reflect the over all progress (e.g., how many of the six steps have been finished) would be sufficient.
I also want to be able to handle a Cancel button event and just stop the whole process and reset the application (losing whatever work has been done is OK).
So - I really can't tell what the best approach should be. None of the examples in several tutorials I've gone over have really touched on this type of sequential process. I'd appreciate suggestions.
Thanks,
Dave.

Suggested Approach
What you describe is an absolutely classic case for using the javafx.concurrent utilities (Task and Service).
Your application is a perfect fit for using these services, which will provide you:
1. a concurrent execution thread to run your log running processes
2. a threadsafe feedback mechanism for progress that you can bind to a ProgressBar for interactive progress feedback.
3. a threadsafe feedback mechanism for messages that you can bind to a Label for interactive status feedback.
4. sample code that demonstrates the ability to cancel and restart processes.
5, a success callback method setter that can be set to provide a result and take action on success.
6. a failure callback method setter that can be set to provide an exception and take action on failure.
Task and Service Samples
There are many examples of Task usage if you search for JavaFX Task.
There is also great documentation in the Task and Service javadoc.
Here is an example of using a JavaFX service. The example is a little old and uses doesn't use some new API features such as setOnSucceeded or setOnFailed, it also uses the now-deprecated Builder patterns, however, the bulk of it should still be relevant to what you want.
Here is another more complicated sample to Render 300 charts off screen and save them to files in JavaFX, though I doubt your task needs to be that complicated, and likely a single controlling service is all you need, so don't pay too much attention to the more complicated example unless you must have that kind of functionality.
Here is another simpler example for Re: Creating multiple parallel tasks by a single service, that actually demonstrates sequential and parallel demonstration of step tasks within a service.
The progress can be reset between steps, so that the message indicates the step being performed and the progress indicates the progress of the step rather than overall progress. You could expose separate mechanisms for feeding back overall progress in addition to step progress.
For further help
If you are still having issues, I'm sure somebody on the forum could easily mock up a sample application stub that demonstrates the techniques based on the info you provided in your question, just ask if you would like that...

Sequential Processing for MDBs of Cluster.

Dear All,
I am facing a strange problem with MDBs. I am deploying the MDB on cluster. I also specify that there is only one instance to be available. the following description was put in the deployment descriptor.
<pool>
<max-beans-in-free-pool>1</max-beans-in-free-pool>
<initial-beans-in-free-pool>0</initial-beans-in-free-pool>
</pool>When I tried to deploy I was having 2 instances, i.e., there was one instance per node on the cluster. So the message processing was done parallely.
My requirement was to do sequential processing for a set of beans and parallel processing for other set of beans. I want to have a realtime system where I cannot have a batch program that does sequential processing for me.
Any help is welcomed!

Hey I have got a poor solution that is working.
I have made the MQ Queue that is configured for my MDS as not sharable.
If any one has a better solution kindly let me know.

Synchronizing multiple threads = sequential processing ???

Hi !
I am trying to solicit some comments and views.
I tested a program which updates an account with two amounts each of 1000, via two different threads.
I can see thread-1 kicks up , waits for some resource (e.g. from the db server ) while thread-2 kicks in and grab the cpu.
Without sychronisation, they overwrote each other so that at the end I have only one amount credited to the account (plus the original balance).
Now I simply add the directive "synchronized" and both amounts are added to the balance correctly !
However, I can also see (via much use of PrintWriter) that thread-1 completes the synchronised block of java-code first (along with a palpable delay) before thread-2 kicks in.
In the sychronized case, the cpu was idle while thread-1 waits for an I/O and idle again while thread-2 waits for an I/O.
Isn't this simple sequential processing ?
Is this an optimal model for concurrency ?
I do not see any significant advantages !

I know the book: Zukovski Java 2 from Sybex.
Two threads are fighting for single resource. In such case synchronization does not defeat the purpose of concurrent programming. It just introduces the order: not too much of a good thing. Sure, you are better off with only one thread in your account, but think that they can service several diffrent accounts at once not just one.

Error in Data Transfer Process (DTP)

Hi,
ive encountered an error in uploading data from R3 using DTP in a specific cube and it says "Exceptions in Subset: Load and Generation" and "Dump: ABAP/4 processor: MESSAGE_TYPE_X", how can i fix this problem? is there any problem with the upgrade process of our system or in KERNEL? and what is KERNEL?
Thanks,
nips

Hi
It looks like a Memory issue. Try restarting the load when the system is relatively free.
Regardss,
Namrata

Sequential processing of messages with bpm process

hi,
i have a bpm process that i want to process my messages sequential. for this i initially have played around with crerating my own queue but that didn t work. then i mocved to use the collect pattern and then process the messages. this works only for around 150 messages and the others are staying stuck in the queue for the bpm process the queue is in status stop. if a drop in another file then the queue get cleared and the new messages are placed in it and it still stays in stop and i need to delete queu and start again. Is there a solutio for this that the queue will collect the messages and when the bpm proces is finished it will start again ?
i have tried to avoid using the collect pattern and worked with my bpm process to let it use a specific queue but that also didn t work. i can process 1 message and then the rest stays in the queue? any help would be welcome

Hey
is there any reason specific reason for using BPM?
you can use EOIO to transfer your files sequentially.
thanx
ahmad

Regarding Transformation and Data Transfer Process(DTP)

Dear Gurus
1) Transformation replaces the transfer rule and update rule.
2) DTP replaces the info package.
Hencse, there is a some advantages are there in Transformation and DTP.
I couldn't understand in help.sap.com.
Could you please tell me in simple language what all are the new features are there in Transformation and DTP which is not possible in Transfer rule, Update rule and infopackage.
Thanks and Regards
Raja

Hi Raja,
These are the advantages of DTP and Transformation over their predecessors.
DTP:1)Improved transparency of staging processes across data warehouselayers (PSA, DWH layer, ODS layer, Architected Data Marts)
2)Improved performance:Intrinsic parallelism
3)Separation of delta mechanism for different data targets: delta capability is controlled by the DTP
4)Enhanced filtering in data flow
5)Repair modes based on temporary buffers (buffers keep complete set of data)
Transformation: SAP NetWeaver2004s significantly improves transformation capabilities. The improved graphical UI contributes to decrease TCO.
1)Transformation Improved performance, flexibility and usability
2)Graphical UI
3)Unification and simplification of transfer and update rules
4)New rule type: end routine
5)New rule type: expert routine (pure coding of transformation)
6)Unit Conversion Capabilities for unit conversion during data load (and reporting)
Assign points if it is helpful.
Cheers,
Bharath

Sequential processing of inbound idoc

Hi experts
Does anyone know whether the inbound idoc processing is sequential (one by one) if the partner profile is maintained to be triggered immediately? Can this be done instead of using an external program for processing?
thanks in advance!

By sequential do you mean in the order that were received for a particular message type? If this is the type, you need to enable qRFC processing in WE20.

Parallel & sequential processing

Hi Experts,
i have little bit confusion regarding sequential and parallel processing ,when to go for sequential and parallel processing,what is the advantage ?
please help me,i am new to odi.
Regards
ksbabu

ksbabu wrote:
Hi Experts,
i have little bit confusion regarding sequential and parallel processing ,when to go for sequential and parallel processing,what is the advantage ?
please help me,i am new to odi.
Regards
ksbabu
The advantage ? In simple terms, say you have 3 steps that take 10 minutes, in serial :
Step 1 -> Step 2 -> step 3
10 + 10 + 10 = 30 Minutes to complete.
Now lets say you can run these steps in Parallel at the same time
10
10
10
They will all be finished in 10 minutes, you have saved 20 minutes running in Parallel compared to Serial. In a data warehouse, we can commonly load Dimensions in parallel (providing there are no dependancies) , then we might load the fact tables in parallel also (again , assuming no dependancies).
Load Plans allow you to orchestrate Parallel / Serial calls to interfaces and Package scenarios, you can also run steps in Parallel in Packages using asynchronous scenario calls.
Hope this helps.

Data Transfer Process (DTP) - Messages Never Received and Times Out

Hello,
I'm having an Issue with DTPs at the moment. First I'll give you a little background on the system
Formerly BW 3.1, upgraded recently to BI 7.0 (Support Pack 15). Most of our Data Flows are still under 3.x style, but many are being migrated or recreated under BI 7.0 standards.
I am able to successfully load data using DTPs however on many, and seemingly random, occasions the message for individual data packages under "Processing -> Updating InfoProvider" never arrive, and thus the DTP never completes and eventually times out.
Under BW 3.x it was a simple matter of changing the QM status to Red and then "Update Manually" on the data package that did not receive the message. This would reprocess and complete the data package, allowing you to then turn the QM status Green and move on.
Under BI 7.0 I do not seem to have any options for the Data Packages regardless of QM status. I have not found a way to resolve this situation and in every instance had to delete the request from the InfoProvider and try again. It seems like a rather large design flaw, so I'm hoping I'm missing something.
Any suggestions would be greatly appreciated.
Thanks,
Matt

Three things to be noted:
1. Dont use the std. settings of 50000 records. Change it to 10000 records in DTP.
2. Since you are not getting till Updating tab, I foresee something wrong with routine..start/end/transformation. Check there how much time it is taking.
3. I dont think we have any option as you mentioned for QM. We need to delete the req and start the DTP again.
Thanks..
Shambhu

File to IDoc ( sequential processing )

Hi All,
I need a clarification for one of my scenario..
The scenario is about PO create, PO change and PO del. We receive a flat file with all the above mentioned in the same file in any order.. But we need to ensure that we <b>post and process all of them in sequence as we receive from the file</b>..
We need to consider the performance even. Please suggest on how to go ahead with this..
Thanks in advance..
Rgds,
Yuva.

thanks for reply.
Am not clear in the concept you are saying.
Let me give more details abt the scenario.
XI gets the flatfile form the legacy with PO create/change/delete, were it maybe in any order.
Maintaining the order in XI for pickup and sending the IDOC is not a problem, but in R/3 how to confirm processing order as it receives.
plz help.

How to skip sequentially processing of FTP-Adapter

Hello,
well we have the problem that on ftp are many files from many sources.
Sometimes one source send wrong structure in file that the processing is stopped.
It's stopped even though there are files in directory which are in right structure. But because the wrong files are "before" the right files the adapter is not processing the right structured files!
So how to get the adapter to process the "good" files?!
Quality of Service is not helping here!
Can someone help?
br

Dear Fritz,
You can Validate XML Paylod in PI 7.1, But this option is not available in lower versions.
Check here for the same
[Validating Source XMLPayload|https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/5002ac06-aff3-2a10-6798-cbe11ca35535]
I think we can write an adapter module to filter unwanted XML payloads to be processed.
Best Regards
Praveen

Sequential processing DTP

Similar Messages

Maybe you are looking for