Parallel execution in owb

Hii all,
Is it possible to execute mapping in a parallel manner in owb 11.1?If yes how do we do it?Please help
Thanks
Edited by: 854918 on Apr 26, 2011 9:15 PM

Good morning Ajay,
The checkbox appears on the 4th screen when you use the "New Transformation Wizard" to create a function (directly under checkbox "Function is deterministic").
IMHO, whether the code is run in parallel or not depends on how the mapping is run; if parallel it would try to run the function in parallel as well (unless - I guess - you've altered the property of the function in the mapping which says it can only be run row-based).
HTH.
Regards, Patrick

Similar Messages

Query Cubes with Parallel executions?

I have the following problem:
As I mentioned in my first question here: Combined Cube of smaller cubes?
We joined four cube views to form a fact table for a bigger cube. Actually we don't form a bigger view based on the cube views' now, but use an etl to insert into a fact table the results by months. Let's say our cubes are DDS_CUBE, KD_CUBE, GFO_CUBE and ZL_CUBE.
We use DDS_CUBE as our main and do a left join on the others to insert rows in fact table for AOR_CUBE. There are around 238 000 rows per month in DDS_CUBE and DDS_CUBE have data for 12 months. The other cubes have average the same rows of data.
And when I ran the query with all the rows after 3 hours it's still running and I think it shouldn't be.
*When I limit the rows with rownum < 1000 it executes for under 5 minutes.
Is there a way to optimize this, can I query the cubes with parallel executions not from the views but from the table they are kept?
Edit: Forgot to mention that DDS_CUBE is partitioned by month and have a total of 84 partitions, but only 12 are loaded.
Message was edited by: valeksandrova
Also is there a way to import OLAP cubes from AWM to OWB?

Update:
I wrote a procedure with bulk collect. It turns out that the DDS_CUBE is causing problems. The query selects from it around 238k rows which are the total amount of rows in the cube for the selected month and then it just stops, it doesn't proceed the rest of the query to select from the other cubes.
Also, lets say my select statement is like this:
SELECT <cols> FROM DDS_CUBE
LEFT JOIN GFO_CUBE on <join>
LEFT JOIN KD_CUBE on <join>
LEFT JOIN ZL_CUBE on <join>
WHERE <condition that select only the members of the lowest dimension levels and for only one month>
And I'm wondering why does the execution plan does right join on the GFO, KD and ZL cubes and not a LEFT join based on the DDS_CUBE.
It goes selecting all(all months, all levels, everything) the rows of the other cubes (11M from ZL and 238k from DDS, and there it stops, doesn't proceed to KD or GFO cube). Why isn't just selecting first the needed 238k from DDS_CUBE and then filter only the needed ones from the other cubes?

11g Parallel Execution on AIX 6 - SMT Enabled or Disabled?

Greetings,
I've had no luck searching for an answer to this question and I'm hoping someone can answer it:
Can Oracle 11g Parallel Execution spread the "granules" of paralllism across the threads (logical cpus) in an AIX SMT enabled environment, or should SMT be disabled and the "granules" be spread scross the processors (virtual cpus)? The application is a data warehouse in a non-RAC configuration using a p570 server. From what I've read, the server must be SMP for Oracle parallel execution capabilities to be maximized, but I think all AIX servers are SMP (not sure if the server needs to be ordered as an SMP server). I'm mostly concerned with the data load processing at this point, and not so concerned for the query right now. I believe AIX 6.1 can enable/disable SMT dynamically. So would it make sense to disable during data loads, and enable for DSS query?
Hope the question makes sense. Thanks for any help in advance!

SMT will determine Oracle's cpu_count parameter.
However this is a static parameter.
So it won't work, and it might be even dangerous to change it on the fly.
Sybrand Bakker
Senior Oracle DBA
Experts: those who did read documentation.

How to run multiple CodedUI Ordered Tests over multiple Test Agents for parallel execution using Test Controller

we are using VS 2013, I need to run multiple Coded UI Ordered Tests in parallel on different agents.
My requirement :
Example: I have 40 Coded UI Test scripts in single solution/project. i want to run in different OS environments(example 5 OS ). I have created 5 Ordered tests with the same 40 test cases.
I have one Controller machine and 5 test agent machines. Now I want my tests to be distributed in a way that every agent gets 1 Ordered test to execute.
Machine_C = Controller (Controls Machine_1,2,3,4,5)
Machine_1 = Test Agent 1 (Should execute Ordered Test 1 (ex: OS - WIN 7) )
Machine_2 = Test Agent 2 (Should execute Ordered Test 2 (ex:
OS - WIN 8) )
Machine_3 = Test Agent 3 (Should execute Ordered Test 3
(ex: OS - WIN 2008 server) )
Machine_4 = Test Agent 4 (Should execute Ordered Test 4 (ex:
OS - WIN 2012 server) )
Machine_5 = Test Agent 5 (Should execute Ordered Test 5 (ex:
OS - WIN 2003 server) )
I have changed the “MinimumTestsPerAgent” app setting value
as '1' in controller’s configuration file (QTController.exe.config).
When I run the Ordered tests from the test explorer all Test agent running with each Ordered test and showing the status as running. but with in the 5 Test Agents only 2 Agents executing the test cases remaining all 3 agents not executing the test cases but
status showing as 'running' still for long time (exp: More then 3 hr) after that all so its not responding.
I need to know how I can configure my controller or how I can tell it to execute these tests in parallel on different test agents. This will help me reducing the script execution time.
I am not sure what steps I am missing.
It will be of great help if someone can guide me how this can be achieved.
-- > One more thing Can I Run one Coded UI Ordered Test on One Specific Test Agent?
ex: Need to run ordered Test 1 in Win 7 OS (Test Agent 1) only.
Thanks in Advance.

Hi Divakar,
Thank you for posting in MSDN forum.
As far as I know, we cannot specify coded UI ordered test run on specific test agent. And it is mainly that test controller determine which coded UI ordered test assign to which test agent.
Generally, I know that if we want to run multiple CodedUI Ordered Tests over multiple Test Agents for parallel execution using Test Controller.
We will need to change the MinimumTestsPerAgent property to 1 in the test controller configuration file (QTControllerConfig.exe.config) as you said.
And then we will need to change the bucketSize number of tests/number of machines in the test settings.
For more information about how to set this bucketSize value, please refer the following blog.
http://blogs.msdn.com/b/aseemb/archive/2010/08/11/how-to-run-automated-tests-on-different-machines-in-parallel.aspx
You can refer this Jack's suggestion to run your coded UI ordered test in lab Environment or load test.
https://social.msdn.microsoft.com/Forums/vstudio/en-US/661e73da-5a08-4c9b-8e5a-fc08c5962783/run-different-codedui-tests-simultaneously-on-different-test-agents-from-a-single-test-controller?forum=vstest
Best Regards,
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Parallel execution of multiple scripts

Hi All,
I understand that by using parallel hint we can achieve parallel execution of the queries(insert/update/delete).
For my today's question I would like know if Parallelism can be achieved for the following scenario.
I have a script with an insert-select statement and multiple merge statements and few update statements all on the same table.
I have to run this script 12 times on the same table, once for each month of the year.
Currently we run for Jan (where record_date = '201001') commit it, and then run for Feb, and so on.
Can all the 12 month be run in parallel. One way I can think of is create 12 different scripts and kick them of by opening 12 different SQL Plus sessions (all on the same table).
Is there a better way of doing this ?
Note: each month data will not effect the other other month data.
Regards,
Aj

Creating 12 different scripts would be a sub-optimal solution, and a maintenance nightmare. Creating 1 parametrized script and call that 12 times with different parameters would be slightly better.
Creating 1 stored procedure with parameters, and run that procedure in the scheduler 12 times would still be better, as everything runs at the server side only.
Your description is deliberately vague, so the possibility of deadlock can not be excluded.
Sybrand Bakker
Senior Oracle DBA

Parallel Execution questions

Hi everyone, i have few questions about Parallel Execution.
1- Query Coordinator to scan the table, split up the table to the processes. But, each process take different number of rows. For example, in oracle 10g database architecture, thomas kyte gave an example:
"SELECT COUNT(*) FROM BIG_TABLE"
It is distributed to 4 processes. One process take 1000 rows, another process 1200 etc. Why this is not equal? How the number of rows is determined by the QC?
2- If we do not determine the degree of parallelism ( /*+ PARALLEL(B) */ instead of /*+ PARALLEL(B,16) */ ) how the cbo determine the degree of parallelism?
3- in the explain plan i see lots of thing i do not know. For example :
:TQ10000
what is that?
-> TQ, IN-OUT, PQ_Disturb columns?
thanks for responses.

Hi
Why this is not equal? How the number of rows is determined by the QC?The number of rows is not used to split the table. Data is split in granules and distributed to the slave processed based on two methods:
- partition granules: a whole partition is given to a specific slave process
- block range granules: range of blocks are given to each slave process
So, depending on the size of the granules, one slave process might process much more data than another.
If we do not determine the degree of parallelism how the cbo determine
the degree of parallelism?It depends on the configuration. In fact, there is a default at session level, at system level and at table level. Depending which ones are set, a DOP is chosen. In addition, the DOP might be decreased at runtime (before the execution starts, not dynamically during it).
For example : :TQ10000 what is that?Producers send data to consumers through so called "table queues" (TQ). The number, in your case 10000, is just a identifier generated by the database engine.
TQTable queue, e.g.: TQ10000 -> Q1,00
IN-OUTThis is the relationship between parallel operations. E.g. P->P means that a parallel operation sends data to another parallel operation.
PQ_Disturb columns?This is the method used to distribute rows. E.g. RANGE means that the producers send specific ranges of rows to different consumers.
For a more detailed discussion about these topics have a look to the documentation:
http://download.oracle.com/docs/cd/B19306_01/server.102/b14223/usingpe.htm#i1009828
HTH
Chris Antognini
Author of Troubleshooting Oracle Performance, Apress 2008 (http://top.antognini.ch)

Parallel execution in a web template

We have a web template with several queries. It is possible execute our queries with parallel execution?
Thanks !!

Hi Dani,
currently all DP's are executed sequentially, because in general it would be possible that the dataproviders have influence on each other.
i heard that sap is building a prototyp to allow parallelization in BEX web 7.0. But currently there is no release date known, May this will come with some enhancement package.
You should consider the Functional enhancement schedule on http://service.sap.com/bi. If this feature will be released sometime, it will be listed there.
best regards,
Kai

Parallel execution of multiple test cases.

Does flex unit 4.x version supports for parallel execution of multiple test cases?
Any help will be greatly appreciated.

No.
Flash Player and AIR are single-threaded virtual machines. The only parallel execution one could do is during asynchronous tests, but we do not support that presently for a variety of reasons.
Mike

Parallel execution

Hello!
One of my views includes
"decode" in which one of expressions is "select from ... " ,
all indexes and tables have degree of parallelism equal 1,
and only sometimes I see parallel execution of guery.
My question is
whether can my decode's become the reason of parallel execution?
Thanks and regards,
Pavel

Hi Pavel,
Pavel wrote:
Hello!
One of my views includes
"decode" in which one of expressions is "select from ... " ,
all indexes and tables have degree of parallelism equal 1,
and only sometimes I see parallel execution of guery.
My question is
whether can my decode's become the reason of parallel execution?No, decision to run a statement in parallel is taken based on many considerations, e.g. degree of parallelism of the objects involved, session settings (parallel query/parallel DML), cost etc. but use of decode function isn't one of them.
Best regards,
Nikolay

Parallel Execution against Normal Execution

Hi,
Can someone explain why in this case Serial Execution is faster although enabling parallel dml at session level , What are the possibilities to improve speed of executoin for parallel execution as i need to populate for 139 stores data having around half a million rows for each store , i will have to run a cursor on the distinct value of store to achieve this , just to test i got the following Results , can anyoe guide where i am going Wrong?
This is the Script
set timing on
insert into r8_win_store
select * from win_store@rms8 where store=99;
commit;
alter session enable parallel dml;
insert /*+ Parallel(t,8) */ into r8_win_store t
select /*+ parallel(e,8)*/ * from win_store@rms8 e where e.store=99;
commit;
alter session disable parallel dml;
OUtput
SQL> @test1.sql
299666 rows created.
Elapsed: 00:03:48.12
Commit complete.
Elapsed: 00:00:00.01
Session altered.
Elapsed: 00:00:00.00
299666 rows created.
Elapsed: 00:08:02.81
Commit complete.
Elapsed: 00:00:01.31
Session altered.
Elapsed: 00:00:00.00

Parallel processing in Oracle is intended to reduce I/O latency. When you tell the kernel to do an I/O, you need to wait for that call to complete - disk platters to spin, disk controller heads to move, etc.
If you need to make a bunch of I/O calls after one another, you will spend up to 90% of the elapsed time waiting for that I/O to actually put the data into your buffer to process.
Now imagine doing a million I/Os.. and 90% of the time spend waiting for I/O to complete. A big performance knock and a frustrating one - as you cannot make that actual I/O any faster. It is simply slow. The slowest operation you can do on the computer and you're doing a million of them.
Parallel processing in Oracle addresses this problem. There can be sufficient I/O bandwidth to make a 100 I/O calls per second. But your process that does an I/O call, wait, process, and does an I/O call, wait, process, can only reach a speed of 10 I/O calls per second.
Which means 90% of the I/O pipe is free to do I/O in parallel. So instead of a single process doing that million I/Os (using 10% I/O bandwidth/thruput), Oracle spawns 10 process each doing a 100K I/Os each - thus making better use of the I/O thruput.
So Oracle PQ is useless if you scan small volumes of data - it is intended for large volumes of data. There are overheads in PQ as the parallel processes have to be coordinated in order to work together. When each only needs to do 10 I/Os, the time spend on coordination alone can be more than what the time would have been to simply do a 100 I/Os using a single process.
It is also a fallacy that number of CPUs determine the just how many parallel processes you can start. The real determining factor is the load you can put on your I/O subsystem.
Bottom line is that PQ is nothing "special" or "magic". It is simply a method to reduce I/O latency by performing parallel I/O. And it is only sensible to use when the amount of I/O to be done warrants parallel processing.
Oh yeah - and the CBO is very capable in deciding when to use PQ and not. So rather than force PQ down the CBO's throat using the PARALLEL clause and hardcoding the degrees and instances, it should rather make those decisions (as informed decisions) itself. Which means using the PARALLEL clause on tables and not as SQL hints. The DBA can easily tune that by altering the PARALLEL clause if a table.. The DBA cannot by any means do the same thing when dealing with SQLs that insists on a specific number of PQ processes on a specific number of instances.

Parallel execution for Expression Filters

I'm looking for any information on whether expression filters are amenable to parallel execution or not.
I had a look through the documentation without success, and saw that in the type declarations for supporting objects there is no mention of DETERMINISTIC or PARALLEL_ENABLE. However, the static functions and procedures do not look like they have any constructs that the database would see as an impediment for parallel execution.
Can anyone advise on this?

Thanks for that.
Maybe in a parallel query environment the index will not be used. But I was really wondering whether the execution of the Evaluate function itself would be parallelised, as it invokes functions that are not explicitly marked as deterministic or as safe for parallel execution.
http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14251/adfns_packages.htm#BABIGDGE
Well, I'll see if I can investigate (maybe I'll have to suspend those system triggers that prevent modification of the Type ... just for experimental reasons, you understand).

Parallel Execution and Partitioning ?

Hi,
Can anybody explain me -- "How to implement Parallel execution and Partitioning in Data Warehouse?" on a single server.
Any examples related to implement Parallel Execution helps me a lot.
Thanks in Advance,
-Vency

Hi Vency,
Try posting this in the following forum:
General Database Discussions
Thanks, Mark

Parallel Execution and disk affinity on MPP

Hello,
In Chapter 25 Using Parallel Execution
Oracle® Database Data Warehousing Guide
10g Release 2 (10.2)
Part Number B14223-02
There is a very short quote "Additionally, Oracle Database considers the disk affinity of the granules on MPP systems to take advantage of the physical proximity between parallel execution servers and disks."
I understand the benefits but :
- I'm wondering what it really means ?
- How it can work ?
- How to demonstrate, show this phenomenon ?
Best Regards,
Gregory

Hi Vency,
Try posting this in the following forum:
General Database Discussions
Thanks, Mark

Parallel execution on WebJobs using ServiceBusTrigger

Does ServiceBusTrigger support the Parallel execution functionality of QueueTrigger?
The one described here: http://azure.microsoft.com/en-us/documentation/articles/websites-dotnet-webjobs-sdk-storage-queues-how-to/
Regards, Andres.

Hi Andres,
From your description, I recommend you could refer to Azure webjobs SDK service bus:
http://azure.microsoft.com/en-us/documentation/articles/websites-dotnet-webjobs-sdk-service-bus/
You need use service bus queue trigger.
You also create a project about webjobs and service bus.
Resource:
http://azure.microsoft.com/en-us/documentation/articles/websites-webjobs-resources/
Regards,
Will
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

ORA-12842: Cursor invalidated during parallel execution Database driver err

Hi gurus,
I have got an PL/SQL package in DWH environment and sometimes it generates the follwoing error message:
ORA-12842: Cursor invalidated during parallel execution Database driver error...
When I restart the process, it runs successfully.
Any ideas about this behaviour?
Regards
Bernd

More info needed.
Which Oracle version?
Are you running up against a known bug? Check metalink.
Cheers,
Colin

Parallel execution in owb

Similar Messages

Maybe you are looking for