Parallel execution for Expression Filters

I'm looking for any information on whether expression filters are amenable to parallel execution or not.
I had a look through the documentation without success, and saw that in the type declarations for supporting objects there is no mention of DETERMINISTIC or PARALLEL_ENABLE. However, the static functions and procedures do not look like they have any constructs that the database would see as an impediment for parallel execution.
Can anyone advise on this?

Thanks for that.
Maybe in a parallel query environment the index will not be used. But I was really wondering whether the execution of the Evaluate function itself would be parallelised, as it invokes functions that are not explicitly marked as deterministic or as safe for parallel execution.
http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14251/adfns_packages.htm#BABIGDGE
Well, I'll see if I can investigate (maybe I'll have to suspend those system triggers that prevent modification of the Type ... just for experimental reasons, you understand).

Similar Messages

Parallel execution for transformation

Hi
I have a mapping which process around 6-7 million records every day, the mapping has 5 expression and 4 joiner transformation. 1 expression transformation is very complex which is using patition clause window. My question is how can i parallise the dml operation in mapping. Any help will be greatly appreciated.
Thanks

See the post below for defining parallel hints on OWB mapping objects;
https://blogs.oracle.com/warehousebuilder/entry/owb_11gr2_parallel_dml_and_query
Cheers
David

Can I use Parallel execution for Global Temporary table within SP and How

Dear Gurus,
I have Global temporary table as below
Create global temporary table Temp_Emp
empno number,
ename varchar2(20),
deptno number
) on commit preserve rows;
During processing I insert the data into this table and then fire query on Temp_Emp, get the data and pass it to front end.
The SP as shown below
Create or replace procedure get_emp_data
empid in number,
emp_detail out RefCsr -- Ref cursor
as
begin
-- some code here
open emp_detail for
select *
from Temp_Emp
where empno = empid;
end get_emp_data;
Can use Parallel Query execution on Temp_Emp table and how ?
i.e. do need to explicitly use parallel construct in query or is it default.
Because I have many SQL like above (on global temporary tables) within Stored Procedures.
Can anybody give me any suggestion.
Thanking in Advance
Sanjeev

How come you are populating a temporary table and then opening a cursor on this temporary table for the front end to use?
Couldn't you presumably just form a query out of the code you use to populate the temporary table? This is the recommended approach in Oracle.

How to run multiple CodedUI Ordered Tests over multiple Test Agents for parallel execution using Test Controller

we are using VS 2013, I need to run multiple Coded UI Ordered Tests in parallel on different agents.
My requirement :
Example: I have 40 Coded UI Test scripts in single solution/project. i want to run in different OS environments(example 5 OS ). I have created 5 Ordered tests with the same 40 test cases.
I have one Controller machine and 5 test agent machines. Now I want my tests to be distributed in a way that every agent gets 1 Ordered test to execute.
Machine_C = Controller (Controls Machine_1,2,3,4,5)
Machine_1 = Test Agent 1 (Should execute Ordered Test 1 (ex: OS - WIN 7) )
Machine_2 = Test Agent 2 (Should execute Ordered Test 2 (ex:
OS - WIN 8) )
Machine_3 = Test Agent 3 (Should execute Ordered Test 3
(ex: OS - WIN 2008 server) )
Machine_4 = Test Agent 4 (Should execute Ordered Test 4 (ex:
OS - WIN 2012 server) )
Machine_5 = Test Agent 5 (Should execute Ordered Test 5 (ex:
OS - WIN 2003 server) )
I have changed the “MinimumTestsPerAgent” app setting value
as '1' in controller’s configuration file (QTController.exe.config).
When I run the Ordered tests from the test explorer all Test agent running with each Ordered test and showing the status as running. but with in the 5 Test Agents only 2 Agents executing the test cases remaining all 3 agents not executing the test cases but
status showing as 'running' still for long time (exp: More then 3 hr) after that all so its not responding.
I need to know how I can configure my controller or how I can tell it to execute these tests in parallel on different test agents. This will help me reducing the script execution time.
I am not sure what steps I am missing.
It will be of great help if someone can guide me how this can be achieved.
-- > One more thing Can I Run one Coded UI Ordered Test on One Specific Test Agent?
ex: Need to run ordered Test 1 in Win 7 OS (Test Agent 1) only.
Thanks in Advance.

Hi Divakar,
Thank you for posting in MSDN forum.
As far as I know, we cannot specify coded UI ordered test run on specific test agent. And it is mainly that test controller determine which coded UI ordered test assign to which test agent.
Generally, I know that if we want to run multiple CodedUI Ordered Tests over multiple Test Agents for parallel execution using Test Controller.
We will need to change the MinimumTestsPerAgent property to 1 in the test controller configuration file (QTControllerConfig.exe.config) as you said.
And then we will need to change the bucketSize number of tests/number of machines in the test settings.
For more information about how to set this bucketSize value, please refer the following blog.
http://blogs.msdn.com/b/aseemb/archive/2010/08/11/how-to-run-automated-tests-on-different-machines-in-parallel.aspx
You can refer this Jack's suggestion to run your coded UI ordered test in lab Environment or load test.
https://social.msdn.microsoft.com/Forums/vstudio/en-US/661e73da-5a08-4c9b-8e5a-fc08c5962783/run-different-codedui-tests-simultaneously-on-different-test-agents-from-a-single-test-controller?forum=vstest
Best Regards,
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

11g Parallel Execution on AIX 6 - SMT Enabled or Disabled?

Greetings,
I've had no luck searching for an answer to this question and I'm hoping someone can answer it:
Can Oracle 11g Parallel Execution spread the "granules" of paralllism across the threads (logical cpus) in an AIX SMT enabled environment, or should SMT be disabled and the "granules" be spread scross the processors (virtual cpus)? The application is a data warehouse in a non-RAC configuration using a p570 server. From what I've read, the server must be SMP for Oracle parallel execution capabilities to be maximized, but I think all AIX servers are SMP (not sure if the server needs to be ordered as an SMP server). I'm mostly concerned with the data load processing at this point, and not so concerned for the query right now. I believe AIX 6.1 can enable/disable SMT dynamically. So would it make sense to disable during data loads, and enable for DSS query?
Hope the question makes sense. Thanks for any help in advance!

SMT will determine Oracle's cpu_count parameter.
However this is a static parameter.
So it won't work, and it might be even dangerous to change it on the fly.
Sybrand Bakker
Senior Oracle DBA
Experts: those who did read documentation.

Parallel execution of multiple scripts

Hi All,
I understand that by using parallel hint we can achieve parallel execution of the queries(insert/update/delete).
For my today's question I would like know if Parallelism can be achieved for the following scenario.
I have a script with an insert-select statement and multiple merge statements and few update statements all on the same table.
I have to run this script 12 times on the same table, once for each month of the year.
Currently we run for Jan (where record_date = '201001') commit it, and then run for Feb, and so on.
Can all the 12 month be run in parallel. One way I can think of is create 12 different scripts and kick them of by opening 12 different SQL Plus sessions (all on the same table).
Is there a better way of doing this ?
Note: each month data will not effect the other other month data.
Regards,
Aj

Creating 12 different scripts would be a sub-optimal solution, and a maintenance nightmare. Creating 1 parametrized script and call that 12 times with different parameters would be slightly better.
Creating 1 stored procedure with parameters, and run that procedure in the scheduler 12 times would still be better, as everything runs at the server side only.
Your description is deliberately vague, so the possibility of deadlock can not be excluded.
Sybrand Bakker
Senior Oracle DBA

Parallel Execution questions

Hi everyone, i have few questions about Parallel Execution.
1- Query Coordinator to scan the table, split up the table to the processes. But, each process take different number of rows. For example, in oracle 10g database architecture, thomas kyte gave an example:
"SELECT COUNT(*) FROM BIG_TABLE"
It is distributed to 4 processes. One process take 1000 rows, another process 1200 etc. Why this is not equal? How the number of rows is determined by the QC?
2- If we do not determine the degree of parallelism ( /*+ PARALLEL(B) */ instead of /*+ PARALLEL(B,16) */ ) how the cbo determine the degree of parallelism?
3- in the explain plan i see lots of thing i do not know. For example :
:TQ10000
what is that?
-> TQ, IN-OUT, PQ_Disturb columns?
thanks for responses.

Hi
Why this is not equal? How the number of rows is determined by the QC?The number of rows is not used to split the table. Data is split in granules and distributed to the slave processed based on two methods:
- partition granules: a whole partition is given to a specific slave process
- block range granules: range of blocks are given to each slave process
So, depending on the size of the granules, one slave process might process much more data than another.
If we do not determine the degree of parallelism how the cbo determine
the degree of parallelism?It depends on the configuration. In fact, there is a default at session level, at system level and at table level. Depending which ones are set, a DOP is chosen. In addition, the DOP might be decreased at runtime (before the execution starts, not dynamically during it).
For example : :TQ10000 what is that?Producers send data to consumers through so called "table queues" (TQ). The number, in your case 10000, is just a identifier generated by the database engine.
TQTable queue, e.g.: TQ10000 -> Q1,00
IN-OUTThis is the relationship between parallel operations. E.g. P->P means that a parallel operation sends data to another parallel operation.
PQ_Disturb columns?This is the method used to distribute rows. E.g. RANGE means that the producers send specific ranges of rows to different consumers.
For a more detailed discussion about these topics have a look to the documentation:
http://download.oracle.com/docs/cd/B19306_01/server.102/b14223/usingpe.htm#i1009828
HTH
Chris Antognini
Author of Troubleshooting Oracle Performance, Apress 2008 (http://top.antognini.ch)

Expression Filters Performance

Hi,
I'm trying to test the expression filters functionality using two tables:
Env: Oracle 11g R2 (11.2.0.2) EE on AIX
T1 is the data table and contains about 90 million rows with around 60 columns. Only 4 columns are evaluated in the filter with three of them always having a value (me_cat, me_tp, me_code) and the other one (base_plan) having nulls in some rows.
T2 contains 666 expressions using the four columns I mentioned before in every expression.
I have tried different parameters for the index on the T2(expression column) but it doesn't help at all.
This is the query I'm using:
insert into ma_pps_mpt_eligibles
select
m.id_monthly_record,
m.id_client,
m.name_client,
m.cd_sex,
m.cd_race,
m.dt_birth,
m.sig,
m.dt_elig,
m.dt_smib_from,
m.dt_smib_thru,
m.flag_smib,
m.cd_buy_in,
m.base_plan,
m.mc_county,
m.mc_statuscode,
m.mc_cd_occur,
m.me_cat,
m.me_code,
m.dt_me_open,
m.dt_me_close,
m.me_tp,
m.me_sd,
m.me_cd_occur,
m.age,
m.contractor,
m.mc_plan,
m.dt_mc_from,
m.dt_mc_to,
m.cd_smib_buyin,
m.id_hmo,
m.id_state_rg,
m.excl_prem,
m.excl_count,
m.rate_pure,
m.rate_admin,
m.page_count,
m.rg_page,
m.voucher_page,
m.id_provider_sp,
m.srv_grp,
m.srv_code,
m.med_choice_code,
m.dt_admit,
m.dt_discharge,
m.dt_int_admit,
m.flag_alias,
m.id_client_real,
m.zip_mail,
m.size_family,
m.income_family,
m.education,
m.id_case,
m.flag_tx_hold,
m.id_type_plan,
m.cd_partition,
m.validity,
m.hic,
m.ssn,
m.flag_lockin,
m.counter,
m.rg_comp_id,
t.id_mtp_elig_rule
from
ma_pps_monthly m,
ma_pps_mtp_elig_rules_exp t
where
m.cd_partition = '201104' and
m.validity = 0 and
evaluate
t.mtp_rule_condition,
ty_ma_pps_mtp_elig_attr (m.me_cat, m.me_tp, m.me_code, m.base_plan).getvarchar()
) = 1
What I'm doing/assuming wrong here?
Has anyone tried to evaluate such amount of data?
Regards,
Galo

what exactly is the problem? it doesn't work? it takes too long?

What is the algorithmn for smoothing filtering in Filter VI?

What is the algorithmn for smoothing filtering found in Filter VI of Labview 7?

The Smoothing selection the the Filter Express VI uses a moving average. To do this it implements an IIR filter. You can open the Filter Express VI up and look inside (to a point) to see exactly how it is working. You can't see the algorithm that they used for the IIR itself, however. To open it up, drop one, configure it, and then right click on the icon and select Open front panel from the menu list.
Hope that this helps,
Bob Young
Bob Young - Test Engineer - Lapsed Certified LabVIEW Developer
DISTek Integration, Inc. - NI Alliance Member
mailto:[email protected]

Parallel execution of multiple test cases.

Does flex unit 4.x version supports for parallel execution of multiple test cases?
Any help will be greatly appreciated.

No.
Flash Player and AIR are single-threaded virtual machines. The only parallel execution one could do is during asynchronous tests, but we do not support that presently for a variety of reasons.
Mike

Parallel execution

Hello!
One of my views includes
"decode" in which one of expressions is "select from ... " ,
all indexes and tables have degree of parallelism equal 1,
and only sometimes I see parallel execution of guery.
My question is
whether can my decode's become the reason of parallel execution?
Thanks and regards,
Pavel

Hi Pavel,
Pavel wrote:
Hello!
One of my views includes
"decode" in which one of expressions is "select from ... " ,
all indexes and tables have degree of parallelism equal 1,
and only sometimes I see parallel execution of guery.
My question is
whether can my decode's become the reason of parallel execution?No, decision to run a statement in parallel is taken based on many considerations, e.g. degree of parallelism of the objects involved, session settings (parallel query/parallel DML), cost etc. but use of decode function isn't one of them.
Best regards,
Nikolay

Parallel Execution against Normal Execution

Hi,
Can someone explain why in this case Serial Execution is faster although enabling parallel dml at session level , What are the possibilities to improve speed of executoin for parallel execution as i need to populate for 139 stores data having around half a million rows for each store , i will have to run a cursor on the distinct value of store to achieve this , just to test i got the following Results , can anyoe guide where i am going Wrong?
This is the Script
set timing on
insert into r8_win_store
select * from win_store@rms8 where store=99;
commit;
alter session enable parallel dml;
insert /*+ Parallel(t,8) */ into r8_win_store t
select /*+ parallel(e,8)*/ * from win_store@rms8 e where e.store=99;
commit;
alter session disable parallel dml;
OUtput
SQL> @test1.sql
299666 rows created.
Elapsed: 00:03:48.12
Commit complete.
Elapsed: 00:00:00.01
Session altered.
Elapsed: 00:00:00.00
299666 rows created.
Elapsed: 00:08:02.81
Commit complete.
Elapsed: 00:00:01.31
Session altered.
Elapsed: 00:00:00.00

Parallel processing in Oracle is intended to reduce I/O latency. When you tell the kernel to do an I/O, you need to wait for that call to complete - disk platters to spin, disk controller heads to move, etc.
If you need to make a bunch of I/O calls after one another, you will spend up to 90% of the elapsed time waiting for that I/O to actually put the data into your buffer to process.
Now imagine doing a million I/Os.. and 90% of the time spend waiting for I/O to complete. A big performance knock and a frustrating one - as you cannot make that actual I/O any faster. It is simply slow. The slowest operation you can do on the computer and you're doing a million of them.
Parallel processing in Oracle addresses this problem. There can be sufficient I/O bandwidth to make a 100 I/O calls per second. But your process that does an I/O call, wait, process, and does an I/O call, wait, process, can only reach a speed of 10 I/O calls per second.
Which means 90% of the I/O pipe is free to do I/O in parallel. So instead of a single process doing that million I/Os (using 10% I/O bandwidth/thruput), Oracle spawns 10 process each doing a 100K I/Os each - thus making better use of the I/O thruput.
So Oracle PQ is useless if you scan small volumes of data - it is intended for large volumes of data. There are overheads in PQ as the parallel processes have to be coordinated in order to work together. When each only needs to do 10 I/Os, the time spend on coordination alone can be more than what the time would have been to simply do a 100 I/Os using a single process.
It is also a fallacy that number of CPUs determine the just how many parallel processes you can start. The real determining factor is the load you can put on your I/O subsystem.
Bottom line is that PQ is nothing "special" or "magic". It is simply a method to reduce I/O latency by performing parallel I/O. And it is only sensible to use when the amount of I/O to be done warrants parallel processing.
Oh yeah - and the CBO is very capable in deciding when to use PQ and not. So rather than force PQ down the CBO's throat using the PARALLEL clause and hardcoding the degrees and instances, it should rather make those decisions (as informed decisions) itself. Which means using the PARALLEL clause on tables and not as SQL hints. The DBA can easily tune that by altering the PARALLEL clause if a table.. The DBA cannot by any means do the same thing when dealing with SQLs that insists on a specific number of PQ processes on a specific number of instances.

Parallel execution on WebJobs using ServiceBusTrigger

Does ServiceBusTrigger support the Parallel execution functionality of QueueTrigger?
The one described here: http://azure.microsoft.com/en-us/documentation/articles/websites-dotnet-webjobs-sdk-storage-queues-how-to/
Regards, Andres.

Hi Andres,
From your description, I recommend you could refer to Azure webjobs SDK service bus:
http://azure.microsoft.com/en-us/documentation/articles/websites-dotnet-webjobs-sdk-service-bus/
You need use service bus queue trigger.
You also create a project about webjobs and service bus.
Resource:
http://azure.microsoft.com/en-us/documentation/articles/websites-webjobs-resources/
Regards,
Will
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

ORA-12842: Cursor invalidated during parallel execution

Hi,
Database version: 9.2.0.6.0
OS : Red Hat AS 3.
I encountered this problem lately in one of our scripts.
The error message shows:
BEGIN SP_RPT77B_V2(SYSDATE -1); END;
ERROR at line 1:
ORA-12842: Cursor invalidated during parallel execution
ORA-06512: at "REPORTADMIN.SP_RPT77B_V2", line 273
ORA-06512: at line 1
Elapsed: 00:02:49.60
Does anyone have any clues on what does this error messages means? Is there a way to rectified the problem?
Any advise, thanks.

Hi!
Check the error description --
ORA-12842 schema modified during parallel execution
Cause: Schema modified during the parse phase of parallel processing.
Action: No action required.
And the other error is --
ORA-06512 at string line string
Cause: Backtrace message as the stack is unwound by unhandled exceptions.
Action: Fix the problem causing the exception or write an exception handler for this condition. Or you may need to contact your application administrator or database administrator.
Regards.
Satyaki De.

Parallel executions on AIX

Hi,
9.2 AIX5.3
Since I enabled parallel executions, and table monitoring there are performance issues while database (warehouse) is loaded (sqlldr) .
The LRUD root process gets active and maxes up the CPU to extend that performance is trashed.
The process is active even after all db activities are gone.
Is there something that could be done from db side to tune-accommodate the AIX behavior?
The only solution so far is to disable the parallel executions that I'm reluctant to do.
Thx,

Greg Rahn wrote:
If LRUD is consuming lots of CPU and there is also a high paging rate, it would seem to point to an issue with the VMM file cache. Are you using direct I/O? Not doing so, while using PQ would cause the VMM file cache to be flooded with I/O requests from all the PQ slaves thus resulting in a high CPU usage for LRUD. Direct I/O allows I/O to bypass the VMM and eliminates LRUD from having to do any work at all - it bypasses this code path. This is a necessity while using PQ (as well as a recommendation in the Oracle docs).
Greg,
I was going to say "concurrent I/O" rather than "direct I/O" - but either way it looks like there's a load of memory being used for the filesystem cache when bypassing the cache and letting Oracle use the memory seems to be the obvious bet.
Nemohm
Could you supply a little more precise about your comments:
The LRUD root process gets active and maxes up the CPU to extend that performance is trashed.
The process is active even after all db activities are gone.When you say "after all db activities are gone" - do you mean just the heavy duty loader activity is complete, or has all activity from all other users stopped as well; and is this only during and directly after a loader session, or does it happen at other times when parallel queries are going on; and how long does it take before the LRU daemon calms down ? How many CPUs do you have, by the way ?
As Greg points out - parallel execution can result in a very heavy demand for I/O requests that bypass Oracle's own cache - this means that data that could have been thrashed through Oracle's cache when you run serially is suddenly thrashed through the filesystem cache (if hasn't been bypassed). Moreover, parallel execution often does things that put a heaavy load on the PGA memory - which could cause lots of (OS) memory pages to be reclaimed from the filesystem cache so that they can be used by Oracle processes in their PGA heaps.
In general: if you've got memory set it up so that Oracle can use it effectively - leaving it for the filesystem cache can help in some cases, but avoiding the filesystem cache is often the better bet.
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
"Science is more than a body of knowledge; it is a way of thinking" Carl Sagan

Parallel execution for Expression Filters

Similar Messages

Maybe you are looking for