Slow performance after 10g upgrade

Question

After upgrade from 9.2.0.3.0 to 10.2.0.1.0, the following query runs extremely slow, any suggestion how to adjust the DB settings without re-writing this query
SELECT SUM (ABS (ship_net_clc_amt))
FROM ship_dtl
WHERE order_section_number = '940007320686'
AND SUBSTR (misc_charge_code, 1, 2) IN ('72', '77', 'A9')
AND ics_status_flag2 IN ('W', 'S')
AND dsr_trans_date >= to_date('1/1/2008', 'MM/DD/YYYY')
AND dsr_trans_date < to_date('1/31/2008', 'MM/DD/YYYY')
AND product_base_number NOT IN (SELECT DISTINCT sku
FROM ap_smb_sku_based
WHERE fiscal_period = '200801'
AND country = 'TAIWAN')
AND quota_product_line_code IN (SELECT pl
FROM ap_pl_bu
WHERE bu = '3C')
The exec plan for 10g (optimizer mode = ALL ROWS) is
------------------------------------------------------------------------------------------------------------------------------|
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time | Pstart| Pstop ||
------------------------------------------------------------------------------------------------------------------------------|
| 0 | SELECT STATEMENT | | 1 | 49 | 7 (15)| 00:00:01 | | ||
| 1 | SORT AGGREGATE | | 1 | 49 | | | | ||
|* 2 | FILTER | | | | | | | ||
|* 3 | TABLE ACCESS BY LOCAL INDEX ROWID| SHIP_DTL | 1 | 42 | 1 (0)| 00:00:01 | 39 | 39 ||
| 4 | NESTED LOOPS | | 1 | 49 | 5 (20)| 00:00:01 | | ||
| 5 | SORT UNIQUE | | 1 | 7 | 3 (0)| 00:00:01 | | ||
|* 6 | TABLE ACCESS FULL | AP_PL_BU | 1 | 7 | 3 (0)| 00:00:01 | | ||
| 7 | PARTITION RANGE SINGLE | | 3 | | 0 (0)| 00:00:01 | 39 | 39 ||
|* 8 | INDEX RANGE SCAN | IX_SHIP_DTL_ORD_SEC_NM | 3 | | 0 (0)| 00:00:01 | 39 | 39 ||
| 9 | PARTITION RANGE SINGLE | | 1 | 39 | 2 (0)| 00:00:01 | 25 | 25 ||
|* 10 | TABLE ACCESS FULL | AP_SMB_SKU_BASED | 1 | 39 | 2 (0)| 00:00:01 | 25 | 25 ||
------------------------------------------------------------------------------------------------------------------------------|
The exec plan for 9i (optimizer mode=choose) for
----------------------------------------------------------------------------------------------------------------|
| Id | Operation | Name | Rows | Bytes | Cost | Pstart| Pstop ||
----------------------------------------------------------------------------------------------------------------|
| 0 | SELECT STATEMENT | | 1 | 47 | 10 | | ||
| 1 | SORT AGGREGATE | | 1 | 47 | | | ||
| 2 | FILTER | | | | | | ||
| 3 | HASH JOIN SEMI | | 1 | 47 | 8 | | ||
| 4 | TABLE ACCESS BY LOCAL INDEX ROWID| SHIP_DTL | 1 | 36 | 5 | 13 | 13 ||
| 5 | INDEX RANGE SCAN | IX_SHIP_DTL_ORD_SEC_NR | 9 | | 3 | 13 | 13 ||
| 6 | TABLE ACCESS FULL | AP_PL_BU | 2 | 22 | 2 | | ||
| 7 | TABLE ACCESS FULL | AP_SMB_SKU_BASED | 1 | 21 | 2 | 13 | 13 ||
Thanks.
Liz

Answer 1

ship_dtl has 94690531 records
ap_smb_sku_based has 19 records
ap_plbu has 19 records
The query returns a single row, because it calculates the sum. The query could be better written to get rid of IN or NOT IN which are costly. But I just wonder why the plans/performance are so different?
I used analyze to analyze other tables and it is still working fine in 10g. Now based on the plans, do you think anything wrong ?
10g -
-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Id  | Operation                                   | Name                   | Rows  | Bytes | Cost (%CPU)| Time     | Pstart| Pstop |    TQ  |IN-OUT| PQ Distrib ||
-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|   0 | SELECT STATEMENT                            |                        |     1 |    50 |    10 (-550| 00:00:01 |       |       |        |      |            ||
|   1 |  SORT AGGREGATE                             |                        |     1 |    50 |            |          |       |       |        |      |            ||
|*  2 |   FILTER                                    |                        |       |       |            |          |       |       |        |      |            ||
|*  3 |    PX COORDINATOR                           |                        |       |       |            |          |       |       |        |      |            ||
|   4 |     PX SEND QC (RANDOM)                     | :TQ10002               |     1 |    50 |    66   (5)| 00:00:01 |       |       |  Q1,02 | P->S | QC (RAND)  ||
|*  5 |      FILTER                                 |                        |       |       |            |          |       |       |  Q1,02 | PCWC |            ||
|   6 |       MERGE JOIN                            |                        |     1 |    50 |    66   (5)| 00:00:01 |       |       |  Q1,02 | PCWP |            ||
|   7 |        SORT JOIN                            |                        |     2 |    14 |     4  (50)| 00:00:01 |       |       |  Q1,02 | PCWP |            ||
|   8 |         BUFFER SORT                         |                        |       |       |            |          |       |       |  Q1,02 | PCWC |            ||
|   9 |          PX RECEIVE                         |                        |     4 |    28 |     2   (0)| 00:00:01 |       |       |  Q1,02 | PCWP |            ||
|  10 |           PX SEND HASH                      | :TQ10000               |     4 |    28 |     2   (0)| 00:00:01 |       |       |        | S->P | HASH       ||
|  11 |            SORT UNIQUE                      |                        |     4 |    28 |     2   (0)| 00:00:01 |       |       |        |      |            ||
|* 12 |             TABLE ACCESS FULL               | AP_PL_BU               |     4 |    28 |     2   (0)| 00:00:01 |       |       |        |      |            ||
|* 13 |        SORT JOIN                            |                        |     1 |    43 |    62   (2)| 00:00:01 |       |       |  Q1,02 | PCWP |            ||
|  14 |         PX RECEIVE                          |                        |     1 |    43 |    61   (0)| 00:00:01 |       |       |  Q1,02 | PCWP |            ||
|  15 |          PX SEND HASH                       | :TQ10001               |     1 |    43 |    61   (0)| 00:00:01 |       |       |  Q1,01 | P->P | HASH       ||
|  16 |           PX PARTITION RANGE ITERATOR       |                        |     1 |    43 |    61   (0)| 00:00:01 |   KEY |   KEY |  Q1,01 | PCWC |            ||
|* 17 |            TABLE ACCESS BY LOCAL INDEX ROWID| SHIP_DTL               |     1 |    43 |    61   (0)| 00:00:01 |   KEY |   KEY |  Q1,01 | PCWP |            ||
|* 18 |             INDEX RANGE SCAN                | IX_SHIP_DTL_ORD_SEC_NR |    14 |       |    49   (0)| 00:00:01 |   KEY |   KEY |  Q1,01 | PCWP |            ||
|  19 |    PARTITION RANGE SINGLE                   |                        |     1 |    39 |     2   (0)| 00:00:01 |    14 |    14 |        |      |            ||
|* 20 |     TABLE ACCESS FULL                       | AP_SMB_SKU_BASED       |     1 |    39 |     2   (0)| 00:00:01 |    14 |    14 |        |      |            ||
-------------------------------------------------------------------------------------------------------------------------------------------------------------------|Plan for 9i
-----------------------------------------------------------------------------------------------------------------------------------------------|
| Id  | Operation                              |  Name                   | Rows  | Bytes | Cost  | Pstart| Pstop |  TQ    |IN-OUT| PQ Distrib ||
-----------------------------------------------------------------------------------------------------------------------------------------------|
|   0 | SELECT STATEMENT                       |                         |     1 |    53 |    74 |       |       |        |      |            ||
|   1 |  SORT AGGREGATE                        |                         |     1 |    53 |       |       |       |        |      |            ||
|   2 |   FILTER                               |                         |       |       |       |       |       |        |      |            ||
|   3 |    FILTER                              |                         |       |       |       |       |       |        |      |            ||
|   4 |     HASH JOIN SEMI                     |                         |     1 |    53 |    72 |       |       | 30,01  | P->S | QC (RAND)  ||
|   5 |      PARTITION RANGE ITERATOR          |                         |       |       |       |   KEY |   KEY | 30,01  | PCWP |            ||
|   6 |       TABLE ACCESS BY LOCAL INDEX ROWID| SHIP_DTL                |     1 |    42 |    54 |   KEY |   KEY | 30,01  | PCWP |            ||
|   7 |        INDEX RANGE SCAN                | IX_SHIP_DTL_ORD_SEC_NR  |    21 |       |    37 |   KEY |   KEY | 30,01  | PCWP |            ||
|   8 |      TABLE ACCESS FULL                 | AP_PL_BU                |     2 |    22 |     2 |       |       | 30,00  | S->P | BROADCAST  ||
|   9 |    TABLE ACCESS FULL                   | AP_SMB_SKU_BASED        |     1 |    39 |     2 |    14 |    14 |        |      |            ||
-----------------------------------------------------------------------------------------------------------------------------------------------|