Database Link Problem-Peculiar SQL stmt execution.. Please help

Question

Hi all,
This is a strange problem i'm facing while running the following query.
This query is run on the local machine which is fetching data from another remote database. All the functions included also are fetching data from the remote database through db links.
I know lot of db links are into picture, but the requirement is like this only.
SQL :SELECT billing_extract_subscriber.get_external_id_types_descr
(ciem.external_id_type,
'ra_delhi'
) AS "EXTERNAL_ID_TYPE",
ciem.external_id, ciem.subscr_no customer_equip_map_subscr_no,
ciem.subscr_no_resets, s.subscr_no servive_subscriber_no,
s.service_active_dt, s.service_inactive_dt, s.is_prepaid,
billing_extract_subscriber.get_status_values_descr
(ss.status_id,
'ra_delhi'
) AS "STATUS_VALUES",
billing_extract_subscriber.get_status_type_values_descr
(ss.status_type_id,
'ra_delhi'
) AS "STATUS_TYPE_VALUES",
ss.subscr_no service_status_subscr_no, NULL "point_target",
NULL "customer_corridors_subscr_no", cmc.component_id, cmc.package_id,
billing_extract_subscriber.get_component_name_descr
(cmc.component_id,
'ra_delhi'
) AS "COMPONENT_NAME",
billing_extract_subscriber.get_package_def_values_descr
(cmc.package_id,
'ra_delhi'
) AS "PACKAGE_NAME",
cmc.component_status,
billing_extract_subscriber.get_mkt_code_values_descr
(cf.mkt_code,
'ra_delhi'
) AS "MKT_CODE",
cf.account_no,
billing_extract_subscriber.get_bill_period_descr
(cf.bill_period,
'ra_delhi'
) AS "BILL_PERIOD",
cf.account_type,
billing_extract_subscriber.get_account_category_descr
(cf.account_category,
'ra_delhi'
) AS "ACCOUNT_CATEGORY",
billing_extract_subscriber.get_gender_descr (cf.gender,
'ra_delhi'
) AS "GENDER"
FROM customer_id_equip_map@ra_delhi ciem,
service@ra_delhi s,
service_status@ra_delhi ss,
cmf_package_component@ra_delhi cmc,
cmf@ra_delhi cf
WHERE ciem.subscr_no = s.subscr_no
AND s.subscr_no = ss.subscr_no
AND s.parent_account_no = cf.account_no
AND s.service_active_dt >= cf.date_active
AND NVL (s.service_inactive_dt, '31-dec-9999') <=NVL (cf.date_inactive, '31-dec-9999')
AND s.service_active_dt <= ciem.active_date
AND NVL (s.service_inactive_dt, '31-dec-9999') >=NVL (ciem.inactive_date, '31-dec-9999')
AND cmc.parent_account_no = cf.account_no
AND ciem.active_date <= cmc.active_dt
AND NVL (ciem.inactive_date, '31-dec-9999') >=NVL (cmc.inactive_dt, '31-dec-9999');
*1. Now when i'm running this sql all as a whole I'm getting the error:*
ORA-00904: "S"."SERVICE_INACTIVE_DT": invalid identifier
ORA-02063: preceding line from RA_DELHI
Sometimes Invalid Identifier, sometimes invalid table etc. is coming.
*2. Now when i'm running the above query after breaking into two parts is :*
a. first part .. WHERE clause is removed -
SELECT billing_extract_subscriber.get_external_id_types_descr
(ciem.external_id_type,
'ra_delhi'
) AS "EXTERNAL_ID_TYPE",
ciem.external_id, ciem.subscr_no customer_equip_map_subscr_no,
ciem.subscr_no_resets, s.subscr_no servive_subscriber_no,
s.service_active_dt, s.service_inactive_dt, s.is_prepaid,
billing_extract_subscriber.get_status_values_descr
(ss.status_id,
'ra_delhi'
) AS "STATUS_VALUES",
billing_extract_subscriber.get_status_type_values_descr
(ss.status_type_id,
'ra_delhi'
) AS "STATUS_TYPE_VALUES",
ss.subscr_no service_status_subscr_no, NULL "point_target",
NULL "customer_corridors_subscr_no", cmc.component_id, cmc.package_id,
billing_extract_subscriber.get_component_name_descr
(cmc.component_id,
'ra_delhi'
) AS "COMPONENT_NAME",
billing_extract_subscriber.get_package_def_values_descr
(cmc.package_id,
'ra_delhi'
) AS "PACKAGE_NAME",
cmc.component_status,
billing_extract_subscriber.get_mkt_code_values_descr
(cf.mkt_code,
'ra_delhi'
) AS "MKT_CODE",
cf.account_no,
billing_extract_subscriber.get_bill_period_descr
(cf.bill_period,
'ra_delhi'
) AS "BILL_PERIOD",
cf.account_type,
billing_extract_subscriber.get_account_category_descr
(cf.account_category,
'ra_delhi'
) AS "ACCOUNT_CATEGORY",
billing_extract_subscriber.get_gender_descr (cf.gender,
'ra_delhi'
) AS "GENDER"
FROM customer_id_equip_map@ra_delhi ciem,
service@ra_delhi s,
service_status@ra_delhi ss,
cmf_package_component@ra_delhi cmc,
cmf@ra_delhi cf
The query is running fine.
b. when i'm running the another part where i'm removing the functions and replacing with then also it is running fine. e.g*
SELECT *
FROM customer_id_equip_map@ra_delhi ciem,
service@ra_delhi s,
service_status@ra_delhi ss,
cmf_package_component@ra_delhi cmc,
cmf@ra_delhi cf
WHERE ciem.subscr_no = s.subscr_no
AND s.subscr_no = ss.subscr_no
AND s.parent_account_no = cf.account_no
AND s.service_active_dt >= cf.date_active
AND NVL (s.service_inactive_dt, '31-dec-9999') <=NVL (cf.date_inactive, '31-dec-9999')
AND s.service_active_dt <= ciem.active_date
AND NVL (s.service_inactive_dt, '31-dec-9999') >=NVL (ciem.inactive_date, '31-dec-9999')
AND cmc.parent_account_no = cf.account_no
AND ciem.active_date <= cmc.active_dt
AND NVL (ciem.inactive_date, '31-dec-9999') >=NVL (cmc.inactive_dt, '31-dec-9999');
*3. I can trace out there is some problem related to the concurrent db links getting opened.*
i've done resizing the following parameters as well but isn't working :
NAME TYPE VALUE
open_cursors integer 3000
open_links integer 100
open_links_per_instance integer 100
read_only_open_delayed boolean FALSE
session_max_open_files integer 10
NAME TYPE VALUE
open_cursors integer 3000
open_links integer 100
open_links_per_instance integer 100
read_only_open_delayed boolean FALSE
session_max_open_files integer 10
SQL>
SQL> sho parameter distributed
NAME TYPE VALUE
distributed_lock_timeout integer 300
I've tried breaking up the query but in any case i'm opening same no. of dblinks. So it din't help me.
Kindly Suggset what to do? Is there any more parameter which govern maximum db links opened at a time? or is this problem due to someother reasons?
Database Details :
Version : 10.2.0.3.0
Platform : HP UX

Answer 1

Hi all,
NO RESPONSE AT ALL???
Well not a PROBLEM....
I got my solution so thought of writing it here for everybody's reference.
SQL> alter session set events '10176 trace name context forever';
Session altered.
SQL> alter system flush shared_pool;
System altered.
And then I have execute original query given by Prabhat, it's running fine.
Applies to:
Oracle Server - Enterprise Edition - Version: 10.2.0.1 to 11.1.0.7
This problem can occur on any platform.
Symptoms
-- Problem Statement:
Following query over dblink having Local database 9iR2 and remote 10gR2 works..
select *
from ctps3.institutions@ctps3 i,
ctps3.state_types@ctps3 s,ods.institutions oi
where s.stt_state_type_id (+) = i.stt_state_type_id
and oi.ctps_insttn_id = i.inst_insttn_id
and i.inst_modifd_dt = trunc(sysdate)
and (nvl (oi.inst_state_txt, 'x') <> nvl (s.stt_state_type_nm, 'x'))
and (nvl (oi.inst_phone_txt, 17) <> nvl (i.inst_phone_txt, 17));
The same query fails when both local and remote databases are 10g R2, with following errors:
ERROR at line 2:
ORA-00904: "OI"."INST_STATE_TXT": invalid identifier
ORA-02063: preceding line from CTPS3
Cause
Outer join query over dblink can fail with ORA-904, as referenced in:
Bug 6620988 QUERY OVER DBLINK FAILS WITH ORA-904 SELECTING DATE
Predicates are not checked to verify if they belong to same network node when we attempt to colocate the remote tables. This results in wrongly generating remote query and ORA-904
REDISCOVERY INFORMATION:
1. ORA-904
2. DB link
3. OJ predicates across network nodes
4. predicates wrongly pushed network nodes
Solution
-- To implement the solution, please execute the following steps::
Use the workaround of disabling colocated joins via event 10176 and force a hard parse to happen
(ie by flushing the shared pool), ie:
SQL> alter session set events '10176 trace name context forever';
SQL> alter system flush shared_pool;
or
For a permanent fix, request a One-Off Backport of 6620988 for the appropiate platform.
References
Bug 6620988 - QUERY OVER DBLINK FAILS WITH ORA-904 SELECTING DATE