Subquery Factoring Help Needed

Question

Newb question here...
The following query with it's contained subquery's (With) does not seem to be working correctly.
In particular, the subquery titled "INSTANCES" wich is referenced 3 times (in the TRENDS, UNKNOWNS, and STARTS subquery) seems to provide no data when it is used in the "TRENDS" subquery as the end result gives me only one row, the row from the "STARTS" subquery.
If I duplicate the INSTANCES subquery 3 times so that each subquery is only referenced once, I get all the expected data in the TRENDS subquery....obviously this is not ideal..
Any insight is much appreciated.
Background info:
1. This query is used in HP Quality Center. The database reference is located here: http://support.openview.hp.com/selfsolve/document/KM749209/binary/QC10_DataBaseRefernce.zip?searchIdentifier=-5b22d9a5%3a126f600a568%3a-5b1a&resultType=document
2. Strings contained in @ symbols are parameters inserted into the query by Quality Center.
3. I have access only to SQL, no stored procedures or functions of any kind alllowed.
3. Oracle version is 10g - 10.2.0.3.0
4. I wouldn't consider myself an expert at SQL at all....other opimizations to this query would be welcome...
SELECT DT "DATE",
  SUM(NA) OVER (PARTITION BY TREND ORDER BY DT) NA,
  SUM(EXCLUDED) OVER (PARTITION BY TREND ORDER BY DT) EXCLUDED,
  SUM(BLOCKED) OVER (PARTITION BY TREND ORDER BY DT) BLOCKED,
  SUM(NOT_COMPLETED) OVER (PARTITION BY TREND ORDER BY DT) NOT_COMPLETED,
  SUM(NO_RUN) OVER (PARTITION BY TREND ORDER BY DT) NO_RUN,
  SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT) FAILED,
  SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT) PASSED,
  ((SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT)) + (SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT))) ATTEMPTED
  FROM
      WITH TSF_PATHS AS(
        SELECT CF_ITEM_PATH AS PATH FROM CYCL_FOLD WHERE CF_ITEM_ID IN ( @TestSet_Folder_ID@ )
      ), INSTANCES AS (
        SELECT TESTCYCL.TC_TESTCYCL_ID, RELEASE_CYCLES.RCYC_ID RCID FROM TESTCYCL
        JOIN CYCLE ON CYCLE.CY_CYCLE_ID=TESTCYCL.TC_CYCLE_ID
        LEFT JOIN RELEASE_CYCLES ON CYCLE.CY_ASSIGN_RCYC=RELEASE_CYCLES.RCYC_ID
        LEFT JOIN RELEASES ON RELEASE_CYCLES.RCYC_PARENT_ID=RELEASES.REL_ID
        JOIN TEST ON TEST.TS_TEST_ID=TESTCYCL.TC_TEST_ID
        WHERE CYCLE.CY_FOLDER_ID IN (SELECT CF_ITEM_ID FROM CYCL_FOLD, TSF_PATHS WHERE CF_ITEM_PATH LIKE TSF_PATHS.PATH || '%')
      ), TRENDS AS (
        SELECT 'TREND' TREND, DT,
          SUM(NOT_COMPLETED) NOT_COMPLETED,
          SUM(NO_RUN) NO_RUN,
          SUM(FAILED) FAILED,
          SUM(PASSED) PASSED,
          SUM(BLOCKED) BLOCKED,
          SUM(EXCLUDED) EXCLUDED,
          SUM(NA) NA
          FROM (
            SELECT TO_CHAR(AU_TIME, 'yyyy-mm-dd') DT,
              DECODE(AP_OLD_VALUE, 'Not Completed', -1, 0) + DECODE(AP_NEW_VALUE, 'Not Completed', 1, 0) NOT_COMPLETED,
              DECODE(AP_OLD_VALUE, 'No Run', -1, 0) + DECODE(AP_NEW_VALUE, 'No Run', 1, 0) NO_RUN,
              DECODE(AP_OLD_VALUE, 'Failed', -1, 0) + DECODE(AP_NEW_VALUE, 'Failed', 1, 0) FAILED,
              DECODE(AP_OLD_VALUE, 'Passed', -1, 0) + DECODE(AP_NEW_VALUE, 'Passed', 1, 0) PASSED,
              DECODE(AP_OLD_VALUE, 'Blocked', -1, 0) + DECODE(AP_NEW_VALUE, 'Blocked', 1, 0) BLOCKED,
              DECODE(AP_OLD_VALUE, 'Excluded', -1, 0) + DECODE(AP_NEW_VALUE, 'Excluded', 1, 0) EXCLUDED,
              DECODE(AP_OLD_VALUE, 'N/A', -1, 0) + DECODE(AP_NEW_VALUE, 'N/A', 1, 0) NA
            FROM AUDIT_LOG
            JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
            WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES )
            AND AU_ENTITY_TYPE='TESTCYCL'
            AND AP_FIELD_NAME='TC_STATUS'
        GROUP BY DT
        ORDER BY DT
      ), UNKNOWNS AS (
        SELECT COUNT(DISTINCT AU_ENTITY_ID) CNT
            FROM AUDIT_LOG
            JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
            WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES )
            AND AU_ENTITY_TYPE='TESTCYCL'
            AND AP_FIELD_NAME='TC_STATUS'
            AND DECODE(AP_OLD_VALUE, 'No Run', 0, 'Not Completed', 0, 'Failed', 0, 'Passed', 0, 'Blocked', 0, 'Excluded', 0, 'N/A', 0, 1) = 1
            AND AP_NEW_VALUE='No Run'
      ), STARTS AS (
        SELECT 'TREND' Trend, TO_CHAR(TO_DATE((SELECT DT FROM TRENDS WHERE ROWNUM=1), 'yyyy-mm-dd')-1, 'yyyy-mm-dd') DT, 0 NOT_COMPLETED, (SELECT COUNT(*) FROM INSTANCES)-(SELECT CNT FROM UNKNOWNS WHERE ROWNUM=1) NO_RUN, 0 FAILED, 0 PASSED, 0 BLOCKED, 0 EXCLUDED, 0 NA FROM DUAL
      SELECT * FROM STARTS
      UNION ALL
      SELECT * FROM TRENDS
)Edited by: user9191784 on Feb 22, 2010 9:36 AM

Answer 1

Lakmal,
Unfortunately, my hands are tied in Quality Center such that I can only use SQL queries that begin with "Select". As a result my queries have to be in the form:
SELECT * FROM (
  WITH X AS (....)
  SELECT ... FROM X
)Frank,
I have taken your approach and ensured each subquery works on it's own.
Here is some more info that might be useful though...
I tried to simplify the query to make it more user friendly and in doing so left out something that might reveal the underlying issue. Here is my original query below(using your suggestion to remove the in-line view).
You'll notice several parameters in the where statement in the INSTANCES subquery. Each parameter has a default value of -1 and in most situations, only one of these parameters will be used.
Here's the kicker....If I use an ID in the @Testset_Folder_Parameter@, the query works just fine. But if I use an ID in one of the other Paramters, I only get my data from the STARTS subquery and other references to the INSTANCES subquery seem to return no rows, as a result TREND_DATA is empty.
I'll try and add create/insert statements when I have time. It will have to be on the base tables, becuase as I mentioned, all subqueries work when executed alone, this issue only appears when I reference the INSTANCES subquery multiple times and when one of the parameters of ther than @TestSet_Folder_ID@ is used...
SELECT DT "DATE",
  SUM(NA) OVER (PARTITION BY TREND ORDER BY DT) NA,
  SUM(EXCLUDED) OVER (PARTITION BY TREND ORDER BY DT) EXCLUDED,
  SUM(BLOCKED) OVER (PARTITION BY TREND ORDER BY DT) BLOCKED,
  SUM(NOT_COMPLETED) OVER (PARTITION BY TREND ORDER BY DT) NOT_COMPLETED,
  SUM(NO_RUN) OVER (PARTITION BY TREND ORDER BY DT) NO_RUN,
  SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT) FAILED,
  SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT) PASSED,
  ((SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT)) + (SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT))) ATTEMPTED
  FROM
      WITH TSF_PATHS AS(
        SELECT CF_ITEM_PATH AS PATH FROM CYCL_FOLD WHERE CF_ITEM_ID IN ( @TestSet_Folder_ID@ )
      ),INSTANCES AS (
        SELECT TESTCYCL.TC_TESTCYCL_ID, RELEASE_CYCLES.RCYC_ID RCID FROM TESTCYCL
        JOIN CYCLE ON CYCLE.CY_CYCLE_ID=TESTCYCL.TC_CYCLE_ID
        LEFT JOIN RELEASE_CYCLES ON CYCLE.CY_ASSIGN_RCYC=RELEASE_CYCLES.RCYC_ID
        LEFT JOIN RELEASES ON RELEASE_CYCLES.RCYC_PARENT_ID=RELEASES.REL_ID
        JOIN TEST ON TEST.TS_TEST_ID=TESTCYCL.TC_TEST_ID
        WHERE  CY_ASSIGN_RCYC IN ( @CYCLE_ID@ )
          OR CYCLE.CY_FOLDER_ID IN (SELECT CF_ITEM_ID FROM CYCL_FOLD, TSF_PATHS WHERE CF_ITEM_PATH LIKE TSF_PATHS.PATH || '%')
          OR RELEASE_CYCLES.RCYC_PARENT_ID IN ( @Release_ID@ )
          OR RELEASES.REL_USER_06 IN ( @Ticket_ID@ )
      ), TREND_DATA AS(
        SELECT TO_CHAR(AU_TIME, 'yyyy-mm-dd') DT,
          DECODE(AP_OLD_VALUE, 'Not Completed', -1, 0) + DECODE(AP_NEW_VALUE, 'Not Completed', 1, 0) NOT_COMPLETED,
          DECODE(AP_OLD_VALUE, 'No Run', -1, 0) + DECODE(AP_NEW_VALUE, 'No Run', 1, 0) NO_RUN,
          DECODE(AP_OLD_VALUE, 'Failed', -1, 0) + DECODE(AP_NEW_VALUE, 'Failed', 1, 0) FAILED,
          DECODE(AP_OLD_VALUE, 'Passed', -1, 0) + DECODE(AP_NEW_VALUE, 'Passed', 1, 0) PASSED,
          DECODE(AP_OLD_VALUE, 'Blocked', -1, 0) + DECODE(AP_NEW_VALUE, 'Blocked', 1, 0) BLOCKED,
          DECODE(AP_OLD_VALUE, 'Excluded', -1, 0) + DECODE(AP_NEW_VALUE, 'Excluded', 1, 0) EXCLUDED,
          DECODE(AP_OLD_VALUE, 'N/A', -1, 0) + DECODE(AP_NEW_VALUE, 'N/A', 1, 0) NA
        FROM AUDIT_LOG
        JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
        WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES )
        AND AU_ENTITY_TYPE='TESTCYCL'
        AND AP_FIELD_NAME='TC_STATUS'
      ), TRENDS AS (
        SELECT 'TREND' TREND, DT,
          SUM(NOT_COMPLETED) NOT_COMPLETED,
          SUM(NO_RUN) NO_RUN,
          SUM(FAILED) FAILED,
          SUM(PASSED) PASSED,
          SUM(BLOCKED) BLOCKED,
          SUM(EXCLUDED) EXCLUDED,
          SUM(NA) NA
        FROM TREND_DATA
        GROUP BY DT
        ORDER BY DT
      ), UNKNOWNS AS (
        SELECT COUNT(DISTINCT AU_ENTITY_ID) CNT
            FROM AUDIT_LOG
            JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
            WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES )
            AND AU_ENTITY_TYPE='TESTCYCL'
            AND AP_FIELD_NAME='TC_STATUS'
            AND DECODE(AP_OLD_VALUE, 'No Run', 0, 'Not Completed', 0, 'Failed', 0, 'Passed', 0, 'Blocked', 0, 'Excluded', 0, 'N/A', 0, 1) = 1
            AND AP_NEW_VALUE='No Run'
      ), STARTS AS (
        SELECT 'TREND' Trend, TO_CHAR(TO_DATE((SELECT DT FROM TRENDS WHERE ROWNUM=1), 'yyyy-mm-dd')-1, 'yyyy-mm-dd') DT, 0 NOT_COMPLETED, (SELECT COUNT(*) FROM INSTANCES)-(SELECT CNT FROM UNKNOWNS WHERE ROWNUM=1) NO_RUN, 0 FAILED, 0 PASSED, 0 BLOCKED, 0 EXCLUDED, 0 NA FROM DUAL
      SELECT * FROM STARTS
      UNION ALL
      SELECT * FROM TRENDS)What has me baffled is that the following query works just fine. I've just duplicated the INSTANCES subquery, once for each time it is used in the following queries.
SELECT DT "DATE",
  SUM(NA) OVER (PARTITION BY TREND ORDER BY DT) NA,
  SUM(EXCLUDED) OVER (PARTITION BY TREND ORDER BY DT) EXCLUDED,
  SUM(BLOCKED) OVER (PARTITION BY TREND ORDER BY DT) BLOCKED,
  SUM(NOT_COMPLETED) OVER (PARTITION BY TREND ORDER BY DT) NOT_COMPLETED,
  SUM(NO_RUN) OVER (PARTITION BY TREND ORDER BY DT) NO_RUN,
  SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT) FAILED,
  SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT) PASSED,
  ((SUM(FAILED) OVER (PARTITION BY TREND ORDER BY DT)) + (SUM(PASSED) OVER (PARTITION BY TREND ORDER BY DT))) ATTEMPTED
  FROM
      WITH TSF_PATHS AS(
        SELECT CF_ITEM_PATH AS PATH FROM CYCL_FOLD WHERE CF_ITEM_ID IN ( @TestSet_Folder_ID@ )
      ),INSTANCES AS (
        SELECT TESTCYCL.TC_TESTCYCL_ID, RELEASE_CYCLES.RCYC_ID RCID FROM TESTCYCL
        JOIN CYCLE ON CYCLE.CY_CYCLE_ID=TESTCYCL.TC_CYCLE_ID
        LEFT JOIN RELEASE_CYCLES ON CYCLE.CY_ASSIGN_RCYC=RELEASE_CYCLES.RCYC_ID
        LEFT JOIN RELEASES ON RELEASE_CYCLES.RCYC_PARENT_ID=RELEASES.REL_ID
        JOIN TEST ON TEST.TS_TEST_ID=TESTCYCL.TC_TEST_ID
        WHERE  CY_ASSIGN_RCYC IN ( @CYCLE_ID@ )
          OR CYCLE.CY_FOLDER_ID IN (SELECT CF_ITEM_ID FROM CYCL_FOLD, TSF_PATHS WHERE CF_ITEM_PATH LIKE TSF_PATHS.PATH || '%')
          OR RELEASE_CYCLES.RCYC_PARENT_ID IN ( @Release_ID@ )
          OR RELEASES.REL_USER_06 IN ( @Ticket_ID@ )
      ),INSTANCES2 AS (
        SELECT TESTCYCL.TC_TESTCYCL_ID, RELEASE_CYCLES.RCYC_ID RCID FROM TESTCYCL
        JOIN CYCLE ON CYCLE.CY_CYCLE_ID=TESTCYCL.TC_CYCLE_ID
        LEFT JOIN RELEASE_CYCLES ON CYCLE.CY_ASSIGN_RCYC=RELEASE_CYCLES.RCYC_ID
        LEFT JOIN RELEASES ON RELEASE_CYCLES.RCYC_PARENT_ID=RELEASES.REL_ID
        JOIN TEST ON TEST.TS_TEST_ID=TESTCYCL.TC_TEST_ID
        WHERE  CY_ASSIGN_RCYC IN ( @CYCLE_ID@ )
          OR CYCLE.CY_FOLDER_ID IN (SELECT CF_ITEM_ID FROM CYCL_FOLD, TSF_PATHS WHERE CF_ITEM_PATH LIKE TSF_PATHS.PATH || '%')
          OR RELEASE_CYCLES.RCYC_PARENT_ID IN ( @Release_ID@ )
          OR RELEASES.REL_USER_06 IN ( @Ticket_ID@ )
      ),INSTANCES3 AS (
        SELECT TESTCYCL.TC_TESTCYCL_ID, RELEASE_CYCLES.RCYC_ID RCID FROM TESTCYCL
        JOIN CYCLE ON CYCLE.CY_CYCLE_ID=TESTCYCL.TC_CYCLE_ID
        LEFT JOIN RELEASE_CYCLES ON CYCLE.CY_ASSIGN_RCYC=RELEASE_CYCLES.RCYC_ID
        LEFT JOIN RELEASES ON RELEASE_CYCLES.RCYC_PARENT_ID=RELEASES.REL_ID
        JOIN TEST ON TEST.TS_TEST_ID=TESTCYCL.TC_TEST_ID
        WHERE  CY_ASSIGN_RCYC IN ( @CYCLE_ID@ )
          OR CYCLE.CY_FOLDER_ID IN (SELECT CF_ITEM_ID FROM CYCL_FOLD, TSF_PATHS WHERE CF_ITEM_PATH LIKE TSF_PATHS.PATH || '%')
          OR RELEASE_CYCLES.RCYC_PARENT_ID IN ( @Release_ID@ )
          OR RELEASES.REL_USER_06 IN ( @Ticket_ID@ )
      ), TREND_DATA AS(
        SELECT TO_CHAR(AU_TIME, 'yyyy-mm-dd') DT,
          DECODE(AP_OLD_VALUE, 'Not Completed', -1, 0) + DECODE(AP_NEW_VALUE, 'Not Completed', 1, 0) NOT_COMPLETED,
          DECODE(AP_OLD_VALUE, 'No Run', -1, 0) + DECODE(AP_NEW_VALUE, 'No Run', 1, 0) NO_RUN,
          DECODE(AP_OLD_VALUE, 'Failed', -1, 0) + DECODE(AP_NEW_VALUE, 'Failed', 1, 0) FAILED,
          DECODE(AP_OLD_VALUE, 'Passed', -1, 0) + DECODE(AP_NEW_VALUE, 'Passed', 1, 0) PASSED,
          DECODE(AP_OLD_VALUE, 'Blocked', -1, 0) + DECODE(AP_NEW_VALUE, 'Blocked', 1, 0) BLOCKED,
          DECODE(AP_OLD_VALUE, 'Excluded', -1, 0) + DECODE(AP_NEW_VALUE, 'Excluded', 1, 0) EXCLUDED,
          DECODE(AP_OLD_VALUE, 'N/A', -1, 0) + DECODE(AP_NEW_VALUE, 'N/A', 1, 0) NA
        FROM AUDIT_LOG
        JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
        WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES )
        AND AU_ENTITY_TYPE='TESTCYCL'
        AND AP_FIELD_NAME='TC_STATUS'
      ), TRENDS AS (
        SELECT 'TREND' TREND, DT,
          SUM(NOT_COMPLETED) NOT_COMPLETED,
          SUM(NO_RUN) NO_RUN,
          SUM(FAILED) FAILED,
          SUM(PASSED) PASSED,
          SUM(BLOCKED) BLOCKED,
          SUM(EXCLUDED) EXCLUDED,
          SUM(NA) NA
        FROM TREND_DATA
        GROUP BY DT
        ORDER BY DT
      ), UNKNOWNS AS (
        SELECT COUNT(DISTINCT AU_ENTITY_ID) CNT
            FROM AUDIT_LOG
            JOIN AUDIT_PROPERTIES ON AUDIT_LOG.AU_ACTION_ID=AUDIT_PROPERTIES.AP_ACTION_ID
            WHERE AU_ENTITY_ID IN ( SELECT TC_TESTCYCL_ID FROM INSTANCES2 )
            AND AU_ENTITY_TYPE='TESTCYCL'
            AND AP_FIELD_NAME='TC_STATUS'
            AND DECODE(AP_OLD_VALUE, 'No Run', 0, 'Not Completed', 0, 'Failed', 0, 'Passed', 0, 'Blocked', 0, 'Excluded', 0, 'N/A', 0, 1) = 1
            AND AP_NEW_VALUE='No Run'
      ), STARTS AS (
        SELECT 'TREND' Trend, TO_CHAR(TO_DATE((SELECT DT FROM TRENDS WHERE ROWNUM=1), 'yyyy-mm-dd')-1, 'yyyy-mm-dd') DT, 0 NOT_COMPLETED, (SELECT COUNT(*) FROM INSTANCES3)-(SELECT CNT FROM UNKNOWNS WHERE ROWNUM=1) NO_RUN, 0 FAILED, 0 PASSED, 0 BLOCKED, 0 EXCLUDED, 0 NA FROM DUAL
      SELECT * FROM STARTS
      UNION ALL
      SELECT * FROM TRENDS)