How to delete the duplicate data in between two distinct rows in SQL?

Question

Hi,
I need to identify the duplicate data with two distinct rows. See my data structure below.
NAME NAME_1 VALUE START_DATE END_DATE FLAG INDEX
SUR SE 275 13/12/2005 31/12/2010 B 1
SUR SE 375 A 1
SUR SE 475 A 1
SUR SE 275 13/12/2005 31/12/2010 B 2
SUR SE 375 A 2
SUR SE 475 A 2
SUR SE 175 13/12/2006 31/12/2010 B 3
SUR SE 375 A 3
SUR SE 475 A 3
This is my sample data. Here data are duplicate with different index columns. INDEX 1 and 2 contains same group of combination. So i need to identify any one of duplicate combination(i.e INDEX 1 or 2). Can anyone come up with exact solution?
Thanks

Answer 1

Try this:
with test_table as
(select 'SUR' NAME, 'SE' NAME_1, 275 VALUE, '13/12/2005' START_DATE, '31/12/2010' END_DATE, 'B' FLAG, 1 IND from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 1 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 1 from dual union all
select 'SUR', 'SE', 275, '13/12/2005' ,'31/12/2010' ,'B', 2 from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 2 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 2 from dual union all
select 'SUR', 'SE', 175, '13/12/2006', '31/12/2010', 'B', 3 from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 3 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 3 from dual )
select t.*,
       CASE WHEN START_DATE IS NULL THEN
         first_value(row_number) OVER (PARTITION BY NAME, NAME_1, IND ORDER BY START_DATE)
       ELSE
         row_number
       END row_number
from (
SELECT t.*,
       CASE WHEN START_DATE IS NOT NULL THEN
         row_number() over(PARTITION BY NAME, NAME_1,VALUE, START_DATE, END_DATE, FLAG
                           ORDER BY IND)
       END row_number
  FROM test_table t) t
order by IND, start_dateNote that this is only checking for diferences in the rows where start_date is not null. Do you want to also check if the records where start_date is null it there are differences? If so you can do this:
with test_table as
(select 'SUR' NAME, 'SE' NAME_1, 275 VALUE, '13/12/2005' START_DATE, '31/12/2010' END_DATE, 'B' FLAG, 1 IND from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 1 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 1 from dual union all
select 'SUR', 'SE', 275, '13/12/2005' ,'31/12/2010' ,'B', 2 from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 2 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 2 from dual union all
select 'SUR', 'SE', 175, '13/12/2006', '31/12/2010', 'B', 3 from dual union all
select 'SUR', 'SE', 375, null, null, 'A', 3 from dual union all
select 'SUR', 'SE', 475, null, null, 'A', 3 from dual )
SELECT t.*,
       MIN(row_number) OVER(PARTITION BY NAME, NAME_1, IND) MIN
  FROM (SELECT t.*,
               row_number() over(PARTITION BY NAME, NAME_1, VALUE,
                                              START_DATE, END_DATE, FLAG
                                     ORDER BY IND) row_number
          FROM test_table t) t
ORDER BY IND,
          start_date;Edited by: Manuel Vidigal on 13/Abr/2009 12:05