How to avoid duplicate record in a file to file

Hi Guys,
          Could you please provide a soultion
          in order to avoid duplicate entries in a flat file based on key field.
          i request in terms of standard functions
         either at message mappingf level or by configuring the file adapter.
warm regards
mahesh.

hi mahesh,
write module processor for checking the duplicate record in file adapter
or
With a JAVA/ABAP mapping u can eliminate the duplicate records
and check this links
Re: How to Handle this "Duplicate Records"
Duplicate records
Ignoring Duplicate Records--urgent
Re: Duplicate records frequently occurred
Re: Reg ODS JUNK DATA
http://help.sap.com/saphelp_nw2004s/helpdata/en/d0/538f3b294a7f2de10000000a11402f/frameset.htm
regards
srinivas

Similar Messages

How to avoid Duplicate Records while joining two tables

Hi,
I am trying to join three tables, basically two tables are same one is like history table, so I wrote a query like
select
e.id,
e.seqNo,
e.name,
d.resDate,
d.details
from employees e,
((select * from dept)union(select * from dept_hist)) d
join on d.id=e.id and e.seqno=d.seqno
but this returing duplicate records.
Could anyone please tell me how to avoid duplicate records of this query.

Actually it is like if the record is processed it will be moved to hist table, so both table will not have same records and I need the record from both the tables so i have done the union of both the tables, so d will have the union of both records.
But I am getting duplicate records if even I am distinct.

Scenario - Webservice - XI - BW. How to Avoid duplicate records?

Hi all,
Webservice --> XI -->BW .
BPM has been used to send to send the response back.
BPM :
start ->Receive(Request)> Transformation(Responsemap)>Send(SendtoBW)->Send(Send Response) ---> stop.
We are making use of MSGID to maintain the uniqueness of each message which is coming from Webservice. Uniqueness is maintained for the combination of sale-num:trans-num:sap-saletype:sale-type like below. One msgID will be registered in XI for each Unique message.
ex:   sale-num:trans-num:sap-saletype:sale-type
       1983:5837:E:NEW
If they receive any duplicate message again it will send the response back to webservice as "DUPLICATE_GUID:c9237200-0c69-2a80-dd11-79d5b47b213a".*
It is working correctly. But only problem is when XI is down or if any communication failure happens in the middle of the processing like below example.
Sample example which has failed recently. A webservice call has been failed three times and the reasons are..
First time :
It got the error as ""FAILED TO INVOKE WEB SERVICE OPERATION OS_CWUSales
Error receiving Web Service Response: Fatal Error: csnet read operation failed (No such file or directory) (11773)" .
Second time:
MessageExpiredException: Message c9237200-0c69-2a80-dd11-79d5b47b213a(OUTBOUND) expired.
Third Time :
"DUPLICATE_GUID:c9237200-0c69-2a80-dd11-79d5b47b213a" ""
If you observe when the call made 2nd time, the MsgID has been registered but due to server down or some other reason it could not able to process further.So MSGID got registered here but processing wasn't happened for the message. When they retried thrid time again to send the same call again they are getting error as "DUPLICATE GUID".
DUPLICATE GUID means it has meaning that the message has been processed and the records has been updated in the backend system which is not happened now.
Final Result is :
Status in Webservice showing as "it has been updated in receicing system" as it is indicating as duplicate guid.
- But it has not updated in backend system which is a problem.
Firstly is there any suggestions on how to solve this problem?
Is there any better way to handle this duplicate thing instead of Msgid?
Please help me in solving this.
Thanks & Regards
Deepthi.
Edited by: deepthi reddy on Jan 7, 2009 2:07 AM
Edited by: deepthi reddy on Jan 7, 2009 2:07 AM

>> My suggestion: You can have a Webservice - BW synch-synch synario without BPM. Sender SOAP adapter sending a synch req msg, getting it mapped to BW req and getting its response back from BW, then map it to webservice response and send to webservice without any receiver SOAP adapter.
Thanks for the suggestion . Looks like a good Idea.
>> Regarding the problem of duplicate check: see when your BW system gets req msg, it processes it and then sends a response msg.........in this response message have a STATUS field with values S for success and E for error - send this response to webservice and store it in database for that req MSGID ........now in web service application, check the response code for a MSGID and if it is E for error, then only resend the msg to BW.
Initially they have planned the same way. But sometimes the response is getting very late back from BW. So now once the request reached to XI then immediately they are sending back the response from XI itself withhardcoded "OK" status. They are not waiting for BAPI response from BW.
So If message is succesfull the Status will go as "OK"
     If message is not succesfull the status will go with blank. and this will indicate that there is some problem in the other side. Then they will check the SOAP Fault message which will have the errors like
"DUPLICATE_GUID:c9237200-0c69-2a80-dd11-79d5b47b213a".
"FAILED TO INVOKE WEB SERVICE OPERATION "
Right now they are having the issue only for duplicate data and response time to go back. So by making use of MsgID they solved the Issue.But due to this we are seeing daily so many error messages failing with this DUPLICATE error in production which is hampering the performance.
So we are thinking of to get rid of this MsgId method and BPM. So from your first answer I think we can able to acheive it w/o BPM and after that I need to check the response time how fast it will go back to webservice.
-Deepthi.

How to avoid duplicate data while inserting from sample.dat file to table

Hi Guys,
We have issue with duplicate data in flat file while loading data from sample.dat file to table. How to avoid duplicate data in control file.
Can any one help me on this.
Thanks in advance!
Regards,
LKR

No, a control file will not remove duplicate data.
You would be better to use an external table and then remove duplicate data using SQL as you query the data to insert it to your destination table.

How to delete duplicate records in 10 G.

how to delete duplicate records in 10 G.

--Here is one way to do it using a second table
create table temp1
(col1 char(1));
--Table created.
insert into temp1 (col1) values('A');
insert into temp1 (col1) values('B');
insert into temp1 (col1) values('B');
--1 row created.
--1 row created.
--1 row created.
create table temp2 as select distinct * from temp1;
--Table created.
--now you have a second table with no duplicates
--truncate your old table
truncate table temp1;
--Table truncated.
--and reload it with data from the new table
insert into temp1 select * from temp2;
--2 rows created.
--then drop the temp2 table
drop table temp2

How to avoid duplicate posting of noted items for advance payment requests?

How to avoid duplicate posting of noted items for advace payments request?

Puttasiddappa,
In the PS module, we allow the deletion of a component pruchase requisition allthough a purchase order exists. The system will send message CN707 "A purchase order already exists for purchase requisition &" as an Iinformation message by design to allow flexible project management.
If you, however, desire the message CN707 to be of type E you have to
modify the standard coding. Doing so, using SE91, you can invoke the
where-used-list of message 707 in message class CN, and to change the
i707(cn)
to
e707(cn)
where desired.
Also, user exit CNEX0039 provides the possibility to reject the
deletion of a component according to customers needs e. g. you may
check here whether a purchase order exists and reject the deletion.
Hope this helps!
Best regards
Martina Modolell

How to remove duplicates records from output ?

how to remove duplicates records from output ? i used delete adjacent but duplicates records are coming again ..suggest me

hi shruthi,
thanks for ur answer ..but duplicates records coming again
here is my code >> plz check it out
*& Report ZCRM_TROUBLE_TICKET
REPORT zcrm_trouble_ticket.
TYPES : BEGIN OF ty_qmih,
 qmnum TYPE qmnum,
 equnr TYPE equnr,
 iloan TYPE iloan,
 ausvn TYPE ausvn,
 ausbs TYPE ausbs,
 auztv TYPE auztv,
 auztb TYPE auztb,
 iwerk TYPE iwerk,
 END OF ty_qmih,
 BEGIN OF ty_qmel,
 qmnum TYPE qmnum,
 qmtxt TYPE qmtxt,
 indtx TYPE indltx,
 priok TYPE priok,
 strmn TYPE strmn,
 strur TYPE strur,
 ltrmn TYPE ltrmn,
 ltrur TYPE ltrur,
 objnr TYPE qmobjnr,
 arbpl TYPE lgwid,
 vkorg TYPE vkorg,
 vtweg TYPE vtweg,
 spart TYPE spart,
 END OF ty_qmel,
 BEGIN OF ty_ihpa,
 parnr TYPE i_parnr,
 parvw TYPE parvw,
 objnr TYPE qmobjnr,
 END OF ty_ihpa,
 BEGIN OF ty_crhd,
 arbpl TYPE arbpl,
 objid TYPE cr_objid,
 END OF ty_crhd,
 BEGIN OF ty_crtx,
 ktext TYPE cr_ktext,
 objid TYPE cr_objid,
 END OF ty_crtx,
 BEGIN OF ty_qmfe,
 fecod TYPE fecod,
 fegrp TYPE fegrp,
 qmnum TYPE qmnum,
 END OF ty_qmfe,
 BEGIN OF ty_qmur,
 urcod TYPE urcod,
 urgrp TYPE urgrp,
 urtxt TYPE urstx,
 qmnum TYPE qmnum,
 END OF ty_qmur,
 BEGIN OF ty_iloa,
 tplnr TYPE tplnr,
 iloan TYPE iloan,
 END OF ty_iloa,
 BEGIN OF ty_output,
 qmnum TYPE qmnum,
 equnr TYPE equnr,
 iloan TYPE iloan,
 ausvn TYPE ausvn,
 ausbs TYPE ausbs,
 auztv TYPE auztv,
 auztb TYPE auztb,
 iwerk TYPE iwerk,
 qmtxt TYPE qmtxt,
 indtx TYPE indltx,
 priok TYPE priok,
 strmn TYPE strmn,
 strur TYPE strur,
 ltrmn TYPE ltrmn,
 ltrur TYPE ltrur,
 objnr TYPE qmobjnr,
 arbpl TYPE lgwid,
 vkorg TYPE vkorg,
 vtweg TYPE vtweg,
 spart TYPE spart,
 parnr TYPE i_parnr,
 parvw TYPE parvw,
 arbpl TYPE arbpl,
 objid TYPE cr_objid,
 arbpl1 TYPE arbpl,
 ktext TYPE cr_ktext,
 fecod TYPE fecod,
 fegrp TYPE fegrp,
 urcod TYPE urcod,
 urgrp TYPE urgrp,
 urtxt TYPE urstx,
 tplnr TYPE tplnr,
 END OF ty_output.
DATA : it_qmih TYPE STANDARD TABLE OF ty_qmih,
 it_qmel TYPE STANDARD TABLE OF ty_qmel,
 it_ihpa TYPE STANDARD TABLE OF ty_ihpa,
 it_crhd TYPE STANDARD TABLE OF ty_crhd,
 it_crtx TYPE STANDARD TABLE OF ty_crtx,
 it_qmfe TYPE STANDARD TABLE OF ty_qmfe,
 it_qmur TYPE STANDARD TABLE OF ty_qmur,
 it_iloa TYPE STANDARD TABLE OF ty_iloa,
 it_output TYPE STANDARD TABLE OF ty_output,
 wa_qmih TYPE ty_qmih,
 wa_qmel TYPE ty_qmel,
 wa_ihpa TYPE ty_ihpa,
 wa_crhd TYPE ty_crhd,
 wa_crtx TYPE ty_crtx,
 wa_qmfe TYPE ty_qmfe,
 wa_qmur TYPE ty_qmur,
 wa_iloa TYPE ty_iloa,
 wa_output TYPE ty_output.
INITIALIZATION.
REFRESH : it_qmih,
 it_qmel,
 it_ihpa,
 it_crhd,
 it_crtx,
 it_qmfe,
 it_qmur,
 it_iloa,
 it_output.
CLEAR: wa_qmih,
 wa_qmel,
 wa_ihpa,
 wa_crhd,
 wa_crtx,
 wa_qmfe,
 wa_qmur,
 wa_iloa,
 wa_output.
start-of-selection.
SELECT qmnum
 equnr
 iloan
 ausvn
 ausbs
 auztv
 auztb
 iwerk
 FROM qmih
 INTO TABLE it_qmih.
SORT it_qmih BY qmnum .
DELETE ADJACENT DUPLICATES FROM it_qmih COMPARING qmnum equnr iloan ausvn ausbs auztv auztb iwerk.
SELECT qmnum
 qmtxt
 indtx
 priok
 strmn
 strur
 ltrmn
 ltrur
 objnr
 arbpl
 vkorg
 vtweg
 spart
 FROM qmel
 INTO TABLE it_qmel
 FOR ALL ENTRIES IN it_qmih
 WHERE qmnum = it_qmih-qmnum.
SORT it_qmel BY qmnum.
DELETE ADJACENT DUPLICATES FROM it_qmel COMPARING qmnum
 qmtxt
 indtx
 strmn
 strur
 ltrmn
 ltrur
 objnr
 arbpl
 vkorg
 vtweg
 spart.
IF it_qmel IS NOT INITIAL.
 SELECT parnr
 parvw
 objnr
 FROM ihpa
 INTO TABLE it_ihpa
 FOR ALL ENTRIES IN it_qmel
 WHERE objnr = it_qmel-objnr.
ENDIF.
DELETE ADJACENT DUPLICATES FROM it_ihpa COMPARING parnr
 parvw
 objnr.
IF it_qmel IS NOT INITIAL.
 SELECT arbpl
 objid
 FROM crhd
 INTO TABLE it_crhd
 FOR ALL ENTRIES IN it_qmel
 WHERE objid = it_qmel-arbpl.
ENDIF.
DELETE ADJACENT DUPLICATES FROM it_crhd COMPARING arbpl
 objid.
IF it_qmel IS NOT INITIAL.
 SELECT ktext
 objid
 FROM crtx
 INTO TABLE it_crtx
 FOR ALL ENTRIES IN it_crhd
 WHERE objid = it_crhd-objid.
ENDIF.
DELETE ADJACENT DUPLICATES FROM it_crtx COMPARING ktext
 objid.
IF it_qmih IS NOT INITIAL.
 SELECT fecod
 fegrp
 qmnum
 FROM qmfe
 INTO TABLE it_qmfe
 FOR ALL ENTRIES IN it_qmih
 WHERE qmnum = it_qmih-qmnum.
ENDIF.
SORT it_qmfe BY qmnum.
DELETE ADJACENT DUPLICATES FROM it_qmfe COMPARING fecod
 fegrp.
IF it_qmih IS NOT INITIAL.
 SELECT urcod
 urgrp
 urtxt
 qmnum
 FROM qmur
 INTO TABLE it_qmur
 FOR ALL ENTRIES IN it_qmih
 WHERE qmnum = it_qmih-qmnum.
ENDIF.
SORT it_qmur BY qmnum.
DELETE ADJACENT DUPLICATES FROM it_qmur COMPARING urcod
 urgrp
 urtxt.
IF it_qmih IS NOT INITIAL.
 SELECT tplnr
 iloan
 FROM iloa
 INTO TABLE it_iloa
 FOR ALL ENTRIES IN it_qmih
 WHERE iloan = it_qmih-iloan.
ENDIF.
DELETE ADJACENT DUPLICATES FROM it_iloa COMPARING tplnr
 iloan.
LOOP AT it_qmih INTO wa_qmih.
 wa_output-qmnum = wa_qmih-qmnum.
 wa_output-equnr = wa_qmih-equnr.
 wa_output-iloan = wa_qmih-iloan.
 wa_output-ausvn = wa_qmih-ausvn.
 wa_output-ausbs = wa_qmih-ausbs.
 wa_output-auztv = wa_qmih-auztv.
 wa_output-auztb = wa_qmih-auztb.
 wa_output-iwerk = wa_qmih-iwerk.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_qmel INTO wa_qmel WITH KEY qmnum = wa_qmih-qmnum.
 wa_output-qmtxt = wa_qmel-qmtxt.
 wa_output-indtx = wa_qmel-indtx.
 wa_output-priok = wa_qmel-priok.
 wa_output-strmn = wa_qmel-strmn.
 wa_output-strur = wa_qmel-strur.
 wa_output-ltrmn = wa_qmel-ltrmn.
 wa_output-ltrur = wa_qmel-ltrur.
 wa_output-objnr = wa_qmel-objnr.
 wa_output-arbpl = wa_qmel-arbpl.
 wa_output-vkorg = wa_qmel-vkorg.
 wa_output-vtweg = wa_qmel-vtweg.
 wa_output-spart = wa_qmel-spart.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_ihpa INTO wa_ihpa WITH KEY objnr = wa_qmel-objnr.
 wa_output-parnr = wa_ihpa-parnr.
 wa_output-parvw = wa_ihpa-parvw.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_crhd INTO wa_crhd WITH KEY objid = wa_qmel-arbpl.
 wa_output-arbpl = wa_crhd-arbpl.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_crtx INTO wa_crtx WITH KEY objid = wa_crhd-objid.
 wa_output-ktext = wa_crtx-ktext.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_qmfe INTO wa_qmfe WITH KEY qmnum = wa_qmih-qmnum.
 wa_output-fecod = wa_qmfe-fecod.
 wa_output-fegrp = wa_qmfe-fegrp.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_qmur INTO wa_qmur WITH KEY qmnum = wa_qmih-qmnum.
 wa_output-urcod = wa_qmur-urcod.
 wa_output-urgrp = wa_qmur-urgrp.
 wa_output-urtxt = wa_qmur-urtxt.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
 READ TABLE it_iloa INTO wa_iloa WITH KEY iloan = wa_qmih-iloan.
 wa_output-tplnr = wa_iloa-tplnr.
 APPEND wa_output TO it_output.
 CLEAR wa_output.
ENDLOOP.
DELETE ADJACENT DUPLICATES FROM it_output COMPARING qmnum
 equnr
 ausvn
 ausbs
 auztv
 auztb
 iwerk
 qmtxt
 indtx
 priok
 strmn
 strur
 ltrmn
 ltrur
 vkorg
 vtweg
 spart
 parnr
 parvw
 arbpl
 ktext
 fecod
 fegrp
 urcod
 urgrp
 urtxt
 tplnr.
*CALL FUNCTION 'STATUS_TEXT_EDIT'
EXPORTING
CLIENT = SY-MANDT
FLG_USER_STAT = ' '
 objnr =
ONLY_ACTIVE = 'X'
 spras = en
BYPASS_BUFFER = ' '
IMPORTING
ANW_STAT_EXISTING =
E_STSMA =
LINE =
USER_LINE =
STONR =
EXCEPTIONS
OBJECT_NOT_FOUND = 1
OTHERS = 2
*IF sy-subrc <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
 WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
*ENDIF.
*CALL FUNCTION 'READ_TEXT'
EXPORTING
CLIENT = SY-MANDT
 id =
 language =
 name =
 object =
ARCHIVE_HANDLE = 0
LOCAL_CAT = ' '
IMPORTING
HEADER =
tables
 lines =
EXCEPTIONS
ID = 1
LANGUAGE = 2
NAME = 3
NOT_FOUND = 4
OBJECT = 5
REFERENCE_CHECK = 6
WRONG_ACCESS_TO_ARCHIVE = 7
OTHERS = 8
*IF sy-subrc <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
 WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
*ENDIF.
*LOOP AT IT_OUTPUT INTO WA_OUTPUT.
*WRITE : / WA_OUTPUT-qmnum,
 WA_OUTPUT-equnr,
 WA_OUTPUT-iloan,
 WA_OUTPUT-ausvn,
 WA_OUTPUT-ausbs,
 WA_OUTPUT-auztv,
 WA_OUTPUT-auztb,
 WA_OUTPUT-qmtxt,
 WA_OUTPUT-indtx,
 WA_OUTPUT-strmn,
 WA_OUTPUT-strur,
 WA_OUTPUT-ltrmn,
 WA_OUTPUT-ltrur,
 WA_OUTPUT-objnr,
 WA_OUTPUT-arbpl,
 WA_OUTPUT-parnr,
 WA_OUTPUT-parvw,
 WA_OUTPUT-objid,
 WA_OUTPUT-ktext,
 WA_OUTPUT-fecod,
 WA_OUTPUT-fegrp,
 WA_OUTPUT-urcod,
 WA_OUTPUT-urgrp,
 WA_OUTPUT-urtxt,
 WA_OUTPUT-tplnr.
*ENDLOOP.
CALL FUNCTION 'GUI_DOWNLOAD'
 EXPORTING
BIN_FILESIZE =
 filename = 'E:\CRM1.TXT'
FILETYPE = 'ASC'
APPEND = ' '
 write_field_separator = '|'
HEADER = '00'
TRUNC_TRAILING_BLANKS = ' '
WRITE_LF = 'X'
COL_SELECT = ' '
COL_SELECT_MASK = ' '
DAT_MODE = ' '
CONFIRM_OVERWRITE = ' '
NO_AUTH_CHECK = ' '
CODEPAGE = ' '
IGNORE_CERR = ABAP_TRUE
REPLACEMENT = '#'
WRITE_BOM = ' '
TRUNC_TRAILING_BLANKS_EOL = 'X'
WK1_N_FORMAT = ' '
WK1_N_SIZE = ' '
WK1_T_FORMAT = ' '
WK1_T_SIZE = ' '
WRITE_LF_AFTER_LAST_LINE = ABAP_TRUE
IMPORTING
FILELENGTH =
 TABLES
 data_tab = it_output
FIELDNAMES =
EXCEPTIONS
FILE_WRITE_ERROR = 1
NO_BATCH = 2
GUI_REFUSE_FILETRANSFER = 3
INVALID_TYPE = 4
NO_AUTHORITY = 5
UNKNOWN_ERROR = 6
HEADER_NOT_ALLOWED = 7
SEPARATOR_NOT_ALLOWED = 8
FILESIZE_NOT_ALLOWED = 9
HEADER_TOO_LONG = 10
DP_ERROR_CREATE = 11
DP_ERROR_SEND = 12
DP_ERROR_WRITE = 13
UNKNOWN_DP_ERROR = 14
ACCESS_DENIED = 15
DP_OUT_OF_MEMORY = 16
DISK_FULL = 17
DP_TIMEOUT = 18
FILE_NOT_FOUND = 19
DATAPROVIDER_EXCEPTION = 20
CONTROL_FLUSH_ERROR = 21
OTHERS = 22
IF sy-subrc <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
 WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.

How to avoid duplicates in CROSS JOIN Query

Hi,
I am using CROSS JOIN to get all the subset of a table col values as shown below:
PRODUCT (Col Header)
Bag
Plate
Biscuit
While doing cross join we will get as
Bag Bag
Bag Plate
Bag Biscuit
Plate Bag
Plate Plate
Plate Biscuit ..... like this
By placing where condition prod1 <> prod2 to avoid Bag Bag and Plate Plate values. So the output will be like below
Bag Plate
Bag Biscuit
Plate Bag
Plate Biscuit
Now "Bag Plate" and "Plage Bag" are same combination how to avoid these records. My expected result is
Bag Biscuit
Plate Biscuit
How to derive this ?
Sridhar

Hi,
This is the the solution that I found as fit to the OP question, but
Visakh16 already posted the same idea (assuming the names are unique) from the start and I don't think that anyone notice it!
Sridhar.DPM did
you check Visakh16's response
(the second response received)?!?
I will mark his response as an answer. If this is not what you need pls clarify and you can unmark it :-)
[Personal Site] [Blog] [Facebook]

Avoid duplicate records

hi guys
could u pls let me know where is the option for avoiding duplicate records?
1. in case of Info package
2.In case of DTP?

Hi,
Incase of infopackage in 3.5 - > Processing tab -> select only PSA ,update subsequent data tagets,ignore double data records
in 7.0 processing tab by default the selection is only PSA
Incase of DTP - >update tab -> select handle duplicate data records.

How to avoid duplicates values from alvgird see below code

how to avoid duplicates values from alvgird see below code
in below query docno no is repeated again and again
how i can avoid duplication in this query.
select * into corresponding fields of table itab
 from J_1IEXCHDR
 inner join J_1IEXCDTL
 on J_1IEXCDTLlifnr = J_1IEXCHDRlifnr
 where J_1IEXCHDr~status = 'P'.

Hi Laxman,
after that select statement
select * into corresponding fields of table itab
from J_1IEXCHDR
inner join J_1IEXCDTL
on J_1IEXCDTLlifnr = J_1IEXCHDRlifnr
where J_1IEXCHDr~status = 'P'.
if sy-subrc = 0.
delete adjucent duplicates from itab comparing <field name of itab internal table>
endif.
this will delete your duplicate entries.once you done with this call the alv FM.
 call function 'REUSE_ALV_GRID_DISPLAY'
exporting
I_INTERFACE_CHECK = ' '
I_BYPASSING_BUFFER = ' '
I_BUFFER_ACTIVE = ' '
 i_callback_program = v_repid
I_CALLBACK_PF_STATUS_SET = ' '
I_CALLBACK_USER_COMMAND = 'IT_USER_COMMAND'
I_CALLBACK_TOP_OF_PAGE = ' '
I_CALLBACK_HTML_TOP_OF_PAGE = ' '
I_CALLBACK_HTML_END_OF_LIST = ' '
I_STRUCTURE_NAME =
I_BACKGROUND_ID = ' '
 i_grid_title = 'Purchase Order Details'
I_GRID_SETTINGS = I_GRID_SETTINGS
 is_layout = wa_layout
 it_fieldcat = it_fieldcat
IT_EXCLUDING = IT_EXCLUDING
IT_SPECIAL_GROUPS = IT_SPECIAL_GROUPS
 it_sort = it_sort
IT_FILTER = IT_FILTER
IS_SEL_HIDE = IS_SEL_HIDE
I_DEFAULT = 'X'
I_SAVE = ' '
IS_VARIANT = IS_VARIANT
 it_events = it_event
IT_EVENT_EXIT = IT_EVENT_EXIT
IS_PRINT = IS_PRINT
IS_REPREP_ID = IS_REPREP_ID
I_SCREEN_START_COLUMN = 0
I_SCREEN_START_LINE = 0
I_SCREEN_END_COLUMN = 0
I_SCREEN_END_LINE = 0
I_HTML_HEIGHT_TOP = 0
I_HTML_HEIGHT_END = 0
IT_ALV_GRAPHICS = IT_ALV_GRAPHICS
IT_HYPERLINK = IT_HYPERLINK
IT_ADD_FIELDCAT = IT_ADD_FIELDCAT
IT_EXCEPT_QINFO = IT_EXCEPT_QINFO
IR_SALV_FULLSCREEN_ADAPTER = IR_SALV_FULLSCREEN_ADAPTER
IMPORTING
E_EXIT_CAUSED_BY_CALLER = E_EXIT_CAUSED_BY_CALLER
ES_EXIT_CAUSED_BY_USER = ES_EXIT_CAUSED_BY_USER
 tables
 t_outtab = ITAB
exceptions
 program_error = 1
 others = 2
if sy-subrc <> 0.
 message id sy-msgid type sy-msgty number sy-msgno
 with sy-msgv1 sy-msgv2 sy-msgv3 sy-msgv4.
endif.
Thanks
Vikranth Khimavath

How to find out duplicate record contained in a flat file

Hi Experts,
For my project I have written a program for flat file upload.
Requirement 1
In the flat file there may be some duplicate record like:
Field1   Field2
11        test1
11        test2
12        test3
13        test4
Field1 is primary key.
Can you please let me know how I can find out the duplicate record.
Requirement 2
The flat file contains the header row as shown above
Field1   Field2
How our program can skip this record and start reading / inserting records from row no 2 ie
11        test1
onwards.
Thanks
S
FORM upload1.
DATA : wf_title TYPE string,
lt_filetab TYPE filetable,
l_separator TYPE char01,
l_action TYPE i,
l_count TYPE i,
ls_filetab TYPE file_table,
wf_delemt TYPE rollname,
wa_fieldcat TYPE lvc_s_fcat,
tb_fieldcat TYPE lvc_t_fcat,
rows_read TYPE i,
p_error TYPE char01,
l_file TYPE string.
DATA: wf_object(30) TYPE c,
wf_tablnm TYPE rsdchkview.
wf_object = 'myprogram'.
DATA i TYPE i.
DATA:
lr_mdmt TYPE REF TO cl_rsdmd_mdmt,
lr_mdmtr TYPE REF TO cl_rsdmd_mdmtr,
lt_idocstate TYPE rsarr_t_idocstate,
lv_subrc TYPE sysubrc.
TYPES : BEGIN OF test_struc,
/bic/myprogram TYPE /bic/oimyprogram,
txtmd TYPE rstxtmd,
END OF test_struc.
DATA : tb_assum TYPE TABLE OF /bic/pmyprogram.
DATA: wa_ztext TYPE /bic/tmyprogram,
myprogram_temp TYPE ziott_assum,
wa_myprogram TYPE /bic/pmyprogram.
DATA : test_upload TYPE STANDARD TABLE OF test_struc,
wa2 TYPE test_struc.
DATA : wa_test_upload TYPE test_struc,
ztable_data TYPE TABLE OF /bic/pmyprogram,
ztable_text TYPE TABLE OF /bic/tmyprogram,
wa_upld_text TYPE /bic/tmyprogram,
wa_upld_data TYPE /bic/pmyprogram,
t_assum TYPE ziott_assum.
DATA : wa1 LIKE test_upload.
wf_title = text-026.
CALL METHOD cl_gui_frontend_services=>file_open_dialog
EXPORTING
window_title = wf_title
default_extension = 'txt'
file_filter = 'Tab delimited Text Files (*.txt)'
CHANGING
file_table = lt_filetab
rc = l_count
user_action = l_action
EXCEPTIONS
file_open_dialog_failed = 1
cntl_error = 2
OTHERS = 3. "#EC NOTEXT
IF sy-subrc 0.
EXIT.
ENDIF.
LOOP AT lt_filetab INTO ls_filetab.
l_file = ls_filetab.
ENDLOOP.
CHECK l_action = 0.
IF l_file IS INITIAL.
EXIT.
ENDIF.
l_separator = 'X'.
wa_fieldcat-fieldname = 'test'.
wa_fieldcat-dd_roll = wf_delemt.
APPEND wa_fieldcat TO tb_fieldcat.
CALL FUNCTION 'MESSAGES_INITIALIZE'.
CLEAR wa_test_upload.
Upload file from front-end (PC)
File format is tab-delimited ASCII
CALL FUNCTION 'GUI_UPLOAD'
EXPORTING
filename = l_file
has_field_separator = l_separator
TABLES
data_tab = i_mara
data_tab = test_upload
EXCEPTIONS
file_open_error = 1
file_read_error = 2
no_batch = 3
gui_refuse_filetransfer = 4
invalid_type = 5
no_authority = 6
unknown_error = 7
bad_data_format = 8
header_not_allowed = 9
separator_not_allowed = 10
header_too_long = 11
unknown_dp_error = 12
access_denied = 13
dp_out_of_memory = 14
disk_full = 15
dp_timeout = 16
OTHERS = 17.
IF sy-subrc 0.
EXIT.
ELSE.
CALL FUNCTION 'MESSAGES_INITIALIZE'.
IF test_upload IS NOT INITIAL.
DESCRIBE TABLE test_upload LINES rows_read.
CLEAR : wa_test_upload,wa_upld_data.
LOOP AT test_upload INTO wa_test_upload.
CLEAR : p_error.
rows_read = sy-tabix.
IF wa_test_upload-/bic/myprogram IS INITIAL.
p_error = 'X'.
MESSAGE s153 WITH wa_test_upload-/bic/myprogram sy-tabix.
CONTINUE.
ELSE.
TRANSLATE wa_test_upload-/bic/myprogram TO UPPER CASE.
wa_upld_text-txtmd = wa_test_upload-txtmd.
wa_upld_text-txtsh = wa_test_upload-txtmd.
wa_upld_text-langu = sy-langu.
wa_upld_data-chrt_accts = 'xyz1'.
wa_upld_data-co_area = '12'.
wa_upld_data-/bic/zxyzbcsg = 'Iy'.
wa_upld_data-objvers = 'A'.
wa_upld_data-changed = 'I'.
wa_upld_data-/bic/zass_mdl = 'rrr'.
wa_upld_data-/bic/zass_typ = 'I'.
wa_upld_data-/bic/zdriver = 'yyy'.
wa_upld_text-langu = sy-langu.
MOVE-CORRESPONDING wa_test_upload TO wa_upld_data.
MOVE-CORRESPONDING wa_test_upload TO wa_upld_text.
APPEND wa_upld_data TO ztable_data.
APPEND wa_upld_text TO ztable_text.
ENDIF.
ENDLOOP.
DELETE ADJACENT DUPLICATES FROM ztable_data.
DELETE ADJACENT DUPLICATES FROM ztable_text.
IF ztable_data IS NOT INITIAL.
CALL METHOD cl_rsdmd_mdmt=>factory
EXPORTING
i_chabasnm = 'myprogram'
IMPORTING
e_r_mdmt = lr_mdmt
EXCEPTIONS
invalid_iobjnm = 1
OTHERS = 2.
CALL FUNCTION 'MESSAGES_INITIALIZE'.
**Lock the Infoobject to update
CALL FUNCTION 'RSDG_IOBJ_ENQUEUE'
EXPORTING
i_objnm = wf_object
i_scope = '1'
i_msgty = rs_c_error
EXCEPTIONS
foreign_lock = 1
sys_failure = 2.
IF sy-subrc = 1.
MESSAGE i107(zddd_rr) WITH wf_object sy-msgv2.
EXIT.
ELSEIF sy-subrc = 2.
MESSAGE i108(zddd_rr) WITH wf_object.
EXIT.
ENDIF.
*****Update Master Table
IF ztable_data IS NOT INITIAL.
CALL FUNCTION 'RSDMD_WRITE_ATTRIBUTES_TEXTS'
EXPORTING
i_iobjnm = 'myprogram'
i_tabclass = 'M'
I_T_ATTR = lt_attr
TABLES
i_t_table = ztable_data
EXCEPTIONS
attribute_name_error = 1
iobj_not_found = 2
generate_program_error = 3
OTHERS = 4.
IF sy-subrc 0.
CALL FUNCTION 'MESSAGE_STORE'
EXPORTING
arbgb = 'zddd_rr'
msgty = 'E'
txtnr = '054'
msgv1 = text-033
EXCEPTIONS
OTHERS = 3.
MESSAGE e054(zddd_rr) WITH 'myprogram'.
ELSE.
CALL FUNCTION 'MESSAGE_STORE'
EXPORTING
arbgb = 'zddd_rr'
msgty = 'S'
txtnr = '053'
msgv1 = text-033
EXCEPTIONS
OTHERS = 3.
ENDIF.
*endif.
*****update Text Table
IF ztable_text IS NOT INITIAL.
CALL FUNCTION 'RSDMD_WRITE_ATTRIBUTES_TEXTS'
EXPORTING
i_iobjnm = 'myprogram'
i_tabclass = 'T'
TABLES
i_t_table = ztable_text
EXCEPTIONS
attribute_name_error = 1
iobj_not_found = 2
generate_program_error = 3
OTHERS = 4.
IF sy-subrc 0.
CALL FUNCTION 'MESSAGE_STORE'
EXPORTING
arbgb = 'zddd_rr'
msgty = 'E'
txtnr = '055'
msgv1 = text-033
EXCEPTIONS
OTHERS = 3.
ENDIF.
ENDIF.
ELSE.
MESSAGE s178(zddd_rr).
ENDIF.
ENDIF.
COMMIT WORK.
CALL FUNCTION 'RSD_CHKTAB_GET_FOR_CHA_BAS'
EXPORTING
i_chabasnm = 'myprogram'
IMPORTING
e_chktab = wf_tablnm
EXCEPTIONS
name_error = 1.
IF sy-subrc 0.
MESSAGE ID sy-msgid TYPE sy-msgty NUMBER sy-msgno
WITH sy-msgv1 sy-msgv2 sy-msgv3 sy-msgv4.
ENDIF.
****Release locks on Infoobject
CALL FUNCTION 'RSDG_IOBJ_DEQUEUE'
EXPORTING
i_objnm = 'myprogram'
i_scope = '1'.
ENDIF.
ENDIF.
PERFORM data_selection .
PERFORM update_alv_grid_display.
CALL FUNCTION 'MESSAGES_SHOW'.
ENDFORM.

Can you please let me know how I can find out the duplicate record.
you need to split the records from flat file structure into your internal table ans use a delete ADJACENT duplicates comparing fields
split flat_str into wa_f1 wa_f2 wa_f2 at tab_space.

How to avoid duplicate measures in reports due to case functions?

Hi,
If I create a report, using a dimension called insert_source_type where the next measure would be insert_source in the dimensions hirarchie, if I do not put any formula, when I become a report where i can drill down on insert_source_type and i get insert_source values.
If I use a function like (CASE "Ins Source"."Ins Source Type" WHEN 'OWS' THEN 'WEB' ELSE "Ins Source"."Ins Source Type" END) and change the label of insert_source_tpye to Channel Group instead, when
I drill down on Channel Group, it goes to insert_source_tpye and from there i can drill down to insert_source.
There is an insert_source_type too much!
How can be this avoided?
Thanks and Regards
Giuliano

hi mahesh,
write module processor for checking the duplicate record in file adapter
or
With a JAVA/ABAP mapping u can eliminate the duplicate records
and check this links
Re: How to Handle this "Duplicate Records"
Duplicate records
Ignoring Duplicate Records--urgent
Re: Duplicate records frequently occurred
Re: Reg ODS JUNK DATA
http://help.sap.com/saphelp_nw2004s/helpdata/en/d0/538f3b294a7f2de10000000a11402f/frameset.htm
regards
srinivas

How to delete duplicate record in Query report

Hi Experts,
I had created an infoset and query in my sap, but I want to delete some duplicate records before the list out put.Please can we add some further codes in the Extras code to delete duplicates? And how do it? Would you please give me a simple brief.
Joe

Hi,
You can try to restrict in the filter area in query designer with the values for characteristic which gives correct
result.
But still i would suggest that in the cube you keep not the duplicate records as this is not your requirement and giving
you wrong result.
So you can reload the correct records in the cube inorder to avoid such problems even in future.
Regards,
Amit

Sqlloader controlfileparam's to avoid duplicate records loading

Hi All,
I am trying for a option in control file which should restrict sql loader to load duplicate records.I know if we apply a constraint on table itself, it wont allow you to load duplicate data and reject into reject file but in controlfile i have to do it to make sql loader to avoid loading duplicate records.Can you please suggest me which option in controlfile will enable this.
Can you please also inform me the exact difference between badfile and reject file.In what scenarios it will write to reject or to badfile
Regards

Hey
i dont think there is any option to avoid loading duplicate records by using a parameter in the control file
On the difference between the bad and reject files try this link
http://www.exforsys.com/content/view/1587/240/
Regards,
Sushant

How to delete Duplicate records from the informatica target using mapping?

Hi, I have a scenario like below: In my mapping I have a source, which may containg unique records or duplicate records. Source and target are different tables. I have a target in my mapping which contains duplicate records. Using Mapping I have to delete the duplicate records in the target table. Target table does not contain any surrogate key. We can use target table as a look up table, but target table cannot be used as source in the mapping. We cannot use post SQL.

Hi All, I have multiple flat files which i need to load in a single table.I did that using indirect option at session level.But need to dig out on how to populate substring of header in name column in target table. i have two columns Id and Name. in all input file I have only one column 'id' with header like H|ABCD|Date. I need to populate target like below example. File 1 File2 H|ABCD|Date. H|EFGH|Date.1 42 5 3 6 Target tale: Id Name1 ABCD2 ABCD3 ABCD4 EFGH5 EFGH6 EFGH can anyone help on what should be the logic to get this data in a table in informatica.

How to avoid duplicate record in a file to file

Similar Messages

Maybe you are looking for