How to load duplicate data to a temporary table in ssis

i have duplicate data in my table.i want to load unique records in one destination .and i want to load duplicate data in a temporary table in another destination. .how can we impliment package for this

Hi V60,
To achieve your goal, you can use the following two approaches:
Use Script Component to redirect the duplicate rows.
Use Fuzzy Grouping Transformation which performs data cleaning tasks by identifying rows of data that are likely to be duplicates and selecting a canonical row of data to use in standardizing the data. Then, use a Conditional Split Transform to redirect
the unique rows and the duplicate rows to different destinations.
For the step-by-step guidance about the above two methods, walk through the following blogs:
http://microsoft-ssis.blogspot.in/2011/12/redirect-duplicate-rows.html
http://hussain-msbi.blogspot.in/2013/02/redirect-duplicate-rows-using-ssis-step.html
Regards,
Mike Yin
TechNet Community Support

Similar Messages

How to check the data in a temporary table

Hi,
A procedure inserting data into a temporary table , data exists in the table now. so, how to see the data from the temporary table. Is it possible to see from the sqlplus by selecting, right now i'm not getting any data. .thanks Bcj.

If you are referring to Global Temporary Tables, then the only way to see the contents of the table are to select from the table while connected to the same session that inserted the data into the GTT.
Please note however that there is not a 1 to 1 correspondence between sessions and users (shcemas). A user may be connected to 1 or more sessions, but it is only the session that inserted the records that will be able to view the records.

How to load the data using a plsql table in ODI.

Hi All ,
Can anyone help me on this ?
We have a PLSQL procedure which returns a plsql table as out parameter.
We are supposed to load the data in to a file using this plsql table (Table type) in ODI.
Can this be done using ODI?
Regards,
Karthik+

Hi,
We have one process with a ref cursor (Oracle) as a source and remote Oracle DB as a target. I ended up writing my own KM that populates a global temporary table from the cursor first and then transfers the data to target. If temporary table is an option for you, the rest is pretty easy.
Regards.

How to load external data without using external tables

Hi,
I'm asked to develop an ETL for loading external data into a database but, unfortunately, the vers. is 8i so I can't use external tables.
I know that it's possible by using SQL-Loader. What I want to know is whether there's another way in 8i to load external data from a text file or a CSV file directly with a stored procedure without having to write CTL of SQL-Loader on the server. I mean, is there a way to write everything on the database the same manner I'd do whether I wrote data from a table to a file using for example UTL_FILE or the unique way is to write control files of SQL-Loader directly on the server?
Thanks!

Mark1970 wrote:
Thank you very much Karthick
I didn't know I could use UTL_FILE also for reading files. I've always use it only for writing data into external files.Yes you can use UTL_FILE to read. The version of oracle you are using i last used in 2004 :) Still remember giving the OS path of the file to open the file. That is long gone now. Its surprising that you are still in 8i.

How to load the data from a staging table to interface table

Hi..
I have a staging table having these many columns
invoice_number,invoice_date,vendor_name,vendor_site_code,description,line-amount,line-description,segment1,segment2,segment3,segment4,segment5
I want to insert data into oracle interface tables
1st table is ap_invoices_interface which is primary
and 2nd is ap_invoice_lines_interfaces.
According to the invoice_id I have to insert the sum of amount in the amount column of primary table
can anyone plz give the codes .
any help appreciate

Hi,
you need to write pl/sql procedure or package for validiating the data and inserting.
first u need to know wat r the mandatory colums. and write the code igiving here a simple example
Create or replace procedure xxstg_po_vendors_int(errbuf out varchar2,retcode out number) IS
Cursor po_cur IS Select sno,VENDOR_NAME,SUMMARY_FLAG,ENABLED_FLAG From xxstg_po_vendor;
l_SUMMARY_FLAG Varchar(1);
l_ENABLED_FLAG varchar(1);
l_VENDOR_NAME varchar2(240);
l_err_msg varchar2(240);
l_flag varchar2(2);
l_err_flag varchar2(2);
Begin
Delete from Ap_suppliers_INT;
commit;
for rec_cur in po_cur loop
l_flag :='A';
l_err_flag:= 'A';
Begin
select summary_flag into l_SUMMARY_FLAG from po_vendors
where summary_flag = rec_cur.summary_flag;
Exception
when others then
l_summary_flag:= null;
l_flag:='E';
l_err_msg:= 'Summary_flag Does not Exist';
END;
FND_FILe.PUT_LINE(FND_FILE.LOG,'Inserting data into interface table'||l_flag);
Begin
Select enabled_flag into l_enabled_flag from po_vendors
where enabled_flag = rec_cur.enabled_flag;
exception
when others then
l_enabled_flag:=null;
l_flag :='E';
L_err_msg:='Enabled_flag Does not Exist';
End;
FND_FILE.PUT_LINE(FND_FILE.log,'Inserting data into interface table'||l_flag);
FND_FILE.PUT_LINE(FND_FILE.log,'Inserting data into interface table'||l_flag);
INSERT INTO AP_SUPPLIERS_INT
( VENDOR_INTERFACE_ID,VENDOR_NAME,SUMMARY_FLAG,ENABLED_FLAG )
values(rec_cur.sno,rec_cur.VENDOR_NAME,rec_cur.SUMMARY_FLAG,rec_cur.ENABLED_FLAG);
l_flag :=null;
l_err_msg:=null;
end loop;
commit;
end;
Regards
Goutham

How to load xml data into a database table....

Hi All,
Iam new to this forum.I have an xmldoc table of xmltype(datatype).Iam able to insert xml data to it.I have another table called new_books.sql:
CREATE TABLE NEW_BOOKS
TITLE          VARCHAR2(255) NOT NULL,
LINK          VARCHAR2(80) NULL,
PUBLISHER     VARCHAR2(255) NULL,
SUBJECT     VARCHAR2(80) NULL,
PUBDATE     VARCHAR2(40) NULL,
DESCRIPTION     VARCHAR2(4000) NULL,
AUTHOR     VARCHAR2(80) NULL,
PRIMARY      KEY(TITLE)
Now i want to copy the data in the xmldoc table into the table new_books.sql.Is there any procedure to do that in PL/SQL?
Given below is the xmlfile:
- <rdf>
- <item>
<title>Enterprise SOA: Designing IT for Business Innovation</title>
<link>http://safari.oreilly.com/0596102380?a=102682</link>
<publisher>O'Reilly</publisher>
<creator>Thomas Mattern</creator>
<creator>Dan Woods</creator>
<subject>IT Infrastructure</subject>
<date>April 2006</date>
</item>
</rdf>
Thanks in Advance,
Gita.

Assuming the table xmldoc(of xmltype) has this XML
SQL> select * from xmldoc;
SYS_NC_ROWINFO$
<rdf>
<item>
<title>Enterprise SOA: Designing IT for Business Innovation</title>
<link>http://safari.oreilly.com/0596102380?a=102682</link>
<publisher>O'Reilly</publisher>
<creator>Thomas Mattern</creator>
<creator>Dan Woods</creator>
<subject>IT Infrastructure</subject>
<date>April 2006</date>
</item>
</rdf>
SQL> INSERT INTO NEW_BOOKS(TITLE, LINK, PUBLISHER, SUBJECT)
2 select extractvalue(value(x),'/rdf/item/title') as title,
3 extractvalue(value(x),'/rdf/item/link') as link,
4 extractvalue(value(x),'/rdf/item/publisher') as publisher,
5 extractvalue(value(x),'/rdf/item/subject') as subject
6 from xmldoc x
7 ;
1 row created.

How to Load the data from excel file(Extension is .CSV) into the temp.table

Hi
How to Load the data from excel file(Extension is .CSV) into the temporary table of oracle in Forms11g.
My Forms Version is - Forms [64 Bit] Version 11.1.2.0.0 (Production)
Kindly Suggest the Solution.
Regards,
Sachin

Hello Sachin,
You can use the following metalink note:How to Read Data from an EXCEL Spreadsheet into a Form Using Webutil Client_OLE2 (Doc ID 813535.1) and modify it a little bit.
Instead of copy values into forms you can save them in your temporary table.
Kind regards,
Alex
If someone's helpful or correct please mark it accordingly.

How to load the data from excel file into temprory table in Forms 11g?

Hi
How to Load the data from excel file(Extension is .CSV) into the temporary table of oracle in Forms11g.
My Forms Version is - Forms [64 Bit] Version 11.1.2.0.0 (Production)
Kindly Suggest the Solution.
Regards,
Sachin

Declare
    v_full_filename         varchar2(500);
    v_server_path           varchar2(2000);
    v_separator             VARCHAR2(1);
    v_filename              VARCHAR2(400);
    filename                VARCHAR2 (100);
    v_stop_load             varchar2 (2000);
    v_rec_error_log         varchar2(4000);
    v_error_log             varchar2(4000);
    ctr                     NUMBER (12);
    cols                    NUMBER (2);
    btn                     number;
    RES                     BOOLEAN;
    application             ole2.obj_type;
    workbooks               ole2.obj_type;
    workbook                ole2.obj_type;
    worksheets              ole2.obj_type;
    worksheet               ole2.obj_type;
    cell                    ole2.obj_type;
    cellType                ole2.OBJ_TYPE;
    args                    ole2.obj_type;
    PROCEDURE olearg
    IS
    args   ole2.obj_type;
    BEGIN
    args := ole2.create_arglist;
    ole2.add_arg (args, ctr);
    ole2.add_arg (args, cols);
    cell := ole2.get_obj_property (worksheet, 'Cells', args);
    ole2.destroy_arglist (args);
    END;
BEGIN
v_full_filename := client_get_file_name(directory_name => null
                                 ,file_name      => null
                                 ,file_filter    => 'Excel files (*.xls)|*.xls|'
                                                                        ||'Excel files (*.xlsx)|*.xlsx|'
                                 ,message        => 'Choose Excel file'
                                 ,dialog_type    => null
                                 ,select_file    => null
If v_full_filename is not null Then
v_separator := WEBUTIL_CLIENTINFO.Get_file_Separator ;
v_filename := v_separator||v_full_filename ;
:LOAD_FILE_NAME := substr(v_filename,instr(v_filename,v_separator,-1) + 1);
RES := Webutil_File_Transfer.Client_To_AS(v_full_filename,"server_path"||substr(v_filename,instr(v_filename,v_separator,-1) + 1));
--Begin load data from EXCEL
BEGIN
    filename := v_server_path||substr(v_filename,instr(v_filename,v_separator,-1) + 1); -- to pick the file
    application := ole2.create_obj ('Excel.Application');
    ole2.set_property (application, 'Visible', 'false');
    workbooks := ole2.get_obj_property (application, 'Workbooks');
    args := ole2.create_arglist;
    ole2.add_arg (args, filename); -- file path and name
    workbook := ole2.get_obj_property(workbooks,'Open',args);
    ole2.destroy_arglist (args);
    args := ole2.create_arglist;
    ole2.add_arg (args, 'Sheet1');
    worksheet := ole2.get_obj_property (workbook, 'Worksheets', args);
    ole2.destroy_arglist (args);
    ctr := 2;                                                     --row number
    cols := 1;                                                -- column number
    go_block('xxx');
    FIRST_RECORD;
    LOOP
            --Column 1 VALUE --------------------------------------------------------------------
        olearg;
        v_stop_load := ole2.get_char_property (cell, 'Text'); --cell value of the argument
        :item1 := v_stop_load;
        cols := cols + 1;
          --Column 2 VALUE --------------------------------------------------------------------
        olearg;
        :item2 := ole2.get_char_property (cell, 'Text'); --cell value of the argument
        cols := cols + 1;
        --<and so on>
    ole2.invoke (application, 'Quit');
    ole2.RELEASE_OBJ (cell);
    ole2.RELEASE_OBJ (worksheet);
    ole2.RELEASE_OBJ (worksheets);
    ole2.RELEASE_OBJ (workbook);
    ole2.RELEASE_OBJ (workbooks);
    ole2.RELEASE_OBJ (application);
END;
--End load data from EXCELPlease mark it as answered if you helped.

How to avoid duplicate data while inserting from sample.dat file to table

Hi Guys,
We have issue with duplicate data in flat file while loading data from sample.dat file to table. How to avoid duplicate data in control file.
Can any one help me on this.
Thanks in advance!
Regards,
LKR

No, a control file will not remove duplicate data.
You would be better to use an external table and then remove duplicate data using SQL as you query the data to insert it to your destination table.

Can u give clear steps how to load 3 data target at a time by the help of p

can u give clear steps how to load 3 data target at a time by the help of parllalesim

hi,
create the load infopackage type and give the infopack you need to load.
create 3 similar process types.
chain should have this flow
start -> delet index(if cube is the target) -> load target(connect the load process to start process) parallel -> and process -> create index(if cube)/actiavtion of ods(if ods)
Ramesh

How to load the data from .csv file to oracle table???

Hi,
I am using oracle 10g , plsql developer. Can anyone help me in how to load the data from .csv file to oracle table. The table is already created with the required columns. The .csv file is having about 10lakh records. Is it possible to load 10lakh records. can any one please tell me how to proceed.
Thanks in advance

981145 wrote:
Can you tell more about sql * loader??? how to know that utility is available for me or not??? I am using oracle 10g database and plsql developer???SQL*Loader is part of the Oracle client. If you have a developer installation you should normally have it on your client.
the command is
sqlldrType it and see if you have it installed.
Have a look also at the FAQ link posted by Marwin.
There are plenty of examples also on the web.
Regards.
Al

How to load the data from excel file into table in oracle using UTL_FI

How to load the data from excel file into table in oracle
and from table to excel file
using UTL_FILE package
Please give me some example

This is something i tried in oracle apex
http://avdeo.com/2008/05/21/uploading-excel-sheet-using-oracle-application-express-apex/
Regards,
CKLP

How to load the data from informatica into bw & how to report the data

Hi friends,
how to load the data from informatica into bw & how to report the data
using cognos.(i.e how to access the data in sap bw using cognos 8 BI suite).
Thanks,
madhu.

Inorder to report BW data into Cognos you can extract data from using Open Hub to the DB table from which Cognos reads.
For BW informatic integration refer following docs:
http://www.aman.co.il/aman/pfd/DataInteg_BR.q103cd.pdf.pdf
http://h71028.www7.hp.com/enterprise/cache/3889-0-0-225-121.html
http://devnet.informatica.com/learning/ePresentations.asp
http://72.14.203.104/search?q=cache:C741L86Q19oJ:devnet.informatica.com/showcase/resources/Essbase_DataSheet.pdfinformaticapowerconnect(BI)&hl=en&gl=in&ct=clnk&cd=3
http://www.informatica.com/customers/utilities_energy/fpl_group.htm
http://www.informatica.com/solutions/resource_center/technote_sapbw_65241004.pdf#search=%22Informatica%20to%20Bw%22

How to load master data from SAP R/3 system like Customer master...........

How to load master data from SAP R/3 system like Customer master, materioal master , vendor master.............

Hi Bramha,
Check ...........
Re: master data loading in BI 7.0
/message/4708129#4708129 [original link is broken]
Re: Master data loading.
Regards,
Vijay.

Step- by- Step on How to Load Excel data into Crystal Reports?

Hi Friends,
Can anyone send me a Step- by- Step on How to Load Excel data into Crystal Reports? Pls help me. Thanks in Advance.
Vijay

It's also important to 'prep' the excel file prior to connecting to it.
Give the data tab a meaningful name
Make sure the column headers are unique and that every column has a header
Delete any blank tabs
If you have trouble with Excel changing the data type of a field (say, a social security number you want to be a string value rather than a number so you don't lose leading zero) an alternative would be to save the spreadsheet file as a CSV, create a schema.ini to specify the data types for each column (example below) and use the same steps to connect except instead of choosing Excel 8.0, scroll to the bottom and choose Text. You have to make sure the CSV file is in the same folder as the schema.ini file that defines the columns.
Schema.ini example:
200912PUSD.csv
ColNameHeader=True
Format=CSVDelimited
MaxScanRows=25
CharacterSet=OEM
Col1=SSN Char Width 9
Col2=LAST_NM Char Width 25
Col3=FIRST_NM Char Width 25
Col4=DOB Date
Col5=STDNT_ID Char Width 10
Col6=SORTKEY Char Width 10
Col7=SCHOOL_NM Char Width 30
Col8=OTHER_ID Integer
Col9=GRADE Char Width 2
The filename in the first line needs to have the [] brackets around it, but I couldn't get it to display in this forum correctly.
Edited by: Eric Petersen on Jan 27, 2010 9:40 AM

How to load duplicate data to a temporary table in ssis

Similar Messages

Maybe you are looking for