Merge two text files

Question

Need your help with merging two text source files into single table.  Each text file is single column containing names.  Let's say that file one is list of members in DEPARTMENT A and second file members of DEPARTMENT B.  Text files look
something as follows:
Filename: DEPARTMENT_A
NAME (header)
Steve
Joe
Mary
Filename: DEPARTMENT_B
NAME (header)
Ron
Joe
Susie
Ultimately, I need the resultant table data to look like this:
NAME     DEPARTMENTS
Steve     A
Joe        A, B
Mary      A 
Ron        B
etc.
I think the solution involves derived columns, pivot, coalesce, but can't figure out how to put them together.  What do you recommend?  Thanks.

Answer 1

You need a data flow task
Inside that have two flat file sources connecting to both files. Following that have a derived column task to add department information (A,B). use a union all transform to merge both the inputs and finally use OLEDB destination to dump the result into table
with two columns Name and Department.
Then add a execute sql task to do update as below
UPDATE t
SET Department = Department + ', B'
FROM Table t
WHERE Department = 'A'
AND EXISTS (SELECT 1
FROM Table
WHERE Name = t.Name
AND Department = 'B'
DELETE t
FROM Table t
WHERE Department = 'B'
AND EXISTS (SELECT 1
FROM Table
WHERE Name = t.Name
AND Department = 'A, B'
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs