How to create a dynamic SSIS package for multiple flat file destinations

Hi,
I have to create a ssis package which has single data flow task and inside that I have 23 source (sql- select * from - statements)- destination (flat files, 23 distinct) connection.
Now for each product I have to create separate SSIS package (i.e. if prod=abc then these read select * from abc_tables and 23 abc_ txt files)
I want to do it dynamically, means only single package and inside that variables will take select * values for each source-dest connection (so i believe 23 variables) and same for destination flat files.
Let me know. :)
ANK HIT - if reply helps, please mark it as ANSWER or helpful post

Sorry It seems you're contradicting yourself. you say I know my source and dest structure and the you're
asking all I want is to have a dynamic structure
what does that mean?
and reading your next sentence
I want to run a package for 5 products, instead of creating 5 ssis packages with 23 source- dest connection, I would
like to have one with only 23 source- dest connections 
What I feel is what you're looking for is to  have a looping structure to loop through each of the 5
products.
In that case what you could do is this
1. Create a object variable in SSIS 
2. Use a Execute SQL Task to populate the variable with all available products (I think you'll have a master table for that). Set ResultSet property to Full ResultSet and then in ResultSet tab map Object variable to 0 th index
3. use a ForEachLoop container with ADO .NET recordset enumerator and map to object variable. Create a variable of datatype same as that of Product identifier field to get individual values out
4. Inside loop create your data flow task with 23 source destination connection. In the query part use a parameter for product field and map it to the variable containing product value to get only data for the product.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Similar Messages

  • How to create a dynamic entry list for an input field in VC(ce 7.1)

    Hello all,
    I have an Input field, i need to create a Dynamic Entry List for it in VC(ce 7.1).
    How can this be done.
    Thanks in Advance.
    Thanks and Regards,
    Santhosh Guptha N

    Hi Santhosh,
    You can define Dynamic entry list for Drop down list and combo box but not for input field.
    [Refer this|http://help.sap.com/saphelp_nwce10/helpdata/en/2a/28249060dd4dbc872f6266f4557364/frameset.htm] for defining entry list.
    Let me know if it helped.
    Regards,
    Dharmi

  • How to create a Dynamic Logon pages for a portal.

    Hi all ,
    Is it possible to create a dynamic logon pages for a portal.My requirement is when ever we enter the Portal url in the browser we will get logon page ..now when we reenter the Portal link the logon page should change. is it possible .
    thanks
    Rajeev.

    Hi Rajeev,
    Your requirement isn't very clear here.
    Do you meant that is userA is trying to logon, he must see different logon pages at different tims he tries to logon?
    Thanks  Hermann, I too was thinking about the same...just need to have some clarity on what really needs to be achieved.  Also unless the whole logon page needs to be different then cookies are best -- if its just some images then some javascript would be good enough.
    Thanks,
    GLM
    Edited by: GLM on Sep 26, 2008 12:11 PM

  • How to create an installation setup package for a java project?

    hi,
    i have a small project written in java. i used eclipse ide. i am trying to create an installation setup package for my application. can some one help me?
    thanks.

    hi daven,
    iam not using the websphere application developer.
    iam using eclipse release 3.2
    is there a solution?

  • SSIS project - read multiple flat files with different formats

    hi all,
    i need to import multiple flat files with different formats into different tables of the sql server database and not able to figure out the best way out in ssis to do so...
    please advise the possible methods in ssis to do so and if possible the process which can be dynamic as file names or columns might change in future.

    Hi AK1987,
    To import flat files with dynamic columns, we can use Script Task inside a Foreach Loop Container to parse the first row of the flat file to get the columns names and save them into a .NET variable, then, we can create “Create Table” script based on this
    variable, and then store the script into a SSIS package variable. After that, we create a staging table based on the package variable, load the flat file data to the staging table. Eventually, we load data from the staging table to the destination table. For
    the detail steps, please walk through the following blog:
    http://www.citagus.com/citagus/blog/importing-from-flat-file-with-dynamic-columns/ 
    Regards,
    Mike Yin
    TechNet Community Support

  • How to Create .EXE from SSIS Package

    Hello All,
    Can you we create .exe file from SSIS Package in SSIS 2012
    Please share suggestions on this.
    Regards,
    Vaishu

    SSIS doesn't create executable files.
    The closest you have to an "executable" is the deployment to an Integration Services Server (the ispac file)

  • How to create a B/D Order for multiple notifications?

    Dear Sirs,
      I would like to know how to create single order for multiple notifications of the same breakdown type.
    Is it allowed to do so what are the advantages and disadvantages of the same.
    Regards,
    M.Boopathy

    Dear Boopathy,
    You can create a Maintenance Order with Ref. to a main notification thorugh Order Create icon in transaction IW22.
    Once the Order is created, you can add remaining Notification in Object Links Tab in the Maintenance Order.
    This is the standard way of attaching multiple Notifications to a single Order.
    Kindly acknowledge if this answer helped.
    Do let me know if you have any other query in the same.
    Thanks.
    Regards,
    Avi

  • How to create a blu-ray disc with multiple source files

    Hello,
    How is it possible to create a blu-ray disc, AVCHD recordable DVD with multiple source files from Final Cut Pro 10. Is it possible to create a menu with several chapters corresponding to the sequences (source files)?
    Thank you in advance for your support.

    Assume you're talking about using the Create Blu-Ray batch template. It's not possible to do with multiple source filles. But if I understand your objectives, you could pretty much get what you think want – discrete movie segments on a single disk with navigation.
    The way I'd approach it is by making multiple projects in FCP and then copying the finished versions into a new project, separated by gaps. (You could also use compound clips but I'm not a fan except for very short sequences, which is why I'm suggesting the copy route.) Then export and bring into Compressor.
    In Compressor mark your chapters at the gaps between your individual sequences. Then choose the AVCHD option in job actions.
    Bear in mind that you'll have to keep the recording time under roughly 30-35 minutes @a5 Mbts/sec
    Good luck.
    Russ

  • How to create a table using a variable or flat file ?

    Hello All,
    I want to create a table in which column names and data type will be read from a flat file or a variable.
    How can i do this ? Any suggestations are appricaible.....
    Regards,
    Ashish

    How about using this code.
    Used Directory object EXT_DIR where the input file abc.txt is located with the below mentioned data
    TABLE SANJ_TEST
    SANJ_AB NUMBER(6)
    SANJ_BC VARCHAR2(100)
    Declare
    v_file utl_file.file_type;
    z varchar2(100);
    v_cnt number :=0;
    v_str Varchar2(1000) :='';
    v_tab varchar2(40);
    v_col varchar2(30);
    v_data_type varchar2(30);
    Begin
    v_file := utl_file.fopen('EXT_DIR','abc.txt','r');
    loop
    utl_file.get_line(v_file,z);
    if substr(z,1,5) = 'TABLE' then
    if v_cnt <> 0 Then
    v_str := v_str||')';
    execute immediate v_str;
    end if;
    v_cnt := 0;
    v_str := 'Create Table ';
    v_tab :=Ltrim(Rtrim(substr(z,7)));
    v_str := v_str||v_tab||'(';
    Else
    dbms_output.put_line('count in else start '||v_cnt);
    v_col := ltrim(rtrim(substr(z,1,30)));
    v_data_type := ltrim(rtrim(substr(z,31)));
    if v_cnt=0 then
    v_str := v_str||v_col||' '||v_data_type;
    else
    v_str := v_str||','||v_col||' '||v_data_type;
    end if;
    v_cnt := v_cnt+1;
    End if;
    End loop;
    utl_file.fclose(v_file);
    Exception
    When NO_DATA_FOUND then
    v_str := v_str||')';
    execute immediate v_str;
    dbms_output.put_line('In excep '||sqlerrm);
    utl_file.fclose(v_file);
    End;
    /

  • Using ssis import a multiple flat files with different mappings

    I have an scenario for import a file
    20 different flat file source and having XML mapping document in a table.
    get files from that path(i have path and file name extension in table)
    i have map this file based on the file name extension in dynamically
    create a 20 different staging table based on mapping in dynamically
    kindly help for this
     

    Hi Karthick,
    As Arthur said, if you don't want to hard code the data flow, you need to read XML from the SQL Server table and use Script Task to implement the dynamic columns mapping. To read XML from a SQL table, you can refer to:
    http://blog.sqlauthority.com/2009/02/13/sql-server-simple-example-of-reading-xml-file-using-t-sql/ 
    In the Script Task, we need to parse the first row of the flat file to get the columns information and save that to a .NET variable. Then, the variable will be used to create the query that will be used to create SQL table. For more information, please see:
    http://www.citagus.com/citagus/blog/importing-from-flat-file-with-dynamic-columns/ 
    Regards,
    Mike Yin
    TechNet Community Support

  • How to use one dynamic connection managers for multiple parallel data flow tasks

    hi there:
       I have 6 databases residing on the same server. What I want to do is  call a store procedure with identical name on each database dbo schema and transport results to a centralized place. The key is to have those SPs run in parallel instead
    of in sequence as each SP may take around 10 mins to finish. 
    The simplest way is to create 6 OLE DB connection managers and create 6 DFT tasks. However, I do not want to maintain 6 OLE DB connection managers as there is a chance to have more connection  managers.
     What I did so far is to create a OLD DB connection manager and use expression to set up connectionString properties so that it will get populated by variables at run time. It is fine when running all SPs in a Foreach Loop Container. However, it takes
    around 60 mins to finish.
      When I try to run it in parallel ( basically created 6 DFTs but use only one Dynamic Connection Manager), the connection string gets confused therefore all DFT tasks failed.
       Does anyone here have some experience on this topic?
    Thanks
     hui
    --Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

    Yes, basically, on the connectionString property of ONE OLEDB, you are using an expression to supply value and this expression is pointing to a variable. 
    In this case , you can update this variable from a table which contains many connection strings. It's good if you want to execute Store procedures in a sequential order. When in parallel mode, this will cause issues as connectionString gets overwritten. 
     I am thinking about using script task to exec sp.
     The whole idea is that I do not want to maintain a large number of Connection Managers. 
    Hope it helps
    --Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --
    So you are not able to run parallel executions using same conn mgmr, even with dynamic connectionstring, is that correct? Yes, script task will be a way to go if you wish to execute it in parallel, you may connect to SS and query the proper conn string with
    SELECT/WHERE clause in each script > pass it to a script variable > use that script variable and execute the proc. This will require only two things to change in each script, the WHERE condition to get the conn string and the proc name (you may even
    get the proc names the same way you get conn string) and everything else will be same. Let us know how that goes. 
    Hope no two or more procs doing insert/update/delete on the same tables.

  • Creating a Volume Control Bar for multiple audio files

    I'm fairly new to Flash and am developing a project with a
    series of frames that contain unique movie clips. Each of these
    frames are accessible through a chapter based menu as well as being
    viewable straight through as a regular movie. I've just added the
    audio for each "chapter" / frame that are all unique from one
    another. I'm having a problem with creating a volume control bar
    that will affect all audio throughout all frames from the single
    control bar on the general skin/interface that these chapters work
    out of. (Using Flash 8)
    I developed a sliding control bar, which works but does not
    affect the volume in any way. Is there something wrong with the
    following coding that I'm using? (The control bar is made up of a
    button nested in a movie clip and the action is being applied to
    the mc. The bar/line to follow is 60px long and the control is to
    move horizontally while the increase corresponds to increase in
    volume. The original code was for a 100px line from a macromedia
    tutorial that I adjusted to be 60px) Any advice on best practice
    for creating a volume control bar would be greatly appreciated! (I
    currently have all of my corresponding audio files on separate
    layers, should I be placing these within a mc rather than just
    having them on the main timeline?) Thank You!!!!

    Answering my own question.....
    Each individual swf has the code...
    var my_sound:Sound = new Sound();
    my_sound.loadSound("someSound.mp3", true);
    my_sound.setVolume(50);
    Code on Shell/main slide....
    //SOUND OBJECT
    var soundtrack:Sound = new Sound;
    soundtrack.setVolume(50);
    //END OF SOUND OBJECT
    //GLOBAL VOLUME CONTROL
    var nVolCheck:Number;
    volSlider.volBall.onPress = function():Void {
    this.startDrag (false, 0, 0, 75, 0);
    nVolCheck = setInterval(updateVolume, 150);
    volSlider.volBall.onRelease = function():Void {
    this.stopDrag ();
    clearInterval(nVolCheck);
    function updateVolume():Void {
    var vol:Number = (volSlider.volBall._x)*2;
    soundtrack.setVolume(vol);
    //END OF GLOBAL VOLUME CONTROL
    my bar is 75 pixels in width and the volume is being
    increased by 1.5 at its maximum.

  • [Flat File Destination [220]] Error: Failed to write out column name for column "Column 2"

    I am using SSIS to extract fixed width data into a flat file destination and I keep getting below error. I have tried almost everything in this forum but still no solution. can anyone help me out to solve this problem.
    [Flat File Destination [220]] Error: Failed to write out column name for column "Column 2".
    [SSIS.Pipeline] Error: component "Flat File Destination" (220) failed the pre-execute phase and returned error code 0xC0202095
    Thanks

    Hi Giss68,
    Could you check the Advanced tab of the Flat File Connection Manager to see whether the InputColumnWidth and the OutputColumnWidth properties of the Column2 has the same value? Please refer to the following link about the same topic:
    http://stackoverflow.com/questions/10292091/how-do-i-fix-failed-to-write-error-while-exporting-data-to-ragged-right-flat-fil 
    If it doesn’t work, please post the sample data and the advanced settings of Column2 for further analysis.
    Regards,
    Mike Yin
    If you have any feedback on our support, please click
    here
    Mike Yin
    TechNet Community Support

  • Save an oracle package to a flat file

    Hallo,
    how can I save an oracle package to a flat file?
    Best Regards
    Werner

    Here is a script you can use. You may need to change the references to dba_source to user_source or all_source depending on your access privileges.
    set termout off
    store set sqlplus.cfg replace
    column pkg_spec new_value pkg_spec noprint
    column pkg_body new_value pkg_body noprint
    set pagesize 0
    set linesize 10000
    set trimspool on
    set echo off
    set verify off
    set feedback off
    set timing off
    set recsep off
    set termout on
    accept pkg prompt   'Package name:  '
    accept owner prompt 'Owner:         '
    set termout off
    select lower('&&pkg') || '_spec.sql' pkg_spec,
      lower('&&pkg') || '_body.sql' pkg_body from dual;
    spool &pkg_spec
    select 'create or replace' from dual;
    select text from dba_source
      where owner = upper('&&owner')
      and name = upper('&&pkg')
      and type = 'PACKAGE'
      order by line;
    select '/' || chr(10) || 'sho err' from dual;
    spool off
    spool &pkg_body
    select 'create or replace' from dual;
    select text from dba_source
      where owner = upper('&&owner')
      and name = upper('&&pkg')
      and type = 'PACKAGE BODY'
      order by line;
    select '/' || chr(10) || 'sho err' from dual;
    spool off
    @sqlplus.cfg
    set termout on

  • 100 packages for 100 seperate files in SSIS 2012---------

    Hi,
    I am new to this Microsoft Forum.
    I have worked for last 3 years in MSBI(mainly SSIS and SSAS). Recently I have joined a new company and been assigned to new project. Here we have to first build Operational Data Stores from 50 source files (which is built-100 tables). then from this we need
    to pull data in Data Warehousing and later Cube.
    My question is: My architect telling me to create 100 separate packages for each source file from source to staging (one to one source to staging mapping) and connect it through master package. then when we pull data from staging to Dev. there would
    be 30 destination tables so 30 packages!!
    I have not designed any ETL in this way.
    the files can be segregated as per daily, monthly, weekly and quarterly, so I would have created daily, monthly and so on package. In each package I would have included source to staging and staging to development phase.
    His points are, testing team  can work separately on each package, multiple developers can work on separate files at the same time. can anyone tell me how feasible the design is.....advantage/disadvantage... But Would  it be good to handle
    100 odd packages for one database where I can achieve this by creating 6 packages.
    thanks, Rims

    Hi Rims,
    Personally, I agree with your architect's opinion from the perspective of "multi-developer" as well as "unit test your SSIS packages".
    If your main concern of creating dedicated SSIS packages is time consuming, I would recommend you to have a look at BIML / Mist. You can quickly get the idea from this YouTube video: https://www.youtube.com/watch?v=RKi2zIoFUAg
    Basically, BIML / Mist can help you to build a SSIS code generator to loop through your database objects and generate SSIS packages on the fly. If you take this approach, it would be faster to create 100 SSIS packages than 6 customized SSIS packages.
    Regards,
    George Qiao

Maybe you are looking for