How to use one dynamic connection managers for multiple parallel data flow tasks

hi there:
   I have 6 databases residing on the same server. What I want to do is  call a store procedure with identical name on each database dbo schema and transport results to a centralized place. The key is to have those SPs run in parallel instead
of in sequence as each SP may take around 10 mins to finish. 
The simplest way is to create 6 OLE DB connection managers and create 6 DFT tasks. However, I do not want to maintain 6 OLE DB connection managers as there is a chance to have more connection  managers.
 What I did so far is to create a OLD DB connection manager and use expression to set up connectionString properties so that it will get populated by variables at run time. It is fine when running all SPs in a Foreach Loop Container. However, it takes
around 60 mins to finish.
  When I try to run it in parallel ( basically created 6 DFTs but use only one Dynamic Connection Manager), the connection string gets confused therefore all DFT tasks failed.
   Does anyone here have some experience on this topic?
Thanks
 hui
--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

Yes, basically, on the connectionString property of ONE OLEDB, you are using an expression to supply value and this expression is pointing to a variable. 
In this case , you can update this variable from a table which contains many connection strings. It's good if you want to execute Store procedures in a sequential order. When in parallel mode, this will cause issues as connectionString gets overwritten. 
 I am thinking about using script task to exec sp.
 The whole idea is that I do not want to maintain a large number of Connection Managers. 
Hope it helps
--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --
So you are not able to run parallel executions using same conn mgmr, even with dynamic connectionstring, is that correct? Yes, script task will be a way to go if you wish to execute it in parallel, you may connect to SS and query the proper conn string with
SELECT/WHERE clause in each script > pass it to a script variable > use that script variable and execute the proc. This will require only two things to change in each script, the WHERE condition to get the conn string and the proc name (you may even
get the proc names the same way you get conn string) and everything else will be same. Let us know how that goes. 
Hope no two or more procs doing insert/update/delete on the same tables.

Similar Messages

  • How to use one pageflow to cater for multiple display?

    Hi, I trying to use one pageflow to display different kind of contents because the logic behind the retrieval is similar except that different parameter(string) us passed in for different content retrieval.
    How do i achieve the above? thanks in advance :D
    Cheers

    What do you mean by "display different kind of contents"? do you mean you want to display PDF/HTML/Image based on certain parameters or You are using different media like PC/PDA etc.
    In both cases you can redirect to different success page based on your query parameters.
    if(param.equals(image))
    forward image.jsp
    if(param.equals(pdf))
    forward pdf.jsp
    else
    forward html.jsp
    Hope it helps

  • How to use one pop up window for multiple buttons and input fields?

    Hi Experts,
    I have created a pop up window that will be opened from multiple buttons in the same view. There are input fields that the data will be populated from a pop up window.  How can I set up which button that a pop up window is opened from? I also would like to populate the data from a pop up window to the input field next to a clicked button. There are 6 buttons and 6 input fields that share the same pop up window. I would very appreciate your responses.
    Thank you,
    Don

    Hi,
    Try creating 2 context attributes, one in your component controller and the other in the pop-up view. Bind the attribute of pop-up view to the component controller attribute.
    In the main view, on click of every button set a unique code in the controller's context which helps you in identifying the button clicked. Since u have created a binding to the pop-up view attribute the value flows from the controller.
    In the init method of your pop-up view, check the value of the attribute and based on that display which ever UI elements are required.
    Eg:
    On Button 1 click set value "B1", Button 2  value "B2" etc. In the init() of pop-up view u can check the values and perform the required operation:
    if(("B1").wdContext().currentContextElement().getButtonIdentifier()){
    else...{
    Hope this helps you.
    Regards,
    Poojith MV

  • How to use the same POWL query for multiple users

    Hello,
    I have defined a POWL query which executes properly. But if I map the same POWL query to 2 portal users and the 2 portal users try to access the same page simultaneously then it gives an error message to one of the users that
    "Query 'ABC' is already open in another session."
    where 'ABC' is the query name.
    Can you please tell me how to use the same POWL query for multiple users ?
    A fast reply would be highly appreciated.
    Thanks and Regards,
    Sandhya

    Batch processing usually involves using actions you have recorded.  In Action you can insert Path that can be used during processing documents.  Path have some size so you may want to only process document that have the same size.  Look in the Actions Palette fly-out menu for insert path.  It inserts|records the current document work path into the action being worked on and when the action is played it inserts the path into the document as the current work path..

  • How to create a dynamic SSIS package for multiple flat file destinations

    Hi,
    I have to create a ssis package which has single data flow task and inside that I have 23 source (sql- select * from - statements)- destination (flat files, 23 distinct) connection.
    Now for each product I have to create separate SSIS package (i.e. if prod=abc then these read select * from abc_tables and 23 abc_ txt files)
    I want to do it dynamically, means only single package and inside that variables will take select * values for each source-dest connection (so i believe 23 variables) and same for destination flat files.
    Let me know. :)
    ANK HIT - if reply helps, please mark it as ANSWER or helpful post

    Sorry It seems you're contradicting yourself. you say I know my source and dest structure and the you're
    asking all I want is to have a dynamic structure
    what does that mean?
    and reading your next sentence
    I want to run a package for 5 products, instead of creating 5 ssis packages with 23 source- dest connection, I would
    like to have one with only 23 source- dest connections 
    What I feel is what you're looking for is to  have a looping structure to loop through each of the 5
    products.
    In that case what you could do is this
    1. Create a object variable in SSIS 
    2. Use a Execute SQL Task to populate the variable with all available products (I think you'll have a master table for that). Set ResultSet property to Full ResultSet and then in ResultSet tab map Object variable to 0 th index
    3. use a ForEachLoop container with ADO .NET recordset enumerator and map to object variable. Create a variable of datatype same as that of Product identifier field to get individual values out
    4. Inside loop create your data flow task with 23 source destination connection. In the query part use a parameter for product field and map it to the variable containing product value to get only data for the product.
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • How to maintain One product cost collector for multiple materials and configuration setting

    Hi experts,
    my requirement is that i want to maintain one product cost collector for multiple materials ans also i want to know the configuration setting for the same.
    I have used KKF6N but it is not working in my case. I went through KKF6M also but there i found multiple cost collectors.
    please guide me in the same.
    Thanks in advance.

    Hi Shripad,
    you cannot assign same  Product cost collector to different material.
    Because you creating cost collector for material combination of material /production version,material /Bom Routing.
    so please create individual cost collector for every material.
    if you have any query kindly revert back.
    Please mark the answer as helpful if it is helpful to you.
    Because march 5 onwards scn has stopped awarding points to liked content.
    Starting now: No more points for likes on comments/replies
    Thanks & Regards
    Sandeep Kumar Praharaj

  • Dynamically pick the table names in data flow task SSIS

    Hi All,
    I want to create a SSIS package which loads the data to a table on the other server every day. I have around 250 tables to load everyday and source and destination table names are available in a metadata table, table names have to read from the metadata
    table and data should be loaded. Is there a way that we can configure the source and destination table names dynamically in Data flow task?
    I am newbie to SSIS can any help with the solution for this problem.

    You can do that, not a big deal. The underlying problem is say suppose you constructed a ETL based on some x source and y destination and have put x(3 columns) as source and y destination(3 columns).. As you said if we have choice of dynamically pick the
    table names.. ETL might fail when you face below situation
    source x(3 columns)   destination y (4 columns) and there will be no mapping as it is dynamic. Sometimes mapping also fails even if the source and destination have same number of columns. If you still want to do... follow below steps:
    Create two variables:
    1.variable1 , datatype string
    2.variable datatype string  
    take one execute sql task, pick your source table names dynamically as you desired from metadata table \
    "SELECT sourcetblname as Res FROM @metadata WHERE ID=1" in sql statement and then go to name the result name as Res (I meant same as table alias) and map it to variablename1
    And in variable2 go to expression and write "Select * from "+@[User::variable].. and this will be your constructed dynamic command for oledb destination.
    And connect that execute sql task to (Data flow task)oledb source and choose data access mode as sql command with variable,and choose variable2. below is the diagram.
    - please mark correct answers

  • How to use the camera connection kit for iPad 3rd generation?

    Hi I just bought a new camera connection kit for my iPad 3rd generation. Does anyone have any experience or knows how to use it? I tried to connect a USB to it and nothing happened. Please help...

    This is how you use it.

  • How to use one external jar (SDK) for several apps in WTK?

    Hi,
    I have one external jar (SDK) I use for developing J2ME applications.
    Every time I have no choice but to copy this JAR (SDK) into my current application lib directory.
    I am building a family of MIDlets that I dont want to put into just one huge JAR but rather to have several JAR files for each application.
    In C world I need only to tell the linker where it should pickup ".so" or ".lib" file.
    Is any way to do the same with WTK? Or any other J2ME development tool?
    Thanks in advance,
    Andrew

    Link to wtk2.5 beta has been posted to this forum
    while ago. It's worth to try it It is MSA1.0
    compliant. It has many new JSRs.TomTom,
    Thanks again.
    I tested the WTK2.5BETA and here I ahve strange fact. My application works perfectly on WTK2.1, WTK2.2 WTK2.3 BETA but it crashes with a very weird message on WTK2.5BETA
    Method............: 22482ac 'com/tinyline/app/SVGEventQueue.handleEvent (virtual)'
    Stack Chunk.......: 2216e44
    Frame Pointer.....: 2216e7c
    Current IP........: 224820b = 22481fc + offset 15
    Previous Frame....: 2216e58
    Previous IP.......: 226afd6 (offset 26)
    Frame size........: 3 (2 arguments, 1 local variables)
    Argument[0].......: 20bc0b8
    Argument[1].......: 2216d7c
    ALERT: java/lang/NoSuchMethodError: No such method dispatchEvent.(Lorg/w3c/dom/events/Event;)Z.
    So I thought, OK it was compiled under WTK2.1 may it was the reason of crash.
    I took sources and compile them under WTK2.5 BETA. I came up with the same result - crash.
    Thanks,
    Andrew

  • How to use a bluetooth connected speaker for iTunes only

    Greetings. I have connected the bluetooth speaker to my mac, and can play itunes on it, but I also hear the computer's beeps and notices through this speaker. This detracts from the musical experience, to say the least. Please help.

    Hi X42:
    Your last paragraph intrigued me as I had the same impression:
      I thought unlicensed BT devices were legally limited by the FCC to about 30 feet (3 meters)
    Actually, 30 feet is 10 meters. 
    Anyway, I researched and found this as part of a Wikipedia item:
    Bluetooth is a standard wire-replacement communications protocol primarily designed for low power consumption, with a short range (power-class-dependent, but effective ranges vary in practice; see table below) based on low-cost transceiver microchips in each device.[7] Because the devices use a radio (broadcast) communications system, they do not have to be in visual line of sight of each other, however a quasi optical wireless path must be viable.[2]
    Class
    Maximum Permitted Power
    Range
    (approximate)
    mW
    dBm
    Class 1
    100
    20
    ~100 meters
    Class 2
    2.5
    4
    ~10 meters
    Class 3
    1
    0
    ~5 meter
    The effective range varies due to propagation conditions, material coverage, production sample variations, antenna configurations and battery conditions. In most cases the effective range of class 2 devices is extended if they connect to a class 1 transceiver, compared to a pure class 2 network. This is accomplished by the higher sensitivity and transmission power of Class 1 devices.[8]
    Apparently there are BT devices that will transmit about 300 feet.  I did look at the FCC site, but quickly became confused in the technbabble.
    Barry

  • How to use one I-tunes library with multiple windows users (family) on 1 pc

    On our family pc we log in with different accounts. We want to use I-Tunes but all have the same library. I tried to create a library not in the users directory, but in the All Users folder that is accessible for everyone. However, when I import the music in the library for one user and set the same location for another user, I-tunes does not recognize the library. So everyone has to create it's own library.
    What are the best practices to overcome this?

    Keep in mind that what you have done now is you have multiple iTunes libraries accessing the same media folder. Meaning, that each account can have their own ratings, playlists, etc. but more importantly, each account does NOT know what the other account does, so if your daughter adds a CD to her account, it will go into the shared folder, but it will NOT automatically go into your wife's iTunes library. She would have to add it manually. Likewise, if one account deletes music from their library and tells iTunes to remove it to the trash, the other accounts will not know and iTunes will still try to access the file from the shared location even though the file is now trashed.
    Each account has their own database files (.itl files in the iTunes folder) which stores this stuff.
    If you want to have everyone use the exact same library which means the same ratings, playlists, etc. then you need to move the database files into that same location and set each iTunes account to read the same data.
    How to open an alternate iTunes Library file or create a new one
    http://docs.info.apple.com/article.html?artnum=304447
    Patrick

  • How to manage one wsp and dll for multiple clients in farm environment

    1. There is a product which is developed using C sharp , jquery,CSS and sharepoint object models which have been packaged into .wsp file. Whenever we introduce new functionality to the product we used to branch the
    previous code as a version , say Version 1.0 and new functionality of the product will in another solution. This is how we are managing the code in TFS as versions. Each newer version will have new functionalities. We do not give latest functionality for all
    the clients. Each client is having its own version of functionality. Technically in order to access the functionality, the wsp solution should be present in the solution repository which is available in SharePoint central administrator site. This solution
    will be deployed on the client’s site. We are following the above process in SharePoint standalone installation where we used to purchase dedicated server per client and installed sql, SharePoint foundation 2010 as standalone installation and adding the client
    related version of the code to the solution repository. Later host on the site which is created for that client purpose. This process is same for all the clients where we purchase individual server for each client .
        Now we want to host our product in farm environment of sharepoint foundation 2010 where we are going to try 3 level architecture. 
    • SQL Server-In this sever we are going to install sql server 2008R2 standard edition. Which should serve the database service for all the web applications/sitecollections which we are going to create in Web front end server.
    • Application server- In this server we are going to install the sharepoint as farm and will install search server express for serving search functionality for our product
    • Web front end server- In this server we are going to add this server to Sharepoint farm which we have created in application server. Here we are going to create web applications and site collections for all the clients.
    In this scenario how to manage multiple versions of same wsp solution?
    Another major issue w.r.t the architecture of the product and new approach for client deployment as follow.We have CSS, jquery files for serving the functionality.These files have been mapped to 14 hive folder.If any changes we do one of the jquery file or
    css file which is meant for latest version and not for old version, then how to manage this new functionality for that particular css or jquery file in 14 hive folder, since there is only one 14 hive folder. What is the best practice to make this happen? Another
    thing is, how to manage dll files for individual client?

    It sounds like you have a farm scoped solution at work. In that case you can only have a single instance of it per farm, you'd have to branch each version so they appear to be seperate solutions entirely (thus ruining your clients upgrade process).
    Bluntly i don't think a single farm can manage all your user environments.

  • How to use Index, Match, or lookup for multi cell data..

    Hey all,  I'm new to using numbers (any spreadsheet really).  I can't figure out how to make this work.
    What I want to do for example is lookup a weight value in (F) by matching all the criteria in (A),(B),(C),(D) & (E).  If possible I would like my search criteria to match everything exactly except the Temp in (E).  The search temp can be warmer or greater than the temp listed. 
    I've tried using Index and Match together but I can't figure out how to match more than one valvue.  If all the other criteria is matched there should only be one weight to return.  I can match one criteria valvue but it only returns the first or last match.  I need it to match each item and return one weight.  What am I doing wrong??
    Please help, and keep it simple for the stupid me.
    Thanks

    The difficulty here is that MATCH and VLOOKUP return the values from the single row with the first match best fitting the type of match specified. VLOOKUP searches from the bottom of the column, MATCH form the top.
    I'd suggest a rearrangement of your data to allow a search with fewer steps.
    Since you want an exact match for the first four columns and a 'smallest value equal to or greater than' match for the fifth column I would suggest concatenating the values in columns A through E into a single value in a new column F inserted after column E.
    For the part of the data table shown, this concatenated value would remain the same for 13 rows, while the temperature ranges in five degree steps from -20 to +45, then a single three-degree step to 48.
    One value in those concatenated then changes, and the new concatenated value repeats for the next 13 rows with the temperature passing through the same range with the same steps.
    If this pattern is consistent (or even reasonably consistent) through the whole table. then a rearrangement of the data as shown below will greatly reduce table size and search time.
    Each distinct set of values A though D is presented on only a single row, the four values are concatenated in column E, and are followed by the temperature values, one per column, in the header row, with the associated weights for those conditions and that temperature listed across that row.
    Note: weights in row 2 (runway 13) are taken from your table. Boredom with retyping then set in, so those in row 2 (runway 31) are formula generated to present a series of decreasing weights, but bear no other relation to those in your table.
    With the table presented in this form, the search is reduced to a single OFFSET expression, with the ROW offset determined by matching the concatenated value of columns A-D of the Query table with their exact counterpart in the Data table, and the column offset determined by matching the temperature in the Query with its closest less than or equal to match in row 1 of Data.
    Formula:
    Query::F2: =OFFSET(Data :: $A$1,MATCH(A&B&C&D,Data :: $E,0)-1,MATCH(E,Data :: $1:$1,1)-1)
    Not handled: What do you want returned for temperatures less than -20 or greater than +48 degrees? As written, the formula will return a not found error for -21 and below, and the value associated with 48° for 49 and above.
    Regards,
    Barry

  • How to use one Assign action to create multiple context variables

    Hello, everyone.
    I read some tips from Oracle documentation that said:
    Avoid creating many OSB context variables that are used just once within another XQuery
    Context variables created using an Assign action are converted to XmlBeans and then reverted to the native XQuery format for the next XQuery. Multiple "Assign" actions can be collapsed into a single Assign action using a FLWOR expression. Intermediate values can be created using "let" statements. Avoiding redundant context variable creation eliminates overheads associated with internal data format conversions. This benefit has to be balanced against visibility of the code and reuse of the variables.
    Oracle® Fusion Middleware Performance and Tuning Guide
    +11g Release 1 (11.1.1)+
    Part Number E10108-03
    But I don't know how to do that. Can you show me ?
    Thank in advance
    Edited by: Doubt_Man on Aug 17, 2011 3:30 PM

    if you return sequences, you can declare the return type of your xquery as xs:double*
    (notice the asterix at the end)
    but I have the impression that in the assign action only the first element will be assigned to the context variable
    (correct me if I am wrong)
    So in fact you might indeed have to transform the sequence into a element()*, or concatenate it into a CVS string - for instance using string-join
    http://www.xqueryfunctions.com/xq/fn_string-join.html

  • How to make one album show up for multiple artists?

    I'd like some albums to show up under multiple artists in iTunes in Windows.  Say for example "The Basement Tapes" by Bob Dylan and The Band.  It would be nice to see this album under both these artists.  Or to have "Two Men With the Blues" show up under both Willie Nelson and Wynton Marsalis.  Can I do that with iTues?  If so I haven't figured out how.  It would be nice if using a delimiter such as as comma, slash of semi-colon would signify to iTunes that it should lists those songs under all artists but it doesn't.  At least commas didn't work.  Any help would be appreciated.

    iTunes doesn't have the ability to do what you want, i.e. to define multiple separated values in a field and then have the item show up when looking at a selection based on each of those values. "Bob Dylan", "The Band" and "Bob Dylan & The Band" are three distinct values that can't be linked together. Sort values can change where in a list things are displayed but shouldn't be used to attempt to merge different values as results are undefined and unpredictable.
    tt2

Maybe you are looking for