SSIS 2012 Project Deploymeny Progressively Slower

I've noticed a gradual increase in the amount of time it takes for me to deploy a project to the SSIS Catalog. First of all, is there a way to deploy only specific packages or do I need to deploy the project everytime a package is added or changed?
In the beginning, the project only had few packages and the deployment time was not noticiably slow. Now, as I've added more projects (currently upto like 15 packages) I am beginning to notice an increase in the amount of time it takes for the project to
get deployed (like 5 minutes or more.)
Any explanation for this and how to make it go faster?

Hi All
I too am experiencing this exact same problem and have tried all suggestions listed so far, nothing stood out. I'm running SQL 2012 SP1 with CU3 or 4 (whichever is the one with the PowerView MD update!!) which I hoped would fix this issue which is really
starting to bug me, despite loving the new deployment method.
The only thing that made a small difference was adding several suggested missing indexes on the SSISDB database itself (see
http://www.ssistalk.com/2013/01/31/ssis-2012-catalog-indexing-recommendations/), however this increased the speed of the 'Changing protection level' but made no difference with the speed of the 'Deploying project' which used to be super fast, now I deploy
projects which used to deploy fast with say 2 or 3 small packages no take 15 or 20 minutes - come on Microsoft!!!!
I can only think that this is a bug of some kind or there is another index required somewhere on the SSISDB database, hopefully this will be something fixed in another CU or SP2 maybe whenever that arrives. I'll keep searching but let us know if you find
any fix for this too! :-)
Edit: Forgot to mention that I'm running with full admin rights on server and SQL server itself. It makes no difference running from server or remote workstation. This is NOT a network issue. I feel that its most likely an index required somewhere...
Further update: I've been taking a look at the activity monitor which is showing a suspended execute (detail: SSISDB.catalog.start_execution;1) and also it is having a problem with this select query:
SELECT
u.name AS [Name],
u.principal_id AS [ID],
ISNULL(ak.name,N'') AS [AsymmetricKey],
ISNULL(cert.name,N'') AS [Certificate],
ISNULL(suser_sname(u.sid),N'') AS [Login],
        CASE
        WHEN N'C' = u.type THEN 1
        WHEN N'K' = u.type THEN 2       
        WHEN N'S' = u.type AND SUSER_SNAME(u.sid) is null AND u.authentication_type != 2 THEN 3
        ELSE 0 END
       AS [UserType]
FROM
sys.database_principals AS u
LEFT OUTER JOIN sys.asymmetric_keys AS ak ON ak.sid = u.sid
LEFT OUTER JOIN sys.certificates AS cert ON cert.sid = u.sid
WHERE
(u.type in ('U', 'S', 'G', 'C', 'K'))
ORDER BY
[Name] ASC
And also this query seems to flick between suspended and running (wait type is still making me thing some indexing problem but I've checked existing ones and I've rebuilt several with high fragmentation and no difference):-
(@_msparam_0 nvarchar(4000),@_msparam_1 nvarchar(4000))SELECT
u.name AS [Name],
u.principal_id AS [ID],
CAST(CASE WHEN u.principal_id < 5 OR u.principal_id = 16382 OR u.principal_id = 16383 THEN 1 ELSE 0 END AS bit) AS [IsSystemObject],
CASE WHEN N'U' = u.type THEN 0 WHEN N'G' = u.type THEN 1 WHEN N'S' = u.type THEN 2 WHEN N'C' = u.type THEN 3 WHEN N'K' = u.type THEN 4 END AS [LoginType],
CAST(CASE dp.state WHEN N'G' THEN 1 WHEN 'W' THEN 1 ELSE 0 END AS bit) AS [HasDBAccess],
u.sid AS [Sid],
u.create_date AS [CreateDate],
u.modify_date AS [DateLastModified],
ISNULL(u.default_schema_name,N'') AS [DefaultSchema],
ISNULL(cert.name,N'') AS [Certificate],
ISNULL(ak.name,N'') AS [AsymmetricKey],
ISNULL(suser_sname(u.sid),N'') AS [Login],
ISNULL(u.default_language_lcid, -1) AS [DefaultLanguageLcid],
ISNULL(u.default_language_name,N'') AS [DefaultLanguageName],
u.authentication_type AS [AuthenticationType],
        CASE
        WHEN N'C' = u.type THEN 1
        WHEN N'K' = u.type THEN 2       
        WHEN N'S' = u.type AND SUSER_SNAME(u.sid) is null AND u.authentication_type != 2 THEN 3
        ELSE 0 END
       AS [UserType]
FROM
sys.database_principals AS u
LEFT OUTER JOIN sys.database_permissions AS dp ON dp.grantee_principal_id = u.principal_id and dp.type = @_msparam_0
LEFT OUTER JOIN sys.certificates AS cert ON cert.sid = u.sid
LEFT OUTER JOIN sys.asymmetric_keys AS ak ON ak.sid = u.sid
WHERE
(u.type in ('U', 'S', 'G', 'C', 'K'))and(u.name=@_msparam_1)
The packages and project at this point seem to be deployed as the appear in the Integration Services Catalog, just seems like these last processes are causing the deployment to take MUCH longer than appears... Is anyone else getting this in their slow deployments?

Similar Messages

  • SSIS 2012 Project Deployment with included EXE application not deployed in Catalog

    Hi,
    I have converted a SSIS solution consisting of 20 packages, two exe applications, and a web service to the project deployment model. My question is: where are the exe applications deployed to? I don't see them in the catalog on the server.  If I exclude
    these from the solution and disable the steps in the packages using them, everything works fine.  In BIDS, I can include the exe applications  and run the solution locally and it works fine. I have parameters for the path to the EXEs, but when configuring
    the path in the catalog, I am unsure what to set it to. Do I need to manually move these EXE applications to the database server separately from the deployment?
    THanks much,
    Pat 

    You can even put exes as files in file system in a shared folder and access them from packages in catalog. Just pass the paths (UNC) using parameters in package
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • SSDT/SSIS 2012 project won't deploy to SSISDB on remote machine URGENT

    hi all getting the incredibly frustrating error message.  I've tried changing SQL Accounts etc. but to no avail.  What are the requirements to be able to deploy a project??? i have created ssisdb, and have deployed in the past but now it is not working.
     all ports etc. are open between me and target machine.  
    *** UPDATE *** I have even created a new folder THROUGH SSDT and it still won't deploy to it!!! This is really slack that such a critical feature can be plagued by stupid bug/permissions issues!!!

    Hi jhowe1,
    Glad to hear that you have resolved the issue. Thank you for the valuable sharing.
    Regards,
    Mike Yin
    If you have any feedback on our support, please click
    here
    Mike Yin
    TechNet Community Support

  • Failed to locate project named ... in SSIS 2012 package scheduled in agent

    Hi
    I have 2 packages that are deployed using Project deployment model on a, the are scheduled to run every 1/2 hour, for the last 2days the have been failing with Failed to locate project named ...:A .Net framework error occurred during execution of user defined
    routine or aggregate "decript_binarydata": System.IO.LoadException Could not load file or assembly.....The thing is that the package was working without issue, this seems to be a decryption issue, so I believe it is to do with Project Deployment
    model, but I am not sure
    Any help would be much appreciated
    Regards
    Andy
    CRM 4, SQL Server and .Net developer using C#

    Hi Andy,
    Based on my research, please refer to the following suggestions to fix this issue:
    Change the SQL Server Service Account from built in default “NT Service\MSSQLSERVER“ to another account with admin rights on the system.
    Grant appropriate permissions to SQL Server Service Account & SQL Agent Service Account.
    1. Note down your SQL Server Service Account & SQL Agent Service Account.
    2. Go to Start-> Run-> secpol.msc-> Local Policies->User Rights Assignment
    3. Check if these 2 accounts are a part of the following policies.
        • Log on as a service
        • Act as part of OS
        • Adjust memory quotas
        • Logon as batch job
        • Replace a process level token
    4. If not, add them explicitly.
    5. Reboot the machine
    Repair the SQL Server instance to test the issue again.
    The following two blogs are for your references:
    http://blogs.msdn.com/b/dataaccesstechnologies/archive/2012/08/20/error-while-deploying-ssis-2012-project-from-ssdt-to-ssis-catalog-system-componentmodel-win32exception-a-required-privilege-is-not-held-by-the-client.aspx
    http://blog.oraylis.de/2013/09/fixing-sql-2012-ssis-deployment-error-6522-a-required-privilege-is-not-held-by-the-client/
    Thanks,
    Katherine Xiong
    If you have any feedback on our support, please click
    here.
    Katherine Xiong
    TechNet Community Support

  • SSIS 2012 - Parent/Child Package "Object" Type Variables

    How do I pass Variables of Object type from Parent to Child packages?
    I am using the SSIS 2012 project deployment model.
    Thanks

    You can do it as outlined in
    http://sqlblog.com/blogs/andy_leonard/archive/2010/01/25/ssis-snack-passing-parent-starttime-to-the-child-package.aspx
    But
    When you need an object it is typically a recordset, then just pass the results, or execute the query in a package.
    Arthur My Blog

  • SSIS 2012 continuous integration using msbuild

    Hi,
    I have an SSIS 2012 project file *.dtproj. I want to create .ispac file from a program for continuous integration. I saw posts saying we cannot do it using msbuild. What are the other options? Has anyone used ssismsbuild (sqlsrvintegrationsrv codeplex)
    I am very new to .NET and SSIS. Any example or step by step instruction to achieve this is highly appreciated.
    Thanks,
    Rajesh

    Hi Rajesh
    I created a CI system for SSIS 2012. I used Microsoft.SqlServer.IntegrationServices.Build.dll from
    the  (Microsoft
    SQL Server Community Samples: Integration Services) to make the MSBuild working. Jenkins is used
    for CI system. Details can be found from this link: http://speaksql.wordpress.com/2013/09/04/ssis-2012-continuous-integration-using-jenkins-and-octopus-a-journey-to-db-deployment-automation/

  • How adding a data source-data destination inside SSIS 2012-SSDT

    Hi,
    I need to see inside a SSIS 2012 project a new SSIS installed component but in the SSDT 2010 I cannot see the SSIS Data Flow Items tab for adding data source/data destination respect to the choose toolbox items pane:
    It seems a SSIS bug.
    Any helps to me, please?
    Thanks

    Hi,
    In SQL 2012 you are no longer required to manually pick the tasks and components you want to use. You have to select from the new custom SSIS Toolbox to use the additional components you need.
    SSIS Tasks Components Scripts Services | http://www.cozyroc.com/

  • Diffrence between SSIS 2008 and SSIS 2012

    Hi,
    I would like to know the difference between 2008 and 2012 versions.
    Since we are having plan to move to 2012 version .
    Please let me know if there is nay drawbacks.
    Thanks,
    Priyanka
    priyanka

    Hi Priyanka,
    New features in SSIS 2012:
    Project Deployment Model - Way of deploying packages through wizard
    Project Parameters - Create parameters which can be used at package level and project levels
    SSISDB Catelog - In SSMS, you can create it and maintain parameters and ENV details.
    DQS - New transformation
    Small features which I noticed:
     - You can undo changes by pressing Ctrl + Z 
     - Variable expressions can be set inside Variable window itself (No need to go to properties window)
     - You can arrange the sequence of tasks in SSIS Toolbox
    For more details, please go through below technet article:
    http://technet.microsoft.com/en-us/library/bb522534(v=sql.110).aspx
    -Vaibhav Chaudhari

  • Referencing to a SSIS pkg belonged to another SSIS project - SSIS 2012

    Hi,
    in a my SSIS 2012 pkg I'd like to call a pkg of another SSIS project using the Execute Package task. The pkg to call is already deployed on a SSISDB catalog.
    Is it possible this operation? Thanks
    I'm afraid that both packages must be inside the same SSIS project.

    I did not try, but there is an option "External Reference"
    You must be then able to choose the package deployed into SSISDB.
    PS: I have just found a note at the very bottom of http://blogs.msdn.com/b/mattm/archive/2011/07/18/changes-to-the-execute-package-task.aspx which states my impression must be correct - "If you want to reference a package in another project, you have
    to use External Reference and reference the package by its path on the file system or on the SQL Server".
    Arthur My Blog

  • How to provide project.params in ssis 2012?

    well i am studying ssis 2012 can i know what steps we have to take to create project parameters and to provide connection string,DB name in ssis project.

    Create a connection and promote to the project level by right-clicking on it:
    And this link explains with pictures how to add a parameter and make it project wide https://msdn.microsoft.com/en-us/library/hh213296.aspx
    Arthur
    MyBlog
    Twitter

  • Script Editor takes forever to load with SSIS 2012 packages in VS 2012 when you click on Edit Script... button

    Hi,
    I'm upgrading some SSIS Packages to the SQL 2012 Project deployment model. However, when I click on the Edit Script... button in a Script Editor Task, Visual Studio just sits there for minutes until it sometimes opens, sometimes doesn't. Surely this should
    open up pretty much instantaneously. Can anyone shed any light on why this is happening ?
    Thanks
    Dave Evans

    Hi Dave Evans,
    It might be due to permission issue, please try to uncheck "Check for publisher’s certificate revocation" under the "Security" group in "Advanced" tab in "Internet Options", please see:
    http://stackoverflow.com/questions/13540151/ssis-script-editor-loads-very-slow 
    Thanks,
    Eileen
    Eileen Zhao
    TechNet Community Support

  • SSIS 2012: SSIS Error Code "Excel Connection Manager" failed with error code 0xC0202009.

    Hi,
    This is kind of weird issue that I am experiencing with excel connection manager in SSIS 2012. This issue occurs sometimes but when I close and re-open SSDT (SQL Server Data Tools - newer BIDS) then this issues goes off temporarily.
    Just FYI, through SSDT environment I executed the package successfully with both settings Run64bit runtime setting to Yes and No when error does not occur.
    So far I have installed
    http://www.microsoft.com/en-us/download/details.aspx?id=13255 (Microsoft Access Database Engine 2010 Redistributable).
    I still remember for older versions of SQL Server (2005 & 2008) that I have executed Excel connection SSIS packages with Run64bit runtime = false i.e. in 32-bit mode. As far as I know I think Excel 64-bit issue has been resolved with SQL Server
    2012 release.
    Here is the detail of error message:
    TITLE: Package Validation Error
    Package Validation Error
    ADDITIONAL INFORMATION:
    Error at Data Flow Task [Excel Source [2]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection
    Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
    Error at Data Flow Task [SSIS.Pipeline]: Excel Source failed validation and returned error code 0xC020801C.
    Error at Data Flow Task [SSIS.Pipeline]: One or more component failed validation.
    Error at Data Flow Task: There were errors during task validation.
    Error at Package [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
    An OLE DB record is available.  Source: "Microsoft Access Database Engine"  Hresult: 0x80004005  Description: "Unspecified error".
     (Microsoft.DataTransformationServices.VsIntegration)
    Here are my environment details:
    SQL Server 2012 {Microsoft SQL Server 2012 (SP1) - 11.0.3368.0 (X64) } , Excel 2010 (32-bit). I am developing SSIS code on Virtual desktops with Windows 7 32-bit OS.
    Also it occurred to me that since Virtual Desktops are on Shared Infrastructure, the source files and SSIS packages (code) can be on Shared drives for e.g. \\<Corpnet>\userdata\<Corp_Users_Grp>\<Username>\Visual Studio 2010\Projects\Integration
    Services Project2\Integration Services Project2\Package.dtsx.
    Does this kind of Shared drives have any impact to give this issue?
    Thanks in advance!
    Ketan
    P.S.: I had look at this forum question -->
    http://social.msdn.microsoft.com/Forums/sqlserver/en-US/903bbe1d-e070-4c43-9d3b-0a5193550029/64bit-error-in-excel-connection-manager-in-ssis

    Hi Arthur,
    Thanks for your response.
    Yes, it looks like SSIS still has bunch of issues with Excel files like as follows:
    1) Some times excel source files cannot be parsed by excel source connection manager.
    2) For derive column conversion, we can't replace the existing column. rather, we have to add the derived column as " add as new column" which is tough to manage  while destination mapping.
    3) If an column in excel contains a data which is not of the data type assigned for the column in excel, the excel source reads that data as "null". For the same, we can't validate the data and redirect the erroneous data in reject file.  <-- For
    this we tried IMEX setting also
    4) In multi-tab/sheet excel file, excel source is unable to detect a tab and identify the metadata of the excel.
    I am also checking Microsoft connect for Excel issues with SSIS 2012(https://connect.microsoft.com/SQLServer/SearchResults.aspx?SearchQuery=excel#&&PageIndex=22
    As worst case scenario, I am thinking of converting Excel to CSV file or Flat text file. (http://www.mssqltips.com/sqlservertip/2772/importing-data-from-excel-using-ssis--part-2/).
    Do you think it is advisable to convert Excel into CSV or Flat file.
    Thanks,
    Ketan

  • Byte input to Webservice Task in SSIS 2012

    Hi,
    I have just created a new project in SSIS 2012 and I am using a webservice task in a package.
    I imported the WSDL file and I have several inputs to set to use it properly.
    I put variables on the 4 first inputs that are strings with success but I have a problem with the last one.
    The last one is called xmlData and is in "byte" type and I can not set it correctly.
    In the XSD file I have this definition: <xsd:element
    minOccurs="0" name="xmlData" nillable="true" type="xsd:base64Binary"
    />
    It is supposed to contain a XML file that I have to encode in base64 and then fill the xmlData with the binary value.
    To encode my XML file to base64 I use a C# task but I do not know how to declare the value and how to set it.
    I do it this way:
                FileStream myStream = new FileStream(@"H:\myXML.XML", FileMode.Open, FileAccess.Read); 
                BinaryReader reader = new BinaryReader(myStream); 
                byte[] fichierXML = new byte[reader.BaseStream.Length]; 
                for (int i = 0; i < reader.BaseStream.Length; i++) 
                    fichierXML[i] = reader.ReadByte();
                reader.Close(); 
                myStream.Close(); 
                string xmlAsString = EncodeBytesAsBase64(fichierXML);
                MessageBox.Show(xmlAsString);
                // Conversion de la String en byte[]
                byte[] xmlData = System.Text.Encoding.UTF8.GetBytes(xmlAsString);            
                Dts.Variables["User::monXmlData"].Value = xmlData;
    My variable User::monXmlData is an Object and there is no problem in execution.
    The C# script runs well and the webservice task too but I always get an error response for the webservice saying that my xmlData field is not correct.
    I think that my base64 encoding is correct because when I copy the result in my messagebox and paste in base64 decode on a free web decoder I get my original XML text.
    Is there someone who can help me please?

    Thanks to all that took some time to read me.
    I have finally found the solution.
    The Base64 encoding is not necessary. It is automatically done by the webservice when the request is sent.
    The important thing to remember is that when you have to send a "byte[]" variable, you have to use a "Object" variable as an imput for the webservice.

  • Retain Same Connection = True - Property Set up for Connection Manager in SSIS 2012- Please help!

    Hi,
        I have a solution with 20 packages.  Target Database is same for all the packages, only target tables are different. All are working fine.
    Now,as part of a new requirement,I have to change some logic in one of the packages.I have to create few 'Global Temp Tables' on the fly and populate some data into it and use those tables for update and delete in both control and data flow.
       Since I am creating and using Global tables on the fly, I have to set up 'Delay Validation = True' for the package and the DFTs.
    Then, most important thing is, I have to set up 'Retain Same Connection = True' for the 'Target database' connection because only then, I assume,the package will not throw errors like 'Tables are not available'.
    My doubt is, if I change the Retain Same Connection = True, will it create any issue for the other packages, as all other packages are using the same connection manager.
    I am using SSIS 2012.
    Thanks for your help!
       

    Although 'RetainSameConnection' is a property of the Project Connection Manager, it only works within a package, but as soon as an other (child) package starts, you will loose the connection.
    Safest option is probably to use a separate package connection manager.
    Please mark the post as answered if it answers your question | My SSIS Blog:
    http://microsoft-ssis.blogspot.com |
    Twitter

  • How to deploy and execute SSIS 2012 packages when only SSDT is installed

    Hi, I am facing a weird situation where we did an upgrade for visual studio to vs 2102 on all the dev machines and as part of that moved to SSDT from BIDS but all the database is still SQL Server 2008 R2. Now I have a few SSIS 2012 packages which I cannot
    schedule & run because DTEXEC.exe is not compatible and I get all sorts of version & “Package Load error 0xC0010014 in CPackage::LoadFromXML” error even though I set it up in 32-bit mode and was trying to save it to msdb. I knew I will not be
    able to schedule this as a job in SQL Server Agent but even saving the package does not work.
    Thanks in advance............
    Ione

    I doubt 2012 ssis packages are backwards compatible with 2008r2. 2008r2 doesn't know anything about the project deployment model and i'm sure there's new tasks and connectors in 2012 so the package deployment model ssis packages won't work either.
    You will need a sql 2012 integration services service installed and running somewhere. You need this to execute your 2012 packages
    Jakub @ Adelaide, Australia Blog

Maybe you are looking for

  • HT4061 How can I find my IPad when it was stolen in Mexico? I havent activted ICloud or Find My IPad??

    Hi my IPad was stolen today from my RV in Mexico. I havent activated ICloud or Find My Ipad. I am trying to report it stolen on line, but have not been able to do much yet. I have emailed to my home in Canada, asking people to look for my serial numb

  • Settlement rule generation

    Hi all. I am using line item settlement. using investment projects. Unable to generate the settelemnt rule for the lower level WBS elements. while settling from WBS to AUC 1. Created project (throught AR) with one one level WBS element (top level), p

  • Using iCloud, how do i sync all email messages/folders etc

    how can i sync all email messages and folders using the icloud service?  i have updated and re-organized my email folders on my imac and i want them to sync with my iphone and ipad.  all of my other things are syncing very well between the three devi

  • How do I turn a list of files and paths into this format using AS?

    Hi everyone, I'm a complete novice with Applescript and I need some help to script turning a list of files from the Finder into a specific format in a text doc, so I can save as CSV and import into another app (Anki, for learning language). Here's an

  • Issue with Evaluation Path

    Hi All, I had created one Evaluation Path P-P. I want to retrieve all employees who are reporting to a particulat employee... ex: A is the manager B , C, D are team leads. Again B is having 2 more employees.. B1,B2... So when we execute for employee