SSIS Queries

I have a date Format like 20140101(yyyymmdd) i want to change the date format as 2014/01/01 (yyyy/mm/dd)
how can i do this by using Derived column in ssis
please help..

You don't need replace. You can use a logic as below
SUBSTRING([columnname],1,4) + "/" + SUBSTRING([columnname],5,2) + "/" + SUBSTRING([columnname],7,2)
Assuming source column data type is string (DT_STR)
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Similar Messages

  • Calling all SSIS users! May TechNet Gurus announced!

    The results for May's
    TechNet Guru competition have been posted!
    http://blogs.technet.com/b/wikininjas/archive/2014/01/16/technet-guru-awards-december-2013.aspx
    Congratulations to all our new Gurus for May!
    We will be interviewing some of the winners and highlighting their achievements, as the month unfolds.
    Post your JUNE contributions here:
    http://social.technet.microsoft.com/wiki/contents/articles/24692.technet-guru-contributions-for-june-2014.aspx
    Read all about June's competition, hopefully in a stickied post, at the top of this forum.
    Below is a summary of the medal winners for May. The last column being a few of the comments from the judges.
    Unfortunately, runners up and their judge feedback comments had to be trimmed from THIS post, to fit into the forum's 60,000 character limit, however
    the full version is available on TechNet Wiki.
    Some articles only just missed out, so we may be returning to discuss those too, in future blogs.
     BizTalk Technical Guru - May 2014  
    Peter Lindgren
    BizTalk 2010: Call SSO from Orchestration
    TGN: "I bet a few people will love you for this, I often see this question at the forums, and you answered it well. Good work!"
    Mandi Ohlinger: "Great topic and great explanation. It also makes SSO seem less scary :)"
    Sandro Pereira: "Very useful sample, well explained with all the necessary code "
    boatseller
    BizTalk: Using an Orchestration Sync or Async
    Sandro Pereira: "Good sample provide by boatseller and well explained."
    TGN: "Hey, great work man! This is a well done article and I love it!"
    Steef-Jan Wiggers
    Exposing data through BizTalk Service Hybrid Connections
    Sandro Pereira: "Nice article with a good overview about BizTalk Service Hybrid Connections and how you can configure them."
    TGN: "Good article, well explained and good pictures. Again Steef-Jan, you know what you're doing!"
    Mandi Ohlinger: "Nice set-up overview. "
     Forefront Identity Manager Technical Guru - May 2014  
    Sheldon.Jaquay
    Forefront Identity Manager - RCDC - Regular Expression
    AM: "Great contribution! Option C is clever, and the other examples are also a useful reference. Thanks for sharing your work with the community."
    Ed Price: "Nice short article. Great topic, and great blend of code, color, and images!"
    Søren Granfeldt: "Nice with a little focus on RegEx with FIM and good help for people wanting to have the portal be just a little more company specific"
    GO: "Thanks for the article, but the images weren't clear enough."
    Scott Eastin
    Installing Oracle MA for FIM R2 on Windows 2012
    GO: "EX-CE-LL-EN-T article!"
    AM: "Very nice article with clear step-by-step instructions - thanks for putting this together. "
    Ed Price: "I love the sections with numbered bullets at the end. They're very clear and easy to read!"
     Microsoft Azure Technical Guru - May 2014  
    João Sousa
    Microsoft Azure - Remote Debbuging How To?
    GO: "Clever. Well Explained and written. Thanks! You absolutely deserve the GOLD medal."
    Ed Price: "Fantastic topic and great use of images!"
    Alex Mang
    The Move to the New Azure SQL Database Tiers
    Ed Price: "Great depth and descriptions! Very timely topic! Lots of collaboration on this article from community members!"
    GO: "great article but images are missing"
    Alex Mang
    Separating Insights Data In Visual Studio Online
    Application Insights For Production And Staging Cloud Services
    Ed Price: "Good descriptions and clarity!"
    GO: "great article but images are missing"
     Microsoft Visio Technical Guru - May 2014  
    Mr X
    How to export your Orchestrator Runbooks to Visio and Word
    Ed Price: "A basic tip, but very helpful. Good job!"
    GO: "Thanks for that!"
    SR: "Nice "How To" article explaining the basic steps."
    AH: "This article is to the point takes a simple tasks and describes it accurately.
     SharePoint 2010 / 2013 Technical Guru - May 2014  
    Dan Christian
    Build a loop workflow using SharePoint 2010
    Jinchun Chen: "Excellent article. Personally speaking, the biggest challenge is SharePoint Designer workflow is “while-loop”. Many customers had the same scene as this article set. I am sure they are like this article.
    Benoît Jester: "An AWESOME, huge, detailed article by Dan. Did I mention the videos? Thanks Dan!"
    GO: "Great article Dan! Thanks!"
    Margriet Bruggeman: "Detailed explanation which I admire, but wouldn't be using a vs workflow be more logical in this case?"
    Geetanjali Arora
    Export User Profile Properties using CSOM
    Benoît Jester: "Great article on this new SharePoint 2013 development capability. I appreciate the code explanations."
    GO: "This is a great article. Love the way how you explain it."
    Margriet Bruggeman: "I will use this piece of code in the future!"
    Jinchun Chen: "Nice. How about customized properties? It would be nice more, if a CSOM script version can be attached. "
    Inderjeet Singh
    Unable
    to restore site collection issue
    GO: "Simple. Good Written. Clear and Clever. Great article."
    Margriet Bruggeman: "Quite handy reference for this particular problem"
    Benoît Jester: "Good explanation on the site collection deletion process."
     Small Basic Technical Guru - May 2014  
    Philip Conrod
    Programming Home Projects with Microsoft Small Basic: Chapter
    1: Writing Programs Using Small Basic
    RZ: "Very systematic introduction."
    Ed Price: "Good overview article that covers all the basics!"
    Michiel Van Hoorn: "Nice introduction into the history of Basic. Needs to be updated to reflect current support for Windows version (Windows NT? LOL )"
    Philip Conrod
    Programming Home Projects with Microsoft Small Basic: Chapter 6: Flash
    Card Math Quiz Project
    Michiel Van Hoorn: "This article (or book chapter) is excellent material to learn how to envision, design and build your program. The actual example program is also very usable."
    Ed Price: "I love how this tutorial keeps building on itself as it goes!"
    Nonki Takahashi
    Small Basic: Variable
    RZ: "Very nice explanation of the concept of variables!"
    Michiel Van Hoorn: "Clear explanation and not frills"
    Ed Price: "Great article with fantastic formatting!"
     SQL BI and Power BI Technical Guru - May 2014  
    Durval Ramos
    SSIS - Event Handling with "OnError" ou "OnTaskFailed"
    Ed Price: "The images are very helpful! Could use a grammar pass. Great descriptions!"
    GO: "This article has everything. A conclusion, reference, see also, other languages section. everybody should write actually like this."
    NN: "An interesting topic and article but unfortunately a bit hard to understand due to grammar problems"
    PT: "This is a good article on a useful topic. Please have your article reviewed and edited for proper language."
    S Kamath
    Expansion of Time dimension in Analysis Service
    PT: "Your article is concise and to the point, and contains useful information. It would be good to conclude with a short summary and perhaps compare this technique to others, discussing best practices."
    Ed Price: "Good details on Time Dimension. The images help us understand as we go."
    GO: "I like this one, but something is missing. Do not know what, but I had a blast reading the other two's. Does not mean that this one is bad, but there is something missing, maybe my knowledge..."
    NN: "Good article, but seems to be missing conclusion. It will also benefit from adding See Also section"
    Sherry Li
    SSAS – Ignore unrelated dimension or not
    NN: "Good and interesting article based on the blog"
    GO: "Wonderful article!"
    PT: "This is an important topic and contains helpful information but this is a simple topic that can be explained in fewer words. I found this article to be overly detailed and hard to read. I suggest having it reviewed and edited for
    proper language."
    Ed Price: "Good descriptions. Could be shorter. Good use of images!"
     SQL Server General and Database Engine Technical Guru - May 2014  
    Shanky
    Curious Case Of Logging In Online and Offline Index Rebuild In Full Recovery
    Model
    Jinchun Chen: "Good article. Thank you!"
    GO: "One of the best Wiki Articles ever! Thanks buddy!"
    DRC: "-- This is a great article which provides in-depth information on internals of Online & Offline rebuild index and Transaction logging. -- The following statement need to be re-written for more clarity. “The less logging can be
    attributed to the fact that no information about page allocation is logged information about de-allocation is logged please see below figure 13. Also if you compare amount of record returned in this case we had output containing just 64 rows while offline
    index rebuild had ____ rows.” -- Overall, a great article, thoroughly enjoyed reading it."
    NN: "Very interesting article, another great contribution by Shanky"
    Ed Price: "Thorough descriptions and great solution! Good article!"
    Uwe Ricken
    SQL Server: Be aware of the correct data type for predicates in queries
    Ed Price: "Incredibly well formatted! Great breakdown of sections!"
    GO: "Whoo, this is a wonderful article!"
    DRC: "-- This article explains the Query execution behaviour when the Query is not optimally written which could cause increased execution time. Great article. -- This topic is clearly explained and documented using a simple example and
    sample output which is easy is understand. -- Simple, very well written and great article to read. "
    NN: "Very good, easy to understand article and important information to know to all SQL Server developers"
     System Center Technical Guru - May 2014  
    Mr X
    Central Management of DSRM password on Domain Controllers using Orchestrator
    Ed Price: "The images really carry you through this article. Great execution!"
    GO: "Great article. I like your article Mr X! Thanks for your passion!"
    Kevin Holman: "Nice to see real world examples of Orchestrator in action solving problems that all customers have. This was very simple, but provides an excellent solution."
    W P Chomak
    System Center Operations Manager 2012 R2 - Customizing E-Mail Notifications
    AB: "Easy reading info that can help many"
    Ed Price: "Short and sweet. An incredibly valuable topic and needed addition to the Wiki!"
    GO: "Clever and well written. Thanks"
    Christoffer S
    System Center Configuration Manager 2012 R2 - Install applications in a task sequence based on AD-Groups
    Ed Price: "Good mix of code, images, and information. Could use more in-depth descriptions. Great article!"
    GO: "Clear and simple! Thank you!"
     Transact-SQL Technical Guru - May 2014  
    Naomi N
    T-SQL: Random Equal Distribution
    Jinchun Chen: "Nice."
    JS: "The crucial thing about such a procedure is to check the data before the randomization and afterwards. You might encounter situations where "John Smith" and "John Meyers" might have exchanged their First names
    which is technically correct, but logically and obviously wrong. So make sure that there is one additional check afterwards that makes sure that eventual privicy concerns will not survive the random process. Normally this would not happen, but I have already
    checked this is one of my older blog entries, where we exactly had that problem obfuscating data to make that operational and live data will not be recognized afterwards. http://blogs.msdn.com/b/jenss/archive/2009/04/08/when-is-random-random-enough.aspx In
    addition to this some attributes are sticky to each other like gender and First Name. You also have to make sure that your distribution might change statistically in relation to other attributes."
    Richard Mueller: "Very instructive. Perhaps the See Also section should have more links."
    Ed Price: "Great formatting and topic! Could benefit from more descriptions. Great article!"
    GO: "Naomi, your article is nice. Simple to understand the 'problem' and execute the 'solution""
    Manoj Pandey: "Nice article with a different way to resolve a given problem. I think this can also be done by using NTILE() function. I've added the code in comments section."
    Rogge H
    Extending SYS.Geometry to Utilize Temporal Data
    GO: "Great article, I enjoyed reading it. Thank you"
    Manoj Pandey: "I like the idea, but it took me some more time to understand the overall logic as I'm new to Geo datatypes, Thanks."
    JS: "For me not using this sort of things regularly, I don't see the problem and the benefit. I have no doubt that this is a brilliant explanations how to cope with a problem, but for me this is missing yet the red line. More pictures
    would be helpful describing the problem and outlining the results produced."
    Richard Mueller: "Needs more explanation, and perhaps an example. There should be links to relevant references."
    Ed Price: "Good job on the opening descriptions! Could benefit from breaking up and explaining the code more. Images and references would be helpful. Good article!"
    Hasham Niaz
    DataCleanUp() Function Implementation in MS SQL Server
    Jinchun Chen: "Good."
    JS: "-Does actually not work for Case senstive areas where I want to remoce certain Upper/lower case characters. This might be not interesting for some people, but is extremely important and relevant to other people. The limitation is
    that I can´t pass multiple values to be removed from the string, right ? Could this be implemented as well as many people wash out their data from unused / unimportant control characters. "I have tested it on a table which has got more than 11 Million
    rows and it executed fine returning the correct results. Since this is a scalar function you will notice decrease in performance." Once you want to maintain the old data and keep the new cleaned up one seperately, you could suggest something like persisting
    the data in a computed column which could be indexed and then help improving the performance. This would not be the case for any adhoc queries though."
    Richard Mueller: "Very clever and also very useful. There should be links to references, for example to explain the PATINDEX function."
    Ed Price: "Great job on this article! Very clear and well executed! See JS's comments for some thoughts about what's possible. Great article!"
    Manoj Pandey: "A good utility Function that I can use and tweak for my future needs, Thanks."
    Jaliya Udagedara
    Calling WCF Service from a Stored Procedure in Microsoft SQL Server 2012
    GO: "Gold Winner. For sure!"
    Ed Price: "Amazing article! The depth, images, and code formatting make this fantastic!"
    NN: "Great article, thorough explanations, great interaction in the comments - very useful tutorial"
    Søren Granfeldt: "Nice work."
    João Sousa
    ASP.NET MVC 5 - Bootstrap 3.0 in 3 Steps
    GO: "Thanks for that great article"
    Ed Price: "Great formatting! Good use of images!"
    NN: "Nice introduction to Bootstrap in ASP.MVC project"
    Søren Granfeldt: "Just a little more technical explanation would be nice"
    Critical_stop
    Using 64-bit shortcuts from a 32-bit application
    NN: "Good and short article, right to the point"
    Søren Granfeldt: "Mixing and matching 32/64 bit always seems to give people a hassle. This will help those having issues."
    GO: "good one!"
    Ed Price: "Good article. Short and sweet."
     Wiki and Portals Technical Guru - May 2014  
    XAML guy
    TechNet Guru Competition: Judge System Explanation
    GO: "No one could do it beter than you Pete! Thanks!"
    Richard Mueller: "Excellent explanation of the judging system. Perhaps could use a See Also section."
    Ed Price: "Good quote from Shanky in the comments, "Awesome....Kudos to your for your beautiful work" -- Great job!"
    NN: "Very good article. It may also benefit from See Also section"
    Payman Biukaghazadeh
    TechNet Wiki Persian Council
    GO: "Go Persion GOOO!"
    Richard Mueller: "The Persian Council is an excellent idea. The link to "How to Write an Article" should be in a See Also section, along with other articles."
    NN: "Great article, missing a link to other portals and councils pages"
    Ed Price: "Thank you to Payman and the Persian community for jumping in! The Wiki is warm!"
    Durval Ramos
    Wiki: Best Practices for building TechNet Wiki Portals
    Ed Price: "Fantastic job from Durval on helping us standardize the portals!"
    NN: "Good article, but unfortunately a bit hard to read and understand due to bad grammar. "
    Richard Mueller: "Excellent and important topic. Grammar still needs work. I like the links and See Also."
     Windows Phone and Windows Store Apps Technical Guru - May 2014  
    Sara Silva
    Authentication using Facebook, Google and Microsoft account in WP8.0 App (MVVM)
    Ed Price: "Great article! Great code formatting and good use of code comments for descriptions of what your code's doing! Could be improved by breaking out the code with more descriptions in the article (in addition to
    the code comments). Very in-depth article! "
    Peter Laker: "An excellent article, pulling together all the bits you need to make this happen"
    SubramanyamRaju.B
    WindowsPhone Facebook Integration:How to post message/image to FaceBook Fan
    Page(C#-XAML)
    Ed Price: "Good topic! Code blocks would help with the formatting. Good job on this article!"
    Peter Laker: "Love this, very useful to many I'm sure, thanks!"
    Saad Mahmood
    Creating a custom control in Expression Blend with Custom Properties (WindowsPhone
    & Store)
    Ed Price: "This has a good mix of descriptions and clarity! The images help a lot!"
    Peter Laker: "A nice introduction to our beloved Blend. Great work!"
     Windows Presentation Foundation (WPF) Technical Guru - May 2014  
    Magnus (MM8)
    WPF/MVVM: Merging Cells In a ListView
    KJ: "Ah the collectionViewSource -- never used it myself but this looks like a good reference article if I ever needed to..."
    GO: "Thank you!"
    Ed Price: "Great formatting and good descriptions. Short and sweet! Another fantastic entry from Magnus!"
    Peter Laker: "Thank you again Magnus"
     Windows Server Technical Guru - May 2014  
    Mr X
    How to implement User
    Activity Recording for AD-Integrated Critical Servers by combining the use of Group Policy, Powershell and Orchestrator
    Philippe Levesque: "Really good information and detailed step."
    JH: "brilliant, love how it combines different technologies to achieve a solution, clearly written and well illustrated."
    JM: "Another excellent article, thanks again for your many great contributions"
    Richard Mueller: "Very creative solution. Great to have such detailed steps and images."
    GO: "I like the conclusion. Thanks"
    Mr X
    How Domain Controllers are located in Windows
    GO: "Super article Mr X! Merci!"
    JM: "Yet again, excellent article."
    Richard Mueller: "Good documentation. An explanation of how the priorities and weights are determined would help. A See Also section would also help."
    Philippe Levesque: "Good "In deep" information. Good to know to help diagnose computer problem in AD's site."
    JH: "another good article, great diagrams. Some repetition but it does help clarify a complex issue. "
    Mahdi Tehrani
    Detailed Concepts:Secure Channel Explained
    JH: "great article. This fills an important gap in this content space. Editing is a little rough, but diagrams and explanations are clear."
    JM: "This is a very good article, however you need to provide more detail in the section on how to fix a broken Channel."
    Richard Mueller: "Excellent topic. Grammar needs work. Good images. Could use a See Also section."
    Philippe Levesque: "Really good explanation of the secure's channel, I like the debugging step included ! "
    GO: "Thanks for this, not everybody know about secure channel."
    As mentioned above, runners up and their judge feedback were removed from this forum post, to fit into the forum's 60,000 character limit.
    A great big thank you to EVERYONE who contributed an article to last month's competition.
    Hopefully we will see you ALL again in this month's listings?
    As mentioned above, runners up and comments were removed from this post, to fit into the forum's 60,000 character limit.
    You will find the complete post, comments and feedback on the
    main post.
    Please join the discussion, add a comment, or suggest future categories.
    If you have not yet contributed an article for this month, and you think you can write a more useful, clever, or better produced wiki article than the winners above,
    here's your chance! :D
    More about the TechNet Guru Awards:
    TechNet Guru Competitions
    #PEJL
    Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over to the one and only
    TechNet Wiki, for future generations to benefit from! You'll never get archived again!
    If you are a member of any user groups, please make sure you list them in the
    Microsoft User Groups Portal. Microsoft are trying to help promote your groups, and collating them here is the first step.

    Congrats to Durval, S Kamath, and Sherry!
     SQL BI and Power BI Technical Guru - May 2014  
    Durval Ramos
    SSIS - Event Handling with "OnError" ou "OnTaskFailed"
    Ed Price: "The images are very helpful! Could use a grammar pass. Great descriptions!"
    GO: "This article has everything. A conclusion, reference, see also, other languages section. everybody should write actually like this."
    NN: "An interesting topic and article but unfortunately a bit hard to understand due to grammar problems"
    PT: "This is a good article on a useful topic. Please have your article reviewed and edited for proper language."
    S Kamath
    Expansion of Time dimension in Analysis Service
    PT: "Your article is concise and to the point, and contains useful information. It would be good to conclude with a short summary and perhaps compare this technique to others, discussing best practices."
    Ed Price: "Good details on Time Dimension. The images help us understand as we go."
    GO: "I like this one, but something is missing. Do not know what, but I had a blast reading the other two's. Does not mean that this one is bad, but there is something missing, maybe my knowledge..."
    NN: "Good article, but seems to be missing conclusion. It will also benefit from adding See Also section"
    Sherry Li
    SSAS – Ignore unrelated dimension or not
    NN: "Good and interesting article based on the blog"
    GO: "Wonderful article!"
    PT: "This is an important topic and contains helpful information but this is a simple topic that can be explained in fewer words. I found this article to be overly detailed and hard to read. I suggest having it reviewed and edited for proper
    language."
    Ed Price: "Good descriptions. Could be shorter. Good use of images!"
    Ed Price, Power BI & SQL Server Customer Program Manager (Blog,
    Small Basic,
    Wiki Ninjas,
    Wiki)
    Answer an interesting question?
    Create a wiki article about it!

  • Error while executing SSIS Package after upgrading the Oracle Client

    Hello,
    I am running to the below error after we upgraded the Oracle client to 11g from 10g. The source of the Data is Oracle database . Looked online but each error is pointing towards different route, Confused here any help is very much appreciated. Have to say
    I am not a pro with SSIS.
    SSIS package "Bentek_ISO_Package (2).dtsx" starting.
    Information: 0x4004300A at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
    Information: 0x4004300A at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
    Warning: 0x80049304 at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available.  To resolve, run this package as an administrator,
    or on the system's console.
    Information: 0x40043006 at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
    Information: 0x40043007 at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
    Error: 0xC0202009 at Temp_tbl Injection Data Flow Task, OLE DB Source [1]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E14.
    An OLE DB record is available.  Source: "OraOLEDB"  Hresult: 0x80040E14  Description: "ORA-12801: error signaled in parallel query server P183, instance *****:qrmgmt2 (2)
    ORA-01861: literal does not match format string".
    An OLE DB record is available.  Source: "OraOLEDB"  Hresult: 0x80004005  Description: "ORA-12801: error signaled in parallel query server P183, instance ****:qrmgmt2 (2)
    ORA-01861: literal does not match format string".
    Error: 0xC004701A at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: component "OLE DB Source" (1) failed the pre-execute phase and returned error code 0xC0202009.
    Information: 0x4004300B at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: "component "OLE DB Destination" (52)" wrote 0 rows.
    Information: 0x40043009 at Temp_tbl Injection Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
    Task failed: Temp_tbl Injection Data Flow Task
    Warning: 0x80019002 at *******: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (2) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches
    the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
    SSIS package "****** (2).dtsx" finished: Failure.

    Do you have any Date conversion functions in your Oracle datetime fields? I did run into a similar issue when we upgraded the oracle client and the provider started to decipher the metadata of the date columns. The SSIS metadata conversion for the date
    columns yielded dates that were not valid. I had to update my queries to use the TO_CHAR conversion to bring it out as a string and then save it to the date field.
    TO_CHAR (DATE, 'MM/DD/YYYY HH24:MI:SS')
    Regards, Dinesh

  • SSIS script component to use defined connection manager to load data from a Oracle

    In SSIS script compoment, I can connect to oracle with hard-coded connectionstring:
    OracleConnection conn;
    conn = new OracleConnection();
    conn.ConnectionString = "Data Source=XE;User ID=hr;Password=******";
    however, when I defined an connection managers in the script compoment and call it as follows:
        IDTSConnectionManager100 connMgr;
        OracleConnection conn;
        public override void AcquireConnections(object Transaction)
            connMgr = this.Connections.MyADONETConnectionManager;
            conn = (OracleConnection)connMgr.AcquireConnection(null);
    I got error below:
    TITLE: Package Validation Error
    Package Validation Error
    ADDITIONAL INFORMATION:
    Error at Data Flow Task source [Script Component C# Oracel HR Oracle [21]]: System.InvalidCastException: Unable to cast COM object of type 'System.__ComObject' to class type 'Oracle.DataAccess.Client.OracleConnection'. Instances of types that represent COM
    components cannot be cast to types that do not represent COM components; however they can be cast to interfaces as long as the underlying COM component supports QueryInterface calls for the IID of the interface.
       at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)
       at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.AcquireConnections(Object transaction)
       at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(IDTSManagedComponentWrapper100 wrapper, Object transaction)
    Error at Data Flow Task source [SSIS.Pipeline]: Script Component C# Oracel HR Oracle failed validation and returned error code 0x80004002.
    Error at Data Flow Task source [SSIS.Pipeline]: One or more component failed validation.
    Error at Data Flow Task source: There were errors during task validation.
     (Microsoft.DataTransformationServices.VsIntegration)
    I did not find any example for Orale. A similar SQL server example is as linked below:
    http://technet.microsoft.com/en-us/library/ms135939(v=sql.110).aspx
    can anybody shed some light? I appreciate it...
    thanks,
    Steve

    You need to create a connectionmanager for Oracle connection and use it within the script task
    See
    http://www.mssqltips.com/sqlservertip/1787/oracle-parameterized-queries-in-sql-integration-services-ssis/
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • SSIS 2005 not running after upgrading (32 bit, Windows XP to 64 bit Windows 7)

    I really need some help. Recently I went from using Visual Studio and SQL 2005 on a laptop (32bit system - Windows XP) to a desktop unit 64bit processor with Windows 7). SSIS on the laptop worked just fine and I could execute and open packages in SSIS; however,
    my new desktop unit will not even allow me to open a new package or run an existing package. As soon as I attempt to create a new SSIS project, I receive the following error: "An error prevented the view from loading. The specified module could not be
    found. (Exception from HResult:0x8007007E)(System Windows Forms).
    SSIS won't allow me to view the control flow or data flow screens and if I attempt to run an existing package created with the SSIS wizard I receive the following error: SSIS package "Package1.dtsx" starting.
    Information: 0x4004300A at Data Flow Task, DTS.Pipeline: Validation phase is beginning.
    Error: 0xC0202009 at Package1, Connection manager "SourceConnectionExcel": SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040154.
    An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".
    Error: 0xC020801C at Data Flow Task, Source - Without_Sample$ [1]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "SourceConnectionExcel" failed with error code
    0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
    Error: 0xC0047017 at Data Flow Task, DTS.Pipeline: component "Source - Without_Sample$" (1) failed validation and returned error code 0xC020801C.
    Error: 0xC004700C at Data Flow Task, DTS.Pipeline: One or more component failed validation.
    Error: 0xC0024107 at Data Flow Task: There were errors during task validation.
    SSIS package "Package1.dtsx" finished: Failure.
    I have tried changing the properties in the package to run in 32-bit mode; however, this does not work. I can run queries and import data in SQL Server Management Studios just fine, as well as run queries and reports in Visual Studios; however, I can't execute
    or create any package in Visual Studio with the new machine. Am I missing a needed system file in the new sysWOW64 folder? The IT person who installed the software isn't familiar with the program and doesn't know how to fix it either. I'm relatively new with
    using SSIS and really need some help on how to get this fixed. Any help you can offer would be greatly appreciated.

    If the Development Studio environment does not even open then it is probably an installation issue. Possibly a DLL did not register properly. Could you take a look at the following forums where a similar issue is being discussed? You can also look for more
    responses by searching for "0x8007007e visual studio on windows 7" in your search engine.
    http://support.microsoft.com/kb/978714
    http://social.msdn.microsoft.com/Forums/sqlserver/en-US/0bcf22d6-adab-4595-b0d8-3a37ce7fbff3/2008-ssis-designer-stops-working-after-installing-vs11-dev-preview?forum=sqlintegrationservices
    http://stackoverflow.com/questions/10460118/the-specified-module-could-not-be-found-exception-from-hresult-0x8007007e
    - Aalamjeet Rangi | (Blog)

  • How to use XQuery Exist() Function on a SSIS XML file

    I have a Package Inventory table that has an XML Column named CurrentPackageXML. This XML column contains the SSIS Package XML. I need to use the XQuery Exist() function to determine if the
    errorRowDisposition="IgnoreFailure" exists.
    Below I have a basic SQL statement, but I have no idea how to write the Correct XQuery Expression. In my example below, I just tried to see if the DTS:Name Property existed, but that XQuery Expression is invalid also. It is not what I need in the end, but
    I was just trying to get anything to work.
    Below my SQL, I have included a snip-it of the SSIS package XML where I can find the errorRowDisposition. It is to the far right, so you may have to scroll to the right to see it. I bolded the text so it is easier to find.
    Finally, once I have got a SQL statement that checks if errorRowDisposition exists = False, I need to check for every occurrence of  errorRowDisposition exists = False.
    Would there be an easier way to do this by converting the XML to a varchar(max) then searching for all instances of  errorRowDisposition exists = False?
    SELECT CurrentPackageXML.exist('/DTS:Executable/DTS:Property[DTS:Name]')
    FROM [dbo].[PackageInventory]
    <inputs>
    <input id="43" name="OLE DB Destination Input" description="" hasSideEffects="true" dangling="false" errorOrTruncationOperation="Insert" errorRowDisposition="FailComponent" truncationRowDisposition="NotUsed">
    <inputColumns>
    <inputColumn id="113" name="" description="" lineageId="110" usageType="readOnly" errorOrTruncationOperation="" errorRowDisposition="NotUsed" truncationRowDisposition="NotUsed" externalMetadataColumnId="95" mappedColumnId="0" />
    <inputColumn id="172" name="" description="" lineageId="167" usageType="readOnly" errorOrTruncationOperation="" errorRowDisposition="NotUsed" truncationRowDisposition="NotUsed" externalMetadataColumnId="94" mappedColumnId="0" />
    </inputColumns>
    <externalMetadataColumns isUsed="True">
    <externalMetadataColumn id="50" name="DateCreated" description="" precision="0" scale="0" length="0" dataType="dbTimeStamp" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="51" name="ProcessedCount" description="" precision="0" scale="0" length="0" dataType="i4" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="52" name="ErrorCount" description="" precision="0" scale="0" length="0" dataType="i4" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="90" name="AcknowledgementID" description="" precision="0" scale="0" length="0" dataType="i4" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="91" name="Date" description="" precision="0" scale="0" length="0" dataType="dbTimeStamp" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="92" name="FileSeqNumber" description="" precision="0" scale="0" length="0" dataType="i4" codePage="0" mappedColumnId="0" />
    <externalMetadataColumn id="93" name="FileType" description="" precision="0" scale="0" length="50" dataType="str" codePage="65001" mappedColumnId="0" />
    <externalMetadataColumn id="94" name="FileName" description="" precision="0" scale="0" length="50" dataType="str" codePage="65001" mappedColumnId="0" />
    <externalMetadataColumn id="95" name="DateReceived" description="" precision="0" scale="0" length="0" dataType="dbTimeStamp" codePage="0" mappedColumnId="0" />
    </externalMetadataColumns>
    </input>
    </inputs>
    Ryan P. Casey • <a href="http://www.R-P-C-Group.com">www.R-P-C-Group.com</a>

    Try this and let know what errors you get.  Note, this is a rough draft of one of a series of queries that I have started writing to document SSIS using SQL XQuery.  I read a file in my version (the one I tested) and get the results.
    -- Get the flat file destinations and their mappings
    with xmlnamespaces ('www.microsoft.com/SqlServer/Dts' as DTS
    ), compflow as (
    SELECT
    task.xml.value('@DTS:ObjectName', 'varchar(200)') as TaskName
    , task.xml.value('@DTS:ExecutableType', 'varchar(200)') as TaskType
    , task.xml.value('@DTS:refId', 'varchar(1000)') as TaskRefId
    --, task.xml.query ('.') as Node
    , component.xml.value ('@name', 'varchar(200)') as ComponentName
    , component.xml.value ('@refId', 'varchar(1000)') as ComponentRefId
    , component.xml.value ('@componentClassID', 'varchar(1000)') AS componentClassID
    --, component.xml.value ('count(inputs/input)', 'int') AS NumberOfInputs
    --, component.xml.value ('count(outputs/output)', 'int') AS NumberOfOutputs
    --, component.xml.value ('count(outputs/output[@isErrorOut="true"])', 'int') AS NumberOfErrorOutputs
    , component.xml.query('.') as ComponentNode
    FROM [dbo].[PackageInventory] pk
    cross apply pk.CurrentPackageXML.nodes('//DTS:Executable[@DTS:ExecutableType="Microsoft.Pipeline"]') as task (xml)
    OUTER APPLY task.xml.nodes('DTS:ObjectData/pipeline/components/component') as component (xml)
    WHERE [PackageInventory_ID] = 13
    , inputNode as (
    SELECT c.*
    , input.xml.value ('@name', 'varchar(200)') as InputName
    , input.xml.value ('@refId', 'varchar(1000)') as InputRefId
    , input.xml.value ('@hasSideEffects', 'varchar(1000)') as InputHasSideEffects
    , input.xml.value ('count(inputColumns/inputColumn)', 'int') AS NumberOfInputColumns
    , input.xml.value ('count(externalMetadataColumns/externalMetadataColumn)', 'int') AS NumberOfExternalMetadataColumns
    , input.xml.value ('@errorOrTruncationOperation', 'varchar(1000)') as InputerrorOrTruncationOperation
    , input.xml.value ('@errorRowDisposition', 'varchar(1000)') as InputerrorRowDisposition
    , col.xml.value ('@errorOrTruncationOperation', 'varchar(1000)') as InputColumnErrorOrTruncationOperation
    , col.xml.value ('@errorRowDisposition', 'varchar(1000)') as InputColumnErrorRowDisposition
    from compFlow c
    OUTER APPLY c.ComponentNode.nodes ('component/inputs/input') as input (xml)
    OUTER APPLY input.xml.nodes ('inputColumns/inputColumn') as col (xml)
    , inputAnal as (
    select
    TaskName
    ,TaskType
    ,TaskRefId
    ,ComponentName
    ,ComponentRefId
    ,componentClassID
    ,InputName
    ,InputRefId
    ,InputHasSideEffects
    , Null as IsError
    ,NumberOfInputColumns
    ,NumberOfExternalMetadataColumns
    ,InputerrorOrTruncationOperation
    ,InputerrorRowDisposition
    ,InputColumnErrorOrTruncationOperation
    ,InputColumnErrorRowDisposition
    , count(*) as NumRec
    from inputNode
    group by TaskName
    ,TaskType
    ,TaskRefId
    ,ComponentName
    ,ComponentRefId
    ,componentClassID
    ,InputName
    ,InputRefId
    ,InputHasSideEffects
    ,NumberOfInputColumns
    ,NumberOfExternalMetadataColumns
    ,InputerrorOrTruncationOperation
    ,InputerrorRowDisposition
    ,InputColumnErrorOrTruncationOperation
    ,InputColumnErrorRowDisposition
    , xoutputNode as (
    SELECT
    TaskName
    ,TaskType
    ,TaskRefId
    ,ComponentName
    ,ComponentRefId
    ,componentClassID
    , xout.xml.value ('@name', 'varchar(200)') as OutputName
    , xout.xml.value ('@refId', 'varchar(1000)') as OutputRefId
    , xout.xml.value ('@hasSideEffects', 'varchar(1000)') as OutputHasSideEffects
    , xout.xml.value ('@isErrorOut', 'varchar(1000)') as OutputIsError
    , xout.xml.value ('count(outputColumns/outputColumn)', 'int') AS NumberOfOutputColumns
    , xout.xml.value ('count(externalMetadataColumns/externalMetadataColumn)', 'int') AS NumberOfExternalMetadataColumns
    , xout.xml.value ('@errorOrTruncationOperation', 'varchar(1000)') as OutputerrorOrTruncationOperation
    , xout.xml.value ('@errorRowDisposition', 'varchar(1000)') as OutputerrorRowDisposition
    , col.xml.value ('@errorOrTruncationOperation', 'varchar(1000)') as OutputColumnErrorOrTruncationOperation
    , col.xml.value ('@errorRowDisposition', 'varchar(1000)') as OutputColumnErrorRowDisposition
    from compFlow c
    OUTER APPLY c.ComponentNode.nodes ('component/outputs/output') as xout (xml)
    OUTER APPLY xout.xml.nodes ('outputColumns/outputColumn') as col (xml)
    , outputAnal as(
    select
    TaskName
    ,TaskType
    ,TaskRefId
    ,ComponentName
    ,ComponentRefId
    ,componentClassID
    ,OutputName
    ,OutputRefId
    ,OutputHasSideEffects
    ,OutputIsError
    ,NumberOfOutputColumns
    ,NumberOfExternalMetadataColumns
    ,OutputerrorOrTruncationOperation
    ,OutputerrorRowDisposition
    ,OutputColumnErrorOrTruncationOperation
    ,OutputColumnErrorRowDisposition
    , count (*) as NumberOfRows
    from xoutputNode
    group by TaskName
    ,TaskType
    ,TaskRefId
    ,ComponentName
    ,ComponentRefId
    ,componentClassID
    ,OutputName
    ,OutputRefId
    ,OutputHasSideEffects
    ,OutputIsError
    ,NumberOfOutputColumns
    ,NumberOfExternalMetadataColumns
    ,OutputerrorOrTruncationOperation
    ,OutputerrorRowDisposition
    ,OutputColumnErrorOrTruncationOperation
    ,OutputColumnErrorRowDisposition
    select 'Input' as RowType, i.* from inputAnal i
    union all
    select 'Output' as RowType, o.* from outputAnal o
    Russel Loski, MCT, MCSE Data Platform/Business Intelligence. Twitter: @sqlmovers; blog: www.sqlmovers.com

  • How to find all uses of data source views in an SSIS solution

    I am upgrading Visual Studio from 2008 to 2013 (with SSDT) and SQL Server 2008 R2 to  2012.  I have a solution with over 30 dstx files. Each file has multiple OLE data sources and lookup tasks.  There is inconsistent usage of data source views
    throughout (as compared to SQL queries or table references).  It is my understanding that all data source views need to be removed before upgrading SSIS packages from BIDS to SSDT.  I tried searching the files as XML for the DSVs but it appears the
    GUID reference changes per dstx file.  It seems like I will have to look at each source/lookup. Is there quicker way to search for where they are used? 
    Thanks
    Adding this question here.  Posted question incorrectly in VSO forum.

    All right, yes, they are dropped
    Never upgraded a package that had them.
    What happens if you just upgrade leaving a copy?
    Arthur My Blog
    This ended up being what I did for many of the packages.  Upgrading the packages severed the data source views and left the SQL in the related tasks (e.g. OLE Source task).  Sorry for the delayed mark as answered.

  • Using several data connections in one SSIS data source?

    I am loading data from several SQL Server 2012 databases into a datamart. Currently, I am simply using sql sources and destinations for that. However, some of the queries require JOINs between the source databases. Therefore I currently refer to the databases
    within the command text of the sql source, e.g.
        SELECT t1.Field, t2.Field
        FROM [server1].[db1].[dbo].[table1] t1
        JOIN [server1].[db2].[dbo].[table1] t2 ON t1.Table1Id = t2.RemoteTable1Id;
    This is flawed, since all the sql commands have to be changed if the database or server names change. It would be far better to refer to connections which can be changed on package level and my question is how to get that done.
    One way I can think of to get that done is to use several sql source queries and join the data with SSIS join operations. For that all current data flows need to be reworked and I am unsure about the performance when joining large databases compared to the
    performance of a single t-sql query.
    The other approach would be some dynamic sql stuff which I want to avoid whenever possible. However, if it was possible to use a parameter to insert server/database into the sql command somehow, then that could be an option.

    Whatever you're doing now is a bad practice inside SSIS. You should be using data flow tasks for this if data come from different sources and use connection managers pointing to each of them. You add these connection properties as config items which will
    enable you to change them from outside package based on your environment
    If performance is your concern you can go for staging approach where you bring deltas(changes) alone on daily basis and then use it in the comparisons with destination tables using MERGE or T-SQL for set based processing. You need to have audit columns in
    your tables for this though.
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • Why do we need SSIS and star schema of Data Warehouse?

    If SSAS in MOLAP mode stores data, what is the application of SSIS and why do we need a Data Warehouse and the ETL process of SSIS?
    I have a SQL Server OLTP database. I am using SSIS to transfer my SQL Server data from OLTP database to a Data Warehouse database that contains fact and dimension tables.
    After that I want to create cubes using SSAS form Data Warehouse data.
    I know that MOLAP stores data. Do I need any Data warehouse with Fact and Dimension tables?
    Is not it better to avoid creating Data warehouse and create cubes directly from OLTP database?

    Another thing to note is data stored in transactional system may not always be in end user consumable format for ex. we may use bit fields/flags to represent some details in OLTP as storage required ius minimum but presenting them as is would not make any
    sense to user as they would not know what each bit value represents. In such cases we apply some transformations and convert data into useful information for users to understand. This is also in the warehouse so that information in warehouse can directly be
    used for reporting. Also in many cases the report will merge data from multiple source systems so merging it on the fly in report would be tedious and would have hit on report server. In comparison bringing them onto common layer (warehouse) and prebuilding
    aggregates would be benefitial for the report performance.
    I think (not sure) we join tables in SSAS queries and calculate aggregations in it.
    I think SSAS stores these values and joined tables and we do not need to evaluates those values again and this behavior is like a Data Warehouse.
    Is not it?
    So if I do not need historical data, Can I avoid creating Data Warehouse?
    On the backend SSAS uses queries only to extract the data
    B/w I was not explaining on SSAS. I was explaining on what happens inside datawarehouse  which is a relational database by itself. SSAS is used to built cube (OLAP structures) on top of datawarehouse. star schema is easier for defining relationships
    and buidling aggregations inside SSAS as its simple and requires minimal lookups to be performed. Also data would be held at lowest granularity level which can easily be aggregated to required levels inside OLAP cubes. Cube processing is very resource
    intensive and using OLTP system would really have a huge impact on processing performance as its nnot denormalized and also doing tranformation etc on the fly adds up to complexity. Precreating a layer (data warehouse) having data in required format would
    make cube processing easier and simpler as it has to just cross join tables and aggregate data based on relationships defined and level needed inside the cube.
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • Set SSIS variable = database connection manager name

    Is it possible to set a SSIS string to only the name of a database connection manager or even the connection string it uses ? I don't see an option for that in Evaluate as expression property of ssis variable.
    This is what I mean - 
    SSIS Connection manager name = SQL_DBASE
    SSIS String str_managerName = SSIS Connection manager name: Can you do this dynamically in SSIS ?

    I'm guessing what they really want to do is evaluate some indicator (some input from a user or an infrastructure setting) and then dynamically connect to any one of 10 (arbitrary example) database servers based on what they get as input.  They
    don't care about the connection manager per se.  What seems reasonable is the that the Connection Manager might take a server variable but if they wanted to do things like that they would have bought Datastage.
    You might try attacking this problem at the Control Level and then connect to the database you want based on a variable you set.   I'm seeing that a Sequence Container can branch on the contents of a variable. 
    Or if the dba is your friend you might get the dba to add all your servers as linked servers to a central connection machine and then you might be able to do this by putting the ssis variable in a "Sql Command from a Variable" variable. 
    It might look something like this:
    Server is designated in ssis var @[User::Machine]
    then executing from a variable
    "select top 100 * from " + @[User::Machine] + ".mydb.dbo.mytable"
    Be careful as hades about levels of indirection and what quotes you want at what level.  Evaluate Expression in ssis helps with this.  The syntax I show works only with an ms sql connection server to a remote ms sql server.  This is what a
    dynamic connection to a linked server connection to Oracle would look like:
    "select * from
    openquery("+ @[User::Machine] + ",'select * from oradb.oratable where rownum < 100')"
    When ever a thousand of your best friends are helping you connect to your database (using tools like linked servers as opposed to direct connections) it's probably best to use with only small specific updates or queries, large queries or large
    updates would probably take a long time and or might not finish.  But try it before you give up.   We are actually doing fairly large Oracle queries (5-10 million rows) through ms sql linked server.

  • How to send three attachments using three queries in a single email using sp_senddbmail

    Hi All,
    I have three scripts for extracting permissions at server,database & object level.Now how do i can execute all three queries and send multiple attachments in a single email using sp_senddbmail.I have done this before for single queries but not multiple
    queries. Kindly suggest.
    Regards
    Rahul

    Hi All,
    The requirement was that i had three different queries for listing permissions at server,database and object level.I wanted to build an solution to email results in attachment to user.
    However i have managed to do this with SSIS Package.I was curious to know if it can be done without SSIS.
    Thanks you all for your time and effort for this.
    Rahul
    It can be done without SSIS
    Just have a procedure to return  three query results as a single resultset. Then use sp_send_dbmail to execute query and send results as a email
    See
    http://blogs.msdn.com/b/sqlagent/archive/2010/11/03/sql-database-mail-send-t-sql-results-by-email.aspx
    Please Mark This As Answer if it solved your issue
    Please Vote This As Helpful if it helps to solve your issue
    Visakh
    My Wiki User Page
    My MSDN Page
    My Personal Blog
    My Facebook Page

  • Search Engines + SSIs

    Do search engines pick up info from SSIs?
    TIA,
    JJ

    .oO(Jay Jay)
    >"Alan" wrote:
    >> server side includes are included into the delivered
    file by the web
    >> server
    >> when the main file is requested.
    >>
    >> their code is IN the delivered file.
    >>
    >> it's transparent to the end user- people or bots
    cannot know that there
    >> ever
    >> was an ssi.
    >
    >Thanks Alan, that clears up a niggling query... always
    wondered if bots
    >looked at the actual html without rendering as a complete
    page... and so
    >ignored the SSis
    Bots do exactly that - they look at the actual HTML without
    rendering
    anything. And the HTML as delivered from the server doesn't
    contain any
    SSI directives anymore. These directives are completely
    handled and
    evaluated _inside_ the server, they never reach the client.
    The same
    happens with other server-side techniques like PHP, JSP etc.:
    The final
    result which is delivered to the clients is always just pure
    and plain
    HTML, nothing more. No SSI directives, no PHP, just HTML.
    If your browser renders a <p>Hello World</p>, you
    can't tell if it's
    just static markup or generated by a script after loading a
    hundred
    files and performing half a dozen database queries.
    Micha

  • SSIS - Import Multiple flat files with different metadata

    Hi ,
    I have set of flat files with different metadata structure, I would like to load them into staging tables. 
    1. ) Can we load the flatfiles into the staging tables with out having multiple data flow task.
    2.) If possible , can we programmatically select the staging table based on the metadata of the flatfile and load them.
    Please advise.
    Thanks
    Thiya

    Nope in SSIS a data flow task needs to have a fixed metadata. So if your file metadata varies then best option would be use OPENROWSET syntax to pull the data and populate into your staging table. You may also use 
    SELECT .. INTO StagingTable ... FROM OPENROWSET (...)
    syntax to create staging table at runtime based on the file metadata
    http://sqlmate.wordpress.com/2012/08/09/use-your-text-csv-files-in-your-queries-via-openrowset/
    If you want to do this in SSIS you need to create data flow dynamically using script task and build the metadata
    see
    http://www.selectsifiso.net/?p=288
    Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

  • Flat files data comma separated using SSIS.

    Hi,
    I have multiple flat files which come in comma separated columns. See example below :
    Customer Data
    CustID,FName,LName,Disease,Email,Phone
    12345,Xyz,Smit,Bronchitis, Asthma and fever,[email protected],80000000
    12346,Abc,Doe,fever Headache,[email protected],90000000
    12347,Klu,joe,Sugar, cough and fever,[email protected],12345678
    Please look at the ID's 12345 and 12347. The disease column has a internal comma space between. How do i remove the comma spaces in the disease column, so that it can be loaded from flat file to sql table using SSIS. ?
    Please help !
    Thanks

    Here is a full solution base on my post above (first option)
    1. create temp table (Give it a unique name):
    create table #T (Txt NVARCHAR(MAX))
    GO
    2. Insert all the data into temporary table. Each line in the text file, is a value for one column in a row in the table.
    -- I will jump to the table and use simple insert.
    -- If you have problem with step 1 then please inform us (this is simple bulk insert basically)
    insert #T (Txt) values
    ('1234435,Xyz,Stemit,Brfsdonchitis, Asthma and fever,[email protected],80000000'),
    ('12346,Agjdfjbc,Doge,fevhhhher Headsxdshhache,[email protected],90000000'),
    ('123447,Klu,joe,Sugar, cough and fever,[email protected],12345678')
    GO
    the result should be like this:
    Txt
    1234435,Xyz,Stemit,Brfsdonchitis, Asthma and fever,[email protected],80000000
    12346,Agjdfjbc,Doge,fevhhhher Headsxdshhache,[email protected],90000000
    123447,Klu,joe,Sugar, cough and fever,[email protected],12345678
    I use a SPLIT Function named Split_CLR_Fn. This is a CLR Split function that get input <string to split> and <string as delimiter,> and it return table with 2 columns ID, SplitData
    For example if you use: SELECT * from Split_CLR_Fn('text1,text2,text3,',') then you get result:
    ID SplitData
    1 Text1
    2 Text2
    3 Text3
    ** You can find in the internet several good functions, I HIGHLY RECOMMENDED NOT TO USE T-SQL FUNCTIONS but CLR FUNCTION. Check thi link to understand why:
    http://sqlperformance.com/2012/07/t-sql-queries/split-strings
    ** This is the best function that I know about and I use it, but I change the code a bit to return 2 columns and not just the SplitData as in this blog: http://sqlblog.com/blogs/adam_machanic/archive/2009/04/28/sqlclr-string-splitting-part-2-even-faster-even-more-scalable.aspx
    That's it :-) we are ready for the solution which is very simple
    Solution 1 (BAD solution but easy to write):
    select
    (select SplitData from Split_CLR_Fn(Txt,',') where ID = 1) CustID,
    (select SplitData from Split_CLR_Fn(Txt,',') where ID = 2) FName,
    (select SplitData from Split_CLR_Fn(Txt,',') where ID = 3) LName,
    STUFF((select ',' + SplitData from Split_CLR_Fn(Txt,',') where ID > 3 and ID < (select MAX(ID) from Split_CLR_Fn(Txt,',')) - 1 for XML path('')), 1 , 1,'') Disease,
    (select SplitData from Split_CLR_Fn(Txt,',') where ID = (select MAX(ID) from Split_CLR_Fn(Txt,',')) - 1) Email,
    (select SplitData from Split_CLR_Fn(Txt,',') where ID = (select MAX(ID) from Split_CLR_Fn(Txt,','))) Phone
    from #T
    GO
    Solution 2: better in this case since the format is constant (this is the solution I wrote about above)
    ;With MyCTE as (
    select
    Txt,
    SUBSTRING(Txt, 1, CHARINDEX(',', Txt, 1) - 1) as CustID
    , SUBSTRING(
    Txt
    ,CHARINDEX(',', Txt, 1) + 1 -- I start from the end of preview len
    , CHARINDEX(',', Txt, CHARINDEX(',', Txt, 1)+1)- CHARINDEX(',', Txt, 1) - 1
    ) as FName
    , SUBSTRING(
    Txt
    ,CHARINDEX(',', Txt, CHARINDEX(',', Txt, 1)+1)+1 -- I start from the end of preview len
    , CHARINDEX(',', Txt, CHARINDEX(',', Txt, CHARINDEX(',', Txt, 1)+1)+1) - CHARINDEX(',', Txt, CHARINDEX(',', Txt, 1)+1) - 1
    ) as LName
    , RIGHT(Txt, CHARINDEX(',', REVERSE(Txt), 1) - 1) as Phone
    , RIGHT(LEFT(Txt, Len(Txt) - Len(RIGHT(Txt, CHARINDEX(',', REVERSE(Txt), 1) - 1)) - 1), CHARINDEX(',', REVERSE(LEFT(Txt, Len(Txt) - Len(RIGHT(Txt, CHARINDEX(',', REVERSE(Txt), 1) - 1)) - 1)), 1) - 1) as Email
    from #T
    select CustID,FName,LName, Phone, Email, SUBSTRING(Txt, Len(CustID) + Len(FName) + Len(LName) + 4, Len(Txt) - Len(Email) - LEN(Phone) - Len(CustID) - Len(FName) - Len(LName) - 5) as Disease
    from MyCTE
    I hope that this is useful :-)
      Ronen Ariely
     [Personal Site]    [Blog]    [Facebook]

  • How Do I See When Package Last Ran in SSIS?

    I've searched for possible solutions, however none had worked for me (mostly queries for SQL Server). My problem is this:
    I have a MAIN package that runs about 100 little packages in 1 main process.  A lot of times on the first load the packages are disabled are kept enabled.  I found some missing data that a package had inserted into SQL Server.  It
    could be a few different packages that did this.
    What I need is to see the time and date when the packages I have pinpointed as problematic have ran.  They could be enabled or disabled.  
    Is there a simple way to look somewhere in SSIS to see the last date and time these packages have ran so I can compare to the recorded creation date in one of my tables?
    Thanks.

    Hi ,
    you can try below;
    SELECT TOP 1 j.name as JobName, jh.message, jh.run_status,
    LastRunDateTime = CONVERT(DATETIME, CONVERT(CHAR(8), run_date, 112) + ' ' + STUFF(STUFF(RIGHT('000000' + CONVERT(VARCHAR(8), run_time), 6), 5, 0, ':'), 3, 0, ':'), 121)
    FROM msdb..sysjobs j INNER JOIN msdb..sysjobhistory jh ON j.job_id = jh.job_id
    WHERE CONVERT(DATETIME, CONVERT(CHAR(8), run_date, 112) + ' ' + STUFF(STUFF(RIGHT('000000' + CONVERT(VARCHAR(8), run_time), 6), 5, 0, ':'), 3, 0, ':'), 121) > DATEADD(HOUR, -24, GETDATE())
    AND jh.step_id = 0 AND j.name = 'myPacakge'
    ORDER BY LastRunDateTime desc
    --run status 0 when job failed
    --run status 1 when job succeeded
    http://stackoverflow.com/questions/23504359/ssis-package-last-run-date-in-a-variable
    Thanks
    Please Mark This As Answer or vote for Helpful Post if this helps you to solve your question/problem. http://techequation.com

Maybe you are looking for

  • Best Way to Use iPhoto for Lectures?

    The old utility "iphotowebshare" turns itself off frequently under Mavericks, so I'm forced to look for a better way to do what once worked perfectly. Here's my situation: I've got a few hundred images in an iPhoto library that I have been using for

  • Queries - FI Document FI/Fiscal Data

    Hi, I've created an infoset (SQ02) which connects the table BSEG to BSET with two additional fields: ZHWBAS with the following code: SELECT FROM HWBAS BSET INTO ZHWBAS   WHERE BUKRS = BSEG-BUKRS     AND BELNR = BSEG-BELNR     AND GJAHR = BSEG-GJAHR.

  • NW2004s Preview ABAP - How to get print preview?

    Hi, does anybody had success in getting a print preview of a WD e. g. ALV-List? A Weblog of this feature would be pretty cool ... Greets Olaf

  • JTable Numeric cell editor

    Does anybody can post very simple cell renderer or cell editor class. I need i my table for example in the second column in all rows possible to enter only digits (0...9) for example 125689 but 4578f78 is not valid. Pointer should stay at editable ce

  • Mu ipod touch passcode buttons doesnt work

    I was playing on a game (Red Ball) and i pressed the home button twice, this made the game close, i locked the ipod touch and i went to type in my passcode, when i pressed on a number it wouldnt show, only a thin black square formed around the number