SSIS package causes Step 0, and removes the rest of steps

Hi Guys,
I have a Maintenance Plan to make backups of our databases locally. I then need to move the databases to our NAS (too much network traffic to have it write there directly). I have 7 steps after the creation to do various weekly/monthly checks to see if the
files need to be copied to different retention folders.
However, the 2nd step ran (copy the local files to the network via a For Each Loop in a SSIS package), stopped with no error or log, and deleted all steps after the first.
I recreated the steps, ran just the first to make sure it worked, and everything was ok. I started from step 2, and the same thing happened, no log.
This time I was around to watch it, and it got stuck on Executing: 0 (unknown)  for the step. I checked out the files and things look ok.
The issue seems to be that that either a large file (100GB) is gumming it up, or if the the file already exists at the destination (the first time the issue happened, the file did not already exist). 
Right now it is going through and copying all the files and folders just fine, but now I am extremely nervous about the procedure and not sure how to prevent the steps from disappearing again.
I was initially going to use command line commands to do the work, but SSIS seemed like the better solution.
Any thoughts on this?
-- justin

How a ForEach loop can DELETE steps?
Moving 100 Gb files is best done with RoboCopy IMO.
But such limits (to store backups) do not make sense for being so small.
Arthur My Blog

Similar Messages

  • Extend the EPM install to a new EOI and remove the old EOI's (server decommissioning). EPM version 11.1.2.1 and having essbase and planning; I understand removing EOI's is not as simple as 11.1.2.3 but any suggestion/steps would be of great help.

    Extend the EPM install to a new EOI and remove the old EOI's (server decommissioning). EPM version 11.1.2.1 and having essbase and planning; I understand removing EOI's is not as simple as 11.1.2.3 but any suggestion/steps would be of great help....

    Next time try to create a topic that is not the question.
    There was no option to remove epm instances in 11.1.2.1, basically the cloest you get is uninstalling the products on the server and hope that some of the info is removed from the epm registry
    Cheers
    John

  • Read two CSV files and remove the duplicate values within them.

    Hi,
    I want to read two CSV files(which contains more than 100 rows and 100 columns) and remove the duplicate values within that two files and merge all the unique values and display it as a single file.
    Can anyone help me out.
    Thanks in advance.

    kirthi wrote:
    Can you help me....Yeah, I've just finished... Here's a skeleton of my solution.
    The first thing I think you should do is write a line-parser which splits your input data up into fields, and test it.
    Then fill out the below parse method, and test it with that debugPrint method.
    Then go to work on the print method.
    I can help a bit along the way, but if you want to do this then you have to do it yourself. I'm not going to do it for you.
    Cheers. Keith.
    package forums.kirthi;
    import java.util.*;
    import java.io.PrintStream;
    import java.io.BufferedReader;
    import java.io.FileReader;
    import java.io.IOException;
    import krc.utilz.io.ParseException;
    import krc.utilz.io.Filez.LineParser;
    import krc.utilz.io.Filez.CsvLineParser;
    public class DistinctColumnValuesFromCsvFiles
      public static void main(String[] args) {
        if (args.length==0) args = new String[] {"input1.csv", "input2.csv"};
        try {
          // data is a Map of ColumnNames to Sets-Of-Values
          Map<String,Set<String>> data = new HashMap<String,Set<String>>();
          // add the contents of each file to the data
          for ( String filename : args ) {
            data.putAll(parse(filename));
          // print the data to output.csv
          print(data);
        } catch (Exception e) {
          e.printStackTrace();
      private static Map<String,Set<String>> parse(String filename) throws IOException, ParseException {
        BufferedReader reader = null;
        try {
          reader = new BufferedReader(new FileReader(filename));
          CsvLineParser.squeeze = true; // field.trim().replaceAll("\\s+"," ")
          LineParser<String[]> parser = new CsvLineParser();
          int lineNumber = 1;
          // 1. read the column names (first line of file) into a List
          // 2. read the column values (subsequent lines of file) into a List of Set's of String's
          // 3. build a Map of columnName --> columnValues and return it
        } finally {
          if(reader!=null)reader.close();
      private static void debugPrint(Map<String,Set<String>> data) {
        for ( Map.Entry<String,Set<String>> entry : data.entrySet() ) {
          System.out.println("DEBUG: "+entry.getKey()+" "+Arrays.toString(entry.getValue().toArray(new String[0])));
      private static void print(Map<String,Set<String>> data) {
        // 1. get the column names from the table.
        // 2. create a List of List's of String's called matrix; logically [COL][ROW]
        // 3. print the column names and add the List<String> for this col to the matrix
        // 4. print the matrix by inerating columns and then rows
    }

  • Rewrite  process and remove the call to f-54 and replace with bapi proces

    Hi Gurus,
    Please help me to find the soultion.
    The root cause of this continual problem is the design and use of BDC session for F-54.  Is there a redesign possible with ECC6.0?
    I wanted to rewrite the process and remove the call to f-54 and replace with bapi process.
    if this is now possible in ECC 6.0
    The benefit would be to better control what PO was used in the DP recoupment.
    Thanking you,
    Raju Singhireddy.

    Hi Balaji,
    Check this BAPI
    BAPI_QUOTATION_CREATEFROMDATA
    BAPI_QUOTATION_CREATEFROMDATA2
    BAPI_CUSTOMERQUOTATION_CHANGE
    Regards
    Arun

  • I subscribed two weeks back and on the iTunes site Step 1 gathering data is still going on. Why is it taking so long?

    I subscribed two weeks back and on the iTunes site Step 1 gathering data is still going on. Why is it taking so long?

    I was also having this problem after having successfully used iTunes Match previously. The problem appears to be when there are two version of songs and one of them has the iCloud icon made using a dotted line. Here's what solved it for me:
    1. Identify your duplicate files. I have a large library, so I elected to use Dupin Light (available on the Mac App store). I suppose I could have used iTunes duplicate finder too, but I prefer the flexibility of Dupin.
    2. Once you have identified your duplicates, find them in iTunes. In my case Dupin identifed 50, from 19,000+ tracks, so for me it was not a large number to check manually.
    3. When you find the duplicates, if one of them has the aforementioned dotted line iCloud icon, this is the one you need to delete. If you accidently delete the other version, you can always download it again if you have purchased it from iTunes. In any case, it seems to be the tracks with this icon that it is causing iTunes Match to stall, so you will need to delete all of these.
    4. Once you have completed step 3, iTunes Match should not proceed and complete.

  • My new iPhone 4S has hearing problem.speaker and headphone works very good.However using handset to make and receive calls I cannot hear anything?I did restore the phone and removed the plastic.Is there any solution to this problem please?

    I am having heraing problem with iPhone 4S.Speaker and headphone works well.No echo.When I use handset to receive or make calls,I can't hear anything?I restore the phone and removed the plastic as well.Is there anyway to fix this problem?

    I personally haven't experienced much of the "reverberation/feedback" when using a headset on the i4S...
    Yes, I have near-perfect hearing too (for scope, squeaky brakes hurt my ears) I come from many conversations on many phones and types and first off, CDMA technology is great for coverage, terrible for voice quality. HD Voice in Europe made for some of the best phone conversations I've ever had.
    Back on track, feedback is most noticable (similar to the landline phone) when using the iPhone without a headset, but for me it's not an absolute criticality mainly because I use VoIP apps alot, so maybe it has desensitized me some over the past year.
    But whenever I'm on a call, and the other person has me on speakerphone, I have alot of trouble talking because of the feedback loop caused. So the less of my voice I hear the better I can talk.
    Have you tried a bluetooth headset yet?

  • Creative - C'mon Already - Step up and fix the FIRMWARE

    Just on this page alone I have responded to 5 seperate threads about firmware update problems! Cmon Creative, step up and do the right thing!! If you won't remove the buggy software from your website, at the very least put a warning up there that there is potential to destroy your mp3 player!
    I know this is me beating a dead horse, but if we bring enough light to this situation, maybe we will have a better chance to get it resolved (you know, squeaky wheel gets the grease! )
    How about if you have tried upgrading your firmware and have had some sort of issue that is out of the norm, please respond to this thread...

    Well I for one think it's a valid and frustrating point, and Apple are not noted for their rapid response to feedback so it makes perfect sense to poll the users for their input.
    Are you really suggesting a library of 25,000 songs should not just be backed up, but also the individual playlists? Presumably that would require a complete iTunes duplicate.
    Apple, once the pinnacle of ergonomic usability, has sadly started down the road of dictatorial arrogance. (I have had a mac since 1988).
    I'm peeved because iTunes 8 won't play sound with my muxed music vids. I don't know if they were muxed before or if they got muxed in the upgrade, all I know is they worked then they didn't and there's no solution or explanation readily available from Apple. I got a mac because I'm not technically minded to tinker, I need a tool that just works.
    Rant rant rant gibber gibber. Sorry. Feel a little better now thanks. On with the quest to demux. Or something. Anyone?

  • My iPad is disabled and won't connect to iTunes on any computer; I went to my iCloud and removed the iPad so it will erase all data when the iPad is connected to the internet (the original problem was a restrictions passcode we forgot)

    Here is the order of what I did to my iPad:
    1.  A restrictions passcode was put on and we couldn't remember it.  Despite numerous attempts at righting this, I couldn't. The iPad would not sync with any iTunes on any computer, Mac or PC.
    2.  I put a, 'use passcode after one minute' passcode on it and deliberately put in 10 wrong passcodes so it would disable the iPad.  Now it still will not connect to any iTunes.
    3.  I connected to my iCloud account and removed the iPad from the cloud; it says it will erase all iPad data when it connects to the internet.  I am fine with that, I need to know what to do now, though. iPad says, 'Connect to iTunes,' but it won't.  Please help this amateur of all amateurs!!

    See iPhone DFU mode explained, and how to enter DFU mode.

  • [svn] 3120: When you point Flex Builder at a local sandbox trunk build, it couldn' t generate the html-templates folder correctly for new projects so we moved all the html templates up one level and removed the html-templates directory and adjusted build

    Revision: 3120
    Author: [email protected]
    Date: 2008-09-05 10:44:10 -0700 (Fri, 05 Sep 2008)
    Log Message:
    When you point Flex Builder at a local sandbox trunk build, it couldn't generate the html-templates folder correctly for new projects so we moved all the html templates up one level and removed the html-templates directory and adjusted build.xml's to accommodate the directory change
    Modified Paths:
    flex/sdk/trunk/build.xml
    flex/sdk/trunk/webapps/webtier/build.xml
    Added Paths:
    flex/sdk/trunk/templates/client-side-detection/
    flex/sdk/trunk/templates/client-side-detection/AC_OETags.js
    flex/sdk/trunk/templates/client-side-detection/index.template.html
    flex/sdk/trunk/templates/client-side-detection-with-history/
    flex/sdk/trunk/templates/client-side-detection-with-history/AC_OETags.js
    flex/sdk/trunk/templates/client-side-detection-with-history/history/
    flex/sdk/trunk/templates/client-side-detection-with-history/history/history.css
    flex/sdk/trunk/templates/client-side-detection-with-history/history/history.js
    flex/sdk/trunk/templates/client-side-detection-with-history/history/historyFrame.html
    flex/sdk/trunk/templates/client-side-detection-with-history/index.template.html
    flex/sdk/trunk/templates/express-installation/
    flex/sdk/trunk/templates/express-installation/AC_OETags.js
    flex/sdk/trunk/templates/express-installation/index.template.html
    flex/sdk/trunk/templates/express-installation/playerProductInstall.swf
    flex/sdk/trunk/templates/express-installation-with-history/
    flex/sdk/trunk/templates/express-installation-with-history/AC_OETags.js
    flex/sdk/trunk/templates/express-installation-with-history/history/
    flex/sdk/trunk/templates/express-installation-with-history/history/history.css
    flex/sdk/trunk/templates/express-installation-with-history/history/history.js
    flex/sdk/trunk/templates/express-installation-with-history/history/historyFrame.html
    flex/sdk/trunk/templates/express-installation-with-history/index.template.html
    flex/sdk/trunk/templates/express-installation-with-history/playerProductInstall.swf
    flex/sdk/trunk/templates/metadata/
    flex/sdk/trunk/templates/metadata/AC_OETags.js
    flex/sdk/trunk/templates/metadata/readme.txt
    flex/sdk/trunk/templates/no-player-detection/
    flex/sdk/trunk/templates/no-player-detection/AC_OETags.js
    flex/sdk/trunk/templates/no-player-detection/index.template.html
    flex/sdk/trunk/templates/no-player-detection-with-history/
    flex/sdk/trunk/templates/no-player-detection-with-history/AC_OETags.js
    flex/sdk/trunk/templates/no-player-detection-with-history/history/
    flex/sdk/trunk/templates/no-player-detection-with-history/history/history.css
    flex/sdk/trunk/templates/no-player-detection-with-history/history/history.js
    flex/sdk/trunk/templates/no-player-detection-with-history/history/historyFrame.html
    flex/sdk/trunk/templates/no-player-detection-with-history/index.template.html
    Removed Paths:
    flex/sdk/trunk/templates/html-templates/

    Remember that Arch Arm is a different distribution, but we try to bend the rules and provide limited support for them.  This may or may not be unique to Arch Arm, so you might try asking on their forums as well.

  • How do I find bad music files?  I have thousands of files, but some are bad.  When I try to load them into iTunes, it just spins.  I need a routine to identify and remove the bad files.  Any ideas?

    How do I find bad music files?  I have thousands of files, but some are bad.  When I try to load them into iTunes, it just spins.  I need a routine to identify and remove the bad files.  Any ideas?

    Hi ajoddo20,
    Welcome to the Apple Support Communities!
    You can use Home Sharing to import music and other media from one computer to another. Please use the instructions and information located in the attached article for information on how to complete the process. 
    iTunes 11 for Mac: Use Home Sharing to import items from another iTunes library
    Cheers,
    Joe 

  • My hard drive crashed on my Imac 24" 2009, i put in a new hard drive 2TB and a SSD drive 240 GB and removed the opticdrive. What external DVD can I get to work with the IMac? The Apple super drive is not compatible.

    My hard drive crashed on my Imac 24" 2009,  I installed a new hard drive 2TB and a SSD drive 240 GB and removed the optical drive.
    What external DVD can I get to work with the IMac?                              The Apple super drive is not compatible.

    Virtually any DVD burner that can connect to your Mac will work. They start at $40 on Amazon.

  • I reseted my ipone and removed the number how can i get it back

    i reseted my ipone and removed the number how can i get it back

    Two solutions come to mind:
    Use your phone to call someone, and have that person use Caller ID to tell you your phone number.
    Contact your cellular carrier.  Here's how: Contact a mobile carrier

  • I am running Windows 7 Professional.  When I try to install Flashplayer, I get to step 3, and then the installation will not proceed any further.  A blank dialog box appears, with Adobe Flash Player Installer in the upper left corner.  I have tried to ins

    I am running Windows 7 Professional.  When I try to install Flashplayer, I get to step 3, and then the installaion will not proceed any further.  A blank dialog box appears, with Adobe Flash Player Installer in the upper left corner.  I have tried to install on Explorer, Firefox, and Chrome.  Nothing works. Please help.
    Thanks/ Scott

    1. Restart your computer to stop any Adobe process that is running.
    2. Click on the following Adobe  link. Go to the bottom where it says "Still having problems?". Click on the version of Flash Player for your browser.
    Installation problems | Flash Player | Windows

  • How can I select and remove the football net behind the goalkeeper with Photoshop CS5?

    Hello,
    Could you please help me with the following case. I have a photo of a football game and I would like to select and remove the football (soccer) net behind the goalkeeper. Do you know what is the procedure for selecting and removing of the net so as to "clear" the goal showing only the goalkeeper in the frame of the goal?
    Thank you in advance,
    Petar
    Product: Photoshop CS5

    Hi Petar,
    You're in luck. Photoshop CS5 was the first version to come with Content Aware Fill. You can use this to seamlessly erase objects, like your net. Try taking a look at this video, which should help you do just that:

  • Move a file to external disk and remove the original

    This is a script that was supplied to me on these forums it has been working well, but all the transferring of the files took place locally so a 'Move' command does it eactly what it says, however I now need to move it to an external drive, as a result it leaves trace of the original file.
    How can I make it MOVE and remove the origial File please?
    set fileMatrix to {¬
              {folderName:"BHS", prefixes:{"BH70", "SM70", "AL70", "BH11"}}, ¬
              {folderName:"Bu", prefixes:{"BU40", "BU11"}}, ¬
              {folderName:"Ca", prefixes:{"CW"}}, ¬
              {folderName:"Da", prefixes:{"ES20", "AM20"}}, ¬
              {folderName:"Di", prefixes:{"DV25", "DV11"}}, ¬
              {folderName:"Do", prefixes:{"DJ30", "RA30", "DJ11"}}, ¬
              {folderName:"In", prefixes:{"GT55", "CC55"}}, ¬
              {folderName:"Fr", prefixes:{"FR10", "FR11", "FR17"}}, ¬
              {folderName:"No", prefixes:{"TM17", "NN_"}}, ¬
              {folderName:"Ma", prefixes:{"MA65", "MF65", "FI65", "MC65", "MH65", "MB65"}}, ¬
              {folderName:"Pr", prefixes:{"PR_"}}, ¬
              {folderName:"To", prefixes:{"TM15", "TM11"}}, ¬
              {folderName:"Wa", prefixes:{"WA35", "WA11"}}, ¬
              {folderName:"Se", prefixes:{"SE_"}}, ¬
              {folderName:"Mik", prefixes:{""}}}
    tell application "Finder"
      --set theHotFolder to ((path to pictures folder) as text) & "HotFolderDone"
              set theHotFolder to folder "StudioA:Users:StudioA:Pictures:HotFolderDone"
      --set foldericon to ((path to pictures folder) as text) & "Icons:Rejected Folder Done"
              set foldericon to folder "StudioA:Users:StudioA:Pictures:Icons:Rejected Folder Done"
      --set fakeTrash to ((path to home folder) as text) & "FakeTrash"
              set fakeTrash to folder "StudioA:Users:StudioA:FakeTrash"
    set a to alias "Scratches:Workings"
              repeat with matrixItem in fileMatrix -- look for folder
    set destinationFolder to (folders of a whose name starts with folderName of matrixItem)
                        if destinationFolder is not {} then -- found one
                                  set destinationFolder to first item of destinationFolder -- only one destination
                                  set theFolderName to name of destinationFolder
                                  repeat with aPrefix in prefixes of matrixItem -- look for files
                                            repeat with startFile in ((files of theHotFolder whose name starts with aPrefix) as alias list) -- move files
                                                      try
      move startFile to destinationFolder
                                                      on error
      activate
                                                                display dialog "File “" & (name of startFile) & "” already exists in folder “" & theFolderName & "”. Do you want to replace it?" buttons {"Don't replace", "Replace"} default button 2 with icon 1
                                                                if (button returned of the result) is "Replace" then
                                                                          set {fileName, t_ext} to {name, name extension} of startFile
                                                                          if exists file fileName of fakeTrash then -- and it also exists in the fakeTrash Folder.
                                                                                    set name of file fileName of destinationFolder to "this is a unique name" -- or whatever
                                                                                    set newName to my getUniqueName(fileName, t_ext, fakeTrash)
                                                                                    set movedFile to move file "this is a unique name" of destinationFolder to fakeTrash
                                                                                    set name of movedFile to newName
                                                                          else -- not exists in the fakeTrash Folder.
      move file fileName of destinationFolder to fakeTrash
                                                                          end if
      move startFile to destinationFolder
                                                                else -- "Don't replace"
                                                                          if not (exists folder "StudioA:Users:StudioA:Desktop:Rejected Folder Done") then
                                                                                    set theLastFolder to duplicate foldericon to desktop
                                                                          else
                                                                                    set theLastFolder to folder "StudioA:Users:StudioA:Desktop:Rejected Folder Done"
                                                                          end if
                                                                          delay 0.5
      move startFile to theLastFolder with replacing
                                                                end if
                                                      end try
                                            end repeat
                                  end repeat
                        end if
              end repeat
              try
                        if (count theLastFolder) is 0 then delete theLastFolder
              end try
    end tell
    to getUniqueName(theName, theExtension, someFolder)
         check if someFile exists in someFolder, creating a new unique file name (if needed) by adding a suffix
              parameters -          theName, theExtension : a file name and his name extension
                                  someFolder : a folder (finder item or alias)
              returns :     a unique name
              set {counter, suffixes, divider} to {0, "abcdefghijklmnopqrstuvwxyz", "_"}
              if theExtension is not "" then set theExtension to "." & theExtension
              set theName to text 1 thru -((length of theExtension) + 1) of theName -- just the name part
              set newName to theName & theExtension
              tell application "Finder" to set theseNames to name of items of someFolder
              repeat while theseNames contains newName
                        set counter to counter + 1 -- hopefully there aren't more than 26 duplicates (numbers are easier)
                        set newName to theName & divider & (item counter of suffixes) & theExtension
              end repeat
              return newName
    end getUniqueName

    I do not have the time to read through your whole script and give specific answers, but the general principle is fairly easy.  You're moving with the Finder, so your move command is going to be of the form:
    tell application "Finder"
      move file xxxx to folder yyyy
    end tell
    For cross file system moves (which are as you point out actually duplications) just add a line after each move that sends the old file to the trash:
    tell application "Finder"
      move file xxxx to folder yyyy
      delete file xxxx
    end tell
    the Finder has an empty trash command that you can use at the end of the script if you like.
    One gotcha: because move has two different behaviors, the second code block will throw an error if you try to use if for a local move (it will move the file properly, then try to delete the file it moved, which is obviously no longer there).  For clarity, I'd use duplicate rather than move for if you're working across file systems.  That's what you're actually doing, and if you use the move command you may confuse yourself when you come back to look at the script a year down the road.

Maybe you are looking for

  • Audio Jack Isn't Outputing Any Sound.. What's a fix?

    how can i fix this... when i go to setting, i can flip the connection and make it an input rather than an output. it will pick up my iPhone through an aux cable, while playing music.. but it won't out put any sound when in output mode... i've hade th

  • Text Dataload from Flatfile

    I have an info Object,I am getting 01 key and Name Description in that Text table, I have another key 1 description Name2 I want load the text using flatfile,is it possible  to load the text data to that info Object,my IO is char(2), Ex: 01 Name 1  N

  • Applications not opening after Yosemite

    I downloaded Yosemite about a week and a half ago and I've had nothing but trouble. My adobe applications like Indesign and Dreamweaver will not open, but in the rare instance that they do, they crash about 20 min into working in them. Mail and iTune

  • Importing not working

    I have a Sony Handycam HDD and I can't get FCP to recognize the camera.... Any ideas??

  • Can Adobe Reader be installed from file

    Hi, Looking to install "Adobe Reader 9 / Windows XP SP2 - SP3" Problem - my fixed pc is on a slow connection, my dial-up ISP disconnects after 2 hours, nothing I can do about it. (Unfortunately being distant from the phone exchange broadband is n/a).