Data Deduplication and File Backup

Hello all,
This is my first question here in the forum. I just migrated one of our server from Server 2008 R2 to Server 2012 Standard R2. I use Freefilesync to backup a couple of network storages that was attached to the server 2008 and now it is attached to the Server
2012. I would like to know if I apply data deduplication on the network storage that are now attached to the Server 2012 would that affect the files on my backups? How would that work? Thanks

Thank you again. One last question: So, the storage savings I will have with dedupe won't be carried out to my backups? Thanks?
Space would be preserved it's just your data MSFT would "unpack" in the middle of the migration process. So sequence of actions looks like this:
1) Data generation tools puts bunch of files on dedupe-enabled volume.
2) MSFT scrubber process kicks in and "packs" data from 1) to now smaller amount of used blocks.
3) Copy process takes data from 2) and "unpacks" it in memory and copies it to destination volume, UNPACKED.
4) MSFT scrubber process kicks in on a destination volume to do basically the same it did in 2) for source volume.
So smart implementations like one done by HP and their StoreOnce would skip steps 3) and 4) as copy process would move indexes and hash<->data pairs. MSFT cannot do this (at least for now).
For reference:
HP StoreOnce Global Deduplication
http://h18006.www1.hp.com/storage/pdfs/hpstoreonce.pdf
Global Data Dedupe HOWTO
http://searchdatabackup.techtarget.com/definition/global-data-deduplication
Hope this helped :)
P.S. I'm NOT working for HP or whatever :)
StarWind VSAN [Virtual SAN] clusters Hyper-V without SAS, Fibre Channel, SMB 3.0 or iSCSI, uses Ethernet to mirror internally mounted SATA disks between hosts.

Similar Messages

  • How can I make extra storage on my phone when I have deleted any all data, pictures and files that I couldn't store in a dropbox and not have purchase additional storage?

    how can I make extra storage on my phone when I have deleted any all data, pictures and files that I couldn't store in a dropbox and not have purchase additional storage?

    Purchasing additional storage only applies to iCloud, not to the phone itself. You cannot purchase additional storage for the phone, only purchase a larger capacity phone. If you have deleted all of the content that you can, then that is all of the space that you have. What is it exactly that you are trying to do? Does this have to do with space for performing an OTA update of the iOS?

  • Using Data Guard and hot backups - 9.2.0.6.0

    Hi all,
    I have an existing 9.2.0.6.0 database that is setup in a DataGuard environment - one primary database with a physical standby in a separate datacenter. It is all setup and it works beautifully. On our primary database, we currently have 2 different types of backups we are doing - we do an export of the main schema (all of the application data is all in this one schema) 4 times a day, and we do a full database hot backup once a night.
    My question is in regards to the hot backup - I don't know that it is even worth doing a hot backup of this database? I am trying to think of a situation where we would actually want to restore a hot backup of the primary database... If we ran into some kind of a data issue, it would probably be quickest and easiest to restore data from one of the exports, and when we did that restore (import), I assume that data change would be replicated through DataGuard to the standby site. But if there was some kind of situation where we wanted to restore a recent hot backup of the primary database, that would essentially break the Data Guard configuration, and I assume that after the hot backup was restored, we would have to somehow re-instantiate Data Guard on the standby site.
    Does anyone have any input on this? If you are running with DataGuard, is it even worth it to be doing hot backups? What kind of situation would call for restoring a hot backup, instead of just failing over to the standby?
    Thanks!
    --Brad                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

    If we ran into some kind of a data issue, it would probably be quickest and easiest to restore data from one of the exportsIt would be quickest to failover to stand by database than restroing from dump file. After all you maintaing stand by db for that reason.
    How can you restore database up to the latest changes using export/import ? You may have to restore using rman and apply the logs.
    You can backup from stand by database. You do not need to back up primary.

  • File Adapter : read XML file with data validation and file rejection ?

    Hello,
    In order to read a XML file with the file adapter, I have defined a XSD that I have imported to my project.
    Now the File Adapter reads the file correctly but it does not give an error when:
    - the data types are not valid. Ex: dateTime is expected in a node and a string is provided
    - the XML file has invalid attributes.
    How can I manage error handling for XML files ?
    Should I write my own Java XPath function to validate the file after is processed ? (here is an example for doing this : http://www.experts-exchange.com/Web/Web_Languages/XML/Q_21058568.html)
    Thanks.

    one option is to specify validateXML on the partnerlink (that describes the file adapter endpoint) such as shown here
    <partnerLinkBinding name="StarLoanService">
    <property name="wsdlLocation"> http://<hostname>:9700/orabpel/default/StarLoan/StarLoan?wsdl</property>
    <property name="validateXML">true</property>
    </partnerLinkBinding>
    hth clemens

  • Loading attribute data via data source and file

    Hi gurus,
    My issue is that when I load excel file(2-column: matnr and werks) and load to master data via IP and DTP. After successful upload all available attriubute values which are retrieved from 0material_attr are gone away. Maybe deleted somehow.
    This is my issue.
    Can you help me which is the method loading some columns via sap extractor and one lıne via excel upload?
    Thanks.
    Eddy.

    Hello Eddy,
    I believe, the reason of getting your old data removing might be you are using the Full Upload via the Excel. In that recent excel you are not haviing the old records .
    Check the files and as suggested by raman ,if you have any changes in your master data then better to make delta relevant data source.
    Hope this helps !
    Regards
    YN

  • Data Deduplication, Defrag & DPM 2012 R2 Churn

    We have a protected 2012 R2 server that has Data Deduplication enabled. DPM tried to create a recovery point and ran out of disk space. When I check to see what happened, the job had transferred over 43GB of data.  This is way outside of the norm
    for this protection group.  Upon investigation I found that a scheduled weekly defrag had run.  I assume this to be the source of the churn.  Can anyone provide an guidance on the interaction of the these processes?  The scheduled defrag
    was enabled by default.  I assume we'll need to disable this?  I have never defragged my VM's as it would cause massive churn for the VM backup's in DPM.  But this was not a VM backup, just a backup of files on a deduplicated volume.
    Thanks,
    Scott

    Thanks for the reply.  It's pretty simple really.  I have a 2012 R2 file server with data deduplication enabled on one of the volumes.  There was a scheduled defrag that ran on the volume and appears to have caused massive churn for the
    DPM recovery point.  Question is if this is unique to data deduplication and DPM?  The same problem occurs when you defrag a VM that's being backed up by DPM.  That's why we don't defrag our VHDs.  Normal file servers without data deduplication
    do not exhibit this behavior.  The scheduled defrag was set by default and I'm assuming needs to be disabled.  I'm just looking for guidance on why this is an issue. 

  • DB identifier mismatch with data volujme and log volume

    Hi,
             I would like to perform backup and restore test on linux (maxdb database )  ECC 6.0 system.
    I have taken the backup of (i.e  data , incremental and log backups ) on one system.
    Then created a new system with same host name, SID and instance number.
    Then i Performed to restore the database on the new system in the ADMIN mode.
    First i done the data then incremental backup. These are successful on the new system.
    But when i performed the log backup  it gives the following error as :
    Db identifier mismatches with data volume and log volume.
    Database then goes to offline state.
    How to perform the successful log backup ?
    Thanks
    Srikanth

    Hi,
    As you are performing restore on the new machine  you have to restore with recovery with initialization option.
    for this you have to first  create template on the new machine using DBMGUI or DBMCLI for  complete_bkp/incremental_bkp and log_bkp's.
    It will first restore complete backup after that incremental backup and after that all the available log backups will be applied.After that you will be able to make in online mode.
    You can perform this either using dbmgui or dbmcli.
    http://help.sap.com/saphelp_nw04/helpdata/en/d1/b386654dc211d4aa1100a0c9430730/frameset.htm
    Regards,
    Sahil

  • Not enough space on my new SSD drive to import my data from time machine backup, how can I import my latest backup minus some big files?

    I just got a new 256GB SSD drive for my mac, I want to import my data from time machine backup, but its larger than 256GB since it used to be on my old optical drive. How can I import my latest backup keeping out some big files on the external drive?

    Hello Salemr,
    When you restore from a Time Machine back up, you can tell it to not transfer folders like Desktop, Documents. Downloads, Movies, Music, Pictures and Public. Take a look at the article below for the steps to restore from your back up.  
    Move your data to a new Mac
    http://support.apple.com/en-us/ht5872
    Regards,
    -Norm G. 

  • I backup my iphone on my pc and copy backup file into drive D then i setup new OS on my pc. after that i copy the backup file into itunes backup folder but itunes can't find the backup file to restore my iphone. how can i restore my iphone?

    i backup my iphone on my pc and copy backup file into drive D then i setup new OS on my pc. after that i copy the backup file into itunes backup folder but itunes can't find the backup file to restore my iphone. how can i restore my iphone?

    Don't you just love changes in interfaces?
    I found the answer to my question.
    When you attach a device (iPhone, iPad) to your Mac, in iTunes 12 in appears as a tiny icon in the second "row" of the iTunes display. Click the icon and the familiar iTunes display for the device appears. From there, on the Summary screen, you can see the dates of the backups of the device (iCloud and backup to the computer). You can also use the button to backup to the computer.

  • By backing up the iTunes Library via saving the iTunes folder on an external drive, is it also backing up all iPad and iPhone backups as well as App Data and Documents from your devices?

    If I backup my iTunes Library by saving the iTunes folder on an external hard drive using the instructions contained in the link below, will it also back up all my iPad and iPhone backups as well as App Data and Documents from my devices? In other words, will it also create backups for the backups? Thank you.
    Back up your iTunes library by copying it to an external drive
    Furthermore, when it is time to restore the iTunes folder I copied to my external drive to a new iTunes program on my new computer, how will it merge the information once I plug in my iPad or iPhone to that new laptop to sync? If I did the iTunes library backup a couple months ago and I've added documents/music/pictures on my devices since then, what will happen when I try to sync it with the new laptop now working off of the iTunes library backup from a couple months ago since the information is no longer the same? Which information will dominate and thus be kept? Will it delete the new information/data/pictures/documents/music off of the devices since it is not on the iTunes program when it syncs?
    Sorry for so many questions, but they are all related to backing up and restoring iTunes. I am not very tech savvy if you cannot tell

    It would be a good idea to look into a bigger hard drive. They are not that expensive any more and can save a lot of headach. This is even more important if you are buying music from the iTunes music store. If you lost those files they are gone.
    The point of having it on your PC and iPod is to have a backup. If the iPod fails, or you need to go back to the DVDs and find they are scratched, or just can not be read you have lost days of work converting and organizing all of those songs.
    Or the iPod could hard drive could fail and then you will have to try to bring all of those files back from DVDs. You end up with a mess since some songs will probably be on multiple DVDs, have different names ect. Trying to reorganize it all can be a pain.

  • Formatted HD, but have backup of all the folders and files of Firefox. How can I restore everything, including plugins, bookmarks and saved settings?

    I have formatted my computer's HD because of a problem with Windows 7, the thing is that Windows 7 didn't start, so I couldn't backup my Firefox settings, bookmarks, plugins, themes, personas and etc. the right way.
    I also don't have a Firefox Sync account.
    What I do have are all the folders and files of Firefox, because I just created a new partition and installed Windows 7 again, what I'm having trouble is finding a way (if there's any) to restore everything from my previous installation to the new one.
    I have searched for days on both Google and on te Firefox forum with no success, the only questions I found are about restoring a profile, but what I'm trying to do is the same thing that the Firefox add-on " FEBE " does, which is restoring everything to the previous configuration.
    Here's alink to the add-on: https://addons.mozilla.org/pt-br/firefox/addon/febe/
    I have tried copying, pasting and overwritting from the " .default " folder to my new installation of Firefox (yes, Firefox was closed), but when I opened it again, nothing was restored.
    I every single folder and file Firefox ever created on my computer, this includes the installation folder (at Program Files), the profile (.default at AppData) folder, the Mozilla folder (ProgramData) and the Mozilla Firefox folder (also at AppData).
    I also had the FEBE add-on installed, but like stated before, unfortunately I couldn't start Windows 7, forcing me to create a new partition to install a new copy of the OS.
    Thanks in advance.
    PS. Sorry if I made the text too long and/or if I mentioned the same things twice, just trying to be thorough.

    Hi Sdarts,
    I apologize for the delay in replying to your question, and I am sorry to hear that you are having issues restoring your Firefox user data.
    Please see the following article, which explains how to restore your Firefox user data using a previously backed up Profiles folder, which seems to apply to your situation:
    * [https://support.mozilla.org/en-US/kb/back-and-restore-information-firefox-profiles Backup and Restore information from Firefox Profiles]
    Please let us know if this solves your problem or if you have any questions.
    Thanks!!
    - Ralph

  • How can I force Time Machine to make a complete backup of my Hard Drive.  I just installed a new external drive for Backup since my previous one failed.  Now when I back up, Time Machine only backs up my data folder and the Users folder.

    How can I force Time Machine to make a complete backup of my Hard Drive.  I just installed a new external drive for Backup since my previous one failed.  Now when I back up, Time Machine only backs up my data folder and the Users folder.
    When I start a backup. Time Machine says "Oldest Backup: None; Latest Backup: None", so it seems like it should do a complete backup, but it only does a partial. 

    Hi I'd like to jump in here. Your app showed me this:
    Time Machine:
              Skip System Files: NO
              Mobile backups: OFF
              Auto backup: YES
              Volumes being backed up:
                        Macintosh HD: Disk size: 749.3 GB Disk used: 453.81 GB
              Destinations:
                        Plastic Wrapper [Local] (Last used)
                        Total size: 999.86 GB
                        Total number of backups: 64
                        Oldest backup: 2013-07-24 23:25:11 +0000
                        Last backup: 2013-11-17 01:40:47 +0000
                        Size of backup disk: Too small
                                  Backup size 999.86 GB < (Disk used 453.81 GB X 3)
              Time Machine details may not be accurate.
              All volumes being backed up may not be listed.
              /sbin excluded from backup!
              /usr excluded from backup!
              /System excluded from backup!
              /bin excluded from backup!
              /private excluded from backup!
              /Library excluded from backup!
              /Applications excluded from backup!
    Aside from the size of my backup drive, which I will increase at some point, I'd really like to have time machine backing up all system folders, especially Applications. How to I reset this hidden exclusions?
    Thanks,
    Darcy

  • Check the modification date of a file and compare it to the current date

    Hey everyone,
    I'm writing a script that compares the modification date of a file to the current date, and performs actions based on whether the file was modified 7 days ago or not. I haven't been able to figure out exactly how to do this.
    I haven't been able to find much in the way of this online, and I am not that familiar with manipulating dates and whatnot. I was able to get a bit of it, posted below:
    currentDate=`date +%b-%d`
    fileDate=`ls -l ~/.backup.txt | awk '{ print $6, $7 }'`
    echo "$fileDate"
    echo "$currentDate"
    if [ "$fileDate" <= "$currentDate" ]; then
    echo "old enough to run script"
    else
    echo "not old enough yet"
    fi
    Of course, this doesn't work. Any help would be much appreciated. This is for Leopard.
    TIA,
    Andrew

    find ~/.backup.txt -mtime +7 -exec yourscript {} ;
    You may need to play with the +7 value to get the exact number of days old the file needs to be.
    The find command will accept a directory (actually it is frequently used with directories) and will find all files in that directory and any subdirectories below that match the find selection critiera.
    So you could do something like
    find ~ -mtime +7 | xargs yourscript
    or
    find ~ -mtime +7 -name "*.txt" | xargs yourscript
    and if your script does not accept multiple filenames on the command line, you can use
    find ~ -mtime +7 | xargs -n 1 yourscript
    and if your file names have spaces in them, you can use
    find ~ -mtime +7 -print0 | xargs -0 -n 1 yourscript

  • Making data in tables online and offline - Backup and Recovery

    Hi All,
    I'm working on a project where the functionality is similar to 'Backup and Recovery' for database tables.
    Lets say we have a set of 6 tables T1, T2.... T6. They do have relationship between them. The tables in questions are simple standard tables, which are not table partitioned.
    - I want remove the records from live tables based on user entered date ranges and store it in some offline medium.
    - I might want make the data online again from the offline medium; Application should be able use that data without any modifications.
    - Different offline mediums can be
    a) Flat file
    b) Different table space
    c) Any other secondary medium (like XML, tape..Etc,)
    The total number of records will run in millions.
    The proposed solution should consider,
    1. Performance - Java solutions not feasible. Anything in SQL, PL/SQL or runs in DB itself(tools) are OK.
    2. Reliability - Should be highly reliable, Data corruption simply unacceptable.
    3. Security - Users should not be able to make out of the file.
    Few options include:
    1. Use partition
    2. Use SQL*Loader
    3. Export and import of tables.
    My main targets:
    1. Reduce space.
    2. Increase performance for queries.
    Please pass on your suggestions, any help is highly appreciated!
    Thanks In Advance!

    Few points to note:
    1. I agree partition would be right solution, but as I mentioned in my earlier statement, 'The tables in questions are simple standard tables, which are not table partitioned.'. The tables right now are not partitioned and I believe we cannot add/modify partitions, if the table were not created with the partition option. One work around is to build a partitioned table and copying all the properties(indexes,rows,constraints) from the existing non-partitioned table. But I suspect this is highly riskier and we can't afford to it.
    2. I need to support Oracle database versions starting from 8.0.6.
    3. Flat file is mandatory, others are optional. I can restrict our discussion just for a file.
    4. Considering the above points, the only option I could think of is I can move the records from the table to flat file and remove from tables. When required rollback the file data to the table and application would be able to use it. For export/import few options are: SQL*loader, exp/imp utilities, PL/SQL file UTL packages
    Thanks In Advance

  • Making data in tables online and offline - Backup/Recovery for tables.

    Hi All,
    I'm working on a project where the functionality is similar to 'Backup and Recovery' for database tables.
    Lets say we have a set of 6 tables T1, T2.... T6. They do have relationship between them. The tables in questions are simple standard tables, which are not table partitioned.
    - I want remove the records from live tables based on user entered date ranges and store it in some offline medium.
    - I might want make the data online again from the offline medium; Application should be able use that data without any modifications.
    - Different offline mediums can be
    a) Flat file
    b) Different table space
    c) Any other secondary medium (like XML, tape..Etc,)
    The total number of records will run in millions.
    The proposed solution should consider,
    1. Performance - Java solutions not feasible. Anything in SQL, PL/SQL or runs in DB itself(tools) are OK.
    2. Reliability - Should be highly reliable, Data corruption simply unacceptable.
    3. Security - Users should not be able to make out of the file.
    Few options include:
    1. Use partition
    2. Use SQL*Loader
    3. Export and import of tables.
    My main targets:
    1. Reduce space.
    2. Increase performance for queries.
    Please pass on your suggestions, any help is highly appreciated!
    Thanks In Advance!

    If you truely need to get the data out of the Oracle database into flat files, partitioning is pretty useless. Partitioning the table, though, strikes me as by far the most efficient, reliable, and secure solution.
    What sort of security do you need with the flat file? Do you need the data in the file to be encrypted, or is the binary file format of an Oracle export file sufficiently obfuscated?
    I'd stay away from UTL_FILE here, just because performance is rather poor.
    I always get pretty nervous about recoverability when people start moving data out of the database to flat files for long-term archival.
    - If you ever change the data model, even slightly, you may not be able to move the data back into the database without modifying your loader. A few years down the line, after a few data model changes, it can be almost impossible to find the documentation to make that change.
    - If you do things like change lookup tables over time, reloading data can cause major problems. When you load the data back in, your applications and reports may not treat the old codes properly.
    - Making sure that the flat files get stored and tagged properly can be a challenge. When the database gets moved to new system, you have to make sure that all the flat files also get moved around and the the loader scripts are modified appropriately.
    Justin
    Distributed Database Consulting, Inc.
    http://www.ddbcinc.com/askDDBC

Maybe you are looking for

  • Help need in Table control

    Hi guys,        I am new to dialog programming , I have the following requirement in table control.    I have to be displayed 4 fields in Table control 1. Mara-MATNR (Match code) 2.Mara-BISMT 3. Mara-MATKL 4. Makt-MAKTX         Based on Material numb

  • Number of (field)

    In the following I would like to have the number of PCMS_CHDOC_DATA.CH_DOC_ID found by the select, I tried to use the COUNT function but it gives 1 as a result: SELECT PCMS_CHDOC_DATA.CH_DOC_ID, PCMS_CHDOC_DATA.CH_UID, PCMS_CHDOC_DATA.CH_DOC_TYPE, PC

  • Getting error when trying to download deployed software package

    Hello all,  I have been struggling with this for almost two weeks and am about to give up.  The error I'm getting is when a client tries to download a deployed software package.  The software shows up in IE browser (servername\cmapplicationcatalog),

  • Motion paths not wholly visible

    I'm trying to simply move a solid with a motion path. I copy/pasted a mask path into the Position property of the solid layer. Initially everything looks right after I paste the path -- however if I move the position keyframes apart (to make the moti

  • Configuring Business Package

    Hi , I am in the process of configuring business package.I want to enable the employee bank details information iview.I have install the business packages. I have created till the JCO Connections they are working perfectly and i am struck at creation