Server 2012 R2 - Dedup chunk store bigger than original data

Hi there,
I have a fresh install of a Windows Server 2012 R2 as fileserver with deduplication enabled on several volumes. One volume shows a strange behavior after a couple of weeks in productive environment: Initially I had a dedup saving rate of ~10% (volume contains
mainly images), but after a few weeks, both UI and PowerShell report savings of 0 bytes.
What is really bad about this is, that the original size of the un-deduplicated files is about 880 GB and my volume has filled up to nearly 1 TB (no, data has not increased that much over time, only a few gig). Watching the volume using TreeSize (JamSoft)
I found out, that the dedup folder has grown to 990 GB!
I tried to run optimization and garbage collection with no luck. The main folder is DFS replicated and (still) doing initial sync - this may change files, but dedup is configured to dedup files after 0 days.
Any ideas?
Regards,
Marc

Hi Marc,
From the screenshot it seems that almost all files are put into Dedup folder.
Deduplication supports DFSR so I cannot confirm if it is the cause. However as the initial replication is still running and dedup schedule is set as 0 days, I think we can first eliminate one of them to see if issue could be fixed.
A. So please test to disable Deduplication until initial replication is done - disable Deduplication could help you get rid of the current situation and if the issue is DFSR related, after initial replication is finished, files will not be edited so frequently
which should help on this issue.
Note: In order to speed up the initial replication, you can copy files to target server as a pre-staging so that data will not need to be replicated through DFSR. And if files will not be change during replication, you can use the new function of Windows
2012 R2 that to copy metadata to target server.  See:
DFS Replication Initial Sync in Windows Server 2012 R2: Attack of the Clones
http://blogs.technet.com/b/filecab/archive/2013/08/21/dfs-replication-initial-sync-in-windows-server-2012-r2-attack-of-the-clones.aspx
B. You can also set Deduplication schedule back to 5 Days (the default setting) - You may need to redo an optimization to un-dedup all files (similar to disable dedup) first to get rid of current situation. As the schedule is set to 5 days, files will not
be dedup immediately which should also help on this issue. 
If you have any feedback on our support, please send to [email protected]

Similar Messages

  • Can time capsule store more than the data on my computer?

    Can time capsule store more than the data on my computer?
    I have a lack of data storage space on my macbook hence I would like to know if Time Capsule is an external hard drive and not just a back up device.

    It is a backup device.. in fact it is a backup device for wireless clients in particular hence it is a wireless router with a hard disk inside.. if you use it for storage.. it has one or two big weaknesses..
    It is slow.. cf a real NAS with raid.. a single slow green drive is plenty for backups.. less than adequate for storage.. fine over wireless of course.. lousy if you are trying to pass big files.. like your iphoto library back and forth.
    But the biggie.. IMHO.. no backup.. the TC has no way to back itself up.. and TM cannot include the content of the TC in a backup to another location.. TM cannot backup any network drive.
    So your files will be stored on one bottom of the market, cheapest possible drive available.. with no backup.. !!
    Time Machine and data files may also not so happily co-exist.. the TC cannot be partitioned (well not internally).
    You can create data images... but is this a good idea??
    Read a bit of pondini.
    http://pondini.org/TM/Time_Capsule.html
    Q3

  • Why are 'saved as' .psd files so much bigger than original raw nef files?

    I was under the impression that original raw files were the biggest possible. I appear to be very wrong. Why are 'saved as' .psd files so much bigger than original raw nef files?
    I'm beginning to think that saving them as psd is a bad idea.
    Yes, though I've heard all the arguments of keepng the original raw files (For ex. Did you throw away the negatives when you were using film) I se eno purpose in keeping them. Once I've made the initial adjustments--cropping, color correction etc. I don't feel a need to ever go back and never do. Most of my work is done in Photoshop and I like it that way--but suddenly finding myself with such huge files doesn't appeal to me at all--and other formats like tif...well never mind for now.

    Good point made c.pfaffenbichler however, my thinking is this--there is time spent on the raw file and then there is much more time spent on (usually a psd) the file once in Photoshop. For me to then go back to the orignal raw file, after having worked on it on PS would mean getting rid of all the work (larger amount of work, time wise and artistic wise) done on PS which seems pointless. Although the psd file does show your layers and stuff it only shows the end results of that layer. It does not show from where to where you pointed your brush, from what point to what point you changed the color or part of an image etc. etc.Anyhow I understand why most people keep their raw files, but this is the main reason why I do not. It would mean hours of work on an image you already worked on (and usually were satisfied with) to perhaps make some minor alteration. Also please note that though I was noce a pro photog, no I do it mostly for fun. Getting the exact red in my Coca Cola can has never been of importance. On the other hand, if there were a way of working on a raw file within Photoshop and keep it (save it as) a raw file equivalent, then I would absolutely do so.

  • Server 2012 R2 ISO download is larger than DVD, how do I install on a new physical server?

    I have downloaded Server 2012 R2 (not the trial version) and the size of the ISO is 5.2Gb.  I get 'disc image file is too large' error when trying to create image on DVD.  How do I install 2012 R2 on a new physical server? 

    Does your server have an out-of-band management console?  Those can generally mount virtual media that is simply a file residing on the machine you are using to connect to the console.
    Another option is to use USB -
    https://technet.microsoft.com/en-us/library/dn293258.aspx
    . : | : . : | : . tim

  • SharePoint 2013 - SQL Server 2012 PPIV - using a PPIV workbook as a data source - getting PPIV web service error

    I created a PowerPivot (SQL Server 2012 SP1) workbook and uploaded it to SharePoint 2010 Portal and started using it as a data source in an excel file. This worked fine and we saw no issues with it until we moved to SharePoint 2013 environment.
    I uploaded the same PowerPivot workbook (source workbook) to SharePoint 2013 Portal and now trying to use it as a data source. I tried to change connection properties so that I could use the new portal address for the workbook. When
    I try to save my changes, I see that OLAP queries are getting fired "Refreshing OLAP cube" shows up in the status bar, but eventually after running these OLAP queries (I would say after a minute), I get the following error -
    Couldn't find anything specific in SharePoint logs or maybe I wasn't looking for the right thing.
    Has anyone seen this issue? Why would PPIV service throw an error after running for a while? Is it a timeout issue of some kind? How can we take care of this?
    Thanks,
    Sonal

    ULS log showed the following exception: The maximum number of allowed sessions per user has been exceeded.
    Under Excel Services global settings, max limit is set. Default is 25, increasing it resolved this issue.
    Thanks,
    Sonal

  • SQL Server 2012 PDW - Controling the physical location of a data partition

    In PDW for distributed tables, is it possible to know/control which partition will reside in which storage node? Assuming I have 4 compute nodes, and I have data with partitions A, B, C and D (all tables will have only 4 partitions), can I design in a manner
    that partition A definitely goes to Compute node 1, partition B to Compute node 2, C to 3 and D to 4?
    Please share your thoughts with me.

    The idea of a MPP-based DW appliance is to hide the complexity from the user. Crucial is the choice of the column for the hash key. Everything else should be taken care by the query engine/optimizer. Can you please provide a little bit more context why
    you want to 'go into the business' of managing single partitions etc.? Thanks

  • How to solve the plot if shown twice than original data

    Dear sir,
    I am kunvar yadav, i am using Labview software.
    Here i going to plot multi plot in single plot. but the problem is it that i am applying the data of 18 days, but in output result shows data of 36 days.
    Here i have attache original file data file and programme.
    Attachments:
    TEst.txt ‏40 KB
    TEST new.vi ‏346 KB

    Use a graph instead of a chart (or run the program only once). Whenever you run the program using a chart, the same data is appended to the chart history, duplicating the data.
    (This is a plain LabVIEW question. Why did you post it in the Mathscript forum?)
    Many things could probably be done simpler....
    LabVIEW Champion . Do more with less code and in less time .

  • Link to download Sql Server 2012 "Standard Edition"

    We have purchased Sql Server 2012 “Standard” edition license. Looking for the link to download of installation software for 2012 “Standard” edition. Have tried
    a lot but could only found - the “enterprise” evaluation copy.
    Looking for urgent help on this. Thanks.

    Thanks for the update.
    1. Would like to check if it is possible to download Sql Server 2012 “Standard" Edition straight away rather than doing a two step install?
    2. Assuming we do a two step install - during upgrade once we specify the license key, would it ask whether we need to change edition to standard/ enterprise or it automatically determines the edition based on the value of the license key?
    Hi,
    1.Do you have MSDN subscription ? You can download from MS link directly if you have one. Please ask the vendor who provided you with License he would be best person to call.
    2. On license page you just have to enter license key that's it , after that SQL Server just knows what it has to do. It does not asks you anything about license it just proceeds
    Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
    My Technet Wiki Article
    MVP

  • Server 2012 Upgrade direction Advice

    Hi All, My Scenario:
    Around 80 users
    I have a server 2008 VM which has around 1tb of file shares on it and 500gb of exchange, and seems to be increasing at a pretty decent rate (company expanding etc.) the host sits on needs to be replaced (out of warranty and resources are running out), and
    disks are getting full etc. fileshare access speeds are slow at times, especially if there is any kind of load on the server.
    I am looking at my options for future expansion, what I want to achieve is
    Faster network share access – currently access speeds are a problem
    Put exchange onto a separate server / VM
    Scalable file share location – at the moment I keep needing to extend disks etc.
    I have about 30 VM’s in total doing various different things over about 4 Hosts, which are also part of this environment and I would like them to benefit from whatever solution I put in.
    We are 90% virtual, some ESXi free and some HyperV 2012. I intend on moving in the direction of Hyper-V from here on for the most part as the standby replication feature and shared nothing migration are too good to pass up on
    I am trying to figure out whether I just buy another host server with more disk space, and put a couple of VM’s on it doing file shares and exchange (which is what I did last time and ended up here)
    Or do I go down the path of an ISCSI SAN and some high availability etc.
    Or do I look as some kind of SMB 3 SOFS solution (still a little unsure on how all this would work)
    I’m also considering putting in some kind of  archive solution to get some of the older files off the file shares and onto a cheaper NAS storage to reduce the backup size etc.
    I plan to build new VM's on Server 2012 (R2) and decommission the old ones once data is migrated over. Exchange version is currently 2007, will probably move that to 2010 (as that's what we are licensed for) depending if I can set up a 2010 SCR equivalent
    at our DR site with EX2010 and server 2012 (you needed enterprise server to use Ex2010 HA features but server 2012 I assume can do this in the standard version) 
    I’m keen for anyone’s recommendations and ideas on which path to go down, peoples successes fails etc, is it worth stepping up to a cluster / SAN / High availability type setup?
    Cheers

    Your questions are pretty broad for a technical forum designed to help people with specific technical issues.  It sounds like you need to hire a consultant to come in and evaluate your needs and environment and make a recommendation.
    SOFS is really meant to be used for Hyper-V and SQL, not for general file share usage.  See
    http://technet.microsoft.com/en-us/library/hh831349.aspx for more information.  For VMs and SQL, it works great - easier to configure than iSCSI.  The issue is that you won't find
    SOFS from many SAN vendors.  Most implementations are in the form of building a Windows Server cluster with some sort of shared storage like SAS or PCI RAID.  There is a lot of information on TechNet on it that you can read to your heart's content.
    .:|:.:|:. tim

  • Windows 8.1/Server 2012 R2 Exams - EFFECTIVE DATE ADJUSTED!

    Hi, everyone.
    Microsoft has adjusted the effective starting date of when the Windows 8.0 exams and Windows Server 2012 exams will be updated to Windows 8.1 and Windows Server 2012 R2 at Prometric.
    The new effective date is January 28, 2014.
    This means that current study materials for many of these exams remain current. You have a little extra time to pass these exams before they are updated.
    Which exams specifically? Other questions? Learn more or ask questions at the following blog entry:
    http://borntolearn.mslearn.net/btl/b/weblog/archive/2014/01/09/mcsa-windows-8-and-mcsa-windows-server-2012-exams-to-be-updated-january-28-2014.aspx
    Good luck!
    Best wishes, Davin Mickelson

    Hi, Ken.
    Unfortunately, this exam will be updated on January 28th, 2012 to Windows Server 2012 R2 and Windows 8.1.
    It's too bad that Microsoft did not update the 70-417 exam description to tell you that. I know they
    did update the exam descriptions for the other core exams, like 70-410.
    70-410
    http://www.microsoft.com/learning/en-us/exam-70-410.aspx
    70-417 UPGRADE
    http://www.microsoft.com/learning/en-us/exam-70-417.aspx
    You have three painful choices:
    Just take it anyway. Know that only some of the exam questions were updated. You can also learn what they are testing you for on the exam. You may even get lucky and still pass. You do have four (4) days to cram.
    Reschedule the exam while paying that $35 reschedule fee.
    Cancel the exam.
    New study books will be released this spring. Here is the list from O'Reilly:
    http://search.oreilly.com/?q=%22Server+2012+R2%22+exam&x=9&y=15
    Sorry that Microsoft didn't update the exam's description.  That's why I had the post turned into a sticky.
    Good luck with your decision and with your exams.
    Best wishes, Davin Mickelson

  • Unexpected Server Reboot on Windows Server 2012 Standard

    Hi All,
    I have received unexpected reboot on Windows Server 2012 Standard . After searching on the internet I found one
    hotfix for this, but it is applicable for Windows 2008 R2. Link to download Windows 2008 R2
    hotfix -
    http://support.microsoft.com/kb/2732595/en-US
    Can someone guide me to get a same
    hotfix for Windows Server 2012 Standard.
    Log Name:      System
    Source:        User32
    Date:          2/27/2014 7:27:17 AM
    Event ID:      1074
    Task Category: None
    Level:         Information
    Keywords:      Classic
    User:          SYSTEM
    Computer:      Server1.test.com
    Description:
    The process wininit.exe has initiated the restart of computer "Server1" on behalf of
    user  for the following reason: No title for this reason could be found
     Reason Code: 0x50006
     Shutdown Type: restart
     Comment: The system process 'C:\Windows\system32\lsass.exe' terminated unexpectedly with status code 255.  The system will now shut down and restart.
    Thank you.
    Regards,
    Mahesh Arban.

    Hi Mahesh Arban,
    Sorry for my delay.
    I can’t find the same hotfix for Windows Server 2012 Standard. So, we may need to do some troubleshootings
    to narrow down this issue and solve it.
    Please let me confirm if you have installed all updates for this Windows Server 2012 Standard. Meanwhile, please
    use Sfc command to scans and verifies the integrity of all protected system files.
    In addition, this issue caused to unexpected server reboot. So, please configure and then collect the dump
    file to analysis. It may help us to find the root cause of this issue.
    How to read the small memory dump file that is created by Windows if a crash occurs
    http://support.microsoft.com/kb/315263/en-us
    By the way, can you find any error messages in application log (such as Event ID 1000 or others) after this
    issue occurred?
    Hope this helps.
    Best regards,
    Justin Gu

  • Windows Server 2012 Essential Role

    I am running Win2k12 R2, and have available the essential role. Can someone explain what feature would I gain from having this role?

    fyi, there is a forum specifically for Essentials:
    http://social.technet.microsoft.com/Forums/windowsserver/en-US/home?forum=winserveressentials
    And here is a brief explanation of the features gained with Essentials:
    http://blogs.technet.com/b/sbs/archive/2012/07/17/windows-server-2012-essentials-feature-list.aspx
    For small networks data protection (pc backup to the Essentials Server) and Anywhere Access are probably the two standouts.  The SKU for Essentials only is limited to 25 users and 50 devices to be backed up.  The Essential Role expands this to
    "about" 100 users or devices, although there are seemingly no hard limits.
    Here is a third party listing of the "cool" things about the Essentials role in a server domain.
    http://www.techrepublic.com/blog/10-things/10-cool-new-features-in-windows-server-2012-r2-essentials/
    A little research will turn up lots of articles to help you form your policies in your network.
    Larry Struckmeyer[MVP] If your question is answered please mark the response as the answer so that others can benefit.

  • Windows Server 2012 AD topology

    The Windows Server 2012 AD domain controller is in a secure data center only reachable by VPN.  
    Call it Alpha.   After credentials are setup the first time on work station enrolled in the domain, users outside the secure data center are required to use cached credentials to enter the secure data center via a VPN connection
    (Juniper Pulse).   Workstations and users never fully authenticated again which creates many problems.
      A workstation will NOT see the AD controller when it boots. 
    A functional VPN connection is needed.   I need to know if this topology will provide a better solution.
    Add a domain controller to existing domain outside the secure data center.  
    Alpha and Alpha-replicate will have static IP addresses in their respective DNS spaces.  
    Alpha –replicate will connect to the secure data center via a VPN connection. 
    The IP address on the virtual adapter will be unique each time. 
    There is no way to get a static IP address on a VPN.   
    Users will authenticate to Alpha-replicate and then start a VPN connection to connect to mapped drives on a domain member server in the secure data center. 
     The only domain member systems in the secure data center are Alpha and a domain member server acting as a data server.  
    Will this work?   What should I study? 
     Will Alpha and Alpha-replicate see each other and be able to communicate? 
    Thanks

    You should not need another DC outside your secure data center.  Your PCs don't need to connect to a DC during boot.  Users can use cached credentials to log onto the local device and then connect to via a VPN.  I do this all the time. 
    If you do want to put a DC outside your data center, I would highly recommend it be a Read-Only DC.
    What it sounds like you are describing is something Microsoft provides with the operating system called Direct Access.  Does not require the Juniper box - works just with Windows.  Provides a VPN connection and can be transparent to the user -
    when the user connects to the internet, DA tries to connect to the AD DC.  If successful, the connection is just like being connected locally, so all group policies, etc. get updated.
    . : | : . : | : . tim

  • Windows Store apps on Windows Server 2012 with XenApp?

    We've got asked by a vendor whether our app will be able to support multiple simultaneous users, when installed on Windows Server 2012 and accessed via XenApp.
    I suppose the real question here is whether or not Windows Store apps can be run in XenApp over Windows Server 2012 at all, and if so whether there are any special requirements on the apps to support multiple simultaneous instances execution.
    The app itself takes each user through a log in procedure, during which all the dynamic user-specific data is retrieved from the back-end server; no such data is stored by the app locally.
    Any advice will be greatly appreciated!
    Thank you,
    Alex

    Hi,
    To better help you, the Citrix support could be more helpful on your questions:
    http://support.citrix.com/search?searchQuery=*&lang=en&sort=date_desc&prod=XenApp&pver=
    The reason why we recommend posting appropriately is you will get the most qualified pool of respondents, and other partners who read the forums regularly can either share their knowledge or learn from your interaction with us.  Thank you for your understanding.
    As I known, we always use Remoteapp feature to share app, but it is only worked for desktop app:
    Publishing RemoteApps in Windows Server 2012
    http://social.technet.microsoft.com/wiki/contents/articles/10817.publishing-remoteapps-in-windows-server-2012.aspx
    About citrix product, I knew little about it.
    Kate Li
    TechNet Community Support

  • Hi, I am using HP11 and iPlanet web server. When trying to upload files over HTTP using FORM ENCTYPE="multipart/form-data" that are bigger than a few Kilobytes i get a 408 error. (client timeout).

    Hi, I am using HP11 and iPlanet web server. When trying to upload files over HTTP using FORM ENCTYPE="multipart/form-data" that are bigger than a few Kilobytes i get a 408 error. (client timeout). It is as if the server has decided that the client has timed out during the file upload. The default setting is 30 seconds for AcceptTimeout in the magnus.conf file. This should be ample to get the file across, even increasing this to 2 minutes just produces the same error after 2 minutes. Any help appreciated. Apologies if this is not the correct forum for this, I couldn't see one for iPlanet and Web, many thanks, Kieran.

    Hi,
    You didnt mention which version of IWS. follow these steps.
    (1)Goto Web Server Administration Server, select the server you want to manage.
    (2)Select Preference >> Perfomance Tuning.
    (3)set HTTP Persistent Connection Timeout to your choice (eg 180 sec for three minutes)
    (4) Apply changes and restart the server.
    *Setting the timeout to a lower value, however, may    prevent the transfer of large files as timeout does not refer to the time that the connection has been idle. For example, if you are using a 2400 baud modem, and the request timeout is set to 180 seconds, then the maximum file size that can be transferred before   the connection is closed is 432000 bits (2400 multiplied by 180)
    Regards
    T.Raghulan
    [email protected]

Maybe you are looking for

  • Possible to Scan via Wireless Network?

    Is it possible to add a flatbed scanner via an Airport wireless network? I have my Airport network set up and I am able to print wirelessly. The printer is an Epson all-in-one (Stylus Photo RX 500) so it includes a scanner. I can scan when hooked dir

  • BO XI3.1 dashboard vs SAP BI 4. BI workplace

    Hello all, Is there a way to migration BO XI 3.1 Dashboard ( NOT Xcelsius) to SAP BI 4. Workplace? Or did we have to plan to BI Workplace rebuilds. Remind: In BO XI3.1 In SAP BI 4.1 Regards Laurent

  • Table Control Cursor Position

    Hi All, in table control 6 records are coming. if i change the 5th,6th... row so how to get that position which i have changed. Ex.. SR.         Matnr                                                     QTY. 1           NMSHH01001DENDESS             

  • Optional Date Prompt

    I want to have an optional date prompt  But if no value past it equals a field from the Universe.  Is this possible

  • Print Data

    Hi i work with Oracle Jdeveloper 11g for create adf faces web application i want to print all data of a Rich table for this purpose i used a command button Component in my page and then in my command Button used showPrintablePageBehavior but,all data