Deduplication: how to identify which files are "in-policy" (and which are not)?

Dear experts,
in eventlog I find the following information for one of my deduplicated volumes:
Volume: F: (\\?\Volume{9794e270-fb08-487e-979b-8a08fa9ca311}\)
Error code: 0x0
Error message:
Savings rate: 24
Saved space: 853327714684
Volume used space: 2681869406208
Volume free space: 66771247104
Optimized file count: 1199618
In-policy file count: 1188049
Job processed space (bytes): 0
Job elapsed time (seconds): 2
Job throughput (MB/second): 0
Some things look strange to me:
- The savings rate is only 24% which looks odd because I get about 40% on other file shares with similar characteristics.
- The "Optimized file count" is higher than the "in-policy" file count.
- The volume has about 3.5 million files but only 1.1 million files are "in-policy".
My understanding of "in-policy" files is that all files are in-policy which are older than 3 days (if not configured different, which is not the case) and which are not contained in an excluded folder (nothing configured here) and which have no
excluded file extension (nothing configured here apart from the default). Right?
I'm sure that only a small fraction of the files on this volume are younger than three days, so something seems to be wrong there, but I have no idea how to find the cause of the problem.
Is there any way to identify the files (full path) which are considered to be not "in-policy"?
How can I find out if the optimization process really looks at all files - and doesn't skip a million?
Thanks!
Regards
Christoph

Mandy, thanks for your feedback! I've read these technet articels, but I couldn't learn something really helpfull related to my problem there. To make investigation of the problem easier I did the following:
- created a brand new empty volume (x:) on the same server
- enabled data deduplication on that volume with a minimal file age of 0 days
- copied about 2GB of data from the problem-volume in 15450 files to this new volume
- started "Start-DedupJob x: -Type Optimization -Memory 50"
After a few seconds that job completed and I got the following result:
Volume: X: (\\?\Volume{d1ba9ed8-28f1-44d1-9535-fe603d6a70c6}\)
Error code: 0x0
Error message:
Savings rate: 0
Saved space: 12360718
Volume used space: 3091664896
Volume free space: 7610097664
Optimized file count: 153
In-policy file count: 153
Job processed space (bytes): 46095214
Job elapsed time (seconds): 9
Job throughput (MB/second): 4.88
The question is: why are only 153 files in-policy?
All files (of more than 15000) are of course "older than 0 days", there are no excluded folders configured, there are no excluded extensions configured, no file has one of the default excluded extensions and more than 1000 files are bigger than 100kB
(minimal size for deduplication is 32kB). So what makes only 153 files qualify for deduplication?
My impression is that there are further undocumented requirements which have to be met by a file to qualify for deduplication. But if there's no detailed log of an optimization run available how to find out what's going on?
(Or is something going wrong on my server?)
Kind Regards
Christoph

Similar Messages

How can I transfer files between a PC and a Mac NOT on the same network?

I have an iCloud account, a Time Capsule and a Seagate Free Agent portable hard drive. Which ways can I transfer files (any or all three?) and how? Here's my dilemma: I'm a graphic designer and I work on a PC at my office. At home I use my MacBook Pro...same programs, save files. However, I had trouble earlier saving my new documents onto the Free Agent from my MacBook Pro as the Free Agent was Read Only and original files on it were from the PC. The PC is not on my Time Capsule network and not accessible or even close to my MacBook. I simply want to be able to save the files I updated/changed on my Mac to somewhere that I can access them later from that PC...right now they are saved to my Documents folder. Any help is greatly appreciated. Thanks!

Format the external drive as FAT32 or ExFAT. Both computers will then be able to read and write to it.

How to identify which is rootsite/webapplication url and which are site collection url ?

How to identify which is rootsite/webapplication url and which are site collection url underneath of web application using powershell script in following code?
# Get site objects
$webapplication = Get-SPWebApplication $siteUrl
# Walk through each site in the site collection
foreach($site in $webapplication.Sites)
foreach($subWeb in $site.AllWebs)
$_ = AddLevel123($subWeb.Url)

Hi,
Hope you wanted to know which API is Site collection (SPSite) and Sub site(SPWeb)
$webapplication.Sites = Site Collection (SPSite)
and $site.AllWebs = Subsite (SPWeb)
and see these links - to get webApplication URL
http://social.msdn.microsoft.com/Forums/sharepoint/en-US/e223b607-ab35-454a-a050-1db3005687e5/spwebapplication-url?forum=sharepointdevelopmentlegacy
SPSite Url - SPSite.Url (http://msdn.microsoft.com/en-us/library/office/microsoft.sharepoint.spsite.url.aspx)
SPweb URl - SPWeb.URL (http://msdn.microsoft.com/en-us/library/office/microsoft.sharepoint.spweb.url.aspx)
http://social.technet.microsoft.com/Forums/sharepoint/en-US/b4dfb645-69f4-4abd-947c-64ca42af3a26/script-to-get-list-of-sites-and-subsites
Hope this helps!
MCITP: SharePoint 2010 Administrator
MCTS - MOSS 2007 Configuring, .NET 2.0
| SharePoint Architect | Evangelist |
http://www.sharepointdeveloper.in/
http://ramakrishnaraja.blogspot.com/

Cpu has 4 usb's on the rear. 2 are 2.0 and 2 are 3.0. how can you tell which one is which

Just bought new HP PAV p7 1380t. It has four USB's in the rear. According to specs
2 are 2.0 and 2 are 3.0 How do you tell which one is which?
This question was solved.
View Solution.

Here are the specs and configurable options for your HP Pavilion p7-1380t Desktop Computer. Here are the specs for it's H-Joshua-H61-uATX (Joshua) motherboard. According to the motherboard specs, this system has 4 USB 2.0 ports on the back as shown below;
(#1) USB 2.0 x 4
Typically, USB 3.0 port are blue and have a stylized "SS" symbol near by. There does appear to be a USB 3.0 header on the motherboard, which could be used for front or rear ports.
Frank
{------------ Please click the "White Kudos" Thumbs Up to say THANKS for helping.
Please click the "Accept As Solution" on my post, if my assistance has solved your issue. ------------V
This is a user supported forum. I am a volunteer and I don't work for HP.
HP 15t-j100 (on loan from HP)
HP 13 Split x2 (on loan from HP)
HP Slate8 Pro (on loan from HP)
HP a1632x - Windows 7, 4GB RAM, AMD Radeon HD 6450
HP p6130y - Windows 7, 8GB RAM, AMD Radeon HD 6450
HP p6320y - Windows 7, 8GB RAM, NVIDIA GT 240
HP p7-1026 - Windows 7, 6GB RAM, AMD Radeon HD 6450
HP p6787c - Windows 7, 8GB RAM, NVIDIA GT 240

How to identify that a host is connected to which particular edge switch

Hello Guys
Can anybody explain how to identify that a host is connected to which particular edge switch and port in a Cisco SAN Fabric ??

Hi,
Hopefully you know the host PWWN.
If the edge switch is not in NPV mode, get the FCID from the output of "show fcns database"
The answer may also be as simple as finding this entry in the "show fcns database detail".
If not, once you have the fcid, the first byte of the fcid is the switch domain ID. With the combination of "show fcdomain domain-list vsan xx" "show fcs ie" you should be able to determine what you need.
If the edge switch is in NPV and registers as a NPV device ( Cisco switches do ), then the FCID will be assigned by the core switch upstream of that edge switch. You can see this from a "show flogi database". Find the PWWN here. There will likely be multiple entries for the port where the host is connected. Once you find the port where the NPV switch is attached. The first flogi entry on that port will be the switch WWN. Get the FCID for the switch and then find the entry for this FCID in the "show fcns database detail", this will give you the switch information.
Best regards,
Jim

How can i decide how many dimensions are needed here.and which charactersti

Hi,
i am planning to create custom defined cube for sale order line item data. how can i decide how many dimensions are needed here.and which characterstics are suitable for that dimensions.
Thanks,
chandu.

Hi Chandra,
How many dimensions are needed and which characteristics to be used totally depends upon the data model you are using.
for instance take an example of school.
teachers , students are the imp terms in this example .
you can choose these two as dimensions .
teacher's name , address , subject , class , designation etc can be its characteristics . and for students also the important terms describing them can be its characteristics.
for more understanding of the Dimensional Modeling you can refer to following link.
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/6ce7b0a4-0b01-0010-52ac-a6e813c35a84
Hope It Helps .
Regards
Pratap

Video files of type *.flv and *.f4v are considered Flash files, how play them (win7)

video files of type *.flv and *.f4v are considered Flash files, how play them (win7) are files in file windows explorer?

Not sure what you are saying; are these local or online files?
Adobe does not longer provide Adobe Media Player to play local files; use a 3rd-party player like VLC Media Player.

SharePoint Databases - How to determine which ones are being used and which ones aren't

I am not sure where to exactly post this question. On the SQL Server side or on a SharePoint side.
I am a SQL Server Database Administrator who is monitoring some SharePoint databases. On a daily basis it seems that they are creating new databases but don't delete the databases that they are no longer using. For example, they might be testing
on a development server and if things aren't working properly instead of asking that the databases be deleted they just go ahead and create new databases to do what ever they need to do. Is there a way on the SQL Server side to determine which SharePoint
databases are being used and which ones aren't being used? Or does one determine this information through the SharePoint Central Administration console?
lcerni

Hello,
The following query gives you the databases now in use.
SELECT
DISTINCT d.name
FROM
sys.dm_tran_locks
tl INNER
JOIN sys.databases
d
ON
tl.resource_database_id
= d.database_id
Hope this helps.
Regards,
Alberto Morillo
SQLCoffee.com

How do I move files from my iMac to my Airport without getting 'AirPort can not be modified' message. File sharing is enabled and I'm not getting asked for a password. Thanks

How do I move files from my iMac to my Airport without getting 'AirPort can not be modified' message. File sharing is enabled and I'm not getting asked for a password. Thanks

What OS are you running.. this is usually only a problem in Mavericks.
If so I recommend you mount the hard disk manually..
Use Go, Connect to server.
Type in the IP address if static.. eg
AFP://10.0.1.1
Or the name.. but you will have issues unless the name is short, no spaces and pure alphanumeric.. if you are using bad names.. fix it by a full factory reset in airport utility and give it all names that comply to the above.
Type in
AFP://TCname.local Where TCname is replaced with the actual name.
You will be asked for the password the first time which is public unless you changed it.. please remember to save this in the keychain.
Copy files then to a new directory you create on the TC.. do not place files inside the TM sparsebundle. Nor directly under the main directory.

I have two apple id's because my hotmail account is no longer active. How can I delete the old one and use or update the new one? Every time I try it won't allow me and now my iPad thinks there are two accounts and they are arguing with each other. Help!

I have two apple id's because my hotmail account is no longer active. How can I delete the old one and use or update the new one? Every time I try it won't allow me and now my iPad thinks there are two accounts and they are arguing with each other. Help!

You can't merge accounts or copy content to a different account, so anything that you bought or downloaded via the old account is tied to that account - so any updates that those apps get you will only be able to download via that account. You can change which account is logged in on the iPad via Settings > Store

When syncing iPod touch to MacBook, I have selected to sync only events newer than 360 days. Yet I get message that sync will change 8000 events on "this computer" most of which are years old and many are recurring events. I'm afraid to proceed

When syncing iPod touch to MacBook, I have selected to sync only events newer than 360 days. Yet I get message that sync will change 8000 events on "this computer" most of which are years old and many are recurring events. I'm afraid to proceed with sync.

Having the same problem here. As a first time mac user, Apple has certainly made a bad first impression.
For me, the issue seems to occur when transferring files between computers that are connected to the same access point (when transferring files from wired computers on the network there is no issue). My vista laptop and every laptop I have tried has worked perfectly fine with this access point so I am 100% convinced it is the mac. Basically when I copy the files, after about 100mb, I am unable to access anything on the local network or internet until I restart Airport. The weird thing is that even though I am unable to access anything, the airport utility says it is connected. I might also note that the wireless signal strength is full.
If I can't get this figured out in a few days, this computer is going back to the store where it came from and I will officially label myself anti-mac. This type of issue is just unacceptable for something so main stream.

How to open excel files from email in macro enabled workbooks NOT 2003-2007 worksheets?

I have recently installed Office 365 and it was working great. I needed to open excel documents via email with the macro enabled option. Yesterday it flicked back to only giving me the option to open in 2003-2007 workbook so now I am having issues with the
macros. I am contracting and trying to get work out and this has now caused huge problems.
Am thinking of uninstalling and reinstalling. I did have older versions of ms office so maybe there is some residual content there to remove? I have tried to change the associations and protocols to open in excel macro enabled workbooks but these tick boxes
are greyed out and I do not know how to gain access to these. Have been hunting all through my computer system but do not know how to do this. Am no expert.
If someone could help I would really appreciate it otherwise will need to find some computer shop expert I suppose...urgently ha.
Thanks in advance

it's sound like excel 13 disable the macros, turn on it will fix your issue.
see here:
http://office.microsoft.com/en-us/excel-help/enable-or-disable-macros-in-office-files-HA010354316.aspx
ps: use the local admin to change the setting, the reason why the setting grey out.
KR

I hope you can help me. I purchased adobe captivate 8 on line and when I click on the email link to download, it comes up with 7 programs, some are 64 bit and some are not, my computer is 32 bit. I am not sure which of these 7 to download? All or just

I hope you can help me. I purchased adobe captivate 8 on line and when I click on the email link to download, it comes up with 7 programs, some are 64 bit and some are not, my computer is 32 bit. I am not sure which of these 7 to download? All or just the 4 non 64 bit?

I tracked down the problem with the download and installation, my windows 7 was missing a file and after reinstalling windows everything worked out. The first 32 bit program in their list was used. I hope this can help others.

Which file decide EM to choose which db(10g) ?

I have 2 instances on same machine to be managed by em db console, which file decide EM to choose which db(10g)?
from some document: you can also use DBCA after the installation to configure Database Control for a database.
but I did not see this option in my 10g DBCA.
Thanks.

Don't expect to find a file that configures the so called 'pointer' Enterprise Manager creates a directory where it stores the configuration under a directory named sysman/conf. In your particular case I see you have three instances which have been configured to be managed by Enterprise Manager DB Control Console, the name of your host is m92364 and the three instances are OMFTESET, orcl and TEST. So you only need to change the ORACLE_SID environment variable to 'point' to each oracle Enterprise Manager configuration; actually you don't perform any other task, it is the oemctl command who performs this on your behalf.
~ Madrid
http://hrivera99.blogspot.com/

How to take the back up of MPOS and planning area

Hi Gurus ,
i am using apo dp version 5.0 .We are trying to adding a new key kigfigures in our planning object structure and planning area .
so,we are trying take a back up of our Planning objects structure and planning Area .
1.How to take the back up of MPOS and Planning area ?
2. How loading back the data in to the same MPOS and Planning area after adding some keyfigures to MPOS and planning area.?
I gone thru the www.help.sap.com but i did not understand properly .
I would really appreciate if somebody clearly eleborate the procedural steps .
Thanks!
Kriss.

Hi Kriss,
First let me clear you some points.
1. MPOS always contain characteristcis only not the key figures.
2. Planning area always contain Key figures.
3. When you create planning area at that you have to assign MPOS & Storage bucket Profile. So Automatcially Characteristcis, Key figures & Time charcteristics realetion mentained.
Come to your point.
1. Before creating data source which is depend up on Planning area, you should sure that your basic structure get finalized say, MPOS, Planning area & rest configuration setting. So if you think there will be some extra key figure required after finalizing planning area then in that case you can creat some extra key figure & adding to planning area before finalizing it. So that you can use these key figure in future also.
What ever data you want to extract from planning area you required whole data extraction process. So whenever you create data source depend up on planning area then automatcially all the info Objects( Char. key figures, time char. ) come in to data source by default. So further you have to replicate it in to APO BW & create rest data extraction process depneds up on data source. So automatcially all the info objects come in to an Info Cube & your extraction process will wrk fine.
2. Relignment can effect on data transfer from Info Cube to Planning area becz previously your charcteristcis values are different & you had taken back with those characteristcis values, now if you did relignment then charcteristcis values are suppose to be changed, so while loading data from Info cube to Planning area your charcteristcis values will not match & data will not load for those char. values only.
See, Data always stored in to planning area ( Live cache) against characteristcis, Key figures & time characteristcis. Data is not stored in to MPOS.
Hope this will help you
Regards
Sujay

Deduplication: how to identify which files are "in-policy" (and which are not)?

Similar Messages

Maybe you are looking for