ZFS with de-dupe slowing down...

Hi all,
I'm new to Solaris but am evaluating the de-dupe capabilities of Solaris 11.
I have conifgured a Virtual Machine using VMware vSphere 5 with 8GB RAM and a 1.5TB disk and am slowly copying a few million PDFs into a SMB share in the ZFS pool from a remote server.
It's been going well, I'm getting a dedup ratio of 3.3 but after copying 3.5TB of files, I've noticed it slowing down. Now it seems to copy really fast for around 5-6 seconds but will then pause for 10-15 seconds before carrying on for another 5-6 seconds etc...
I'm using the default record size and running "top" doesn't indicate that I'm using any swap, neither do the performance stats in VMware.
Any help/advice/pointers would be gratefully appreciated!
Dave

Thanks for the info. Here's the output of the zdb -DD command
bucket allocated referenced
refcnt blocks LSIZE PSIZE DSIZE blocks LSIZE PSIZE DSIZE
1 12.6M 1.58T 1.08T 1.08T 12.6M 1.58T 1.08T 1.08T
2 582K 72.8G 64.9G 64.9G 1.32M 169G 151G 151G
4 295K 36.9G 34.1G 34.1G 1.47M 189G 174G 174G
8 189K 23.6G 21.9G 21.9G 1.99M 255G 237G 237G
16 97.2K 12.2G 11.3G 11.3G 2.06M 264G 245G 245G
32 52.9K 6.62G 6.15G 6.15G 2.29M 293G 272G 272G
64 27.5K 3.44G 3.21G 3.21G 2.35M 301G 280G 280G
128 13.3K 1.66G 1.53G 1.53G 2.32M 297G 273G 273G
256 5.75K 736M 672M 672M 2.05M 262G 240G 240G
512 2.96K 379M 351M 351M 2.06M 263G 243G 243G
1K 1.15K 147M 132M 132M 1.68M 215G 193G 193G
2K 711 88.9M 78.7M 78.7M 1.73M 222G 196G 196G
4K 103 12.9M 9.72M 9.72M 560K 69.9G 52.4G 52.4G
8K 33 4.12M 3.76M 3.76M 374K 46.7G 42.5G 42.5G
16K 7 896K 817K 817K 155K 19.4G 17.7G 17.7G
32K 28 3.50M 3.10M 3.10M 1.03M 131G 116G 116G
64K 23 2.88M 2.64M 2.64M 1.69M 217G 200G 200G
128K 6 768K 750K 750K 1.31M 168G 164G 164G
Total 13.9M 1.73T 1.22T 1.22T 39.0M 4.88T 4.10T 4.10T
dedup = 3.36, compress = 1.19, copies = 1.00, dedup * compress / copies = 4.00
By my calculation, that makes the dedup table 13.9M * 320 = 4448M = Approx 4.5GB
Does that look right to you experts? That would indicate that my allocated RAM of 8GB should be plenty I think.

Similar Messages

My magic mouse behaves erratically with intermittent problems - slows down, right click doesn't work, disconnects for a few seconds then reconnects. Anyone suggest what I could do to fix this?

My magic mouse behaves erratically with intermittent problems - slows down, right click doesn't work, disconnects for a few seconds then reconnects. Anyone suggest what I could do to fix this?

I just figured out the print quality issue for my wife with her new iMac and new printer.
She replaced both at once and she couldn't understand why her Artisan 730 was lower quality then her Epson R280 when they had the same specs.
Turns out the newer printer had the option to connect via wifi which we used during setup.
The driver options are completely different depending on how you connect.
Once I connected via USB the correct options were available and the print quality was better.
Looking at the R2400 it dies not have wifi, but while researching the problem for my wife someone esle was having an issue updating to the latest printer driver.
If you go into the print utility from the Printer and Scanner system preference and under the general tab you should have driver 5.5.
One user had to delete the old printer driver before Software Update loaded the newer printer driver.
https://discussions.apple.com/message/15947486#15947486
On my MacBook Pro (w Snow Leopard) I always had to reconnect my wifi at home when it woke up. I upgraded my router from an old Netgear to a newer N D-Link and stopped having to do that.
I would be surprised you would have that problem with an Airport Extreme, you might check to see if there is a firmware update for it.

Execute Case Structure with Button Press Slows Down VI

Hi -
I'm fairly new to LabView, and I am having some issues with using a button to run a timed while loop.
I am writing a VI that outputs a timed voltage pulse to an output channel on a DAQ; meanwhile, the VI reads and graphs the voltage on three input channels on the DAQ. When I use a timed loop that automatically executes when the VI runs, the program works. However, I would like to include a button so I can control the timing and number of voltage pulses sent to the output channel, instead of sending only one voltage pulse each time the VI runs. I have tried to do this using a button wired to a case structure. If the button is 'true,' the VI should send the voltage pulse. If the button is 'false,' the VI should keep the voltage at zero.
When the button is 'false,' the VI runs normally; however, when the button changes to 'true,' the VI slows down and never sends the pulse. Why does this happen? How can I fix it?
Also, how can I send the voltage pulse only when the value of the button changes? I only want the timed loop to execute once when the button changes value.
Thanks for any help or advice!!!
Attachments:
Sensor Read6.vi ‏85 KB

The graph is in the same while loop as the case structure. The while loop won't iterate until all the code inside of it has completed. So the graph only gets updated once, and won't update again until the while loop iterates again. If you need more continual updating you may want to put that in a loop that executes a couple of times, or completely separate your code into 2 while loops. Is it that long of a wait considering your pulse length is 1 second?
Your analog output code is just writing a voltage out (7 volts) until it eventually writes out 0 volts. There is no reason for it to drop down unless you have some sort of electrical problem between your DAQ device and the device on the other end that is reading the 7 volts. What are you connecting that analog output too?
What if you don't use LabVIEW and try to test out that analog output using Measurement and Automation Explorer? Does it do the same thing?

Recording with audio playback slowed down 65% what speed do I need to speed the video back up to to get it into real time?

Ive recorded a test video with audio/music playback slowed down 65% what speed do I need to speed the video back up to to get it into "real" time?
If I'd slowed the audio playback down 50% I would make the video 100% faster.
If I'd slowed the audio playback down 100% I would make the video 200% faster.
So its obviously somewhere inbetween speeding up by 100-200%
Sorry but its melting my brain today and I cant remember the calculation.
thanks

hey all
Thanks for the advise on this. I will explain a little more what am have/am intending to do.
I have used Audacity to slow the song down (Effect>Change Tempo)
Audacity will allow me slow the original song down by up to 99% (Or anything in-between up to 3 decimal places)
Unfortunately I am working to a time restraint of 12 minutes per clip (as my DSLR will only allow up to a 12 minute clip).
The song at normal speed is 4 minutes long.
Originally I slowed the audio down by 50% (Making the audio 8 minutes long), lip synced to it using a rasta blaster and recorded the video using my DSLR at 720p 50fps.
I then imported the video and audio I had been lip syncing to into FCPX.
I sped up the video by x2 (equivalent to speeding it up 200%)
Retime>Fast 2X
Layered the PROPER normal speed audio back over the top and all was fine.
Test video complete.
(You can ignore the 65% slowed down audio I mentioned earlier if you like, that was just an example of a slower than 50% audio test)
Firstly what I really want to do is to be able to slow the AUDIO down as much as possible (But still within the restraints of only being able to adjust FCPX retiming within a whole 1 percentage in the final video edit), but have the AUDIO of the song as near to/under 12 minutes as possible.
I will then re-record the video again to this new slowed down audio.
Secondly I will speed up the video from 12 minutes to 4 minutes.
Thirdly I will layer the correct 100% Normal AUDIO on top.
The FINISHED video should then look like everyone is wizzing around at high speed but the guitar playing/lyrics look like they are being played/sung at the normal speed.
Whatever happens (due to the constraints of FCPX) I need the calculations to work so that FCPX is retimed exactly to a whole 1% for the final video to sync up correctly.
So what I need to know in a nut shell is:-
What calculation do I use to work out the percentage to slow a 4 minute song down to a 12 minute song?
What calculation do I use to work out the percentage of how much I need to then speed the 12 minute video up to turn it back into a 4 minute video?
My mind is melting

Query With BETWEEN Clause Slows Down

hi,
I am experiencing slow down query by using BETWEEN clause. Is there any solution for it?

Here is the difference if I use equal not between.
SQL> select to_char(sysdate,'MM-DD-YYYY HH24:MI:SS') from dual;
TO_CHAR(SYSDATE,'MM
11-14-2005 15:44:03
SQL> SELECT COUNT(*) /*+ USE_NL(al2), USE_NL(al3), USE_NL(al4),
2 USE_NL(al5), USE_NL(al6) */
3 FROM acct.TRANSACTION al1,
4 acct.account_balance_history al2,
5 acct.ACCOUNT al3,
6 acct.journal al4,
7 acct.TIME al5,
8 acct.object_code al6
9 WHERE ( al1.reference_num = al4.reference_num(+)
10 AND al1.timekey = al5.timekey
11 AND al5.timekey = al2.timekey
12 AND al3.surrogate_acct_key = al2.surrogate_acct_key
13 AND al3.surrogate_acct_key = al1.surrogate_acct_key
14 AND al1.report_fy = al3.rpt_fy
15 AND al6.object_code = al1.object_adj
16 )
17 AND ((al1.timekey = 20040701
18 or al1.timekey = 20040801
19 or al1.timekey = 20040901
20 or al1.timekey = 20041001
21 or al1.timekey = 20041101
22 or al1.timekey = 20041201
23 or al1.timekey = 20050101
24 or al1.timekey = 20050201
25 or al1.timekey = 20050301
26 or al1.timekey = 20050401
27 or al1.timekey = 20050501
28 or al1.timekey = 20050601
29 or al1.timekey = 20050701
30 or al1.timekey = 20050801
31 or al1.timekey = 20050901)
32 AND al3.dept = '480');
COUNT(*)/*+USE_NL(AL2),USE_NL(AL3),USE_NL(AL4),USE_NL(AL5),USE_NL(AL6)*/
34245
SQL> select to_char(sysdate,'MM-DD-YYYY HH24:MI:SS') from dual;
TO_CHAR(SYSDATE,'MM
11-14-2005 15:44:24

Problem with tethering D700 - slows down: 'Transfering images...'

Hi,
I have a problem when working tethered. Previously I had no or hardly any trouble but as far as I know nothing has changed.
The problem is (also when I have no CF card in my camera) that all of a sudden I get 'transferring images from camera' and lightroom then is fully occupied doing that. It is a big problem because I cannot work lik that in the studio.
Please advice bcause it is driving me mad...
Leon

Hi Weixuan,
I recomend taking an unneccesarily process out if the loop for example: IMAQ Create, IMAQ Read File, IMAQ WindSetup, IMAQ Dispose, IMAQ WIndClose.
You may refer to my attached screenshot to see how I modify your program.
I can achieve the same task at 17ms interval with <30% CPU consumption.
Regards, Kate
Attachments:
weixuan.PNG ‏16 KB

The Internet connection with WRT54GC V2 is slowing down about time.

I upgraded the router to the newest firmware (1.01.0), but the connection with time still slowing down. I turn the router off and then on, and the connection is fast already. After 1 or 2 days the connection slowing down again. What can I do?

Connect your computer straight to your modem and check if you face the same problem...If you don't face any problems through the modem, hard reset your router...
Press and hold the reset button for 30 seconds...Release the reset button...Unplug the power cable from your router, wait for 30 seconds and re-connect the power cable...Now re-configure your router...If you still face the same problem get your router replaced...

Opening CC project in CC 2014 and having slow down issues

I need to update my project with the newest version of Premeire so I can share it with another editor. When I open the old project in the up to date Premiere, everything takes 10 seconds. Hit space bar - 10 seconds before anything moves. Hit it again to stop - 10 seconds. Everything.
So then I tried an XML out from my old project and opening it in updated Premiere. The slow-down is gone! but all the data I entered for all my footage (this is a feature) has been erased!
Can anybody help me with either the slow down or the XML loss of meta-data?
thank you!

An Update.
I exported an EDL out of CS5 and then brought the EDL into CC2014. I relinked the media in question and it works fine. The EDL however is not ideal for what I am doing here, as the relinking in CC2014 is not working properly either.
S

System slow down after lion update 8/18/11

Has anyone else had a problem with their system slowing down after downloading the system update for Lion on 8/18? My system is not nearly as responsive and is only about two weeks old and have not installed any software other than Microsoft Office 2011 when I bought the machine. Any ideas?

Ok my system is booting and shutting down faster now.. This method worked for me:
First, I repaired the permissions:
1) Open up Disk Utility
2) Select your hard drive
3) Now select Repair Disk Permissions.
Then, I deleted the caches folder:
1) From the Finder's Go menu, select Go To Folder, and go to this folder: /Library
2) Delete everything inside the Caches folder (This might require the Admin Username & Password)
Finally, go to System Preferences and click on Startup Disc then click on your boot drive (In my case I've selected my HD labeled "Macintosh HD Mac OS X, 10.7.1". Now do a restart by clicking on the Restart button. If you don't have a Startup drive selected your mac will waste time at boot searching for a suitable boot drive !
I Hope this works for you as well.
Cheers!

Will 10.4.4 Slow Down the Computer?

Hi there,
When 10.4.3 came out, I heard that it had sped up the fan speed on some or all G5s. I figured that this must be because 10.4.3 was making the G5s work harder. So when I put 10.4.3 into my G4 I was a little unsure if it would be a good idea. My G4 seemed to run no different than it had in the past. My G3, However, ran much slower, starting up took longer than it had ever before, So I took 10.4.3 out of the G3 and it is now and probably will remain running 10.4.2.
Before I update My G4 to 10.4.4, I would like to know if anybody has any problems with their computer slowing down under this system. (10.4.4)
Thanks!
QuickSilver G4 & B&W G3 Mac OS X (10.4.3)

Hi Video Guy;
I think if you can find a way to increase the amount of free sapce you will notice and improvement in performance with the G3. Also running with low free space open you up to file corruption.
Allan

My eMac is slowing down and my hard drive is filling up, what should I do?

I have a lot of music and movie files on my computer and just recenlty my computer has been slowing down. I only have 19 gb left on my 80gig hard drive. I don't know wether to buy more ram or get an external hard drive. I only have 256 mb of ram. Also as a side note my computer slows down drasticly when ever I run Limewire but it did not before. What is the reason for that and how can it be fixed. (note: I'm not a big limewire user and I only have 85 limewire songs compared to 2500 normal iTunes or Imported CD songs, so its not that limewire is the main thing i use for getting music, i just get random singles off of it) Why i does it basicly freeze my computer?
eMac Mac OS X (10.3.9) 1.25 ghz and 256 ram

I posted this...
http://tinyurl.com/7eqxs
to the iDVD4 group, but it still probably applies to your situation. So first thing I would do is what my post says to do and see if that doesn't help your eMac with freezing and slow downs.
If you are going to keep the computer, then I would definately go with more RAM. You have two slots and only one is filled, so I would buy a 512MB module and throw it into the other slot and you should be all set for RAM. Even another 256MB module would be better than what you have now.
Also, get an external Firewire hard drive. Either buy one premade or put one together yourself (buy external case and internal drive to put in it). You can put together a 160+GB drive for under $100. This will allow you to free up a lot of space inside the eMac by putting seldom used stuff onto the external drive. Or if you want, you can move your iTunes library off onto the external.
Patrick

Slow down Mousepointer

Hi,.
does anyone know of a program with which you slow down/increase the speed of a mouse pointer by pressing a key ?
I know that I can connect an external mouse at my laptop, I also know that you can change in the system settings under "Mouse", but that involves me too many clicks.
I use an ASUS which has no Synaptics touchpad, so this driver also is of no use me.
Thank you
HGBMZ

Welcome to the forum.
If you have created either a Roll, or Crawl, with the Animation Preset, then you will want to increase the Duration of that Title, to slow it down. You can do this by click+dragging on the Tail of the Title.
Or, you can create a static Title, then animate it by Keyframing the Fixed Effect>Motion>Position over time. That allows for much more control.
Good luck,
Hunt

Unexpected slow down in VI

I have a large VI that is running data aquisition and control on our system. Recently it has been have some troubles. After running for a period of time (anywhere from a couple hours to several days) it stops updating once a second, and begins to update once every 25 seconds. The data updates are from a UDP stream that is pulled from our system every second. Some version of this VI has been running for on and off for about 9 years and we have never observed this problem before. In this state it also does not respond to the built in 'stop command' - which gracefully stops the whiles loops/data files, however, it can be stopped using the hard execution stop. Starting the VI again after stopping it and it is back to normal with no problems.
This started occuring after we rebuilt the laptop that the VI was running on. We backed up the VI and are running the same version that was running before the system was rebuilt. The slow down does not occur after any set number of data points or time, just randomly. A VI running simultaneously pulling data from the same source as this one does not have any trouble/slow down - this VI is always running concurrently, so it is not a source of the problem. The task manage doesn't indicate that the CPU is bogged down, or that any other applications are running in the background. The computer is on an isolated network with about 5 other machines, all of which are pulling data from different sources.
Is there a way to determine where the VI in it execution while it is running? Anyone else had problems with a VI slowing down after rebuilding a computer? Any hints as to where I should start looking for my problem.

What is the OS? What are the firewall settings? Do you have an updated driver for the network card?
25 seconds is suspiciously similar to the default UDP timeout for UDP read. This might give you a clue where to look.
LabVIEW Champion . Do more with less code and in less time .

Camera slowing down to 4 FPS

Hello everyone,
I have a problem with the camera slowing down in my project.
I thought it could be because of the complexity and memory
consumtion of this work, so I created a completely new movie, typed
such code:
quote:
var camera:Camera = Camera.getCamera();
var video = new Video(camera.width, camera.height);
video.attachCamera(camera);
addChild(video);
function onEnterFrame(event:Event):void
trace(camera.currentFPS);
addEventListener(Event.ENTER_FRAME, onEnterFrame);
Despite there was nothing else done than just displaying the
captured video, the camera fps was still slowing donw (however it
was much lengthened in time than in the complex project), but
ultimately I also finished with 4fps. So I came up with an idea to
check if there is a connection between the memory usage and the
camera fps. So I changed the code a little bit and got:
quote:
var camera:Camera = Camera.getCamera();
var video = new Video(camera.width, camera.height);
video.attachCamera(camera);
addChild(video);
function onEnterFrame(event:Event):void
trace(camera.currentFPS + " / " + System.totalMemory);
addEventListener(Event.ENTER_FRAME, onEnterFrame);
And... this time the camera's fps stayed 25fps all the time.
To be honest - I really don't know why :| I mean, I'm happy the fps
stayed stabily at the level, but I don't know what to do in the
mentioned, complex, project to make the fps faster. I can't just
add the trace line ;)
For any questions here are some details about my project:
PC: Core 2 Extreme Quadro 2,66 GHz, 2.0Gb RAM, EVGA GeForce
8800 Ultra
Flash used: CS4
Tested on cameras: Canon MV 450i Digital Camera and an
ordinary USB webcam (both the same effect)
Thanks in advance for any help.

I'm pretty sure my iSight webcam supports 30 fps as I can record very smooth videos using youTube's webcam page, but even when my camera records at higher rate for example when there is more light in the room and fps goes up to 25 still netStream.currentFPS remains below 15, so the recorded video still has lots of dropped frames. I can't figure out why netStream.currentFPS never goes higher than 15. Perhaps I should decreae the number of keyframes in the video to reduce byte load...

Interactivity slowing down

Hey, everyone,
I've run into a bit of a problem. I'm making eight card games, all with the same interactivity. The cards shuffle, I can flip them, and I can drag them. After I completed the first one, I made the second one simply by changing the words on the cards and the colors. I did the same for the third. The problem now is that my cards in each successive game are flipping slower and slower. They are supposed to show the other side immediately when clicked on (no fancy animation). In the first game, the car flips almost immediately. In the second game, it takes a moment. In the third, it takes several seconds! Beyond that, the click and drag function also gets choppy in the following games.
Does anybody know what might be causing this? It seems like my code is lagging in its functionality in the second and third games, and I don't know why. I have an a seperate .fla and .as file for each game. I also have some code embedded in the first frame of the .fla telling a button on the welcome screen to function. Here's my code for the third game I created. Thanks in advance for your help!
doubletimeA.as
package {
import flash.display.*;
import flash.events.*;
public class doubletimeA extends MovieClip {
// game constants
private static const boardWidth:uint = 7;
private static const boardHeight:uint = 7;
private static const boardOffsetX:Number = 120;
private static const boardOffsetY:Number = 45;
private var firstCard:Card;
private var secondCard:Card;
public function doubletimeA():void {
   // make a list of card numbers
   var cardlist:Array = new Array();
   for(var i:uint=0;i<boardWidth*boardHeight;i++) {
    cardlist.push(i);
   // create all the cards, position them, and assign a randomcard face to each
   for(var x:uint=0;x<boardWidth;x++) { // horizontal
    for(var y:uint=0;y<boardHeight;y++) { // vertical
     var c:Card = new Card(); // copy the movie clip
     c.stop(); // stop on first frame
     var r:uint = Math.floor(Math.random()*cardlist.length); // get a random face
     c.cardface = cardlist[r]; // assign face to card
     cardlist.splice(r,1); // remove face from list
     c.addEventListener(MouseEvent.CLICK,clickCard); // have it listen for clicks
     addChild(c); // show the card
   // This function is called when the mouse button is pressed.
   function startDragging(event:MouseEvent):void
        event.currentTarget.startDrag();
    // This function is called when the mouse button is released.
    function stopDragging(event:MouseEvent):void
       event.currentTarget.stopDrag();
   c.addEventListener(MouseEvent.MOUSE_DOWN, startDragging);
   c.addEventListener(MouseEvent.MOUSE_UP, stopDragging);
// player clicked on a card
public function clickCard(event:MouseEvent) {
   var thisCard:Card = (event.target as Card); // what card?
    firstCard = thisCard; // note it
    firstCard.gotoAndStop(thisCard.cardface+2); // turn it over
doubletimeA.fla (first frame code)
stop();
function buttonClick(myevent:MouseEvent): void
gotoAndStop(2);
btn_start.addEventListener(MouseEvent.CLICK,buttonClick);

Hi stupid rasa,
I'm sorry to hear you are having these issues with your MacBook Pro. It sounds like you have been on the right track in your troubleshooting. If you are having intermittent but persistent issues with your Mac slowing down over time, with temporary relief after a restart, you may find the following articles helpful.
In addition to CPU activity, you may want to check the Memory Pressure in Activity Monitor when your machine is slowing down, as noted here:
How to use Activity Monitor - Apple Support
You may also want to check your available disk space and see if your hard drive is largely full (<10% or so available), which can also greatly affect system speed & responsiveness:
To find out how much disk space you have, open Disk Utility, click your disk (usually named Macintosh HD), then click Info.
OS X Mavericks: Increase disk space
Regards,
- Brenden

ZFS with de-dupe slowing down...

Similar Messages

Maybe you are looking for