Solaris file system performance
I run postmark on solaris and ext3 to compare their performance. I found the Solaris is three times slower than ext3. Is there anything wrong? I use "mount" to display all mount point and can see logging is open for the disk I'm testing. I tried closing the logging by "mount -o nologging" and the performance if even worse. So I think the logging is working. But why the performance is still so bad? My computer has 2G ram and the disk I'm using is SATA disk. I found the white paper from SUN says solaris is much faster than ext3 and they use postmark too. Is there any other parameter?
postmark is all about metadata operation performance. Which UFS has always been fairly bad at since solaris is paranoid about flushing metadata and syncing the disks religously to avoid filesystem corruption in case of sudden reboot.
Logging is not primarily a performance optimisation. Its primary function is to avoid having to fsck the disk after an unclean shutdown. So its not surprising that logging doesnt help postmark all that much.
You can try mounting the filesystem noatime which should help a bit.
You can also try ZFS inctead of UFS which supposedly has excellent postmark scores.
You should also be aware that postmark is a very contrived benchmark which only adequately represents the performance of a small subset of programs. Specifically those which manipulate large numbers of small files. Like a mail server.
Similar Messages
-
Bad file system performance in OS X Mavericks
After installing OS X Mavericks I experience bad file system performance approx. three times per day: Opening Finder and trying to a access a directory gets my MacBook Air (1.8 GHz Intel Core i7 4 GB 1333 MHz DDR3 with 250 GB Flash) stuck every approx. 10th time, not always. Same on my brandnew MacBook Pro 2.6 GHz Intel Core i7, 16 GB 1600 MHz DDR3 with 1 TB Flash. This is not a hardware problem. It is a Mavericks problem. Under Mountain Lion I did not have any problems.
Is there any way to get rid of the annoying wait cycles?Output of EtreCheck follows:
Hardware Information:
MacBook Pro (Retina, 15-inch, Late 2013)
MacBook Pro - model: MacBookPro11,2
1 2.6 GHz Intel Core i7 CPU: 4 cores
16 GB RAM
Video Information:
Intel Iris Pro - VRAM: 1024 MB
Audio Plug-ins:
BluetoothAudioPlugIn: Version: 1.0 - SDK 10.9
AirPlay: Version: 1.9 - SDK 10.9
AppleAVBAudio: Version: 2.0.0 - SDK 10.9
iSightAudio: Version: 7.7.3 - SDK 10.9
System Software:
OS X 10.9.1 (13B3116) - Uptime: 1 day 20:52:39
Disk Information:
APPLE SSD SM1024F disk0 : (1 TB)
EFI (disk0s1) <not mounted>: 209,7 MB
Macintosh HD (disk0s2) /: 999,7 GB (797,68 GB free)
Recovery HD (disk0s3) <not mounted>: 650 MB
USB Information:
Apple Internal Memory Card Reader
Apple Inc. BRCM20702 Hub
Apple Inc. Bluetooth USB Host Controller
Apple Inc. Apple Internal Keyboard / Trackpad
Logitech USB Mouse
FireWire Information:
Thunderbolt Information:
Apple Inc. thunderbolt_bus
Kernel Extensions:
org.virtualbox.kext.VBoxDrv (4.1.8)
org.virtualbox.kext.VBoxUSB (4.1.8)
com.avatron.AVExVideo (1.7 - SDK 10.8)
net.telestream.driver.TelestreamAudio (1.0.4 - SDK 10.6)
com.avatron.AVExFramebuffer (1.7 - SDK 10.8)
Problem System Launch Daemons:
Problem System Launch Agents:
Launch Daemons:
[loaded] com.adobe.fpsaud.plist
[loaded] com.barebones.textwrangler.plist
[loaded] com.google.keystone.daemon.plist
[loaded] com.microsoft.office.licensing.helper.plist
[loaded] org.gpgtools.gpgmail.patch-uuid.plist
[loaded] org.macosforge.xquartz.privileged_startx.plist
Launch Agents:
[not loaded] com.adobe.AAM.Updater-1.0.plist
[loaded] com.google.keystone.agent.plist
[loaded] org.gpgtools.gpgmail.enable-bundles.plist
[loaded] org.gpgtools.gpgmail.patch-uuid-user.plist
[loaded] org.gpgtools.Libmacgpg.xpc.plist
[loaded] org.gpgtools.macgpg2.fix.plist
[loaded] org.gpgtools.macgpg2.shutdown-gpg-agent.plist
[loaded] org.gpgtools.macgpg2.updater.plist
[loaded] org.macosforge.xquartz.startx.plist
User Launch Agents:
[loaded] com.adobe.ARM.[...].plist
[not loaded] org.virtualbox.vboxwebsrv.plist
User Login Items:
Aktivitätsanzeige
iTunesHelper
SpeechSynthesisServer
Microsoft Database Daemon
EvernoteHelper
ScreenFlowHelper
AdobeResourceSynchronizer
ScreenFlowHelper
Dropbox
Google Drive
AirDisplayStatusItem
ScreenCapture
Air Display Host
Google Chrome
fuspredownloader
3rd Party Preference Panes:
Flash Player
Flip4Mac WMV
GPGPreferences
Pastebot Sync
Internet Plug-ins::
Flip4Mac WMV Plugin: Version: 3.2.0.16 - SDK 10.8
FlashPlayer-10.6: Version: 11.9.900.170 - SDK 10.6
Default Browser: Version: 537 - SDK 10.9
Flash Player: Version: 11.9.900.170 - SDK 10.6
QuickTime Plugin: Version: 7.7.3
o1dbrowserplugin: Version: 4.9.1.16010
npgtpo3dautoplugin: Version: 0.1.44.29 - SDK 10.5
googletalkbrowserplugin: Version: 4.9.1.16010
Silverlight: Version: 5.1.20913.0 - SDK 10.6
User Internet Plug-ins::
WebEx64: Version: 1.0 - SDK 10.6
Google Earth Web Plug-in: Version: 7.1
Bad Fonts:
None
Old applications:
Audacity: Version: 2.0.3.0 - SDK 10.4
/Applications/Audacity/Audacity.app
Cisco WebEx Meetings: Version: 1211.02.2808.0 - SDK 10.5
.../WebEx Folder/12_1324/Meeting Center.app
Keynote: Version: 5.3 - SDK 10.5
/Applications/iWork '09/Keynote.app
Time Machine:
Skip System Files: NO
Auto backup: YES
Volumes being backed up:
Destinations:
My Passport [Local] (Last used)
Total size: 931.16 GB
Total number of backups: 51
Oldest backup: 2011-12-16 12:40:10 +0000
Last backup: 2013-12-08 09:13:22 +0000
Size of backup disk: Excellent
Backup size 931.16 GB > (Disk size 0 B X 3)
Time Machine details may not be accurate.
All volumes being backed up may not be listed.
Top Processes by CPU:
13% coreaudiod
10% thunderbird
9% GarageBand
3% WindowServer
1% Activity Monitor
Top Processes by Memory:
1.52 GB GarageBand
377 MB thunderbird
360 MB WindowServer
279 MB Preview
197 MB Safari
Virtual Memory Statistics:
7.41 GB Free RAM
5.80 GB Active RAM
858 MB Inactive RAM
1.63 GB Wired RAM
1.57 GB Page-ins
0 B Page-outs -
Windows 8.1 File System Performance Down Compared to Windows 7
I have a good workstation and a fast SSD array as my boot volume.
Ever since installing Windows 8.1 I have found the file system performance to be somewhat slower than that of Windows 7.
There's nothing wrong with my setup - in fact it runs as stably as it did under Windows 7 on the same hardware with a similar configuration.
The NTFS file system simply isn't quite as responsive on Windows 8.1.
For example, under Windows 7 I could open Windows Explorer, navigate to the root folder of C:, select all the files and folders, then choose
Properties. The system would count up all the files in all the folders at a rate of about
30,000 files per second
the first time, then about 50,000 files per second the next time, when all the file system data was already cached in RAM.
Windows 8.1 will enumerate roughly
10,000 files per second the first time, and around
18,000 files per second the second time -
a roughly 1 to 3 slowdown. The reduced speed once the data is cached in RAM implies that something in the operating system is the bottleneck.
Not every operation is slower. I've benchmarked raw disk I/O, and Windows 8.1 can sustain almost the same data rate, though the top speed is a little lower. For example, Windows 7 vs. 8 comparisons using the ATTO speed benchmark:
Windows 7:
Windows 8:
-Noel
Detailed how-to in my eBooks:
Configure The Windows 7 "To Work" Options
Configure The Windows 8 "To Work" OptionsNo worries, and thanks for your response.
The problem can be characterized most quickly by the slowdown in enumerating files in folders. Unfortunately, besides some benchmarks that show only an incremental degradation in file read/write performance, I don't have any good before/after
measurements of other actual file operations.
Since posting the above I have verified:
My system has 8dot3 support disbled (same as my Windows 7 setup did).
Core Parking is disabled; CPU benchmarks are roughly equivalent to what they were.
File system caching is configured the same.
CHKDSK reports no problems
C:\TEMP>fsutil fsinfo ntfsInfo C:
NTFS Volume Serial Number : 0xdc00eddf00edc11e
NTFS Version : 3.1
LFS Version : 2.0
Number Sectors : 0x00000000df846fff
Total Clusters : 0x000000001bf08dff
Free Clusters : 0x000000000c9c57c5
Total Reserved : 0x0000000000001020
Bytes Per Sector : 512
Bytes Per Physical Sector : 512
Bytes Per Cluster : 4096
Bytes Per FileRecord Segment : 1024
Clusters Per FileRecord Segment : 0
Mft Valid Data Length : 0x0000000053f00000
Mft Start Lcn : 0x00000000000c0000
Mft2 Start Lcn : 0x0000000000000002
Mft Zone Start : 0x0000000008ad8180
Mft Zone End : 0x0000000008ade6a0
Resource Manager Identifier : 2AFD1794-8CEE-11E1-90F4-005056C00008
C:\TEMP>fsutil fsinfo volumeinfo c:
Volume Name : C - NoelC4 SSD
Volume Serial Number : 0xedc11e
Max Component Length : 255
File System Name : NTFS
Is ReadWrite
Supports Case-sensitive filenames
Preserves Case of filenames
Supports Unicode in filenames
Preserves & Enforces ACL's
Supports file-based Compression
Supports Disk Quotas
Supports Sparse files
Supports Reparse Points
Supports Object Identifiers
Supports Encrypted File System
Supports Named Streams
Supports Transactions
Supports Hard Links
Supports Extended Attributes
Supports Open By FileID
Supports USN Journal
I am continuing to investigate:
Whether file system fragmentation could be an issue. I think not, since I measured the slowdown immediately after installing Windows 8.1.
All of the settings in HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\FileSystem
Thank you in advance for any and all suggestions.
-Noel
Detailed how-to in my eBooks:
Configure The Windows 7 "To Work" Options
Configure The Windows 8 "To Work" Options -
Solaris File System/Device Management Information
Hi All,
I a writing a paper about the Solaris operating system and require information about the file system and device management of Solaris 8.
File Management:
I am looking for information or links to sites that would help me find more information about the solaris file system architecture, how it uses drive space, and some of the features of the Solaris file system
Device Management:
I am also looking for information or website links that cover how Solaris talks to devices (overview) and other device management architecture information.
any help is appreciated!Don't use cp because it converts soft links into hard files. Its even worse when you have cyclic soft links. Use tar or cpio and you should be ok.
i.e. If you have a soft link to a file of 10G, a cp will result in 20G. -
Hi All,
While trying to use df -k command in my solaris box, I am getting output shown as below.
Filesystem 1024-blocks Used Available Capacity Mounted on
rpool/ROOT/solaris-161 191987712 6004395 140577816 5% /
/devices 0 0 0 0% /devices
/dev 0 0 0 0% /dev
ctfs 0 0 0 0% /system/contract
proc 0 0 0 0% /proc
mnttab 0 0 0 0% /etc/mnttab
swap 4184236 496 4183740 1% /system/volatile
objfs 0 0 0 0% /system/object
sharefs 0 0 0 0% /etc/dfs/sharetab
/usr/lib/libc/libc_hwcap1.so.1 146582211 6004395 140577816 5% /lib/libc.so.1
fd 0 0 0 0% /dev/fd
swap 4183784 60 4183724 1% /tmp
rpool/export 191987712 35 140577816 1% /export
rpool/export/home 191987712 32 140577816 1% /export/home
rpool/export/home/123 191987712 13108813 140577816 9% /export/home/123
rpool/export/repo 191987712 11187204 140577816 8% /export/repo
rpool/export/repo2010_11 191987712 31 140577816 1% /export/repo2010_11
rpool 191987712 5238974 140577816 4% /rpool
/export/home/123 153686630 13108813 140577816 9% /home/12
My question here is why /usr/lib/libc/libc_hwcap1.so.1 file system is having same size as that of / root filesystem? and what is the significance of /usr/lib/libc/libc_hwcap1.so.1 file system..
Thanks in Advance for your help..You must have a lot of small files on the file system.
There are couple of ways, the simplest is to increase the size of the filesystem.
Or if you can create a new filesystem, but increase the inode count so you can utilize the space and still have enough inodes. Check out the man page mkfs_ufs and the option nbpi=n
my 2 bits -
Can we protect the file system (folder level protection) in Solaris box using access manager?
patrickez wrote:
If I install Solaris 10 on a x86 platform and add a bunch of drives to it to create a zpool (raidz), how do I protect my root filesystem?Solaris 10 doesn't yet support ZFS for a root filesystem, but it is working in some OpenSolaris distributions.
You could use Sun Volume Manager to create a mirror for your root filesystem.
The files in the ZFS file system are well protected, but what about my operating system files down in the root ufs filesystem? If the root filesystem gets corrupted, do I lose the zfs filesystem too?No. They're separate filesystems.
or can I independantly rebuild the root filesystem and just remount the zfs filesystem? Yes. (Actually, you can import the ZFS pool you created).
Should I install solaris 10 on a mirrored set of drives?If you have one, that would work as well.
Can the root filesystem be zfs too?Not currently in Solaris 10. The initial root support in OpenSolaris will require the root pool be only a single disk or mirrors. No striping, no raidz.
Darren -
Solaris File System/ Virtual File system Documentation
can anybody help me in finding solaris virtual file system documentaion/books ?
thanks in advance,
-mayurAFAIK, the VFS is not an official (and documented) interface
and may change from solaris release to solaris release
(perhaps even with a new kernel patch).
Other, you can probably get the Solaris 8 Foundation Source,
and use it as the definitive reference documentation ;-) -
File system for SAP ECC, EP , BI and CRM installation on Solaris/DB2
Hello,
We are going to implement SAP ECC 6.0 with EP 7, BI and CRM on Solaris operating system with IBM DB2 database.
All these applications are going to be installed on single server, as being a basis person, I know this is not all recommended.
But due to client's requirement and keeping cost factor in mind I need to install all these application on single box.
Now here I need your help. as I basis person, I know the required Solaris file system for SAP ECC 6.0 but not having any Idea about other application like EP/ CRM and BI .
If anyone able to help me with required Solaris file system. it will be great help.
Please let me know if there is any query.
Thanks.> All these applications are going to be installed on single server, as being a basis person, I know this is not all recommended.
> But due to client's requirement and keeping cost factor in mind I need to install all these application on single box.
Why not using Solaris zones/container? This decreases the administrative amount tremendeously since you will deal as with "single machines" but they all run together on one box.
> Now here I need your help. as I basis person, I know the required Solaris file system for SAP ECC 6.0 but not having any Idea about other application like EP/ CRM and BI .
So you'd need to read the installation guides
Markus -
File Systems are not shown in CCMS Monitoring
Hi Gurus,
We have installed all SAP components in Solaris 10 zones including Solution Manager.
Solaris File Systems are not shown in CCMS Monitoring under FileSystem. It looks like SAPOSCOL is not sending the OS data to CCMS. It does not show file systems in OS06 also.
The probles exists on Systems runnig in Solaris 10 zones only and NOT on systems running on individual Servers. [without Solaris zones]
Thanks,
PjHi,
You need take some special considerations while installing SOLMAN on SOLARIS 10 zones. Check these notes
Note 870652 - Installation of SAP in a Solaris 10 zone
Note 724713 - parameter settings for Solaris 10
Hope this will solve your problem.
--Ragu -
Accessing FAT and NTFS file systems in same machine
hi
i m new in solaris
is it possible to access my windows file system in solaris.
file systems are FAT and NTFS.
regardsYou should be able to mount FAT filesystems as type pcfs.
Theres no native support for NTFS, but I seem to remember a project working on that.
So google for solaris NTFS will probably find it.. -
Warming up File System Cache for BDB Performance
Hi,
We are using BDB DPL - JE package for our application.
With our current machine configuration, we have
1) 64 GB RAM
2) 40-50 GB -- Berkley DB Data Size
To warm up File System Cache, we cat the .jdb files to /dev/null (To minimize the disk access)
e.g
// Read all jdb files in the directory
p = Runtime.getRuntime().exec("cat " + dirPath + "*.jdb >/dev/null 2>&1");
Our application checks if new data is available every 15 minutes, If new Data is available then it clears all old reference and loads new data along with Cat *.jdb > /dev/null
I would like to know that if something like this can be done to improve the BDB Read performance, if not is there any better method to Warm Up File System Cache ?
Thanks,We've done a lot of performance testing with how to best utilize memory to maximize BDB performance.
You'll get the best and most predictable performance by having everything in the DB cache. If the on-disk size of 40-50GB that you mention includes the default 50% utilization, then it should be able to fit. I probably wouldn't use a JVM larger than 56GB and a database cache percentage larger than 80%. But this depends a lot on the size of the keys and values in the database. The larger the keys and values, the closer the DB cache size will be to the on disk size. The preload option that Charles points out can pull everything into the cache to get to peak performance as soon as possible, but depending on your disk subsystem this still might take 30+ minutes.
If everything does not fit in the DB cache, then your best bet is to devote as much memory as possible to the file system cache. You'll still need a large enough database cache to store the internal nodes of the btree databases. For our application and a dataset of this size, this would mean a JVM of about 5GB and a database cache percentage around 50%.
I would also experiment with using CacheMode.EVICT_LN or even CacheMode.EVICT_BIN to reduce the presure on the garbage collector. If you have something in the file system cache, you'll get reasonably fast access to it (maybe 25-50% as fast as if it's in the database cache whereas pulling it from disk is 1-5% as fast), so unless you have very high locality between requests you might not want to put it into the database cache. What we found was that data was pulled in from disk, put into the DB cache, stayed there long enough to be promoted during GC to the old generation, and then it was evicted from the DB cache. This long-lived garbage put a lot of strain on the garbage collector, and led to very high stop-the-world GC times. If your application doesn't have latency requirements, then this might not matter as much to you. By setting the cache mode for a database to CacheMode.EVICT_LN, you effectively tell BDB to not to put the value or (leaf node = LN) into the cache.
Relying on the file system cache is more unpredictable unless you control everything else that happens on the system since it's easy for parts of the BDB database to get evicted. To keep this from happening, I would recommend reading the files more frequently than every 15 minutes. If the files are in the file system cache, then cat'ing them should be fast. (During one test we ran, "cat *.jdb > /dev/null" took 1 minute when the files were on disk, but only 8 seconds when they were in the file system cache.) And if the files are not all in the file system cache, then you want to get them there sooner rather than later. By the way, if you're using Linux, then you can use "echo 1 > /proc/sys/vm/drop_caches" to clear out the file system cache. This might come in handy during testing. Something else to watch out for with ZFS on Solaris is that sequentially reading a large file might not pull it into the file system cache. To prevent the cache from being polluted, it assumes that sequentially reading through a large file doesn't imply that you're going to do a lot of random reads in that file later, so "cat *.jdb > /dev/null" might not pull the files into the ZFS cache.
That sums up our experience with using the file system cache for BDB data, but I don't know how much of it will translate to your application. -
Removing file system from meta devices in solaris 10
hi,
I have created a file system on meta device in solaris 10 using below command
newfs /dev/md/rdsk/d110
now i want to remove file system to make the meta device free, required command to remove file system ?
Regards
ZeeshanThanks for your response , actually i have performed the below steps to release the space from mount point /u05 which i want to make the space as raw device so that i can use it for ASM , so my question is that how can i unformat the file system so that it can be a raw device.
umount /u05
metaclear d110
(Now i have the below two metadevices 500gb each which i want to use as raw device so that i can allocate it to ASM (Automatic Storage management). So how can we make it as raw device ??
/dev/dsk/emcpower17a
/dev/dsk/emcpower17a -
Solaris 10 - After installation read only file system
Dear All,
I have installed the Solaris 10 on my x86 system with out any problem. The installation was completed successfully. I have followed the installation instructions that are mentioned in the following link.
http://docs.sun.com/app/docs/doc/817-0544/6mgbagb19?a=view
I am facing a different problem. I am not able to create even a single file / sub-directory on any of the existing directories. It always says READ ONLY file system can not create firl / directory.
Please help me how to resolve this issue.
Thanks in advance.
Regards,
Srinivas GWhat do you get for 'svcs -xv' output?
Darren -
I have a HDD under MS-DOS, which claims transfer speeds above and beyond of 480MB/s, but the actual speeds I have been getting are closer to 300kB/s. Is there a way to improve this merely by reformatting volume to another file system?
If you don't need to use it with PCs, copy any data you want to keep off and reformat it as Mac OS Extended (Journaled). Also, since it seems to be connected through USB 2.0, unplug all unnecessary devices when transferring data to improve performance.
(62387) -
How to determine the file system on Solaris
Friends,
How to determine which file system I have installed UFS or ZFS on Solaris
ThanksOther methods would include looking at the /etc/vfstab if it's in there or fstyp(1M):
System Administration Commands fstyp(1M)
NAME
fstyp - determine file system type
SYNOPSIS
fstyp [-a | -v] special [:logical-drive]
Maybe you are looking for
-
Some genius appears to have decided that (unlike almost every other email system... you know, the useful ones) emails should be threaded by "subject" rather than the reply chain of a particular message. This means that all emails with the same "subj
-
Preventing access to Windows Update website on Windows 7
We run a WSUS server locally and I want to prevent users from accessing the windows update web page via IE or via the "Check online for updates from Windows Update" link on the WU control panel. For our XP systems, there is a group policy setting und
-
IOS 6 Buggy and Slow hot to downgrade.
i recently updated to IOS6 the yesterday and it it running really slow on my iphone 4s also the phone is hot when running apps. maps is not working properly and text messages are failing and talking a long time to send/recive.icalled apple to be told
-
I want to upload photos to hosting sites without making extra copies
Someone please answer this. Or fix it. Or something. I can't believe that I have to clutter up my drive/life and use six times as many steps in order to share a single photo. How can I find my photos using the usual search protocol for a site like Ph
-
Output type specific conditions
Hi, I was curious if there's a way on the report template to put an if-statement/condition based on the output type? EG. if the output type is EXCEL do not display image_1234.jpg else display image_1234.jpg Thanks!