Airdisk Performance with small files

I was curious if anyone else it noticing the unique performance issues I am.
I am using a LaCie hardware 1.0TB Raid5 Array: http://www.lacie.com/us/products/product.htm?pid=10326
It shows up properly, however the setup appears to create new files very slowly. If I transfer a large file (movie/mp3/etc) performance is fine, however if it literally takes 5+ seconds to create a new file. On a large file... this isn't a big deal, however it makes transfer a .app (which contains several files) or documents performance go very slow.
None of this occurs with the drive attach locally.
Has anyone else seen this?

I have the same issue and it is killing our iCal Server performance.
My question would be, can you edit an XSAN Volume without destroying the data?
There is one setting that I think might ease the pressure... in the Cache Settings (Volumes -> <Right-Click Volume> -> Edit Volume Settings)
Would increasing the amount of Cache help? Would it destroy the data?!?!?

Similar Messages

Poor performance with small files on Xsan volume

Since I'm running on Xsan for with network users and server shares, I have various problems.
Users complaining on slow logins, Word files that have saving errors. For the Word problem, there are a lot tricks like .TemporaryItems with acl.
But I think there's another reason. My mobile home users are not yet using the new home server with mobile homes. Today I migrated my own account to the new server en syncing is very slow on files from my iCal server and mail archive.
So I did a test on the servers that are connected to the san. The backup servers has the san volume mounted and some old Xraids for backup storage. If I duplicate my iCal folder (8000 files) it takes 8 minutes in the Xsan volume. On an Xraid, less than 30 seconds. If I duplicate 1 2.5GB diskimage file on the san volume, it does it in less than 10 seconds.
My Xsan setup:
All Intel Xserves
1 MD server dedicated (4GB Atto FC)
1 OD server and server shares (and backup MD controller) (4GB Atto FC)
1 home folder server (4GB Atto FC)
1 backup server (also MD backup controller) (4GB Apple FC card)
2 Promise Vtraks with 16X 750 GB disks
1 MD lun (2disks mirrored) (Own FC controller)
2 Data luns (8.87 TB each lun) (Each own FC controller)
Xsan setup is done with configuration for home directories.
Block allocation size: 8kb Round Robin
Separate ethernet metadata network.
I hope someone can give me some pointers.
Patrick

I have the same issue and it is killing our iCal Server performance.
My question would be, can you edit an XSAN Volume without destroying the data?
There is one setting that I think might ease the pressure... in the Cache Settings (Volumes -> <Right-Click Volume> -> Edit Volume Settings)
Would increasing the amount of Cache help? Would it destroy the data?!?!?

Fop 0.19 problems with small files?

Hello!
I have a problem with fop 0.19 serializer: when I try to generate
pdf files smaller then cca. 10kB, IE does not open Acrobat
Reader, and sometimes even freezes. With larger files, it works
OK.
My configuration:
Tomcat 3.2
XDK 9.0.2.0b
fop 0.19
Thanks in advance!
Vedran

Hi Eric/Steve,
I have downloaded the Xml development kit for Java (9.0.2.0.0C
beta) and created a new xsql RTF-serializer class according to
the XSQLSampleSerializer included in the xsqlserializer.jar file.
I also included Eric's CustFOP-serializer.
I can compile my new class with JDeveloper but when i recreate
the xsqlserializer.jar and try to use this jar-file with the
xsql servlet i get an error.
The error is "XSQL-022: cannot load serializer class
oracle.xml.xsql.serializers.XSQLxxxSerializer", with xxx my own
serializer, but also when i use the original FOP-serializer.
So i think the jar-file is not correct.
Can anyone tell me how to recreate the xsqlserializer.jar or
tell me what else i have done wrong?
(I also posted this question in the JDeveloper-forum)

Ntsc to pal conversions with small file sizes

I'm trying to convert a file from NTSC to PAL, which I have done successfully in the past. However, the file needs to be under 200MB (the video is 3.40) and I can not seem to get it any lower than 346 MB using the dv-pal setting and everything as low as possible and the sound set to mono. Any suggestions?
Thanks,
Christy

DV PAL is a set data rate - 3.56 MB/s when run at 25 fps.
If you want a smaller file size you have two choices -
1. convert the file to another codec that allows for smaller frame sizes, slower frame rates and increased intra and inter frame compression.
2. If it must be DV/PAL, cut the length of the video to reach your 200mb limit.
Of course there is the third choice of simply giving them the larger file because that's what an un-compromised DV/PAL version of the file will be.
x

AP3 Performance with RAW files on Mac Mini

Here is a quick summary of my specs:
Aperture 3.0.3 on Mac Mini Core 2 Duo 2.0 Ghz with 4GB RAM
Aperture Library - ~ 200GB managed library
The issue: I have recently started shooting more RAW than JPEG and when I am simply previewing the files in a window, it is taking at least 1-2 seconds for the photo to load. I have always had "slowness" with some of the brushes etc. I JUST did the whole defrag thing last night in hopes of screaming performance but it didn't happen.
Anybody else finding similar issue with similar hardware?? I am tempted to get the new iMac, but will be pi$$ed if it has the same issues....
Thanks,
Erik

Late 2009 Mini, 2.6 GHz, 4GB RAM, 500 GB HD, 150 GB Managed library.
If I bring up an image and then just step through the library, it will take between 1 and 5 seconds to load the image; less for JPEG more for 100 MB TIFF (And I have lots of scanned slides.)
That is about the slowest thing I do. Brushes will take a second or two to take effect, but then are fast thereafter. I usually have Safari and Mail running at the same time. Popping up a hundred thumbs is happens about as fast as I can scroll.
Frankly, I have been amazed at the performance of this little box.
Granted, I tend to run iDefrag after every major upload of images.
DiploStrat

Very Slow performance with large files

Using iTunes with my AppleTV I've been in the slow and painful process of digitizing my dvd library and when converting the LOTR (extended edition) trilogy I ran into a problem post-conversion. They play fine in Quicktime 7.3.1, I can add them to the iTunes library but when attempting to edit any information within iTunes and attempting to save iTunes freezes for several minutes before working or crashing (odds are around 50/50). If I just add the file to the library and try to play it the movie doesn't show up on the AppleTV either which is even stranger.
Output format of the movie: MP4/H.264, native 720x480 resolution, 23.97fps, 2Mbps video stream, 128k audio stream(limit of winavi).
Output Size: 4.4GB
Length: 4hours 24minutes
Software versions: iTunes 7.3.1, QuickTime 7.3.1
OS: Windows XP Pro SP2(current patch level as of 7/15).

Is possible than iTunes have 4 Gb folder limits. I'm trying put a little of light over the problem because iTunes Help don't said.
Cheers

Balance Image Quality with Small File Size

I need to first express that I'm a fully self-taught Flash designer. No one has ever sat down and tried to explain to me the DOs and DONTs about Flash. I have followed tutorials, books, and anything else I can get my hands on, but never a person. People of Flash seem to be very hard to find, in my personal experience.
I am the most comfortable with Photoshop, knowing very little about Illustrator or Fireworks.
That said, I have been asked to create a 45KB (yikes!) max file, rotating 3 .jpg images I created from other .jpgs given to me. The images are usually large, so I am given room to compress them for a 300px x 250 px stage.
However, these images are always my biggest culprit for my huge file size. I'll import them in, making them into Graphic Symbols, but nothing seems to prevent the enourmous file size.
When given the raw images, I would throw them into Photoshop, make the files the correct 300x250 size. Then I have tried: saving the image at the best resolution in .jpg and .png form, and then I tried saving the images as low-as-I-could-stomach quality. I hardly see a difference with file size when they are imported into Flash and used.
I was told to use Fireworks's Optimize function, which I did, but it made my .swf even bigger!
When I have my Flash piece all set up/animted as I want, but I need to replace the bitmap(.jpg/.png) photos, I will:
right click on the bitmap to get properties, "upload" the new image to be used, adjust the Quality, having "Allow smoothing" unclicked.
I understand I should make as much of the graphics in Flash as I can, instead of Import, but I am primarily given photographs to use.
Seeing what my previous peers have done is mind-puzzling, but they are not around, so I cannot ask them for their advice. Their files are under 45KB and look sharp and amazing:
http://creative.freedominteractive.com/clients/atep/banners2/
http://creative.freedominteractive.com/clients/fountainvalleyschool/banners/
http://creative.freedominteractive.com/clients/BranchGymnastics/
I am hoping someone can help me get my .jpg files under control. Thank you in advance for your help.

You're certainly on the right track by sizing and optimizing the photos in Photoshop. Are you using optimize for web or save as? Jpgs are your best bet, I find the a 40 quality is just about the point the quality starts badly degrading. In Flash, the only other things you didn't mention is the frame rate and JPEG compression setting in publish settings. Frame rate has a bigger impact on file size than the additional compression. Also, are you using keyframes for teed ing or the AS tween class? This I don't know for sure if it affects file size, but it just seems that motion Tweens with keyframes would add to the size. How far away from the target are you?

Duplicating images with smaller file size

How do I duplicate an image with a reduced file size without exporting?

If you right-click (control-click) on an image, you have the option to:
1) Duplicate Version
2) New Version from Master
Whichever you choose, you're only creating an additional "preview" that the system uses for editing, sharing, etc. It does not "create" a completely new image. Thereby keeping storage overhead to a minimum.
I guess what might be a pertinent question is, what are you wanting to do with the image?
Cheers
Kent

Problem with Struts file upload with small files

For some reason, when I try to upload a file that is smaller than 45 bytes using Struts (took me a long time to find this number), by the time the file is populated in my form bean and I read the size from it, the size is 0. Has anyone encountered this problem before?
I created a file called test.txt, which contained the following text in it: "This is a test.". This file is about 15 bytes in size. When I was trying to upload this file using Struts, and write it to a temp file, my temp file always was of size 0. At first I was convinced it was my code, but then I tried a Word file (about 19kb), and it worked fine. Finally, I added some debug code at the beginning of my execute() method in my action to print out all the metadata for uploaded files, and I saw the the file size was 0 for files smaller than 45 bytes. I printed this just after I cast the form to be the type of form that I needed. What is happening to the contents of the file? Does Struts have a minimum size limit of files that it is able to process?
Any help is greatly appreciated!

AFter some more testing, I found that this is only a problem when using Firefox and Netscape. When using IE, files as small as 1 byte were properly uploaded, and the size was accurate when queried from FormFile.getFileSize().
Does anyone have any ideas as to what may be happening in this case? Why it would work fine in one browser and not the other?

Edit with Small Files, Finish with Big - How? (CS4)

I've been shooting a project in 1080 AVCHD and PP CS4 works fine editing them on my desktop system.
My laptop: not so much.
I'd like to make small-sized copies of my source clips and edit them in CS4 on my laptop while traveling -- then once the cut is done (or mostly done), move the same project to the desktop machine, swap-in the original source clips, and deliver from those. A bit like the old days of online/offline or having your film negative conformed to your workprint edit.
How? "Conforming" seems to mean something completely different in CS4, is there some keyword I should search for?
Thanks.

I think the word you want is " Proxy "
Here is a link for After Effects but the info should help you find what you want.
http://help.adobe.com/en_US/AfterEffects/9.0/WSB356ACD2-AF59-4604-B378-31D687DB5ACCa.html
ENjoy: GLenn

Alu 2s fails at copying many small files

Hi,
when I transfer big files I get nice speeds and have no problems around 80MB/S)
But then I wanted to backup my mail directory that contains many small (few kb) email files - around 40.000
Speed drops to like 5MB/S. I know it's supposed to drop with small files but this seems a bit extreme.
When copying is done, the LED keeps flashing.
When I try to copy a larger file afterwars, the speed is around 1mb/s.
The LED keeps blinking even when no files are transferred.
When I force unmount the drive and reconnect, many files are filled with null's, so obviously it didn't complete the writing process properly.
I waited over 30mins but the LED keeps blinking, software unmount doesn't work in this state.
Is this like, a known bug? It's really nerving.
First the annoying virtual CD drive and now this.
I'm very disappointed.

Hi
Try to defragment the external HDD
You can use the internal Windows Disk Defragmenter which can be found in
All Programs -> Accessories -> System tools

Wpg_docload fails with "large" files

Hi people,
I have an application that allows the user to query and download files stored in an external application server that exposes its functionality via webservices. There's a lot of overhead involved:
1. The user queries the file from the application and gets a link that allows her to download the file. She clicks on it.
2. Oracle submits a request to the webservice and gets a XML response back. One of the elements of the XML response is an embedded XML document itself, and one of its elements is the file, encoded in base64.
3. The embedded XML document is extracted from the response, and the contents of the file are stored into a CLOB.
4. The CLOB is converted into a BLOB.
5. The BLOB is pushed to the client.
Problem is, it only works with "small" files, less than 50 KB. With "large" files (more than 50 KB), the user clicks on the download link and about one second later, gets a
The requested URL /apex/SCHEMA.GET_FILE was not found on this serverWhen I run the webservice outside Oracle, it works fine. I suppose it has to do with PGA/SGA tuning.
It looks a lot like the problem described at this Ask Tom question.
Here's my slightly modified code (XMLRPC_API is based on Jason Straub's excellent [Flexible Web Service API|http://jastraub.blogspot.com/2008/06/flexible-web-service-api.html]):
CREATE OR REPLACE PROCEDURE get_file ( p_file_id IN NUMBER )
IS
    l_url                  VARCHAR2( 255 );
    l_envelope             CLOB;
    l_xml                  XMLTYPE;
    l_xml_cooked           XMLTYPE;
    l_val                  CLOB;
    l_length               NUMBER;
    l_filename             VARCHAR2( 2000 );
    l_filename_with_path   VARCHAR2( 2000 );
    l_file_blob            BLOB;
BEGIN
    SELECT FILENAME, FILENAME_WITH_PATH
      INTO l_filename, l_filename_with_path
      FROM MY_FILES
     WHERE FILE_ID = p_file_id;
    l_envelope := q'!<?xml version="1.0"?>!';
    l_envelope := l_envelope || '<methodCall>';
    l_envelope := l_envelope || '<methodName>getfile</methodName>';
    l_envelope := l_envelope || '<params>';
    l_envelope := l_envelope || '<param>';
    l_envelope := l_envelope || '<value><string>' || l_filename_with_path || '</string></value>';
    l_envelope := l_envelope || '</param>';
    l_envelope := l_envelope || '</params>';
    l_envelope := l_envelope || '</methodCall>';
    l_url := 'http://127.0.0.1/ws/xmlrpc_server.php';
    -- Download XML response from webservice. The file content is in an embedded XML document encoded in base64
    l_xml := XMLRPC_API.make_request( p_url      => l_url,
                                      p_envelope => l_envelope );
    -- Extract the embedded XML document from the XML response into a CLOB
    l_val := DBMS_XMLGEN.convert( l_xml.extract('/methodResponse/params/param/value/string/text()').getclobval(), 1 );
    -- Make a XML document out of the extracted CLOB
    l_xml := xmltype.createxml( l_val );
    -- Get the actual content of the file from the XML
    l_val := DBMS_XMLGEN.convert( l_xml.extract('/downloadResult/contents/text()').getclobval(), 1 );
    -- Convert from CLOB to BLOB
    l_file_blob := XMLRPC_API.clobbase642blob( l_val );
    -- Figure out how big the file is
    l_length    := DBMS_LOB.getlength( l_file_blob );
    -- Push the file to the client
    owa_util.mime_header( 'application/octet', FALSE );
    htp.p( 'Content-length: ' || l_length );
    htp.p( 'Content-Disposition: attachment;filename="' || l_filename || '"' );
    owa_util.http_header_close;
    wpg_docload.download_file( l_file_blob );
END get_file;
/I'm running XE, PGA is 200 MB, SGA is 800 MB. Any ideas?
Regards,
Georger

Script: http://www.indesignsecrets.com/downloads/MultiPageImporter2.5JJB.jsx.zip
It works great for files upto ~400 pages, when have more pages than that, is when I get the crash at around page 332 .
Thanks

Need help. I am running a 27 in imac with 16 gigs of ram. Photoshop runs really fast, except when opening files. It takes 5-10 minutes to open even a small file of 1 meg. I cleaned and validated all the fonts and removed all questionable fonts. Reset pref

Need help. I am running a 27 in imac with 16 gigs of ram. Photoshop runs really fast, except when opening files. It takes 5-10 minutes to open even a small file of 1 meg. I cleaned and validated all the fonts and removed all questionable fonts. Reset preferences and still have problem. Slow to open and in force quit "Photoshop not responding" At this point should I uninstall and start over.

What are the performance Preferences?

"Performance" problems with the File adapter on Plain J2SE Adapter Engine

Hi,
At the moment I'm on a customer side to solve some XI issues for a few days. One of the issues is the performance of the Plain J2SE Adapter Engine, using the file adapter to transfer XML messages(already XI message format) from the legacy system to the Integration Engine. The File adapter has to deal with "large" XML messages(max at the moment is 65 Mb) and the engine fails with the following error when transferring the big XML file: "ERROR: Finished sending to Integration Engine with error "java.lang.OutOfMemoryError". Skip confirmation and quit this loop".
As far I got the information from the customer the memory use of the Plain adapter engine is set to 512Mb. This is maybe to low. But I don't know where to look for this, I only have the adapter web interface in front of me, no access to the OS it self via for example remote connection.
On the Integration Engine I know there is the ability to split large message with the file adapter(File Content Conversion), but I don't know this for the Plain Adapter Engine. Is there a possibility to do this also on the Plain Adapter Engine?
Thanks in advance for any input.
Greetings,
Patrick

Hi Sameer,
Thanks for your answers.
On the first solution, yes that is possible, we first decided to see if the legacy system can do the splitting, before starting developing a Java program.
On the second solution, as far as I know is this solution possible on the Integration Engine. But we are facing the problems on the Plain J2SE Adapter Engine. I went trough that documentation(link:
http://help.sap.com/saphelp_nw04/helpdata/en/6f/246b3de666930fe10000000a114084/frameset.htm ), to look for I similiar solution in the Plain Adapter Engine. So my question is, is this possible with the Plain Adapter? And if so, what kind of parameters I need to use to achieve this.
Regards,
Patrick

Error processing cube - requested operation cannot be performed on a file with a user-mapped section open

Hi,
We have recently moved our production servers and since the move have been experiencing an intermittent (but frequent) error when processing our OLAP cube.
The error messages presented are:
"Error: The following error occurred during a file operation: The requested operation cannot be performed on a file with a user-mapped section open"
"Error: Errors in the OLAP storage engine: An error occurred while processing index for the <Partition Name> partition of the <Measure Group Name> measure group of the <Cube Name> cube from the <Database Name> database"
I assume the second message is a consequence of the first error. The partitions and measure groups seem to vary each time the process is run.
It appears from similar threads that this is usually caused by backups or anti-virus applications locking the files that Analysis Services is using the process the cube. I have ensured that there are no backups running at the time of processing and
I have disabled anti-virus programs without success.
I have also created a new version of the cube (using the deployment wizard) which deployed without error but then encountered the same error when processing for a second time. There was nothing (client application wise) using this cube when it failed
to process.
As I mentioned earlier, this problem is intermittent. Sometimes the cube will successfully process but usually it fails to process.
We have not encountered this error in our previous production environment or in any of our development environments.
Has anyone encountered this problem before? Any suggestions on possible solutions?
Thanks
Rich

Hi jonesri,
I think you can try to use SSAS Dynamic Management View to monitor SSAS instance, such as existing connections and sessions. For example, please run the following MDX query:
SELECT[SESSION_COMMAND_COUNT],
[SESSION_CONNECTION_ID],
[SESSION_CPU_TIME_MS],
[SESSION_CURRENT_DATABASE],
[SESSION_ELAPSED_TIME_MS],
[SESSION_ID],
[SESSION_IDLE_TIME_MS],
[SESSION_LAST_COMMAND],
[SESSION_LAST_COMMAND_CPU_TIME_MS],
[SESSION_LAST_COMMAND_ELAPSED_TIME_MS],
[SESSION_LAST_COMMAND_END_TIME],
[SESSION_LAST_COMMAND_START_TIME],
[SESSION_PROPERTIES],[SESSION_READ_KB],
[SESSION_READS],[SESSION_SPID],
[SESSION_START_TIME],[SESSION_STATUS],
[SESSION_USED_MEMORY],
[SESSION_USER_NAME],
[SESSION_WRITE_KB],
[SESSION_WRITES]
FROM $SYSTEM.DISCOVER_SESSIONS
Use Dynamic Management Views (DMVs) to Monitor Analysis Services:
http://msdn.microsoft.com/en-us/library/hh230820.aspx
In addition, you can aslo use SQL Profiler to capture some events for further investigation.
Use SQL Server Profiler to Monitor Analysis Services:
http://technet.microsoft.com/en-us/library/ms174946.aspx
If you have any feedback on our support, please click
here.
Regards,
Regards,
Elvis Long
TechNet Community Support

Airdisk Performance with small files

Similar Messages

Maybe you are looking for