I/O Buffer Size for files transfers

Hello,
Do you know how to change I/O Buffer size ?
I use large data transfers from my macbook to volumes of an afp OS X 10.5.8 Leopard.
Since 10.6.4 upgrade, my files transfers on the internal network slows down. Around 2Mo/s. It was best before.
I suppose that size of the packets of datas has ben reduced, and I would like to run comparative tests with various values.

At first, first advantage is that the software document how is implemented standard OS set-up :
- The system parameters are sysctl variables that are set as follows:
net.inet.tcp.sendspace: 131072
net.inet.tcp.recvspace: 358400
kern.ipc.maxsockbuf: 512000
so : Packets of files copied on the finder are by default : 512k large. This is also visible during copies.
With the new set-up, this size is increased to 1024k. I've not found exactly in wich file are saved these system parameters.
After the buffer size change, the file copy speed is not enough improved : finally, interest of the change is not very high.

Similar Messages

What is block size for dma transfers? Can it be set?

Can't find Application Note 011, "DMA Fundamental on Various PC Platforms" on the NI website.
Can someone please send me the link?
What I'm trying to figure out is what is the packet size (chunk size) for DMA transfers on NI M series boards?
i.e. how many samples are collected into the boards FIFO buffer before
DMA transfer takes place. (How many samples (or bytes) are
transferred at a time?)
Is this packet size (chunk size) configurable? If so , what is minimum value that it can take on?
Thanks,
Maurice

See post at http://forums.ni.com/ni/board/message?board.id=170&message.id=162527.

Minimum block size for DMA transfers

Can't find Application Note 011, "DMA Fundamental on Various PC Platforms" on the NI website.
Can someone please send me the link?
What I'm trying to figure out is what is the packet size (chunk size) for DMA transfers on NI M series boards?
i.e. how many samples are collected into the boards FIFO buffer before
DMA transfer takes place. (How many samples (or bytes) are
transferred at a time.
Is this packet size (chunk size) configurable? If so , what is minimum value that it can take on?
Thanks,
Maurice

See post at http://forums.ni.com/ni/board/message?board.id=170&message.id=162527.

ALBPM 6.0 : The maximum size for file uploads has been exceeded.

Hi,
I use AquaLogic BPM Entreprise server to deploy my Process. When I try to publish a process on my server I get the following error:
An unexpected error ocurred.
The error's technical description is:
"javax.servlet.jsp.JspException: null"
Possible causes are:
The maximum size for file uploads has been exceeded.
If you are trying to publish an exported project you should publish it using the remote project option.
If you are trying to upload the participant's photo you should choose a smaller one.
An internal error has ocurred, please contact support attaching this page's source code.
Has someone resolve it?
Thank's.

Hi,
Sure you've figured this out by now, but when you get the "Maximum size for file uploads" error during publish consider:
1. if your export project file is over 10mb, use "Remote Project" (instead of "Exported Project") as the publication source. That way when you select the remote project, you will point to ".fpr" directory of the project you are trying to publish.
Most times your project is not on a network drive that the server has access to. If this is the case, upload the .exp file to the machine where the Process Administrator is running, then expand it in any directory (just unzip the file). Then, from the Process Administrator, use the option to publish a Remote Project by entering the path to the .fpr directory you just created when unzipping the project.
2. Check to see if you have cataloged any jars and marked them as non-versionable. Most of the times the project size is big just because of the external jar files. So as a best practice, when you do a project export select the option "include only-versionable jars", that will get reduce the project size considerably (usually to Kb's). Of course you have to manually copy the Jar files to your Ext folder.
hth,
Dan

Buffer size for SQL statement using JDBC calls

I need to find out the buffer size for SQL statements in jave/JDBC because I need to insert or update a field that could be up to 4KB in size.

I'm not sure that I follow the question; I'm not sure which buffer size you're referring to.
If you have a field that can store up to 4k worth of data, you would create a VARCHAR2(4000) column in the Oracle database (assuming it is character data) or a BLOB column (if the data is binary). Either of those two fields can be populated from JDBC.
Justin
Distributed Database Consulting, Inc.
http://www.ddbcinc.com/askDDBC

How to caluculate buffer size for import/exports in oracle

Hi DBAS,
how to caluculate buffer size for import exports,here is the formula but how can we use if there is a 100 of tables and datatypes,is the any query to find out rows_in_array ,maximum_row_size total schema and datbase
buffer_size = rows_in_array maximum_row_size*
Thanks,
tmadugula

http://download.oracle.com/docs/cd/B10501_01/server.920/a96652/ch01.htm
Search "buffer"

I need to increase my FMS buffer size for display video smoothly

I need to increase my buffer size in FMS.
Please let me know form where i would be increase my FMS buffer size.
My video is running from RTMP and i faces the problem to load. video stalled between the running. so i need to increase buffer size for running video smoothly.
Please reply me as soon as possible so i can resoled my problem.
Thanks in advance.....

Hi,
You can increase the buffer size by using the property bufferTime of NetStream Object you are using. For eg: if ns is your NetStream Object then it can be done by ns.bufferTime=<desired value>.
Also you can go through this
http://livedocs.adobe.com/flash/9.0/ActionScriptLangRefV3/flash/net/NetStream.html#bufferT ime.

Where can I change the buffer size for LKM File to Oracle (EXTRENAL TABLE)?

Hi all,
I'd a problem on the buffer size the "LKM File to Oracle (EXTRENAL TABLE)" as follow:
2801 : 72000 : java.sql.SQLException: ORA-12801: error signaled in parallel query server P000
ORA-29913: error in executing ODCIEXTTABLEFETCH callout
ORA-29400: data cartridge error
KUP-04020: found record longer than buffer size supported, 524288, in D:\OraHome_1\oracledi\demo\file\PARTIAL_SHPT_FIXED_NHF.dat
Do you know where can I change the buffer size?
Remarks: The size of the file is ~2Mb.
Tao

Hi,
The behavior is explained in Bug 4304609 .
You will encounter ORA-29400 & KUP-04020 errors if the RECORDSIZE clause in the access parameters for the ORACLE_LOADER access driver is larger than 10MB and you are loading records larger than 10MB. Which means their is a another limitation on read size of a record which is termed as granule size. If the default granule size is less then RECORDSIZE it limits the size of the read buffer to granule size.
Use the pxxtgranule_size parameter to change the size of the granule to a number larger than the size specified for the read buffer.You can use below query to determine the current size of the granule.
SELECT KSPFTCTXPN PARAMETER_NUMBER,
KSPPINM PARAMETER_NAME,
KSPPITY PARAMETER_TYPE,
KSPFTCTXVL PARAMETER_VALUE,
KSPFTCTXDF IS_DEFAULT,
KSPPIFLG MODIFICATION_FLAG,
KSPFTCTXVF VALUE_FLAG
FROM X$KSPPI X, X$KSPPCV2 Y
WHERE (X.INDX+1) = KSPFTCTXPN AND
KSPPINM LIKE '%_px_xtgranule_size%';
There is no 'ideal' or recommended value for pxxtgranule_size parameter, it is safe to increase it to work around this particular problem. You can set this parameter using ALTER SESSION/SYSTEM command.
SQL> alter system set "_px_xtgranule_size"=10000;
Thanks,
Sutirtha

How to find out the size of files transferred over the SQL * Net?

I am trying to test the Advanced Compress (AC) for 11g Data Guard. When the AC is turned on, the archived log files are supposed to be compressed on the primary database server and sent over SQL*Net, then decompressed on the standby db server. We will see the file sizes are the same on both primary and standby servers. I want to verify that the AC works by monitoring how much data are sent over SQL*Net. Per Oracle, AC uses 35% less of the bandwith. That means the size of the files transferred should be at least 65% of the original size.
Is there a way to find out the size through Oracle utilities? If not, how to find out by OS utilities? OS is Solaris 5.10.
Thanks.

I'm not sure this can be done via SQL*Net, but a network packet sniffer between the two servers should be able to help - you might want to contact your network team.
HTH
Srini

Items In Use for File Transfers

Whenever I transfer several files at a time (7+ or so), I get the error "The operation cannot be complete because the item "(insert filename here)" is in use."
I have tried the lsof command in Terminal with no results. This happens with different files (mainly pictures, as I transfer those in large amounts) and from both local drives and card readers or USB drives. The files are usually being moved to a network attached storage that is in the Finder exceptions for indexing. The files aren't always new, so I do not think finder is indexing them. If I click "ok" (and in doing so cancel the transfer) and start it again, it works just fine (until it decides to hit another file and repeats the process).
It's a very annoying little problem because it forces me to micromanage large file transfers. Any ideas?

As a workaround consider
ditto
Sometimes I get a scrap file in the trash that cannot be deleted for the same reason, although I find no obvious cause. Sometimes it's the mail app and a stray RSS file, but not always. Even then I have to shutdown and restart mail, which is really not acceptable to me.
Usually a logout/in unhooks it but that's not a solution either.
You might try transferring the files using a new account with no apps running or even installed other than the defaults.

Max buffer size for HDS streams

How does OSMF (v2.0) compute the max buffer length for HDS streams (pre-recorded)?
I have mediaPlayer.bufferTime = 5 seconds, but I see that even on very good b/w connections, the buffer length does not exceed 7.5 secs. Is there a way to increase the maximum buffer length value, so that clients on higher b/w can accumulate a larger buffer?
By comparison, for RTMP, the buffer length seems to go up to 60sec which is consistent with what the docs say here:
http://livedocs.adobe.com/flashmediaserver/3.0/hpdocs/help.html?content=00000175.html
Thx,
- abey

No. Did not find a way to set the maxBuffer value, but I was able to workaround the problem by setting the mediaPlayer.bufferTime dynamically (i.e different values for various stages of playback, like loading, seeking, buffering, normal playback etc.)..So setting bufferTime to 60 secs during normal playback allows the buffer to grow to a decent size.
- Abey

How to increase the buffer size for Oracle?

After I installed the patch 9.2.0.4, I kept getting 'ORA-03113: end-of-file on communication channel' error. According to the metalink, increasing the buffer size may solve this problem. I found when I set the trace on, this problem was gone, and after I set the trace off, it came back again. I am not sure if setting the trace on increases buffer size automatically or not, but I want to start from here.
No matter how easy it is, I really didn't change buffer size before, can anyone show me how to do that?
Thanks a lot.

Hi,
I think they asked to increase the db buffer cache size. You may try this
alter system set db_cache_size=<new size in bytes> scope=both;
Cheers
Muneer

ASIO Buffer Size for Records

Hello!!!
Please, help me to set up the ASIO buffer latency to make recordings made by Audition is clean and without cracklings and etc. When I had a value 1 ms of latency, after I've recorded a sample from any source by Audition, I've got some crackling when I playback this sample (in real-time in Audition, and in the recorded file). When I set up 5 ms - it's better. Maybe there is a standard to set up the ASIO buffer latency for Audition? I have a "Creative ASIO" driver and a device "Creative X-Fi Elite Pro".
I just wanna using Audition to make records instead using the Creative audio recording software, which make records without crackling. I think Audition just have to make records without any cracklings too or might be better!!!
Thank you!!!

There's no quick answer. In reality, it's a matter of turning it up until you get reliable recording and playback. How much latency you need will depend on the spec of your computer, how well your computer is optimised for recording, how much other rubbish is running in background and the quality of the ASIO drivers provided with your sound card.
The first thing I have to say is that the Creative X-Fi series of sound cards are NOT well thought of in the recording community. They're aimed far more at gamers and people who want to watch videos than at serious sound recordists. I've also heard a lot of horror stories about the poor quality of their drivers.
Beyond that, I'd suggest that you optimise your computer for recording--exactly how to do this will depend on what operating system your have. However, a Google search on "optimising computer for sound recording" including your Windows version will find you lots of suggestions. There will likely be some pages from Presonus near the top of your results--those are very good ones.
Another point: shut down anything and everything running in background when you record. Pay special attention to networking, Wifi and any anti virus software you have--all those are bad news when recording and mixing.
Finally, depending on how/what you're recording, there may or may not be issues with cranking the ASIO latency up really high. The problem with high latency only really comes into play when you're multi tracking along to pre recorded tracks AND you are monitoring your new track via the computer rather than directly on the sound card. Proper interfaces for multitrack recording feature "direct hardware monitoring" which allows you to monitor via the interface rather than having to go via your software. If you're serious about recording, you'll eventually need to ditch the X-Fi and get a specialist audio interface.
So, optimise your computer, shut down anything unnecessary (especially wifi and anti virus) and just turn up the latency until it's reliable. I know of some people who use a relatively low latency for recording and turn it up for mixing when they use lots of real time effects.

Want Wired for Internet, Wireless for file transfers on home network

I live in Dubai where internet in my house is connected straight from an ethernet port in the wall in numerous rooms. I have one wired connection hardwired from port to airport extreme which creates a wireless network for my laptops for internet.. apple tv et al. (home network 10.0.1.1 etc)
In the other room i have a mac mini which is directly hardwired to a second ethernet port. I use this machine for hard wired internet as its essentially downloading continuously for work.
Looking at network setting states..
Wired connection states in network details : (To be used purely for hardwired internet)
router address of (91.74.X.1)
and ethernet port ip (91.74.x.21)
Wireless connection states in network details : (To be used purely for connection to home wireless network and streaming of files within internal networks)
Router (10.0.0.1)
IP4V address is (10.0.1.4)
Subset mask is 255.255.255.0
I would like to force the mac mini to only use the wired ethernet connection for surfing/downloading, and also have an IP from the home network (10.0.1.2 etc) purely for file sharing/streaming with other computers on my home network.
Is this possible ?

NAS is the right tool for this job.
It is expensive but the market leaders.. synology and QNAP have really been doing it for long time and the ability to do file store/sharing and most importantly backup in these is excellent. Pick the best you can afford.. and buy disks that are in the recommended list. ie the cheapest are not always the best.. indeed they seldom are.
Plan very carefully for rotation of USB drives (easy and cheap now with 4TB single drives). Rotate backups with offsite location on weekly basis.
I would buy a 4 disk case.. you can use 4x3TB which are the best value at the moment.. that gives you 9TB of storage.. plus redundancy for a dead drive.
Alternatives are using a Mac Mini as a server.. with a large stack of disks on it.. generally should be thinking thunderbolt if you want speed. Hideously expensive though for now.
You can buy an Extreme or TC.. either would work well. TC allows you easy TM backups without using your NAS..
Edit very large files on the computer. ie copy to computer.. edit.. copy back to the NAS.
Editing very large files over wireless.. not good. Multiply that by mutliple computers.. not even fair.
Copy a large project to the computer.. work on it.. copy back to the NAS.. in the meantime Time Machine should be able to take care of incremental backups.
There are heaps and heaps of solutions.. as long as it is logical and easy to you.. and covers what you need.
Don't skimp.. spending a $1000 for a NAS with disks.. plus extra for the backup disks.. that represents how many day's work for you plus anyone you have helping.. $$$$ ????
A mini as a server is a good alternative.. You don't need to run server OS.. but share files to the network. Very hard to build the capacity of the NAS though.
And a Mac Pro is now a joke without internal slots and cages for drives. (nice machine but wrong for this).
And Apple have nothing in between.. a short tower case.. been missing for a long long time.

Use Ethernet for file transfers to iMac?

Hi -- In earlier Powerbook use I used to like using the "Target Disk Mode" to drag files from my laptop to my desktop machines, but of course my new MacBook has no firewire.
is there anyway to connect my MacBook to my iMac using an ethernet cable, to drag sel;ect files from the portable to the desktop machine? I've got some multi-gig files I need to shuttle back and forth occasionally, so it's pretty tedious to chug along via wireless . . .
Any other suggestions for most convenient means of shuttling big files?
Thanks

Yes, you can use Ethernet to transfer files via File Sharing. If you have a home network then you can share files over your home network whether it be wired or wireless. You can also create a computer-to-computer network by connecting two computers directly via Ethernet cable.
Select Mac Help from the Finder's Help menu and search for "file sharing." Search for "network" to find an article on computer-to-computer networks.

I/O Buffer Size for files transfers

Similar Messages

Maybe you are looking for