File copy speeds to CSV vs non-CSV

I'm working on bringing up a 2012 R2 cluster and doing a basic test. In this cluster, I have two adapters for iSCSI traffic, one for network traffic, and one for the heartbeat. Cluster node has all the current updates on it. Everything
is set up correctly as far as I can see. I'm taking a folder with 1GB of random files in it and copying it from the C: drive of a node to an iSCSI LUN. If I have the LUN set up as a non-CSV disk, the copy happens about three time faster than if
I have it set up as a CSV disk. All I'm doing is using FCM to change the disk from CSV to non-CSV (right-click, Remove from CSV, right-click, Add to CSV). I can swap it back and forth and each time the copy process is about three time slower when
it's a CSV. Am I missing something here? I've been through all the usual stuff with regard to the iSCSI adapters, MPIO, drivers, etc. But I don't think that would have anything to do with this anyway. The disk is accessed the same with
regard to all that whether it's CSV or not, unless I'm missing something. Right now, I only have a single node configured in the cluster, so it's definitely not anything to do with the CSV being in redirected mode.
I'm not trying to establish any particular transfer speed, I know file transfers are different than actual workloads and performance tools like iometer when it comes to actual numbers. But it seems to me like the transfers should be close
to the same whether the disk is a CSV or not, since I'm not changing anything else.

Which system owns the CSV? If the system from which you are copying does not own the CSV then all the metadata updates have to go across the network to be handled by the node that does own the CSV. If you are copying a lot of little
files, there is more metadata.
Actually, metadata updates always happen in redirected IO from what I'm reading, that has been the part that I was missing. This explains it.
https://technet.microsoft.com/en-us/library/jj612868.aspx?f=255&MSPPError=-2147217396 "When certain small changes occur in the file system on a CSV volume, this metadata must be synchronized on each of the physical nodes that access the
LUN, not only on the single coordinator node... These metadata update operations occur in parallel across the cluster networks by using SMB 3.0. "
So a file copy, even when done on a coordinator node, does the metadata updates in redirected mode. Other articles seem to say the same thing, though not always clearly. So it's still accurate to say that a file copy isn't the best way to measure
CSV performance, but there doesn't seem to be a lot of pointing to the (I think) important distinction regarding how the metadata updates work. From what I can see, that distinction is probably trumping anything else such as who is the
coordinator node, CSV cache, etc. For me anyway, it makes a 3X performance difference, so I think that's pretty significant.

Similar Messages

Slow file copy speeds

Hello, I can't ul or dl files from client to me or vice-versa faster than 70kbs. Both connections are static, both are 7mbs up and 2.5+mbs down and both isps have assured me that no throttling is taking place. Ports are set correctly, encryption is off for file copy; I am only one guy managing one machine for my dear gray haired mother. The files are huge 300megs plus (.psds with necessary layers, etc.) but it doesn't seem to make any diff. if I copy 1 at a time or zip a bunch-- no faster than 70k and usually 50k. Routers on both ends say connected at 7up/2.5 down and any ftp client flies to and fro. It is just much more convenient to use ARD 3.2--
Gracias, Dennis

Welcome to the Discussions Dennis,
Are you using the Copy command while also Viewing or Controlling?
Things that I can think off of the top of my head that could be slowing things down (on one of the machines):
bandwith use from screen sharing
A FAT formatted drive
encrypted user or folder
difference in OS (10.5 to 10.4 - sad but true at times)
encrypted transfer (which you covered)
3rd party firewall / security sw
I've also seen where you may be able to do a good speed test, but due to router port forwarding using ARD to transfer files is slow, so that would be one other thing to check.
Sorry I don't have a know cause. I hope this helps, JD

Extremely slow file copying over airport extreme network

Hi,
I have an Airport Extreme Base Station (10/100) network, also connected to the internet. When copying files from my MacBook Pro to a USB drive connected to the base station, OR when copying files to another computer (a windows machine) the throughput maxes out at about 700 KB/sec which is 10 times slower than when copying to the USB drive connected directly to my MacBook Pro. Although I have updated everything to the latest and greatest versions, I still have very slow file copy speeds. It's always been this way. I've read dozens of threads for potential fixes but none of them have helped. I am using Activity Monitor to measure the throughput and also timing the copy of a 10GB file. At these speeds, that file takes 4 hours. Useless.
My base station is within a few feet. I've tried different channels, 2.4GHz, 5GHz, getting rid of WPA, you name it. At first I thought it might be some issue with the USB drive connected to the base station, but copying to another computer on my network is the same. It is very frustrating.
Any insights would be greatly appreciated.

Thanks. I thought about buying the TC but I'm worried that if my network is operating slowly, which it appears to be, that I'm not going to get the throughput. I also noticed that my windows machine which is on the same network accesses the internet faster as well. I'm wondering if it is something with my MacBook.
BTW - I went to school in Pittsburgh. Great great town.

MacBook slow Wifi (file copying)

Hi there,
I'm running a 802.11n 2,4GHz Wifi at home. My Mac Mini (2011) and Macbook (2007, white) connect to my network using it. My server is connected through gigabit LAN.
Using my Mini I get very decent speeds copying files, a 700MB file takes just a few seconds to copy. But using my Macbook speeds are incredibly slow.
The same file takes minutes to copy.
I've tried changing the Wifi channel and also the router without success. It seems to be a problem with my MacBook. It's running 10.6.8. Had 10.7.4 installed before, wasn't better. The Mini of course runs 10.7.4.
I also remember connecting the MacBook to a friends Wifi in 2008 who already had 802.11n and it was ultra fast. So it should be able to handle it.
Any ideas on how I can get better speeds?
Tried several channels, no interferences, signal is full bars on both machines which are sitting next to each other by the way. So no physical objects blocking the MBs wifi. Also did a clean install on 10.6.8.
Help!?

Thank you for your reply.
I think we have the very same Macbook.
As yours mine is maxed out with 4GB of installed RAM, where 3GB can be addressed. Same specs as you see.
Also I'm not running anything except Finder when testing. Currently there's plenty of RAM free. With Safari, Mail and iTunes open I still have 800MB free.
I'm going to install Leopard or even Tiger on a spare partition, just for testing..
By the way, did you try Lion? Even in 10.7.4 I had Wifi drops on wakeup plus the same slow file copying speeds..

Creating DataSources for File Source Systems in csv format in sap bw 7.0

Hi,
Please explain how to Create DataSources for File Source Systems in csv format in sap bw 7.0. WITH SCREENSHOTS
Thanks
JINI
Edited by: Jini Jayan on Jun 11, 2008 11:36 AM

Step 1. Select Source systems under Modelling in the left panel. In the right panel, right-click Source systems and select Createu2026.
Step 2. Select the FileSystem, manual meta data, data using file inte option, and then click to continue.
Step 3. Enter a name and a description for the source system, and then click to create the source system.
Now create an application component
Step 1. Select InfoSources under Modelling in the left panel. In the right panel, right-click InfoSources and select Create application componentu2026.
Step 2. Enter a name and a description for the application component, and then click to continue. (BW automatically adds a prefix of "Z" to the technical names of application components, unlike the naming system used for other BW objects.If u give the name as AC_DEMO it will be saved as ZAC_DEMO in the system.
Now create infosource
Step 1.Select InfoSources under Modelling in the left panel. Right-click the newly created Application Component , and then select Create InfoSourceu2026.
Step 2. Select the option Master data/texts/hierarchies, and then click to continue.
Step 3. Enter your infoobject name, and then click to continue.
Now you will be asked
Infosource(name) assigned to Appln component(name)?
Click continue
Now go back to workbench and see the Infoobject listed under the Application component name (under Infosource)
Right click the infoobject name and select Assign Datasource
Enter the Infoobject name as Infosource name and the source system name and continue
Now you ll get datasource assignment confirmations for Infosource_ATTR and Infosource_TEXT for master data and text.
Click yes and continue
Now you ll be taken to the Infosource(master data) change screen
Source system name will be given
Below that u need to give the datasource name u2026.._ATTR
Click Activate.
Now Click the tab transfer rules
Copy the communication str infoobject names to an excel sheet
For ex if your infoobj are IO_MATNUM and IO_MATNAME (material number and material name) copy and paste as
IO_MATNUM      IO_MATNAME
MAT001     TEA
MAT002     COFFEE
MAT003     SUGAR
GIVE YOUR DATA IN THE EXCEL. AND CLICK File Save As CSV(comma delimited) and save to ur system. Give file name as something like infosourcename_ATTR.csv
Now back to the Infosourcechange screen
Source system name will be given
Below that u need to give the datasource name u2026.._TEXT
And activate
Now Click the tab transfer rules
Copy the communication str infoobject names to an excel sheet
GIVE YOUR DATA IN THE EXCEL. AND CLICK File Save As CSV(comma delimited) and save to ur system. Give file name as something like infosourcename_TEXT.csv
Now create Infoobject to load data
Go to Infosourceu2014Appln Componentu2014InfoObju2014SourceSystemu2014rightclick->create Infopackage
Step 2. Select the DataSource Material number (Master data), enter a description for the InfoPackage, and then click to continue.
Give infopackage description as Infopackage:InfoObj_ATTR
Now take care to select the first item in datasource and click continue
In the next screen click external data tab
Click client workstation
Datafileu2026.file name (browse to give the file u saved in ur system)
There will be an option to remove header data from file.remove 1 row.
File typeu2014csv file
Now click schedule tabu2014start dataload immediatelyu2014start.
In the same way
Go to Infosourceu2014Appln Componentu2014InfoObju2014SourceSystemu2014rightclick->create Infopackage
Step 2. Select the DataSource Material number (text)enter a description for the InfoPackage, and then click to continue.
Give infopackage description as Infopackage:InfoObj_TEXT
Now take care to select the second item in datasource and click continue
In the next screen click external data tab
Click client workstation
Datafileu2026.file name (browse to give the file u saved in ur system)
There will be an option to remove header data from file.remove 1 row.
File typeu2014csv file
Now click schedule tabu2014start dataload immediatelyu2014start.
Click the icon below admn workbench to go to monitor and check the load
Or you go back to Infosourceu2014Appln Componentu2014InfoObju2014right clickmaintain master data
Click execute
You can see the data load
Hope this helps!!!

Network speed affected by large file copy operations. Also, why intermittent network outages?

Hi
I have a couple of issues on our company network.
The first is thate a single large file copy imapcts the entire network and dramatically reduces network speed and the second is that there are periodic outages where file open/close/save operations may appear to hang, and also where programs that rely on
network connectivity e.g. email, appear to hang. It is as though the PC loses it's connection to the network, but the status of the network icon does not change. For the second issue if we wait the program will respond but the wait period can be up to 1min.
The downside of this is that this affects Access databases on our server so that when an 'outage' occurs the Access client cannot recover and hangs permamnently.
We have a Windows Active Directory domain that comprises Windows 2003 R2 (soon to be decommissioned), Windows Server 2008 Standard and Windows Server 2012 R2 Standard domain controllers. There are two member servers: A file server running Windows 2008 Storage
Server and a remote access server (which also runs WSUS) running Windows Server 2012 Standard. The clients comprise about 35 Win7 PC's and 1 Vista PC.
When I copy or move a large file from the 2008 Storage Server to my Win7 client other staff experience massive slowdowns when accessing the network. Recently I was moving several files from the Storage Server to my local drive. The files comprised pairs
(e.g. folo76t5.pmm and folo76t5.pmi), one of which is less than 1MB and the other varies between 1.5 - 1.9GB. I was moving two files at a time so the total file size for each operation was just under 2GB.
While the file move operation was taking place a colleague was trying to open a 36k Excel file. After waiting 3mins he asked me for help. I did some tests and noticed that when I was not copying large files he could open the Excel file immediately. When
I started copying more data from the Storage Server to my local drive it took several minutes before his PC could open the Excel file.
I also noticed on my Win7 client that our email client (Pegasus Mail), which was the only application I had open at the time would hang when the move operation was started and it would take at least a minute for it to start responding.
Ordinarlily we work with many files
Anyone have any suggestions, please? This is something that is affecting all clients. I can't carry out file maintenance on large files during normal work hours if network speed is going to be so badly impacted.
I'm still working on the intermittent network outages (the second issue), but if anyone has any suggestions about what may be causing this I would be grateful if you could share them.
Thanks

What have you checked for resource usage during one of these copies of a large file?
At a minimum I would check Task Manager>Resource Monitor. In particular check the disk and network usage. Also, look at RAM and CPU while the copy is taking place.
What RAID level is there on the file server?
There are many possible areas that could be causing your problem(s). And it could be more than one thing. Start by checking these things. And go from there.
Hi, JohnB352
Thanks for the suggestions. I have monitored the server and can see that the memory is nearly maxed out with a lot of hard faults (varies between several hundred to several thousand), recorded during normal usage. The Disk and CPU seem normal.
I'm going to replace the RAM and double it up to 12GB.
Thanks! This may help with some other issues we are having. I'll post back after it has been done.
[Edit]
Forgot to mention: there are 6 drives in the server. 2 for the OS (Mirrored RAID 1) and 4 for the data (Striped RAID 5).

Can I use Visual Basic to covert form user data from multiple .pdf files to a single .csv file?

Can I use Visual Basic to covert form user data from multiple .pdf files to a single .csv file? If so, how?

You can automate Acrobat using IAC (InterApplication Communications), as documented in the Acrobat SDK. Your program could loop through a collection of PDFs, load them in Acrobat, extract the form data from each, and generate a CSV file that contains the data.
Acrobat can also do this with its "Merge Data Files into Spreadsheet" function, but this is a manual process.

Speeding up FileIO - Double Buffered File Copy?

We are trying to speed up file copy from disk to tape, and I need a little more speed. I have tried playing with the size of the buffer, but that isn't changing much (makeing it slower if anything).
I'm trying to make a double buffered file copy and I can't figure out how to do it. I figured this would be a good place to get speed. Right now, my write is very simple:
byte buffer = new buffer[8 * 1024 * 1024];
FileInputStream in = new FileInputStream(srcFile);
while(true) {
int amountRead = in.read(buffer);
if (amountRead == -1) { break; }
write(buffer, 0, length);
}So what i need to do it be able to read and write at the same time. So I was thinking that I could either make the write method a sperate thread, or some how make threaded buffers that read while the other is being writen. Has anyone tackled this problem before?
If this isn't the right way to speed up File IO, can you let me know other ideas? Thanks in advance!
Andrew

Once again: I wish I could claim credit for these classes, but they were in fact posted a year or so ago by someone lese. If I had the name I would give credit.
I've used these for two heavy-duty applications with never a problem.
<code>
package pipes;
import java.io.IOException;
import java.io.InputStream;
* This class is equivalent to <code>java.io.PipedInputStream</code>. In the
* interface it only adds a constructor which allows for specifying the buffer
* size. Its implementation, however, is much simpler and a lot more efficient
* than its equivalent. It doesn't rely on polling. Instead it uses proper
* synchronization with its counterpart PipedOutputStream.
* Multiple readers can read from this stream concurrently. The block asked for
* by a reader is delivered completely, or until the end of the stream if less
* is available. Other readers can't come in between.
public class PipedInputStream extends InputStream {
byte[] buffer;
boolean closed = false;
int readLaps = 0;
int readPosition = 0;
PipedOutputStream source;
int writeLaps = 0;
int writePosition = 0;
* Creates an unconnected PipedInputStream with a default buffer size.
* @exception IOException
public PipedInputStream() throws IOException {
this(null);
* Creates a PipedInputStream with a default buffer size and connects it to
* source.
* @exception IOException It was already connected.
public PipedInputStream(PipedOutputStream source) throws IOException {
this(source, 0x10000);
* Creates a PipedInputStream with buffer size <code>bufferSize</code> and
* connects it to <code>source</code>.
* @exception IOException It was already connected.
public PipedInputStream(PipedOutputStream source, int bufferSize) throws IOException {
if (source != null) {
connect(source);
buffer = new byte[bufferSize];
* Return the number of bytes of data available from this stream without blocking.
public int available() throws IOException {
// The circular buffer is inspected to see where the reader and the writer
// are located.
return writePosition > readPosition ? // The writer is in the same lap.
writePosition - readPosition : (writePosition < readPosition ? // The writer is in the next lap.
buffer.length - readPosition + 1 + writePosition :
// The writer is at the same position or a complete lap ahead.
(writeLaps > readLaps ? buffer.length : 0)
* Closes the pipe.
* @exception IOException The pipe is not connected.
public void close() throws IOException {
if (source == null) {
throw new IOException("Unconnected pipe");
synchronized (buffer) {
closed = true;
// Release any pending writers.
buffer.notifyAll();
* Connects this input stream to an output stream.
* @exception IOException The pipe is already connected.
public void connect(PipedOutputStream source) throws IOException {
if (this.source != null) {
throw new IOException("Pipe already connected");
this.source = source;
source.sink = this;
* Closes the input stream if it is open.
protected void finalize() throws Throwable {
close();
* Unsupported - does nothing.
public void mark(int readLimit) {
return;
* returns whether or not mark is supported.
public boolean markSupported() {
return false;
* reads a byte of data from the input stream.
* @return the byte read, or -1 if end-of-stream was reached.
public int read() throws IOException {
byte[] b = new byte[0];
int result = read(b);
return result == -1 ? -1 : b[0];
* Reads data from the input stream into a buffer.
* @exception IOException
public int read(byte[] b) throws IOException {
return read(b, 0, b.length);
* Reads data from the input stream into a buffer, starting at the specified offset,
* and for the length requested.
* @exception IOException The pipe is not connected.
public int read(byte[] b, int off, int len) throws IOException {
if (source == null) {
throw new IOException("Unconnected pipe");
synchronized (buffer) {
if (writePosition == readPosition && writeLaps == readLaps) {
if (closed) {
return -1;
// Wait for any writer to put something in the circular buffer.
try {
buffer.wait();
catch (InterruptedException e) {
throw new IOException(e.getMessage());
// Try again.
return read(b, off, len);
// Don't read more than the capacity indicated by len or what's available
// in the circular buffer.
int amount = Math.min(len,
(writePosition > readPosition ? writePosition : buffer.length) - readPosition);
System.arraycopy(buffer, readPosition, b, off, amount);
readPosition += amount;
if (readPosition == buffer.length) {
// A lap was completed, so go back.
readPosition = 0;
++readLaps;
// The buffer is only released when the complete desired block was
// obtained.
if (amount < len) {
int second = read(b, off + amount, len - amount);
return second == -1 ? amount : amount + second;
} else {
buffer.notifyAll();
return amount;
package pipes;
import java.io.IOException;
import java.io.OutputStream;
* This class is equivalent to java.io.PipedOutputStream. In the
* interface it only adds a constructor which allows for specifying the buffer
* size. Its implementation, however, is much simpler and a lot more efficient
* than its equivalent. It doesn't rely on polling. Instead it uses proper
* synchronization with its counterpart PipedInputStream.
* Multiple writers can write in this stream concurrently. The block written
* by a writer is put in completely. Other writers can't come in between.
public class PipedOutputStream extends OutputStream {
PipedInputStream sink;
* Creates an unconnected PipedOutputStream.
* @exception IOException
public PipedOutputStream() throws IOException {
this(null);
* Creates a PipedOutputStream with a default buffer size and connects it to
* <code>sink</code>.
* @exception IOException It was already connected.
public PipedOutputStream(PipedInputStream sink) throws IOException {
this(sink, 0x10000);
* Creates a PipedOutputStream with buffer size <code>bufferSize</code> and
* connects it to <code>sink</code>.
* @exception IOException It was already connected.
public PipedOutputStream(PipedInputStream sink, int bufferSize) throws IOException {
if (sink != null) {
connect(sink);
sink.buffer = new byte[bufferSize];
* Closes the input stream.
* @exception IOException The pipe is not connected.
public void close() throws IOException {
if (sink == null) {
throw new IOException("Unconnected pipe");
synchronized (sink.buffer) {
sink.closed = true;
flush();
* Connects the output stream to an input stream.
* @exception IOException The pipe is already connected.
public void connect(PipedInputStream sink) throws IOException {
if (this.sink != null) {
throw new IOException("Pipe already connected");
this.sink = sink;
sink.source = this;
* Closes the output stream if it is open.
protected void finalize() throws Throwable {
close();
* forces any buffered data to be written.
* @exception IOException
public void flush() throws IOException {
synchronized (sink.buffer) {
// Release all readers.
sink.buffer.notifyAll();
* writes a byte of data to the output stream.
* @exception IOException
public void write(int b) throws IOException {
write(new byte[] {(byte) b});
* Writes a buffer of data to the output stream.
* @exception IOException
public void write(byte[] b) throws IOException {
write(b, 0, b.length);
* writes data to the output stream from a buffer, starting at the named offset,
* and for the named length.
* @exception IOException The pipe is not connected or a reader has closed
* it.
public void write(byte[] b, int off, int len) throws IOException {
if (sink == null) {
throw new IOException("Unconnected pipe");
if (sink.closed) {
throw new IOException("Broken pipe");
synchronized (sink.buffer) {
     if (sink.writePosition == sink.readPosition &&
     sink.writeLaps > sink.readLaps) {
     // The circular buffer is full, so wait for some reader to consume
     // something.
     try {
     sink.buffer.wait();
     catch (InterruptedException e) {
     throw new IOException(e.getMessage());
     // Try again.
     write(b, off, len);
     return;
     // Don't write more than the capacity indicated by len or the space
     // available in the circular buffer.
     int amount = Math.min(len,
     (sink.writePosition < sink.readPosition ?
     sink.readPosition : sink.buffer.length)
- sink.writePosition);
     System.arraycopy(b, off, sink.buffer, sink.writePosition, amount);
     sink.writePosition += amount;
     if (sink.writePosition == sink.buffer.length) {
     sink.writePosition = 0;
     ++sink.writeLaps;
     // The buffer is only released when the complete desired block was
     // written.
     if (amount < len) {
     write(b, off + amount, len - amount);
     } else {
     sink.buffer.notifyAll();
</code>

Copying speed of files has slowed down significantly

copying speed of files has slowed down significantly
and if initiate two different copy processes then it slows so much that 1 GB data takes time like it was 15GB

Again, it depends on file types. Sometimes Apple files are not single files but packages of many smaller files, for example the iPhoto Library. Right-click in Finder, if there's "Show Package Contents", then it is technically not a single file.
For simple file transfer from one machine to another per USB drive, it can save some time to zip the data before and after transfer to and from the USB drive.

How to export a form that has Asian language in it to CSV file? Currently the CSV file shows [...] for Asian language characters

How to export a form that has Asian language in it to CSV file? Currently the CSV file shows [...] for Asian language characters

Hi George,
Thanks! It does work in XML format. But since I would need to present the data in a spreadsheet, is there any other way I could go around it?
Cheers,
Su Ann

How to read a file whose extension in .csv / .xls

Hello everyone,
I figured that " read from spreadsheet file" can be used if you want to read from a .txt file which may be saved in a spreadsheet format. But if you want to read from a .csv or .xls file, this function returns garbage. Is there a way to read from .csv or .xls files ??
Thanks

.csv and .xls are completely different.
.csv (="comma separated values") is just as ASCII table using a comma as field seperator and linefeed to seperate rows. If you set the delimiter to comma in "read from spreadsheet file", you should be able to read it just fine. Just make sure you never go to any countries where the comma is used as a decimal seperator, or everything will mess up.
.xls is a proprietary fle format by microsoft and you will not be able to read it using plain file I/O. Open one in notepad and you'll see what I mean.
Of course it is possible that your .xls file is not actually a microsoft excel file. Once in a while you see programs posted here that write plain ASCII tables, but decorate the file with an .xls extension. While this does not make it an excel file, the file manager will cause it to be opened by the excel application when double-clicked. Fortunately, excel often does a pretty good job reading such ASCII tables and the data "looks right" in excel. Excel is also the default application to open .csv files.
There are ways to read and write genuine excel files. The example finder has some examples.
If you don't mind, attach one of your data files for our inspection.
LabVIEW Champion . Do more with less code and in less time .

Existing files on drive connected to latest Airport Extreme do not show up, however files copied over the air to the drive do. Any ideas?

I have the latest Airport Extreme with a Seagate drive connected. I copied files to the drive while it was connected to my MacBook Pro. The files do not show up when connected to the AE, but they appear when connected to the Macbook, Files copied over the network to the drive appear. The drive is formatted HFS+.

After playing with this for the last few days, I found a solution. Under the "Disks" tab in Airport Utility, the "Secure Shared Disks" drop down needs to be set to "With device password". Mine was set to "With acounts", which even after correct authentication, none of the files would appear.
Another interesting note: The files that I could see, the ones I copied over the network, do not appear now. I can copy over new files, and they show up, but the ones copied prior to changing the "Secure Shared Disks" option, do not.

File Copy times

My newsreader is acting funny and dropping posted messages, so I
apologize if this shows up twice.
My comments on the file speed are that the times posted by other just go
to show how difficult it sometimes is to make good timing measurements.
I suspect that the wide variations being posted are in large part to
disk caching. To measure this, you should either flush the caches each
time or run them multiple times to make sure that the cache affects them
more equally.
Here is what I'd expect. The LV file I/O is a thin layer built upon the
OS file I/O. Any program using file I/O will see that smaller writes
have somewhat more overhead than a few large writes. However, at some
size, either LV or the OS will break the larger writes into smaller
ones. The file I/O functions in general will be slower to read and
write contents than making a file copy using the copy node or move node.
Sorry if I can't be more specific, but if you have a task that
seems way to slow, please send it to technical support and report a
performance problem. If we can find a better implementation, we will
try to integrate it.
Greg McKaskle

Maybe this is because of the write buffer?
Try mounting the media using the -o sync option to have data written immediately.

Does the last updated backup in Time Machine have all my files for "standard" file copy? (i want to copy and paste files to another computer that doesn't have TM)

My personal Macbook pro died, but I did have a Time Machine backup. I have a new iMac that I would like to use as a family computer. I would like to transfer some files to the new computer (and set-up a new Time Machine backup), but archive the remainder on a non-TM drive. I was planning to:
1. File copy my last backup folder from my old TM drive to the new computer
2. Copy (and then delete) the files I want to archive on another HD drive
3. Wipe clean my current TM drive
4. Set-up TM on my new computer
Is this a good way to proceed?
Is copying the last backup folder (vs. all backup folders) enough to move my files over?
Any better approaches appreciated!

I suggest you visit MicroCenter and go to there Apple section and ask one of there guys if they are still offering the 2 terabyte Backup For the iMac, Mine was only $100.00.
So the iMac has Time machine plus the USB 2 Terabyte Backup for less than your $130.00

Has anyone else had Mountain Lion 10.8.2 file copying trouble?

Has anyone had any trouble with file copying to external disks?
I have used a third party programme called "Synchronize! Pro X" (SyncPX) for many years with OS X up to 10.5.8 and it has never given any trouble at all. In July I bought a new MacBook Pro 15", upgraded to 10.8.1 and bought the latest update for SyncPX (6.5.1). This worked perfectly as far as I know until I downloaded the 10.8.2 Mountain Lion upgrade about a week ago.
The symptoms are:
1) When files are copied in backup mode (running as a single user, updating only files that have changed) to an external disk using Firewire, a high percentage of them do not have their file information copied correctly. The "Last modified" date is often set to the time that the copy was made rather than being replaced with the "Last modified" date from the source file. Also, "further information" is sometimes not copied.
2) When files are copied in "Full bootable backup" mode (SyncPX runs "as root", copies files from ALL users and tries to set owner and group to be same as source file), the same symptoms as in (1) occur, but also SyncPX hangs right at the end of copying. Sometimes it says "Updating dyld cache…", sometimes "Updating aliases…". When this happens it is impossible to halt SyncPX except by forcing a quit, and then the external disc is not released so that it cannot be ejected except by forcing a shutdown. In that case the external disk usually needs repairing. The errors are always "incorrect number of extended attributes".
I have tried lots of things.
a) Restart
b) Reformatting the external disk and starting over.
c) Reinstalling the system (after checking and repairing the main system disc), followed by (b)
d) Turning off indexing for the external disc
e) Repeating the test with a different external disk (to make sure it's not down to a faulty external disk)
f) I have looked at Console logs but they do not indicate anything odd going on.
None of this makes any difference. By contrast, a straight drag and drop copy from Finder works with no errors.
At this point you probably think the errors are SyncPX's fault. But:
i) The same version of SyncPX worked until 10.8.2 was released
ii) If the destination disk for a SyncPX backup is a network disk, everything works OK.
I started by taking the fault up with SyncPX's developer, Qdea. One other user had noted a fault similar to (2). Qdea maintain that there's nothing wrong with their code, and blame Apple's disc drivers.
On balance I think Qdea could be right, or at least Apple have changed some specifications but not told the developer world.
I haven't yet tried to take this up directly with Apple (through AppleCare) as I think they will probably wash their hands of it and blame the developer. The point of this post is to see if anyone else has had a similar problem, perhaps with different software, and if there is anyone with sufficient experience to give advice on how to take this forward. Is the case for an OS bug convincing or do others feel it's a fault with SyncPX alone? If so how does one explain its perfect behaviour until 10.8.2?
What steps can I take to pin this down further? All advice and comments will be gratefully received..

RobertDHarding wrote:
At this point you probably think the errors are SyncPX's fault.
And you would be right.
I started by taking the fault up with SyncPX's developer, Qdea. One other user had noted a fault similar to (2). Qdea maintain that there's nothing wrong with their code, and blame Apple's disc drivers.
What steps can I take to pin this down further? All advice and comments will be gratefully received..
Dump Qdea for someone who knows how to write Mac software.
1. Qdea displays the following logo: . This is a pre-MacOS X logo.
2. Qdea displays the following review:
MacFixit had a good reputation, if you are old enough to remember when it used to exist.
3. Qdea provides download links to SynchronizeX and version in French, German, and Japanese. Apparently they don't know that Mac software can be localized into a single executable.
I'm sure there are any number of similar utilities available, all of them cheaper than SynchronizeX's $99.99 price.

File copy speeds to CSV vs non-CSV

Similar Messages

Maybe you are looking for