Copy big file in phases

Big file >100GB I want to copy: it takes too long. I want to copy it in phases ie pause, shut down the computer and resume later. Is it feasible? thanks

it's possible, though this would require converting to .zip format, separating the .zip, sending the .zip pieces, putting back toghether and unzipping. This software can separate a .zip files into multiple ones: http://kb.winzip.com/help/help_splitdlg.htm
there are others of course. A simple internet search will get you many

Similar Messages

Solaris 10, Samba 3.0.25a - Server dies copying big files to ZFS volume

Hope someone can help me with this problem, cos I am at my wits end.
We have Solaris 10 Update 2 running on a Sunfire V215 Sparc Server with 2 large storage arrays running ZFS
When copying a large file via samba, after about say 200-300megs... the copy just stops... and the samba server becomes unresponsive for quite a while.
When we first noticed the problem, we had the original Samba 3.0.11 which shiped with SOL 10 Up2, so we hoped the upgrade to Samba 3.0.25a would fix the problem. No such luck.
I have tested with FTP (the same 2.6 GB file) and that transfers completely and very fast, so I am pretty damn sure its not a hardware issue.
I have tested with varios samba configurations. Vanilla configs, tweaked configs, configs which people claim solve some issues... again no luck.
I have looked around these forums and seen that some people have experience samba issues when upgrading from Sol 9 to Sol 10.
Please if ANYONE has any ideas what could be causing this and how to solve it, I would be extremely greatful
Thanks
//Steve
Edited by: reyortsed on Sep 23, 2008 12:29 PM

Update 2 is pretty old, especially if you are talking about ZFS. There's been a variety of problems fixed in ZFS since U2. Were I to just guess out of the blue, you might be running into the ZFS eats all of RAM bug.
http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6505658
If this is the case, it won't be just the samba server that's slow on the server. You should check this by doing the FTP after your samba server slows down and see if you get fast throughputs.
-r

USB Harddrive hangs on access from Windows Vista during copy of big Files

We are using an Airport Extreme in a Windows Vista environment. We are not able to copy big files (around 40 GByte) from a Vista MacBook Pro to the Airport USB drive. Vista times out with the message "The spicified network name is no longer available".
If we copy smaller files (tested with chunks of 2 GByte) we are able to sustain file copy for hours with the sytem.
Any ideas?

I guess file size limit is 4GBytes if your USB HDD is FAT32 format.
If your HDD is HFS+ format, I'm not sure but it's kind of bug for AEBSn.

Cant save big files in pendrives- macbook pro

My macbook pro cant save big files in pendrives and cant copy big files to my HD... it stops when its abou 50-60%... does anyone have an idea?
Thanks!

Hey, i've solved it... i've cleaned the memory and now it's working! Thanks for the attention

Can Server 2012 FSRM send email notification to Administrator while a user copying a big file(e.g. 100MB) onto server?

Can FSRM send e-mail notification to Administrator while a user copying a big file(e.g. 100MB) onto server?
Environment:
Windows Server 2012 Standard 64bit
FSRM install and test email ok
Qouta management and file screen path: D:\Data
Thanks

Hi,
You can create quotas to limit the space allowed for a volume or folder and generate notifications when the quota limits are approached or exceeded.
For more detailed information, please refer to the articles below:
Working with Quotas
http://technet.microsoft.com/en-us/library/cc770989(v=ws.10).aspx
The best feature you've never heard of...
http://blogs.technet.com/b/seanearp/archive/2008/03/11/the-best-feature-you-ve-never-heard-of.aspx
Regards,
Mandy
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place.

Big file can't be copied because it is too large for the volume's format

even thought i have formated my hard drive as an mac extended. but still facing the same problem so what could be the solution of this kind of problem..

HFS+ has a volume size limit of 8 exabytes, and so far I haven't seen any drives in those volume sizes.
What's likely the problem is there isn't enough free space to copy the file to your hard drive.

ITunes won't copy music files to Media folder when songs are dragged

I am trying add songs from my external hard drive to my iTunes Library.
I have the following options checked:
"Keep iTunes Media folder organized."
"Copy files to iTunes Media folder when adding to library."
In the past, I could just drag files from my hard drive into the iTunes song list and add them to the library. iTunes would successfully make a copy of the file to the iTunes Media folder so that I could disconnect the hard drive and still play the songs.
Suddenly, this no longer works. iTunes won't make a copy of the file anymore. It won't even make a copy of files located on my desktop.
I found a workaround -- copy the files from my hard drive to the desktop. Then I have to go to File > Add to Library in order for it to work.
It's an extra step, but it was VERY annoying to have to figure out.
So my question -- Is this an iTunes bug or some kind of deliberate attempt at making it hard to use files not purchased through iTunes?
I noticed this on one of the Apple support pages (my emphasis):
Copying music to and keeping the iTunes Media folder organized
You can select these options on the Advanced pane of iTunes preferences:
"Keep iTunes Media folder organized." Learn more about how iTunes 9 and later organizes your media.
"Copy files to iTunes Media folder when adding to library." Select this option to store all your media files in the iTunes Media folder. Since it's all in one location, you can easily transfer or back up your media. When you purchase or import media into iTunes from a CD, it's automatically added to your iTunes Media folder. If you add media to iTunes another way (choosing "Add to library" from the File menu or by dragging an MP3 file into iTunes), it might not be added to your iTunes Media folder.
Well, why the heck not??

I have posted so many issues to APPLE on the staggering lack of basic functionality with itunes and each time they keep deleting it.
Automatically Addd feature does not work consistently if the library is on NAS or a drive not on the same bok as the Mac, iMac or PC.
iTuns will hang if you have the finder window open and the recently added playlist open
itunes will not add files automatically if more than three phases of adding folders to the automatically add to itune folder is refreshed
Once could even jump to the conclusion that the software testing and Quality Control in the iTunes development team had missed out whole chunks of tsting OR that the test designers wrote such basic test scripts which did not replicate real world useage.

Unable to install a zone: Copying 0 files to the zone.

Hi forum users,
I really hope someone has any idea what could be wrong here.
First of all, the server is patched with security and recommended patches, except for 118344-13 -> R-- SunOS 5.10_x86: Fault Manager Patch which I will install on the next maintenance day. It already has 4 zones running without problem.
However when I try to install a new zone now it always fails.
# zoneadm -z blah install
Preparing to install zone <blah>.
Creating list of files to copy from the global zone.
Copying <0> files to the zone.
Initializing zone product registry.
Determining zone package initialization order.
ERROR: package <SUNWcsu> is not complete: skipping installation of package
ERROR: package <SUNWcsr> is not complete: skipping installation of package
ERROR: package <SUNWcsl> is not complete: skipping installation of package
ERROR: package <SMCreadl> is not complete: skipping installation of package
ERROR: cannot determine dependency ordered package list from package repository </var/sadm/pkg>
ERROR: cannot generate dependency ordered list of packages from global zone </var/sadm/pkg>
ERROR: failed to initialize packages from global zone </> to zone </zones/blah/root>
ERROR: cannot copy and initialize packages from global zone to local zone <blah> path </zones/blah/root>
ERROR: cannot create zone boot environment <blah>
zoneadm: zone 'blah': '/usr/lib/lu/lucreatezone' failed with exit code 74.
To me it seems obvious that the problem lies in the fact that it doesnt even copy a single file to the configured zone, therefor it can't install any packages and all the rest fails too. The big question of course is, why does it think it only needs to copy 0 files? Has anyone encountered such a problem before? I havent found anything yet on patches breaking zoneadm install but might have missed it.
Does it looks like a HD corruption?Might be since the Sun Management Console agent does seem to freeze on that server too once in a while.

All the packages are fine in the global zone, pkginfo -l tells me the packages are complete.
I did try the truss wrap but it gives me so much info it is hard for me to figure out if something is wrong. The only error i think that returns often and that is not resolved is:
ioctl(4, TCGETA, 0x080471E4) Err#25 ENOTTY
ioctl(4, TCGETA, 0x08047294) Err#22 EINVAL
The part where it seems to compile a list of files to copy however is very empty of truss entries:
Preparing to install zone <gal2en-survey>.
Creating list of files to copy from the global zone.
Copying <0> files to the zone.
Initializing zone product registry.
Determining zone package initialization order.
read(4, 0x0806DD3C, 5120) (sleeping...)
ERROR: package <SUNWcsu> is not complete: skipping installation of package
This issue is still unresolved for me. For now the only way to create a new zone on that server is to manually copy all files from another zone, editing the zonecfg entry and net config files for the zone, then i can boot and run it.

Can't move big files also with Mac OS Extended Journaled!

Hi all =)
This time I can't really understand.
I'm trying to move a big file (an app 9 GB large) from my macbook app folder to an external USB drive HFS+ formatted, but at about 5.5 GB the process stop and I get this error:
"The Finder can't complete the operation because some data in "application.app" can't be read or written. (error code -36)"
Tried to search for this error code over the internet with no results.
Tried the transfer of the same file to a different drive (which is also HFS) but I still get the same error code.
Both drives have plenty of available free space.
Tried also different USB cables.
The app in subject has just been fully downloaded with no error from the app store.
What should I try now? Please any suggestion welcome.. this situation it's so frustrating!
Thanks

LowLuster wrote:
The Applications folder is a System folder and there are restrictions on it. I'm not sure why you are trying to copy an App out of it to an external drive. Try copying it to a folder on the ROOT of the internal drive first, a folder you create using a Admin account, and then copying that to the external.
Thanks a lot LowLust, you actually solved my situation!
But apparently in this "forum" you can't cancel the choosen answer if by mistake you clicked on the wrong one and you can't edit your messages and you even can't delete your messages... such a freedom downhere, jeez!

OS X 10.4.7 server: Samba leaking ram when copying large files from windows

Hi.
I'm having problems with:
Copying files from windows clients to OS X Server 10.4.7 uses up the RAM needed for the files to be copied.
If I copy a 3GB file, it uses 3GB of RAM
If I copy a 5GB file, it uses its 4GB of RAM, plus VM.
If I copy 11GB of files (that is several little files, plus some big by dropping a folder to the share), it consumes all the RAM the machine has, and because of VM paging, whatever other clients are reading from the disk (XRaid) start to have hiccups.
The RAM of the machine NEVER gets flushed after the copying has finished. So Samba is unusable as it is. I have four Xserves with 4GB of RAM, with 4 XRaids connected each one to each Xserve with its Apple Fiber Channel card and cables.
I already did the ack=0 thing, got the size of inet.tcp.sendspace and rcvspace to 8388608 and the buffer to 16777216.
The transfers rates are up to 70MB/s with 2 channel 1gb trunking, and at very sustained rates..
We are using these to edit video content (DV 25) in Sony Vegas with 2 or 3 clients for each server.
Any suggestions?
Thanks very much.
XServe G5 cluster node (4) / XRaid 7TB (4) Mac OS X (10.4.7)

Michael, I occasionally notice anomolous behaviour when files get dragged between volumes. Mostly the copying window shows an accurate and immediate indication of what's going on, but other times it just looks like nothing's happening, the display never changes, yet, it is in fact copying the files over. Now, if you're copying 2gb files from DVD to HD, it's gonna take some time, more than 5 minutes, so I'm wondering how long you've left it before forcing it to quit?

Blackbery Link - browse pc folders and copy mp3 files not in music folder

Hello to all of you
I have music archives in different drives and pendrives
It is not intuhitive at all how to browse local PC drives and or PC folders to select and copy single or many .mp3 files from the PC to the BlackBerry device.
Please don't tell me that the silly solution is to move the mp3 files to the windows music folder.
Additionally, i find really against an user friendly approach the BlackBerry Link in the music section. It doesn't allow to show the mp3 files names and use, manage and browse .mp3 files by their name, I see only
- All the music
- Album
- Artists
- Genres
- Playlists
well,
- I have so many .mp3 files
- they don't have all the mp3 tags
- I see only an unfinished list which doesn't allow me to select the file I need, and I must scroll all of them every time
A TOTAL NO SENSE in my personal opinion
Anyway , from BalckBerry Link and from PC side, how to select one single mp3 file, QUICKLY, and copy it inside the BlackBerry device in the music folder?
Thank you
C0r

Yes CRAZY!!! It is confirmed,
trying to find a solution to this crazy behavior, I've turned to documents side.
I've added my mysic folder to the documents and TA-DAAAH! The .mp3 files don't show!!!
On the right panel a big string says "The folder doesn't contain supported files"!!!
Well, looks like that BlackBerry Link leaks like the OS 10
Anyway, if you can provide a solution that allows to copy mp3 files ID3-less (http://en.wikipedia.org/wiki/ID3), mean that none of the ID3 has been filled, thank you so much in advance.
To BB Link developers, think about allow users to tranfer files as files and not as you arbitrary want, thank you.
C0r

Howto copy large files?

Hi, cause of the reason that in java.io.File a copy method
is missing, I used streams to copy files.
But a normal java-app has only about 64MB available, so if the file is very big (about 60MB or more) this method leads to a "java.lang.OutOfMemoryError". I don't want to set any other params for the vm.
So how should I copy such files.
Cheers.
Greetings Michael
I use this code at the moment
                in = new FileInputStream(inputFile);
                out = new FileOutputStream(outputFile);
                byte[] data = new byte[(int)inputFile.length()];
                if( in.read(data,0,(int)inputFile.length()) != -1)
                    out.write(data);


Hi, cause of the reason that in java.io.File a copy
method
is missing, I used streams to copy files.
But a normal java-app has only about 64MB available,
so if the file is very big (about 60MB or more) this
method leads to a "java.lang.OutOfMemoryError". I
don't want to set any other params for the vm.
So how should I copy such files.
Cheers.
Greetings Michael
I use this code at the moment
in = new FileInputStream(inputFile);
out = new
out = new FileOutputStream(outputFile);
byte[] data = new
te[] data = new byte[(int)inputFile.length()];
if(
if(
if( in.read(data,0,(int)inputFile.length()) !=
h()) != -1)
out.write(data);
byte[] data = new byte[] data = new byte[(int)inputFile.length()];
use smaller buffer... like byte[] data = new byte[1024]...

VERY big files (!!) created by QuarkXPress 7

Hi there!
I have a "problem" with QuarkXPress 7.3 and I don't know if this is the right forum to ask...
Anyway, I have createed a document, about 750 pages, with 1000 pictures placed in it. I have divided it in 3 layouts.
I'm saving the file and the file created is 1,20GB !!!
Isn't that a very big file for QuarkXPress??
In that project there are 3 layouts. I tried to make a copy of that file and delete 2 of 3 layouts and the project's file size is still the same!!
(Last year, I had created (almost) the same document and as I checked that document now, its size is about 280 MB!!)
The problem is that I have "autosave" on (every 5 or 10 minutes) and it takes some time to save it !
Can anyone help me with that??
Why does Quark has made SO big file???
Thank you all for your time!

This is really a Quark issue and better asked in their forum areas. However, have you tried to do a Save As and see how big the resultant document is?

Photo library gone during copying the file...

I bought a new Mac and wanted to import the library into my new computer. So I started to copy the file onto my external hard drive wth the idea to connect that drive to my new computer and use if from there to imported into my new iPhoto 11.
However, the copying was going to take 256 hours accoring to my G5 because the file was 25 GB big, so I cannceled it to try something else. After canceling, the copied file showed a size of 500 mb and the original file was gone! I checked everywhere, but it seems that I lost my comlete iphoto library. This is rerrible, how can a file dissapear only because I canncels a copy, (not a cut and past).
Does someone has suggestions?
André

How did you go about trying to copy the library from the G5 to the EHD? Did you just click and drag it to the EHD?
Or did you use the Move method? That is hold down the Command+Shift key and drag the file from the G5 to the EHD. This method copies the file to the destination and delete it from the source when the copy is done. If you did use the move method and cancelled the "move" when you did it might have deleted the source file and left you with just the partial file on the EHD. The "move" feature was an issue a while back as I recall.

Can't copy large files to any Samba share

Just updated to Mavericks but i'm having big problems moving bigger files (so far i've tried a couple of 4GB files) to a SMB share. Just the other day i could copy these files over just fine under Mountain Lion but Mavericks throws this error:
"The item blablabla.bla can't be copied because it's too large for the volume's format"
So far i've tried with a couple of files smaller than 4GB (up to 2.5gb so far) work just fine. No write errors either. The files can be copied without problems when i boot from my older harddrive with Mountain Lion still on it so i'm going to go out on a limb and say it's not a file or server error but a Mavericks error. Anyone know why or what to edit for this to work normally again?

I have temporarily resolved this problem by reconnecting to the server and shares differently.
Disconnect from the server
In Finder, select "Go" and then "Connect to server..."
For server address enter: CIFS://ServerNameOrIPAdress/
Select the shares you need
You will now be able to move bigger files to SMB shares again. For ease of use, drag a share or a folder within a share to your Sidebar.
As it appears Apple has implemented a newer version of the SMB protocol, SMB2, that is still somewhat buggy and will throw errors like these.
I hope this helps someone else as well.

Copy big file in phases

Similar Messages

Maybe you are looking for