Files disappear at file transfer
I connected to my selfphone through IrDA and transfered picture files through Nokia PC Suite. I moved them to a folder, and when it finished "moving", the files weren't in the folder nor in the selfphone anymore.
**bleep**?
Did you try to move them from the phone to your PC or from your PC to your phone?
Did you use Windows Explorer, or the PC Suite "Store images" application?
(I never move, but copy and if I'm happy with the copy, then I delete. Just to be on the safe side.)
Similar Messages
-
File transfer using non-blocking sockets - data mysteriously vanish
Hello,
I need to pass some big amount of data using sockets. I my appliaction I have noticed that sometimes I didn't get all bytes. To check it out I wrote simple client + server to figure out what is happening. So:
- I have a sender and receiver application
- I'm trying to transfer 5MB text file.
- On receiver side, output file is never larget than 3MB
- If I put some timeout on sender side (1ms timeout between write operations) everything works fine.
Could someone tell me what I do wrong? Why data disappears and when? The same file transfered using old sockets goes always fine...
Thanks in advance!
Here is complete source for receiver and sender:
RECEIVER:
import java.io.FileOutputStream;
import java.net.InetSocketAddress;
import java.nio.ByteBuffer;
import java.nio.channels.SelectionKey;
import java.nio.channels.Selector;
import java.nio.channels.ServerSocketChannel;
import java.nio.channels.SocketChannel;
import java.util.Iterator;
public class ReceiverA {
* @param args
public static void main(String[] args) {
String outputFile = "c:\\outputA.txt", host = "127.0.0.1";
int port = 8001, bufferSize = 10240;
try {
ByteBuffer buffer = ByteBuffer.allocate(bufferSize);
Selector selector = Selector.open();
ServerSocketChannel server = ServerSocketChannel.open();
server.configureBlocking(false);
server.socket().bind(new InetSocketAddress(host, port));
server.register(selector, SelectionKey.OP_ACCEPT);
System.out.println("Server started");
while(true)
selector.select();
Iterator<SelectionKey> iterator = selector.selectedKeys().iterator();
while (iterator.hasNext()) {
SelectionKey key = (SelectionKey) iterator.next();
iterator.remove();
if (key.isAcceptable()) {
SocketChannel client = server.accept();
client.configureBlocking(false);
client.register(selector, SelectionKey.OP_READ);
continue;
SocketChannel channel = (SocketChannel) key.channel();
int counter = 1;
if ( key.isReadable() ) {
FileOutputStream os = new FileOutputStream(outputFile);
int res;
do
buffer.clear();
res = channel.read(buffer);
counter += res;
System.out.println(res);
buffer.flip();
os.write(buffer.array(), 0, buffer.limit());
while( res >= 0 );
channel.close();
os.close();
System.out.println("Receiver: " + counter);
return;
} catch (Exception e) {
e.printStackTrace();
}SENDER:
import java.io.FileInputStream;
import java.io.IOException;
import java.net.InetSocketAddress;
import java.nio.ByteBuffer;
import java.nio.channels.SelectionKey;
import java.nio.channels.Selector;
import java.nio.channels.SocketChannel;
import java.util.Iterator;
public class SenderA {
public static void main(String[] args) {
String inputFile = "c:\\inputA.txt" , host = "127.0.0.1";
int port = 8001, bufferSize = 10240;
try {
ByteBuffer buffer = ByteBuffer.allocate(bufferSize);
byte[] byteArr = new byte[buffer.capacity()];
Selector selector = Selector.open();
SocketChannel connectionClient = SocketChannel.open();
connectionClient.configureBlocking(false);
connectionClient.connect(new InetSocketAddress(host, port));
connectionClient.register(selector, SelectionKey.OP_CONNECT);
while(true) {
selector.select();
Iterator<SelectionKey> iterator = selector.selectedKeys()
.iterator();
while (iterator.hasNext()) {
SelectionKey key = (SelectionKey) iterator.next();
iterator.remove();
SocketChannel client = (SocketChannel) key.channel();
if (key.isConnectable()) {
if (client.isConnectionPending()) {
System.out.println("Trying to finish connection");
try {
client.finishConnect();
} catch (IOException e) {
e.printStackTrace();
client.register(selector, SelectionKey.OP_WRITE);
continue;
if(key.isWritable()) {
FileInputStream is = new FileInputStream(inputFile);
int res;
int counter = 0;
do
buffer.clear();
res = is.read(byteArr, 0, byteArr.length);
System.out.println(res);
if ( res == -1 ) break;
counter += res;
buffer.put(byteArr, 0, Math.min(res, buffer.limit()));
buffer.flip();
client.write(buffer);
* When I remove comment file transfer goes OK!
//Thread.sleep(1);
while( res != -1 );
client.close();
is.close();
System.out.println("Receiver: " + counter);
return;
catch(Exception e) {
e.printStackTrace();
}There are at least two problems here.
A. In the receiver you should test for -1 from the read() immediately, rather than continue with the loop and try to write -1 bytes to the file.
B. In the sender you are ignoring the return value of client.write(), which can be anything from 0 to the buffer length. If you get 0 you should wait for another OP_WRITE to trigger; if you get a 'short write' you need to retry it until you've got nothing left to write from the current buffer, before you read any more data. This is where the data is vanishing. -
"Windows - No Disk" error message on file transfer
Hello!
I updated our ZDM7 server from plain old ZDM7 with no updates to ZDM7 SP1
IR1. Now, when initiating File Transfer operation with any workstation, up
comes this error message:
"Windows - No Disk"
"Exception Processing Message c0000013 Parameters 75b6bf9c 4 75b6bf9c 75b6bf9c"
[Cancel] [Try Again] [Continue]
If I click "Continue" 4 times, file transfer starts up successfully.
Any ideas about how to get rid of this annoying message?
Toomas AasToomas,
It appears that in the past few days you have not received a response to your
posting. That concerns us, and has triggered this automated reply.
Has your problem been resolved? If not, you might try one of the following options:
- Visit http://support.novell.com and search the knowledgebase and/or check all
the other self support options and support programs available.
- You could also try posting your message again. Make sure it is posted in the
correct newsgroup. (http://support.novell.com/forums)
Be sure to read the forum FAQ about what to expect in the way of responses:
http://support.novell.com/forums/faq_general.html
If this is a reply to a duplicate posting, please ignore and accept our apologies
and rest assured we will issue a stern reprimand to our posting bot.
Good luck!
Your Novell Product Support Forums Team
http://support.novell.com/forums/ -
UCMA 4 and back to backing a file transfer request
OK, I know that file transfer isn't technically supported on UCMA 4.0, but I wanted to take another look at it and see whether there was a way to b2b a file transfer request. After all, there's no reason that it shouldn't work if the messaging is correct,
right? The scenario I have is A <-b2b-> app <-b2b->B. I have an IM conversation going on between A and B, so now I'm trying to set it up so that A can send a file to B.
So far I've extended the platform to accept file transfer requests by creating my own call and factory classes, and then registering them using RegisterPlatformExtension. This means that when A sends a file, the INVITE gets delivered to my application.
Now I'm taking that INVITE and creating a new b2b call. A file transfer request looks something like this:
TL_INFO(TF_PROTOCOL) [0]16A8.4B28::02/10/2015-19:53:05.007.001d492f (SIPStack,SIPAdminLog::ProtocolRecord::Flush:ProtocolRecord.cpp(265))[3939761282] $$begin_record
Trace-Correlation-Id: 3939761282
Instance-Id: FDB3
Direction: incoming
Peer: 10.0.154.20:49282
Message-Type: request
Start-Line: INVITE sip:[email protected] SIP/2.0
From: <sip:[email protected]>;tag=eafd3e699d;epid=ccd5657cac
To: <sip:[email protected]>
Call-ID: 0acf0330423241258576d7c5cc42aa01
CSeq: 1 INVITE
Contact: <sip:[email protected];opaque=user:epid:d2lIs-103l2YSpDwCSajtAAA;gruu>
Via: SIP/2.0/TLS 10.0.154.20:49282
Max-Forwards: 70
Content-Length: 1920
Content-Type: multipart/mixed;boundary="----=_NextPart_000_0026_01D04541.4641C2D0"
Message-Body:
------=_NextPart_000_0026_01D04541.4641C2D0
Content-Type: application/sdp
Content-Transfer-Encoding: 7bit
Content-ID: <[email protected]>
Content-Dis; handling=optional; ms-proxy-2007fallback
v=0
o=- 0 0 IN IP4 192.168.200.71
s=session
c=IN IP4 192.168.200.71
b=CT:99980
t=0 0
m=data 21300 TCP/RTP/SAVP 127
a=ice-ufrag:lYAu
a=ice-pwd:y0gkW4r9zGSW6E2VdtMprlEh
a=candidate:1 1 TCP-PASS 2120613887 192.168.200.71 10856 typ host
a=candidate:1 2 TCP-PASS 2120613374 192.168.200.71 10856 typ host
a=candidate:2 1 TCP-ACT 2121006591 192.168.200.71 21300 typ host
a=candidate:2 2 TCP-ACT 2121006078 192.168.200.71 21300 typ host
a=candidate:3 1 TCP-PASS 2120612863 10.0.154.20 31624 typ host
a=candidate:3 2 TCP-PASS 2120612350 10.0.154.20 31624 typ host
a=candidate:4 1 TCP-ACT 2121005567 10.0.154.20 3921 typ host
a=candidate:4 2 TCP-ACT 2121005054 10.0.154.20 3921 typ host
a=cryptoscale:1 client AES_CM_128_HMAC_SHA1_80 inline:4CZbzYM/GYDbygj8JwMTodKo85C4Xx7TMzeMIuBU|2^31|1:1
a=crypto:2 AES_CM_128_HMAC_SHA1_80 inline:Ohlo65gDsUvxCF39A382Rl4vGL+SG9R/lUEYU/br|2^31|1:1
a=crypto:3 AES_CM_128_HMAC_SHA1_80 inline:EZ7Zm3K0H/WW5K49LAk9/C0T8x8nhkumJOycSek7|2^31
a=setup:active
a=connection:new
a=rtcp:21300
a=mid:1
a=sendonly
a=rtpmap:127 x-data/90000
------=_NextPart_000_0026_01D04541.4641C2D0
Content-Type: application/ms-filetransfer+xml
Content-Transfer-Encoding: quoted-printable
Content-ID: <[email protected]>
Content-Dis; handling=optional
<request xmlns=3D"http://schemas.microsoft.com/rtc/2009/05/filetransfer" =
requestId=3D"13">
<publishFile>
<fileInfo embedded=3D"true">
<id>{67190A30-C59F-480D-96DD-5F3941C39C49}</id>
<name>dbchange.log</name>
<size>3609</size>
</fileInfo>
</publishFile>
</request>
------=_NextPart_000_0026_01D04541.4641C2D0--
$$end_record
I've got my b2bed invite looking almost identical to the original invite by creating a custom MIME type on the CallEstablishOptions for the back to back call using something like this:
Regex r = new Regex(@"^((.|\n)*)(\<request)((.|\n)*)(request\>)((.|\n)*)$");
Match m=r.Match(args.RequestData.GetMessageBodyString());
content=string.Format("Content-Transfer-Encoding: quoted-printable\r\n{0}{1}{2}",m.Groups[3],m.Groups[4],m.Groups[6]);
opt.CustomMimeParts.Add(new MimePartContentDescription(new ContentType("application/ms-filetransfer+xml"),System.Text.ASCIIEncoding.UTF8.GetBytes(content)));
opt.CustomMimeParts[0].ContentDispositionHeader = new SignalingHeader("Content-Disposition", "render; handling=optional");
So far the only differences I can see in my outbound message vs the original SDP are that the Content-Transfer-Encoding might not be seen as a header (since the SignalingHeaders property on the MimePartContentDescription is read only), and the Content-Transfer-Encoding
on the first MIME part (created by the BackToBackCall) is missing (even though I specified it on the PassThroughHeaders). Even with all of this though, I still get a 488 on client B when I attempt the transfer (even though the invite goes through).
What I'm wondering though, is whether there's any way at all to get this working the way I'd expect, where a file gets transferred directly between A and B, without my bot having to receive it first. The other approach I've looked at is binding my
own media provider class to customize the SDP, but if this MIME part approach isn't going to work, then I have a feeling the media provider won't work either.
Any suggestions on where to look next?
Thanks!
ChrisChris,
I am trying to do something similar to this and from what I have read and in talking to MS is that you need to extend the Call and Flow class which it looks like you have been able to do. Could I bother you to share what you have written? Maybe we can help
each other out on this. I am basically trying to create an application that will be able to capture a file transfer and save it, then send the original request on to the intended recipient.
Thanks in advance,
Anthony -
i just purchase the new iphone 4s. I also have an old ipod with a lot on songs which are not on my itunes becasue i didn't do a file transfer when i got my new computer a ew months ago. How can i add my songs from the old ipod to my itunes.
See this older post from another forum member Zevoneer covering the different methods and software available to assist you with the task of copying content from your iPod back to your PC and into iTunes.
https://discussions.apple.com/thread/2452022?start=0&tstart=0
B-rock -
MBP (mid-2009) freezing, slow installations and file transfer
I bought the latest MacBook Pro model and installed Snow Leopard on a cleanly formatted hard drive. I have tried migrating via ethernet and FireWire from my iMac, but the migrations failed either due to freezing (via FireWire after roughly 24 hours of file transfer) or by an error message (ethernet with Migration Assistant).
Only through a Time Machine backup was I able to transfer my account files to the MBP, which again totaled at over 20 hours of transferring. The system was a mess, clogged constantly by freezing and spinning beach balls of death for durations lasting around 10-20 seconds during which music would clip after 5-10 seconds of everything not responding, this being accentuated especially during installations. I decided to format and try anew.
Now I've formatted the hard drive, installed Snow Leopard and will transfer my files manually onto a clean account. Installations take a long time although SL installation is within 30 minutes, iLife took 1.5 hours to install 5 GB. During the installation Safari stopped responding, as did the entire system, and the spinning beach ball would keep spinning. Watching a 480p trailer in Quicktime made the entire computer freeze up (no video/audio) for 10 seconds halfway. Transferring 136 GB (my Music folder) will take around 15 hours according to the estimate after 10 minutes of transferring.
I've sold my iMac now and all I have are the files on my external hard drive. I want to get them onto my MBP ASAP but the slowness is preventing me from doing what needs to be done and it's very frustrating. When I try to boot into Hardware Testing by holding D down the computer doesn't do it no matter what (Application DVD in or not, plugged into power or not). I've tried resetting PRAM but I get the same inaction.
Any ideas?
Edit: I've done Disk Utility to no avail, it finds nothing wrong.Installed, still getting freezes with spinning beach balls. Transfer says it would take 1 hour opposed to that 15 hours, but it stops transferring after X amount of gigabytes (from 0.5 to 5), not do anything for a while and then continue, stretching the estimate to over 2 hours after some time. I don't know if this is just with the hard drive.
The freeze-ups are frustrating as **** and make for a very poor experience. Any ideas to get to the bottom of this? I still haven't been able to boot into the Hardware Test no matter how much I try. -
Setup:
Cable modem to Linksys WRT54g broadcasting only in G only mode for PBG4.
AEBSn#1 in bridge mode via Ethernet from Linksys, N only mode, broadcasting wirelessly.
AEBSn#2 is wirelessly extending N-only from AEBSn#1, and is connected to a mini with external hard drive.
Using PBG4, if I mount a volume from the mini and transfer a file, transfer time is very slow: approx. 20 minutes for a 200MB file. If I FTP from PBG4 into the mini, transfer time is 2 minutes.
(I think the same happens if I use a Macbook Pro connected to the N-only network, but it's in for repairs right now, so I can't be sure.)
Any idea why the transfer times are so different b/w AFP and FTP and, more importantly, what I can do to remedy this? Thanks.Same problem here. I have two AEBS Gigabit in bridge mode. Transfering a file via FTP or with Apple Remote Access (ARD) brings up to 3 MB/sec. Same file and same configuration connected via AFP only brings 60 kB/sec.
I hope somebody has an idea how to fix this.
Thanks in advance -
How to achieve the maximum file transfer rate from PXI to local host?
I will have to copy a huge amount of data (as big as 50 GB) from a PXI-8106 unit on site to a laptop. Currently it would take several hours. It is critical to max out the data transfer rate.
The standard method we've been using is just drag and drop using Windows Explorer via FTP. I tried to use FTP VIs with Filezilla Server as well but the transfer rate is only like 1.5 MB/s. Is this normal? Once I saw it was 3.0 MB/s but for some reason, that isn't happening now.
For another option, I tried to transfer data to a USB flash drive but it's even slower. As far as I know, USB 2.0 transfer rate is supposed to be around 60 MB/s but why would it be slower than 1.5 MB/s? What could be the speed limiting factor in my file transfer setup?
Any tips on improving file transfer rate would be appreciated!Sustained 40 MB/s? That is my dream speed! The maximum speed I've ever seen here was about 25 MB/s, which is still very good, and that happened only after copying back and forth, which I explained above. Let me go through what I did with screencaps first.
These are the test tdms files to transfer in the PXI: an original file witten in the PXI and its copy file. I copied the original file from PXI to laptop and renamed it (added '_copy') and then copied it back to PXI.
FTP module is transferring the original file to the Filezilla server on laptop. Note the low speed.
FTP module is transferring the copy file to the Filezilla server on laptop. Note the higher speed.
This is the FTP sub VI I'm using. It transfers files in sub-folders (one level lower), too. The data connection is set to 'passive' on the FTP Put Multiple Files VI but it doesn't seem to make any difference. I attach the sub VI.
You tried the file transfer with a 500 MB text file. Would there be any difference if the file type was tdms? Would the RAM size matter? It is 2GB here.
And the LED is orange, which means Gigabit.
Another question: Is there any way to programmatically stop file transfer in progress? Currently, I just have to restart the PXI.
Thank you!
Attachments:
FTP.vi 40 KB -
How do you install CS5 onto a new computer without Time Machine/file transfer
I'm not getting a new computer, but my current one is getting a little old (Macbook Pro V. 10.6.8) and I'm afraid it might crash if I download the newest Maverick system, which is why I want to make absolutely sure I'm able to save and transfer all my old files and CS5 Creative Suite programs if this indeed happens. I don't trust Time Machine to do it; my boss had this happen and Time Machine did not transfer the Adobe programs. I also don't want to rely on Time Machine and any other file transfer (which all new Macs offer) because I've had brand new computers crash because of old corrupt files from my old computer converting over, and the Apple people said it's a bad idea (which would have been nice to know BEFORE the computer crashed and everything. . .) I've been told you can only use the CD to install CS5 onto your computer twice, which I've already done (thanks to my brand new computer crashing once already). So I would like to know how it's possible to install the program onto a new computer should this one crash, without the use of file transfer or Time Machine. I have no interest in upgrading to CC.
Thanks!Avoid using Time Machine for re-installing Adobe software. It rarely works and usually breaks the activation mechanism.
I've been told you can only use the CD to install CS5 onto your computer twice,
Not quite.
You can install the software as many times as you like but you can only activate the software for use on a maximum of two computers at the same time.
To re-install you will need your CS5 serial number.
Download the installer from Download CS5 products
Install then enter your serial number when prompted. -
Will all my files transfer over (or stay) automatically right after upgrading to Yosemite or do I have to backup every single desired program or document? Question is do I HAVE to please if you can answer if its mandatory or not. Not looking for recommendations that I SHOULD back up or anything like that just want to know if it is mandatory to perform a backup to be able to keep or transfer all my current programs and apps and documents currently on my MB Pro Retina.
Yes, upgrading to Yosemite will not touch your 3rd party apps or files in the Home folder.
Although not mandatory you should have a a backup of your hard drive regardless if you upgrade to Yosemite or not. To not have a backup is just playing Russian roulette as there are only two types of hard drives; those that have failed and those that will. -
Remote Execute and File Transfer Error
Whenever we try to do a Remote Execute of File Transfer, we get an 1899
error. Here's the strange thing, we can RE and FT to desktops that are
still running the ZfD 4.x client. Seems to be only happening on the latest
(ZfD 6.5sp2). Any ideas? Also, remote control and remote view still work
w/o problem.Blewis,
It appears that in the past few days you have not received a response to your
posting. That concerns us, and has triggered this automated reply.
Has your problem been resolved? If not, you might try one of the following options:
- Do a search of our knowledgebase at http://support.novell.com/search/kb_index.jsp
- Check all of the other support tools and options available at
http://support.novell.com.
- You could also try posting your message again. Make sure it is posted in the
correct newsgroup. (http://support.novell.com/forums)
Be sure to read the forum FAQ about what to expect in the way of responses:
http://support.novell.com/forums/faq_general.html
If this is a reply to a duplicate posting, please ignore and accept our apologies
and rest assured we will issue a stern reprimand to our posting bot.
Good luck!
Your Novell Product Support Forums Team
http://support.novell.com/forums/ -
Creative Zen USB and File transfer probl
Am the unhappy owner of a brand new Creative Zen touch 20gb mp3 player which apparently works with usb 2.0. After installing the software which came on the cd (file transfer software and nomad explorer) the Zen appears to get recognised by the pc with no problems when i connect via the usb cable. The Zen also displays 'docked' which is all very well. However if i select say 0 tracks to download to the player the xp progress bar seems to halt at around 60-70% and eventually the program (nomad) complains that the operation cannot be completed. I noticed that the small hard dri've in the player feels as though it is 'spinning down' around a similar time to the message being displayed. If at this stage i refresh the players view in nomad explorer it can be found with no problem....its just i cant write to it until i unplug the usb from the zen and reconnect. I spoke to creative who told me that because my pc (in system devices) reports that my usb is an 'open host' adapter...this means it cannot supply adequate power to the player....but surely USB2.0 is USB2.0 and if something claims to be USB2.0 compliant that would be the end of the story? The usb card im using is a usb 2.0 pci card and is also pretty new. Any help/ideas would be greatly appreciated.
I have tried various usb ports, usb and2 conections ( I have both), various cables and combinations and the same happens. I have also tried win xp and win98, and other disks I have with the same result. I have managed to transfer 20 os so mp3s (a small proportion of those I have been trying to transfer)after 3-4 hours hard labour but never the contents of a full folder. After a proportion of the files are transferred then Zen touch becomes 'busy' or 'not connected'. Obviously there is no way I can continue like this and it will have to go back.
I have tried the slightly newer driver but this did not work at all and I had to roll back to the one that came on the CD. I feel that I have given it a fair shot trying all the workarounds.
Is is a USB power problem? Should a powered usb hub cure it's If so why?
But is this surely is Creative's problem. It is obviously a known issue but what are they doing about it's Putting out Zens which are prone to this problem is not good practice. Any solutions out there?Hey,
If you tried it on a friend's computer and you're still having problems then it may be a problem with the Zen. Before you call or e-mail tech support, here is what they will tell you do to first before they really get in depth with helping you. Go into Rescue Mode (there is an explanation on how to do this at the top of the forum) and do a disk clean up. After that, try it. If that doesn't work then click the reload OS option which will take the firmware (like windows to your PC) off the Zen. Don't worry you can easily put it back on. Go to Support>Downloads>select Zen Touch, etc, etc. and download the latest firmware and run it. Hopefully that will fix it....
I had some connection problems myself with my ZT as soon as I got it as well. and simply reflashing the firmware fixed and now I love my Zen. I hope everything works out for you.
Wilco -
Error no. 4 in SAPGUI during graphic call or file transfer.
Hi,
In the landscape there are still 46b sap version, i have some functional queries that when i executes go to the sap graphic screen and it throws with no output. I understand that that it works in ECC version but not for 46b.
This issue is related to SAPGUI, as i have the latest sapgui installed 710 that works well for ECC.
But if i input the parameter in sap 46b system , and execute to get the graphic chart i get this:
The Generation of Graphs for Stock Movements in the MC49 Transaction.
When you call a hierarchy graphic, the following error messages are displayed
1. 'Too much data in a table or too many tables defined
2. E4: error writing to XC pipe: child #1 ( id: STAT ); reclen12
3. Error no. 4 in SAPGUI during graphic call or file transfer.
I have also look in to note 316232, 361222, 96885. for this but this says to upgrade the sapgui,which is already in.
What is the solution for this.
Regards,
Chetan.Take a look at this thread. This may provide you some guidance as it appears that Error has been encountered before.
[Link Here|Error no. 4 in SAPGUI with Graphics call or file transfer;
Regards,
Zecher -
When will file transfer be used to send a message?
Hi,
My understanding is that a message is only sent via file transfer if the size of the message is greater than 75% of the IPC queue capacity; file transfer will never be used in response to a blocking situation that arises due to the number of messages exhausting the queue capacity (this will result in an immediate failure if the TPNOBLOCK flag is used, or else a failure response when the timeout is reached).
We have the following message in the ULOG:
"TMQUEUE.4288.3081606848.0: LIBTUX_CAT:1285: WARN: tpreturn message send blocked, will try file transfer"
Would I be correct in assuming this is because of the size of the message, or is this something specific to TMQUEUE operations? If my understanding of how transfer by disk can occur is wrong, please set me straight!
Thanks,
Malcolm.Malcolm,
Tuxedo will use file transfer if
a) The size of the message is greater than 75% of the total capacity of the queue.
b) The original msgsnd() fails with EINVAL. (Some operating systems have a MSGMAX kernel configuration parameter limiting the size of an individual message which can be set to less than the total capacity of the queue. If an application attempts to send a message greater than this size it will fail with EINVAL.)
c) The original non-blocking msgsnd() fails with EAGAIN and the message is being sent by tpreturn(). (This is the case where LIBTUX_CAT:1285 is logged.)
d) The original non-blocking msgsnd() fails with EAGAIN, the TPNOBLOCK option is not set, the original message is over 500 bytes, the TMNOTHREADS environment variable is not set to Y, and the message is not being sent by certain system processes that are always single threaded.
For domain gateways only, the file transfer in case (c) can be avoided if GW_FILETRANSFER=OFF is set.
Regards,
Ed -
How to increase the speed of network file transfer
hi ,
In my application i want to use the file from one system to another system.
i am using stream reader to get the file over the network , its working fine for small file,
but i want to access file size exceed 10 MB then i faced the problem. Its get very slow the file transfer over the network.
so i am try to use java NIO for transfer file,
Using NIO , While i am make server and client both are same system then the file tranfer is 10MB file in 10 seconds , but i am making server and client are different machine then its take so long to transfer file ie (10 MB file in 3 minutes).
I want to reduce the time . If any chance to reduced the file transfer time then please suggest me.
my code is
Server Code :
public class NioServer implements Runnable {
// The host:port combination to listen on
private InetAddress hostAddress;
private int port;
// The channel on which we'll accept connections
private ServerSocketChannel serverChannel;
// The selector we'll be monitoring
private Selector selector;
// The buffer into which we'll read data when it's available
private ByteBuffer readBuffer = ByteBuffer.allocate(10000);
private EchoWorker worker;
// A list of PendingChange instances
private List pendingChanges = new LinkedList();
// Maps a SocketChannel to a list of ByteBuffer instances
private Map pendingData = new HashMap();
public NioServer(InetAddress hostAddress, int port, EchoWorker worker) throws IOException {
this.hostAddress = hostAddress;
this.port = port;
this.selector = this.initSelector();
this.worker = worker;
public void send(SocketChannel socket, byte[] data) {
System.out.println("Server Send ");
synchronized (this.pendingChanges) {
// Indicate we want the interest ops set changed
this.pendingChanges.add(new ChangeRequest(socket, ChangeRequest.CHANGEOPS, SelectionKey.OP_WRITE));
// And queue the data we want written
synchronized (this.pendingData) {
List queue = (List) this.pendingData.get(socket);
if (queue == null) {
queue = new ArrayList();
this.pendingData.put(socket, queue);
queue.add(ByteBuffer.wrap(data));
// Finally, wake up our selecting thread so it can make the required changes
this.selector.wakeup();
public void run() {
while (true) {
try {
// Process any pending changes
synchronized (this.pendingChanges) {
Iterator changes = this.pendingChanges.iterator();
while (changes.hasNext()) {
ChangeRequest change = (ChangeRequest) changes.next();
switch (change.type) {
case ChangeRequest.CHANGEOPS:
SelectionKey key = change.socket.keyFor(this.selector);
key.interestOps(change.ops);
this.pendingChanges.clear();
// Wait for an event one of the registered channels
this.selector.select();
// Iterate over the set of keys for which events are available
Iterator selectedKeys = this.selector.selectedKeys().iterator();
while (selectedKeys.hasNext()) {
SelectionKey key = (SelectionKey) selectedKeys.next();
selectedKeys.remove();
if (!key.isValid()) {
continue;
// Check what event is available and deal with it
if (key.isAcceptable()) {
this.accept(key);
} else if (key.isReadable()) {
this.read(key);
} else if (key.isWritable()) {
this.write(key);
} catch (Exception e) {
e.printStackTrace();
private void accept(SelectionKey key) throws IOException {
System.out.println("Server Accept ");
// For an accept to be pending the channel must be a server socket channel.
ServerSocketChannel serverSocketChannel = (ServerSocketChannel) key.channel();
// Accept the connection and make it non-blocking
SocketChannel socketChannel = serverSocketChannel.accept();
Socket socket = socketChannel.socket();
socketChannel.configureBlocking(false);
// Register the new SocketChannel with our Selector, indicating
// we'd like to be notified when there's data waiting to be read
socketChannel.register(this.selector, SelectionKey.OP_READ);
private void read(SelectionKey key) throws IOException {
System.out.println("server Read : ");
SocketChannel socketChannel = (SocketChannel) key.channel();
// Clear out our read buffer so it's ready for new data
readBuffer.clear();
// readFully( readBuffer , socketChannel ) ;
// Attempt to read off the channel
int numRead;
try {
numRead = socketChannel.read(readBuffer);
} catch (IOException e) {
// The remote forcibly closed the connection, cancel
// the selection key and close the channel.
key.cancel();
socketChannel.close();
return;
if (numRead == -1) {
// Remote entity shut the socket down cleanly. Do the
// same from our end and cancel the channel.
key.channel().close();
key.cancel();
return;
// Hand the data off to our worker thread
this.worker.processData(this, socketChannel, this.readBuffer.array(), numRead);
private void write(SelectionKey key) throws IOException {
System.out.println("Server Write ");
SocketChannel socketChannel = (SocketChannel) key.channel();
synchronized (this.pendingData) {
List queue = (List) this.pendingData.get(socketChannel);
// Write until there's not more data ...
while (!queue.isEmpty()) {
ByteBuffer buf = (ByteBuffer) queue.get(0);
socketChannel.write(buf);
if (buf.remaining() > 0) {
System.out.println( "buf.remaining() " + buf.remaining() ) ;
// ... or the socket's buffer fills up
break;
queue.remove(0);
if (queue.isEmpty()) {
// We wrote away all data, so we're no longer interested
// in writing on this socket. Switch back to waiting for
// data.
key.interestOps(SelectionKey.OP_READ);
private Selector initSelector() throws IOException {
// Create a new selector
Selector socketSelector = SelectorProvider.provider().openSelector();
// Create a new non-blocking server socket channel
this.serverChannel = ServerSocketChannel.open();
serverChannel.configureBlocking(false);
// Bind the server socket to the specified address and port
InetSocketAddress isa = new InetSocketAddress(this.hostAddress, this.port);
serverChannel.socket().bind(isa);
// Register the server socket channel, indicating an interest in
// accepting new connections
serverChannel.register(socketSelector, SelectionKey.OP_ACCEPT);
return socketSelector;
private static void readFully(ByteBuffer buf, SocketChannel socket) throws IOException
int len = buf.limit() - buf.position();
while (len > 0)
len -= socket.read(buf);
public static void main(String[] args) {
try {
EchoWorker worker = new EchoWorker();
new Thread(worker).start();
new Thread(new NioServer(null, 9090, worker)).start();
} catch (IOException e) {
e.printStackTrace();
}Client Code :
public class NioClient implements Runnable {
// The host:port combination to connect to
private InetAddress hostAddress;
private int port;
// The selector we'll be monitoring
private Selector selector;
// The buffer into which we'll read data when it's available
private ByteBuffer readBuffer = ByteBuffer.allocate( 10596 ) ;
// A list of PendingChange instances
private List pendingChanges = new LinkedList();
// Maps a SocketChannel to a list of ByteBuffer instances
private Map pendingData = new HashMap();
private byte[] bufferByteA = null ;
// Maps a SocketChannel to a RspHandler
private Map rspHandlers = Collections.synchronizedMap(new HashMap());
public NioClient(InetAddress hostAddress, int port) throws IOException {
this.hostAddress = hostAddress;
this.port = port;
this.selector = this.initSelector();
public void send(byte[] data, RspHandler handler) throws IOException {
// Start a new connection
SocketChannel socket = this.initiateConnection();
// Register the response handler
this.rspHandlers.put(socket, handler);
// And queue the data we want written
synchronized (this.pendingData) {
List queue = (List) this.pendingData.get(socket);
if (queue == null) {
queue = new ArrayList();
this.pendingData.put(socket, queue);
queue.add(ByteBuffer.wrap(data));
// Finally, wake up our selecting thread so it can make the required changes
this.selector.wakeup();
public void run()
while (true)
try
// Process any pending changes
synchronized (this.pendingChanges)
Iterator changes = this.pendingChanges.iterator();
while (changes.hasNext())
ChangeRequest change = (ChangeRequest) changes.next();
switch (change.type)
case ChangeRequest.CHANGEOPS:
SelectionKey key = change.socket.keyFor(this.selector);
key.interestOps(change.ops);
break;
case ChangeRequest.REGISTER:
change.socket.register(this.selector, change.ops);
break;
this.pendingChanges.clear();
// Wait for an event one of the registered channels
this.selector.select();
// Iterate over the set of keys for which events are available
Iterator selectedKeys = this.selector.selectedKeys().iterator();
while (selectedKeys.hasNext())
System.out.println( " ----run 5 " ) ;
SelectionKey key = (SelectionKey) selectedKeys.next();
selectedKeys.remove();
if (!key.isValid())
continue;
// Check what event is available and deal with it
if (key.isConnectable())
this.finishConnection(key);
else if (key.isReadable())
this.read(key);
else if (key.isWritable())
this.write(key);
catch (Exception e)
e.printStackTrace();
private void read(SelectionKey key) throws IOException {
System.out.println( "---------read 1 " ) ;
SocketChannel socketChannel = (SocketChannel) key.channel();
// Clear out our read buffer so it's ready for new data
this.readBuffer.clear();
System.out.println( "---------read 2 " + readBuffer.capacity()) ;
readBuffer = ByteBuffer.allocate( bufferByteA.length ) ;
// Attempt to read off the channel
// int numRead;
try {
// numRead = socketChannel.read(this.readBuffer);
readFully( readBuffer , socketChannel ) ;
} catch (IOException e) {
// The remote forcibly closed the connection, cancel
// the selection key and close the channel.
key.cancel();
socketChannel.close();
return;
// if (numRead == -1) {
// // Remote entity shut the socket down cleanly. Do the
// // same from our end and cancel the channel.
// key.channel().close();
// key.cancel();
// return;
// Handle the response
this.handleResponse(socketChannel, this.readBuffer.array(), readBuffer.capacity() );
private void handleResponse(SocketChannel socketChannel, byte[] data, int numRead) throws IOException {
// Make a correctly sized copy of the data before handing it
// to the client
byte[] rspData = new byte[numRead];
// Look up the handler for this channel
RspHandler handler = (RspHandler) this.rspHandlers.get(socketChannel);
// And pass the response to it
if (handler.handleResponse(rspData)) {
// The handler has seen enough, close the connection
socketChannel.close();
socketChannel.keyFor(this.selector).cancel();
private void write(SelectionKey key) throws IOException {
SocketChannel socketChannel = (SocketChannel) key.channel();
readBuffer.flip() ;
List queue = null ;
synchronized (this.pendingData) {
queue = (List) this.pendingData.get(socketChannel);
writeFully( readBuffer , socketChannel ) ;
// Write until there's not more data ...
while (!queue.isEmpty()) {
// ByteBuffer buf = (ByteBuffer) queue.get(0);
// socketChannel.write(buf);
// writeFully( buf , socketChannel ) ;
// if (buf.remaining() > 0) {
// // ... or the socket's buffer fills up
// break;
queue.remove(0);
if (queue.isEmpty()) {
// We wrote away all data, so we're no longer interested
// in writing on this socket. Switch back to waiting for
// data.
key.interestOps(SelectionKey.OP_READ);
private void finishConnection(SelectionKey key) throws IOException {
SocketChannel socketChannel = (SocketChannel) key.channel();
// Finish the connection. If the connection operation failed
// this will raise an IOException.
try {
socketChannel.finishConnect();
} catch (IOException e) {
// Cancel the channel's registration with our selector
System.out.println(e);
key.cancel();
return;
// Register an interest in writing on this channel
key.interestOps(SelectionKey.OP_WRITE);
private SocketChannel initiateConnection() throws IOException {
// Create a non-blocking socket channel
SocketChannel socketChannel = SocketChannel.open();
socketChannel.configureBlocking(false);
// Kick off connection establishment
socketChannel.connect(new InetSocketAddress(this.hostAddress, this.port));
// socketChannel.finishConnect() ;
// Queue a channel registration since the caller is not the
// selecting thread. As part of the registration we'll register
// an interest in connection events. These are raised when a channel
// is ready to complete connection establishment.
synchronized(this.pendingChanges) {
this.pendingChanges.add(new ChangeRequest(socketChannel, ChangeRequest.REGISTER, SelectionKey.OP_CONNECT));
return socketChannel;
private Selector initSelector() throws IOException {
// Create a new selector
return SelectorProvider.provider().openSelector();
public static void main(String[] args) {
try {
NioClient client = new NioClient(InetAddress.getByName("healsoft1"), 9090);
Thread t = new Thread(client);
t.setDaemon(true);
t.start();
RspHandler handler = new RspHandler();
client.readBytesFromFile( handler ) ;
} catch (Exception e) {
e.printStackTrace();
private void readBytesFromFile( RspHandler handler ) throws IOException
File file = new File( "Y:/output.txt") ;
bufferByteA = getBytesFromFile( file ) ;
readBuffer = ByteBuffer.allocate(bufferByteA.length ) ;
readBuffer.put( bufferByteA , 0 , bufferByteA.length ) ;
send(bufferByteA , handler);
handler.waitForResponse();
private static void readFully(ByteBuffer buf, SocketChannel socket) throws IOException
System.out.println( "readFully : " ) ;
int len = buf.limit() - buf.position();
int count = 0 ;
while (len > 0)
len -= socket.read(buf);
private void writeFully(ByteBuffer buf , SocketChannel socketChannel) throws IOException
System.out.println( "writeFully : " ) ;
int len = buf.limit() - buf.position() ;
SocketChannel socket = socketChannel ;
socket.open();
while (len > 0)
len -= socket.write(buf);
private static byte[] getBytesFromFile(File file) throws IOException
InputStream is = new FileInputStream(file);
// Get the size of the file
long length = file.length();
* You cannot create an array using a long type. It needs to be an int
* type. Before converting to an int type, check to ensure that file is
* not loarger than Integer.MAX_VALUE;
if (length > Integer.MAX_VALUE)
System.out.println("File is too large to process");
return null;
// Create the byte array to hold the data
byte[] bytes = new byte[(int)length];
// Read in the bytes
int offset = 0;
int numRead = 0;
while ( (offset < bytes.length)
( (numRead=is.read(bytes, offset, bytes.length-offset)) >= 0) )
offset += numRead;
// Ensure all the bytes have been read in
if (offset < bytes.length)
throw new IOException("Could not completely read file " + file.getName());
is.close();
return bytes;
public static String printTimeWithMilliSec(long l )
Date date = new Date( l ) ;
SimpleDateFormat f = new SimpleDateFormat("HH:mm:ss SSS");
return f.format(date);
}Data transfer rate for a single client is unlikely to be effected by using NIO or old blocking IO. The important factor is the maximum transfer rate you can get between the sender and receiver.
You should be able to get 0.5-1.0 MB per second for each 10 Mbit per second of available bandwidth. Your timings suggest you are getting about a 10-20 Mbit/s link speed. -
WD Elements External drive file transfer issue.
I have just purchased a 1.5Tb USB 2.0 WD Elements external hard drive for backing up data. I have partitioned it, using Disk Utility in to a 1Tb Fat32 and 500Mb OS Journaled (Extended) pair of partitions. The OS Journaled (Extended) partition will replace a smaller Maxtor drive as my Time Machine Backup drive.
The problem: When I attempt to copy/move a file from either the Mac HD or my current backup drive, a 750Gb Maxtor, I get the message "*The operation can't be completed because an item with the name "file/folder name" already exists*." On the Windows XP Boot Camp partition file transfer is not a problem
WD have not been of much assistance and I am hoping someone can remedy this problem for me.and btw, since I have the exact same My Book Essential USB 2.0 1.5 terabyte drive the poster has, I retrieved the Box it came in (Green) and It says plainly on the box. "Compatibility - Formatted NTFS for Windows XP, Windows Vista or Windows 7.
Requires reformatting for Mac OS X Tiger, or Leopard".
OP states he formatted a 1 terabyte partition FAT32. Do any of you actually understand the size restrictions of FAT32? I didn't think so.
I have no problem with this or any other drive since I format every drive I buy for the purpose that I had in mind.
The decision is size/interface/price. Any WD will do, since usb2 at 480 mbits/sec is faster than firewire 400 and out of my 4 macs only usb2 is common across them all, it's a no brainer. Yeah, firewire 800 is faster but only half my macs support it.
So it goes to sleep after 10 minutes of inactivity? TM only updates once per hour. In loose terms it sleeps 50 minutes of every hour when it's not needed. So What.
So in a day's time, that's 1,200 minutes that it doesn't spin...that sounds like a feature to me.
How many new, inexperienced users have you people talked into taking perfectly good drives back to the store? I see it post after post and quite frankly, you don't know what you're talking about.
Full disclosure. I don't work for, or have ever been paid anything from WD. I don't have stock in WD (although I've thought about it). I don't have any other ID's on this board so I don't "game it" like other users.
Maybe you are looking for
-
Help - My Mac is running very slow
My Mac claims to be using 50.2 gb in Other and I dont know how to find out what an earth it all is. I need to reduce as I only have 21gb left of my 120gb and my machine is running a little slow. Can anyone help me
-
How to avoid booking of stock every time, when ever I make Delivery
Hello friends, Need your help again 1) When I am making the delivery, at the time of PGI, system asks for sale order stock. I donu2019t want to book stock of material against sales order, whenever I make delivery. How can I avoid booking of stoc
-
Macbook Pro 2008 Graphics issue. HELP?
I have the 2008 Macbook Pro, 2.6Ghz intel core 2 duo, and have recently encountered the graphics issue which was very common in this machine. My mac is nowhere near dead though, it still runs most of the time from 10 mins (worst case) to a few days-
-
Error message after downloading Office for Mac
Hi, I just bought and downloaded Office 2011 for Mac, and keep getting this error message when trying to open/install the program. Does anyone know what the problem might be? I've already changed the Security/Privacy settings to allow downloads from
-
Why is my GPU eating up so much memory?
Hello All, My GPU is an nVidia GTX 460. I don't know if this is normal or not but just using my idle OS (i.e., nothing GPU heavy is running at all) my GPU is using 400+ MB of its 1023 MB. This is almost half a gig of just GPU RAM dedicated to me usin