Send huge data through the network
Hi all,
I need to transfer large image (around 200MB) through the network to the neighborhood PCs for processing. The time i have is very short (Say 4 seconds).
Since, i need to send the image to multiple PCs, i thought UDP will be helpful. But the LabVIEW UDP vis having limitation of 548 bytes reading for each run. So i need to run in a loop and get the image. Building the string also will be of great memory related task. So the time taken is very high (in the order of minutes). often, i am missing some of the bytes during the operation.
Then i have tried TCP/IP, planning to send to only one PC. There also when the size is more than 78MB, i am not able to send in single time. Is it so? But i have not seen any limitations in the documents. For 78 MB it take around 18 seconds. But the data is safe.
The great disadvantage of these two method is, i need to flatten as a string and and rebuild the image in the other end.
I have tried one more option also, using save as bmp, and read from the network. This work quite better compared to the other two. Time take to transfer 200MB image is 24 seconds ( 5 seconds to save in the same PC + 19 seconds to read through the network). Still it is far from my requirement. One advantage here is, i can read as image datatype it self.
I have used 100Mps LAN, yes, i can go far 1GPS. Then any other idea how to transfer these huge files in quick manner.
Thanks,
Logic
Hi cc,
Yes, i was quite clear on that. The point i want to explain is - because of the limitation of the VIs (like 548 bytes for UDP & 78MB for TCP/IP) we are not able to achieve this.
I need to flatten to string the 200MB image.
I need to send this in a loop (loop delay may needed to synchronize)
I need to concatenate at the other end
Unflatten to image
Look at the timing i have send in my last mail. Its huge for UDP & TCP/IP
But the File I/O looks simple and comes closer to your calculation. In my trial i have sent 180 Mega byte image - it took 19 seconds to read from the network PC Harddisk in 100mbps line - which looks good. In a way File I/O also, should do the same (Flatten - read thru network -May be in an ideal way). Anyway, I have left with 2 questions now.
In File I/O, i need to first write image in to Harddisk of the same PC - that time going to remain the same, any ideas on reducing this? Any chance for without saving into HD - transfer?
Will it reduce directly 10 times if i go for 1Gbps? (200MB in 2 Secs?) Anything else decides this timing?
Thanks,
logic
Similar Messages
-
I need to find out how much wifi data my apps are using. I am on a very limited amount of WiFi data each month, which I am regularly exceeding. I have been told to work out which of my apps is using the data. Also, I think I have closed an app by double clicking the home button, then swiping the app up - is this the way to close it, or will it still be sending/receiving data?
Go into your Settings : General : and turn off background refresh for your apps. In Settings : Mail turn Fetch new data to OFF and Load Remote Images to OFF. This will mean that Mail will only check for messages when you actually use it, and all your advertising junk mail won't have all the images in it.
Turn off push notifications every chance you get.
Make sure you are actually quitting apps: to quit apps press the Home button twice and you should see a bunch of smaller screen images for every open app. To quit the app swipe from the screen image (not the icon) upward off the top of the iPad. You can swipe left and right to see more open apps, but there must be no left-right movement on the screen when you swipe upward to close the app.
Turn off your internet connection when you do not need it. The easiest way to do this is to swipe up from the bottom of you screen to get the control centre, and then touch the airplane to turn on airplane mode. You can repeat this sequence to turn it back on again when you need it. Most especially turn airplane mode on whenever you are sleeping your iPad for long periods. This will save battery life too. OR actually turn your iPad off - which means holding the power key down for several seconds until the red swipe bar appears, and then swipe to turn it off. If you go this route, note that it will take longer to turn on then it takes to wake from sleep. -
Sending publickey through the network as a byte array.
I send client public key form server to client as a byte array through the network. I'm sruggling when I get that byte array from client side and again assign to the PublicKey variable. Anyone can give me any hints how can I extract the public key from the byte array.
Thank youIf your public key is from an X509 certificate, you can use the X509EncodedKeySpec class.
-
Does ODBC encrypts data while passing through the network?
Does ODBC encrypts data while passing through the network?
ODBC uses the underlying Oracle networking components to transmit data. By default, these components do not encrypt data, although they can be made to do so-- see the "SSL Encryption" thread from a few days ago.
Justin -
The serial port seems to be working, and labview seems to be sending the data, but the problem is in which format does it send the data, because in hyperterminal i just input the string "JDX" and it sends it to my device, with labview it sends something but my device does not recognize it.
nobuto wrote:
> I want to transfer data through the serial port in the same coding
> that hyperterminal uses. How can i do it?
>
> The serial port seems to be working, and labview seems to be sending
> the data, but the problem is in which format does it send the data,
> because in hyperterminal i just input the string "JDX" and it sends it
> to my device, with labview it sends something but my device does not
> recognize it.
Hyperterminal adds the carriage return/line feed to the string which is
generated by the return key to send out the current line. LabVIEW simply
sends out what you tell it, so try to set the string to "Show \ Display"
format and add a \r or \n or \r\n to the command you want to send out.
Assumes of course that you set the right baudr
ate/bits/parity etc in
LabVIEW with the VISA property node, when opening the serial port.
Rolf Kalbermatter
Rolf Kalbermatter
CIT Engineering Netherlands
a division of Test & Measurement Solutions -
Problem related to Sending Of Data through SMS/Mail?
Hi All,
I want to send my Data to the respective client through Mail/SMS. can I configure my system for that, And If yes than HOW?Hi All,
I want to send my Data to the respective client through Mail/SMS. can I configure my system for that, And If yes than HOW? -
TT16060: Failed to read data from the network. select() timed out
hi!
i am working on active standby pair.....i created
[activedsn]
Driver=/d01/oracle/tt70/TimesTen/tt70/lib/libtten.so
DataStore=/d01/oracle/tt70/TimesTen/tt70/info/activedsn
DatabaseCharacterSet=WE8MSWIN1252
PermSize=10
[standbydsn]
Driver=/d01/oracle/tt70/TimesTen/tt70/lib/libtten.so
DataStore=/d01/oracle/tt70/TimesTen/tt70/info/standbydsn
DatabaseCharacterSet=WE8MSWIN1252
PermSize=10
[sub3]
Driver=/d01/oracle/tt70/TimesTen/tt70/lib/libtten.so
DataStore=/d01/oracle/tt70/TimesTen/tt70/info/sub3
DatabaseCharacterSet=WE8MSWIN1252
PermSize=10
replication schemes; .............all are on same hosts..........
activedsn datastore.............
Command> create table readtab(a number not null primary key,b varchar2(31));
Command> insert into readtab values(101,'aaaa');
1 row inserted.
Command> commit;
command>create active standby pair activedsn on "tap2.test3.com",standbydsn on "tap2.test3.com" return receipt subscriber sub3 on "tap2.test3.com";
standbydsn datastore..........
command>ttrepadmin -duplicate -from activedsn -host "tap2.test3.com" -uid adm -pwd adm "dsn=standbydsn";
sub3 datastore..........
command>ttrepadmin -duplicate -from standbydsn -host "tap2.test3.com" -uid adm -pwd adm "dsn=sub3";
now they are working fine when i insert something from activedsn it is replicated to standbydsn and from standbydsn to sub3 ......
problem:
but when i test "Recovering from a failure of the standby master data store"
i ttdestroy standbydsn..............and on activedsn i executed
command>call ttrepstatesave('failed','standbydsn','tap2.test3.com');
after that all updates from activedsn were replicated to sub3....in the meanwhile i again duplicated standbydsn from activedsn
command>ttrepadmin -duplicate -from activedsn -host "tap2.test3.com" -uid adm -pwd adm "dsn=standbydsn";
now what happens updates from activedsn are replicated to standbydsn but no updates are replicated to sub3 it is giving error
15:24:29.29 Warn: REP: 7077: SUB3:receiver.c(1931): TT16060: Failed to read data from the network. select() timed out
15:29:36.09 Warn: REP: 7008: STANDBYDSN:receiver.c(1931): TT16060: Failed to read data from the network. TimesTen replication agent is stopping
replication agents for all are running.............
please helppppp..........
Edited by: Muhammad.Usman on Oct 13, 2009 2:57 AM
Edited by: Muhammad.Usman on Oct 13, 2009 3:08 AM[timesten@tap2 bin]$ ttrepadmin -showconfig activedsn
Self host "TAP2.TEST3.COM", port auto, name "ACTIVEDSN", LSN 0/916688, timeout 120, threshold 0
List of subscribers
Peer name Host name Port State Proto
SUB3 TAP2.TEST3.COM Auto Start 24
Last Msg Sent Last Msg Recv Latency TPS RecordsPS
00:00:03 - -1.00 -1 -1
Peer name Host name Port State Proto
STANDBYDSN TAP2.TEST3.COM Auto Start 24
Last Msg Sent Last Msg Recv Latency TPS RecordsPS
00:00:03 00:00:04 -1.00 -1 -1
List of objects and subscriptions
Table details
Table : ADM.READTAB Timestamp updates : -
Master Name Subscriber name
STANDBYDSN SUB3
STANDBYDSN ACTIVEDSN
Table details
Table : ADM.READTAB Timestamp updates : -
Master Name Subscriber name
ACTIVEDSN SUB3
ACTIVEDSN STANDBYDSN
Datastore details
Master Name Subscriber name
STANDBYDSN SUB3
STANDBYDSN ACTIVEDSN
Datastore details
Master Name Subscriber name
ACTIVEDSN SUB3
ACTIVEDSN STANDBYDSN
[timesten@tap2 bin]$ ttrepadmin -showstatus activedsn
Replication Agent Status as of: 2009-10-13 20:42:02
DSN : activedsn
Process ID : 19000 (Started)
Replication Agent Policy : manual
Host : TAP2.TEST3.COM
RepListener Port : 58698 (AUTO)
Last write LSN : 0.973840
Last LSN forced to disk : 0.973840
Replication hold LSN : 0.968456
Replication Peers:
Name : SUB3
Host : TAP2.TEST3.COM
Port : 58371 (AUTO) (Connected)
Replication State : STARTED
Communication Protocol : 24
Name : STANDBYDSN
Host : TAP2.TEST3.COM
Port : 59000 (AUTO) (Connected)
Replication State : STARTED
Communication Protocol : 24
TRANSMITTER thread(s):
For : SUB3
Start/Restart count : 6
Send LSN : 0.971432
Transactions sent : 2
Total packets sent : 158
Tick packets sent : 112
MIN sent packet size : 48
MAX sent packet size : 568
AVG sent packet size : 59
Last packet sent at : 20:42:00
Total Packets received: 158
MIN rcvd packet size : 48
MAX rcvd packet size : 96
AVG rcvd packet size : 64
Last packet rcvd'd at : 20:42:00
TRANSMITTER thread(s):
For : STANDBYDSN
Start/Restart count : 4
Send LSN : 0.971432
Transactions sent : 2
Total packets sent : 106
Tick packets sent : 84
MIN sent packet size : 48
MAX sent packet size : 560
AVG sent packet size : 63
Last packet sent at : 20:42:00
Total Packets received: 104
MIN rcvd packet size : 48
MAX rcvd packet size : 96
AVG rcvd packet size : 66
Last packet rcvd'd at : 20:42:00
Most recent errors (max 5):
TT16122 in transmitter.c (line 3313) at 20:28:28 on 10-13-2009
TT16121 in transmitter.c (line 3048) at 20:28:28 on 10-13-2009
TT16060 in transmitter.c (line 5028) at 20:33:59 on 10-13-2009
TT16122 in transmitter.c (line 3313) at 20:33:59 on 10-13-2009
TT16121 in transmitter.c (line 3048) at 20:33:59 on 10-13-2009
RECEIVER thread(s):
For : STANDBYDSN
Start/Restart count : 1
Transactions received : 0
Total packets sent : 33
Tick packets sent : 0
MIN sent packet size : 48
MAX sent packet size : 68
AVG sent packet size : 67
Last packet sent at : 20:42:00
Total Packets received: 33
MIN rcvd packet size : 48
MAX rcvd packet size : 135
AVG rcvd packet size : 51
Last packet rcvd'd at : 20:42:00
[timesten@tap2 bin]$
[timesten@tap2 bin]$ ttrepadmin -showstatus standbydsn
Replication Agent Status as of: 2009-10-13 20:42:35
DSN : standbydsn
Process ID : 19102 (Started)
Replication Agent Policy : manual
Host : TAP2.TEST3.COM
RepListener Port : 59000 (AUTO)
Last write LSN : 0.1007904
Last LSN forced to disk : 0.1007904
Replication hold LSN : 0.1002472
Replication Peers:
Name : SUB3
Host : TAP2.TEST3.COM
Port : 58371 (AUTO) (Connected)
Replication State : STARTED
Communication Protocol : 24
Name : ACTIVEDSN
Host : TAP2.TEST3.COM
Port : 58698 (AUTO) (Connected)
Replication State : STARTED
Communication Protocol : 24
TRANSMITTER thread(s):
For : SUB3
Start/Restart count : 2
Send LSN : 0.1005496
Transactions sent : 1
Total packets sent : 48
Tick packets sent : 33
MIN sent packet size : 48
MAX sent packet size : 568
AVG sent packet size : 65
Last packet sent at : 20:42:30
Total Packets received: 48
MIN rcvd packet size : 48
MAX rcvd packet size : 96
AVG rcvd packet size : 64
Last packet rcvd'd at : 20:42:30
Most recent errors (max 5):
TT16229 in transmitter.c (line 6244) at 20:38:01 on 10-13-2009
TRANSMITTER thread(s):
For : ACTIVEDSN
Start/Restart count : 1
Send LSN : 0.1005496
Transactions sent : 0
Total packets sent : 36
Tick packets sent : 34
MIN sent packet size : 48
MAX sent packet size : 135
AVG sent packet size : 50
Last packet sent at : 20:42:30
Total Packets received: 36
MIN rcvd packet size : 48
MAX rcvd packet size : 68
AVG rcvd packet size : 67
Last packet rcvd'd at : 20:42:30
RECEIVER thread(s):
For : ACTIVEDSN
Start/Restart count : 1
Transactions received : 1
Total packets sent : 42
Tick packets sent : 0
MIN sent packet size : 48
MAX sent packet size : 96
AVG sent packet size : 66
Last packet sent at : 20:42:30
Total Packets received: 47
MIN rcvd packet size : 48
MAX rcvd packet size : 190
AVG rcvd packet size : 58
Last packet rcvd'd at : 20:42:30
[timesten@tap2 bin]$
[timesten@tap2 bin]$ ttrepadmin -showstatus sub3
Replication Agent Status as of: 2009-10-13 20:43:05
DSN : sub3
Process ID : 18898 (Started)
Replication Agent Policy : manual
Host : TAP2.TEST3.COM
RepListener Port : 58371 (AUTO)
Last write LSN : 0.707088
Last LSN forced to disk : 0.707088
Replication hold LSN : -1.-1
Replication Peers:
Name : ACTIVEDSN
Host : TAP2.TEST3.COM
Port : 0 (AUTO)
Replication State : STARTED
Communication Protocol : 24
Name : STANDBYDSN
Host : TAP2.TEST3.COM
Port : 0 (AUTO)
Replication State : STARTED
Communication Protocol : 24
RECEIVER thread(s):
For : ACTIVEDSN
Start/Restart count : 1
Transactions received : 0
Total packets sent : 46
Tick packets sent : 0
MIN sent packet size : 48
MAX sent packet size : 96
AVG sent packet size : 65
Last packet sent at : 20:43:00
Total Packets received: 46
MIN rcvd packet size : 48
MAX rcvd packet size : 134
AVG rcvd packet size : 51
Last packet rcvd'd at : 20:43:00
RECEIVER thread(s):
For : STANDBYDSN
Start/Restart count : 1
Transactions received : 1
Total packets sent : 45
Tick packets sent : 0
MIN sent packet size : 48
MAX sent packet size : 96
AVG sent packet size : 66
Last packet sent at : 20:43:00
Total Packets received: 50
MIN rcvd packet size : 48
MAX rcvd packet size : 190
AVG rcvd packet size : 56
Last packet rcvd'd at : 20:43:00
[timesten@tap2 bin]$
[timesten@tap2 bin]$
Edited by: Muhammad.Usman on Oct 13, 2009 9:57 PM -
i am receiving the data through the rs232 in labview and i have to store the data in to the word or text file only if there is a change in the data. I have to scan the data continuasly. how can i do that. I was able to store the data into the text or word file but could not be able to do it. I am gettting the data from rs232 interms of 0 or 1. and i have to print it only if thereis a change in data from 0 to 1. if i use if-loop , each as much time there is 0 or 1 is there that much time the data gets printed. i dont know how to do this program please help me if anybody knows the answer
I have attatched the vi. Here in this it receives the data from rs232 as string and converted into binery. and indicated in led also normally if the data 1 comes then the led's will be off. suppose if 0 comes the corresponding data status is wrtten into the text file. But here the problem is the same data will be printed many number of times. so i have to make it like if there is a transition from 1 to o then only print it once. how to do it. I am doing this from few weeks please reply if you know the answer immediatly
thanking you
Attachments:
MOTORTESTJIG.vi 729 KB -
How can I get my 2010 macbook pro to send signal out through the mini display port?
First, what you said is contradictory. You say "can't get a video signal", then say"the Mac wallpaper is broadcast, the mouse pointer is visible". "No video signal" means an absolutely black,blank screen. It sounds like you have plenty of signal.
I am supposing what you are seeing is actually a blank desktop, which is to be expected if your settings are such that you are extending the desktop, instead of mirroring it.
Within the preference panes is a setting that allows you to change this. Open System Preferences, click Displays, and then click Arrangement. You will see that you are extending the desktop. Change that setting. -
My macbook pro with OS 10.6.7 'mail' program does not send my mail through the IPS wireless, I am connected to. The message is my 'e-mail is rejected by the server'. It has been working until 5 days ago. The connection doctor says I am connected and no log in required.
After trying lots I found now in 'Airport Utility is 'unable to detect any airport wireless devises.....'
There is no provider to be seen in airport utility and only 'rescan' is an option with no results...
even so I am connected and can browse the net receive mail etc. and the outgoing 'mail server' is set to the internet provider I am connected to.
Can you enlighten me what can I do I need to use my e-mail program urgently !!!
Thanks for your helpI'm not sure what "IPS wireless" is, but unless you have an Apple Wi-Fi base station (such as a Time Capsule, AirPort Extreme, or AirPort Express), AirPort Utility won't see anything.
You might try defining a new SMTP server to see if that will work any better.
By the way, the subject field for these messages isn't intended to hold a lot of text. Put a short description of your problem in the subject field and save the rest of your message for the body field. -
How to send binary data in the message body
How can we send binary data in the message body that is base64 encoded? below are the requirements
Mime Header.
Mime-version: 1.0
Content-Type: application/octet_stream; name=test
Content-Transfer-Encoding: Base64
Submission must be named "test.sub" (lowercase)
Submission must be base64 mime-encoded
Submission must be sent in the body of the message (not as an attachment)
Only one submission per mail message
No other comments should be put in the body of the mail message (other than the submission)
I highly appreciate your help. If you can provide few examples, that will be very helpfull.
Thanks,
MadanUse Message.setContent to set the content, or use Message.setDataHandler with
a DataHandler constructed with a ByteArrayDataSource. If the content is not
"naturally" encoded in base64, you can enforce it by setting the Content-Transfer-Encoding
header to "base64". Any reasonable mail reader won't care what encoding you use, as
long as the decoded data is correct. -
why does a standalone program created in Labview 8.5 try connecting to the internet when the program only reads data through the serial port? Firewalls object to progams that contact the internet without permission.
The created program is not performing a command I have written when it tries to connect to the internet, it must be Labview that is doing it. How do I stop this from happening?
Any help would be very appreciated.It looks that way..
"When LabVIEW starts it contacts the service
locator to removes all services for itself. This request is triggering
the firewall.This is done in case there were services that were not
unregistered the last time LabVIEW executed- for example from VIs that
didn't clean up after themselves"
This is not yet fixed in LV2009.
Message Edited by Ray.R on 11-04-2009 12:25 PM -
Backup my external hard drives through the network.
I have a small network at the house. Three computers hooked up to the airport extreme router. Then I have a usb hub connected to the input of the router. To the hub I have 4 external Maxtor 1tb hard drives. Everything works beautifully.
I would like to have two of the external hard drives back up the other two externals.
I tried time machine, special software, Maxtor sync manager nothing works.I'm having similar issues to that. I have a Maxtor 500GB external drive that I would like to be able to attach to my Airport Extreme and access it that way. I am part of a three computer home network, but I'm the only one running Leopard, and I want the other two computers to be able to use the drive for simple drag and drop backup, rather than TM. However, after much searching, I haven't really got anywhere in figuring out how to set it up. How did you set up your drives going through the network?
-
I installed Mavericks and now I can't print to my brother HL-2040 through the network
I installed Mavericks and now I can't print to my brother HL-2040 through the network, it does not see the printer
Here's the link to that article:
http://support.apple.com/kb/PH11143
However it has not been updated to refelct if it works with Mavericks -
When I send an imessage with wifi it sends it from the original number I got with the phone before I ported my number over. When I send an imessage on the network it comes from my own ported number. How do I change the imessage so that it comes from my own ported number?
Yeah send it from your phone.
Your computer has no knowledge of your phones phone number, it is not a phone.
Maybe you are looking for
-
Upgrade path 10.0.4 - 10.3.9
Is it possible to upgrade from OS X 10.0.4 to 10.3.9? Or what is the highest I can go from 10.0.4. I have an old iMac graphite DV Special Edition
-
I've got a hp 4215 all-in-one. The scan and fax doesn't work. I've browsed through this forum and tried various fixes but noting seems to work. Actually, t briefly worked and then when I tried it today, nothing. I've uninstalled, reinstalled, install
-
Error Message :- ORA-12203 TNS : Unable to connect to destination
Hi, I am trying to install Oracle 8i and oracle Forms and reports on my personal system for prectise purpose, I have window XP on my system and I installed Oracle Forms & Reports first on my system in C: drive, then I installed Oracle 8i(sql, pl/sql)
-
BB Pearl Missing Symbols in Internet Browser
I am having a problem with missing symbols within the internet browser. When I attempt to use the symbols button in the internet browser, only one page appears (no matter how many times I push it - it says page 1/1). There is only the first page of
-
My iPhone was partially damaged by some dude running it over with a bike. It still worked, although the screen was a little messed up, I could still see and operate everything. However, last night, I tried to put it into Restore mode ( turning power