TCP data server or better solution?

Hi all,
We upgraded our software system from 32 bit to 64 bit then LabVIEW is also upgraded from LabVIEW 2010 x86 to LabVIEW 2010 x64. However, one device of us does not have the 64 bit driver thus in order to make all the devices works seamlessly in one computer as before, I used TCP data server and client. The server and the main VI are set up on the LabVIEW x64 whereas the client, which drives one device with 32 bit driver, is running on the LabVIEW x86 process on the same computer. I used the Simple Data Server and Simple Data Client in Examples of LabVIEW.
Would you please advise me or give me some suggestions for the following questions:
1. By using this configuration, I can only transfer data in one way. If I want to transfer data in both directions, what should I do? Could you please give me some example codes?
2. I do not understand clearly the synchronization of the server and the client in this case. For example, when I change the waiting time of server and client, sometimes it freezes the program, sometimes it does not work. Could you advise me the perfect way to set the synchronization (as fast as possible).
3. Is there any possible solution that could be better than this data server/client approach for my 32 bit driver related problem as described above?
Thank you very much, I appreciate your help.
Trung

Could you guys plesae give me some answers/suggestions.
I appreciate it.
Regards,
Trung

Similar Messages

Problems Running a TCP/IP Data Server VI as a Windows XP service

I need to run a TCP/IP data server as a Windows service. As my first step, I modified the LabVIEW example "Multiple Connections - Server.vi" under the TCP.llb to eliminate all controls with constants. I can run succesfully the VI under the LabVIEW environment and get the data from other computers in the network using the "Multiple Connections - Client 1.vi"
After read and followed the instructions posted in the document "Creating a Windows NT Service Using LabVIEW", I was able to create the Windows XP service. The "task manager" shows it running. A freeware Etherenet port monitor shows it listening. When I try running my client, the port monitor shows a connection being established but after few seconds goes into a "time_wait" state and stays there. End result: the client does not get the data.
Any hints will be highly appreciated!
Attachments:
RadMon_DataServer.vi ‏41 KB

Hola buen día,
Para darte una mejor solución podrías decirnos que aplicación estás tratando de hacer?. Que versión de Labview tienes?
Saludos,
NorSa
NI Applications Engineer Latin America
Para Soporte entra aquí

Monitor/capture tcp data between a server and client

Hi
I am doing a server/client TCP connection between my laptop and another computer running the server program. With my client program I am able to send commands to the server to which it reacts. However I do not know what the commands are (I just press a button in the client GUI and the command is sent), so my initial thought was that, maybe I was able to monitor/capture the strings/bytes/integers commands, which is send over the TCP/IP. There are only these two computers on the network, so no problem in other traffic there. FYI, they are connected with a wireless peer-to-peer connection.
My problem comes from the manufature of the software making a crabby manual, so really the commands in the manual, which I was supposed to send with my own TCP vi, are just impossible to understand, and don't get me started with their support :-)
SO, any suggestions if it is possible to capture what is sent over the TCP when I press a button in my client GUI?
LabVIEW 8.6 / 2009 / 2010
Vision Development Module 8.6 / 2009 / 2010
VBAI 3.6 / 2010

Matthew Williams wrote:
Wireshark, http://www.wireshark.org , will capture data off the network and sort/display/categorize.
I don't know how well it will work in a wireless environment, we usually use a wired hub (not switch).
Matt
Hi Matt
I have just tried Wireshark, I get a lot of data, so I just have to use a bit of time figuring out what is what, but good program to monitor the LAN connection also wireless. I can monitor all the packages between the client and server. It looks like there is a bunch of data just from keeping the connection active, but again I have to dig a bit deeper before I can say anymore:-)
MikeS81 wrote:
Hi SCMAJA,
another way is to build your own TCP/IP Server with LabView and receive with it the commands send with your client program.
Mike
Hi Mike
Yeah I tried that right now using the TCP Communicator - Passive example, unfortunately the connection between the client and server is kept alive using some commands, so the only command I can get to read is the connect command, because the client then refuses the connection because there is no "right" answer/repsonse from the server :-(
edit:
I just got in touch with the support, and got some of the commands to work. I had to make some crazy command with a header first, then size and last my command, all converted from DEC to HEX.. Not easy to figure out :-)
Message Edited by SCMAJA on 02-08-2008 04:29 PM
LabVIEW 8.6 / 2009 / 2010
Vision Development Module 8.6 / 2009 / 2010
VBAI 3.6 / 2010

Data server switch in SQL query

Hi guys,
I have a question about data server switch in the sql query template. We have been developing all the sql queris pointing to the customer test db server say "TESTDB", now we have to change the db connection to "PRODUCTDB", do we need to change sql queries one by one or is there a better solution for this? I think this is a common requirement to change back and forth data server connection for a bulk number of queries
Thanks,
Tony.

Tony,
From a design perspective it is advisible to name your data servers in a more abstract way, since the query templates themselves only save the Name of the data server in them. Data Servers also have a description field (typically overlooked) which will appear in the list and the workbench where you can be explicit or to even serve as a reminder that you are working with either test or production data. The true 'switch' should happen when you reconfigure your data server settings for server url and user/pwd.
TESTDB and PRODUCTDB might be better served with a meaningful name that provides a correlation to the data stored in the database. In more mature system landscapes having a DEV/QA/PROD arrangement of MII servers, the ability to promote content comes from configuration and projects, not from actually changing the content on the same server.
If you need to rapidly modify your content to adopt this practice then I would simply export the associated project and unzip it to a folder. Then use windows explorer to do a search for files containing your data server name (they will appear in your query templates as Server="TESTDB"). With a text editor that can do search and replaces across multiple files (http://www.editplus.com is my personal favorite) you can easily change the data server name to a better convention. Then zip up the folder content and reimport the project. This will effectively switch your data servers (don't forget to create the new abstract data server in place of the TESTDB and PRODUCTDB).
Regards,
Jeremy

How to migrate 'table' data type into oracle solution?

Say, I have following sample code in Sql Server:
Declare @v1 table(old_value int, new_value int)
insert into @v1 select old_value, new_value from aTable where....
declare cur cursor for
select new_value from @v1 where old_value=...
what should I use in oracle to convert above code? I was thinking about nested table, but it seems not very suitable here. Any better solutions out there?

It's been a while since I've done any SQL Server development, but if I recall correctly, a table data type in Transact SQL is used for storing temporary result sets.
In your example, you seem to be temporaily storing the results of a query in a Transact SQL table, and then opening a cursor to iterate over the results.
In Oracle PL/SQL, there is usually no need to do this, just open a cursor:
create or replace procedure test_proc as
begin
for curs_rec in (select old_value, new_value from myTable) loop
... process each row ...
end loop;
end test_proc;
If you really want your results in an array which your code can iterate over, look into the BULK COLLECT clause of the SELECT statement:
create or replace procedure test_proc as
TYPE array_type IS TABLE of myTable%ROWTYPE INDEX BY BINARY_INTEGER;
my_array array_type;
begin
SELECT * BULK COLLECT INTO my_array FROM myTable;
for idx in my_array.FIRST..my_array.LAST loop
dbms_output.put_line(my_array(idx).col1);
end loop;
end test_proc;
Note that I have not actually compiled the above code, so there may be syntax errors :)
Also, prior to 9i you can not BULK COLLECT into a table based on a rowtype (you need to created an array for each attribute).
SQL Server also allows function which return table types. This is similar to PL/SQL pipelined table functions (available in 9i and higher - see the PL/SQL guide), which can be used to materialize rows which can be processed like any other result set.
SQL Server also has a concept of temporary tables which is totally different than Oracle's temporary tables. SQL Server developers must often resort to using temporary tables in their stored procedures; in Oracle, this is rarely necessary.

TCP_DATAREADY event slows down TCP data

I'm working on some Labwindows/CVI code that communicates with an embedded device using the TCP libarary.
The CVI code is a client that sends requests for data to the embedded server.
The request / response happens in a timer callback.
The code does not use the TCP library callback TCP_DATAREADY event to collect the data. This event has no code in it.
Rather the code running in the timer callback calls ClientTCPWrite(...) to send the request to the server.
Then it waits in a loop and uses calls to ClientTCPRead(...) to collect the response data as quickly as possible.
Most of the time this works well. The TCP_DATAREADY never gets called.
However sometimes, if I do something with the user interface, like drag a window around or something it gets into a situation where it starts
calling the TCP_DATAREADY very rapidly. This has the effect of slowing things waaaay down. No data is read in the TCP_DATAREADY callback so it eventually gets all the data in the loop in the timer callback.
Is there any way to shut off calls to TCP_DATAREADY?
Or is there a better way to set this up?
Thanks,
Kirk

The CPU usage goes up significantly when it gets in this "state".
It's not really while you're dragging the window around, rather it seems like causes it to start a vicious cycle where it makes very many calls to the TCP_DATAREADY event.
I put a counter in the TCP_DATAREADY callback. When I start the code that requests data from the server and check the counter it hardly ever counts up. Then if I move the window or click a button that starts some data logging boom! the counter starts counting up like crazy. It's as if my code that is polling ClientTCPRead(...) gets interrupted long enough to allow a TCP_DATAREADY event and from then on it always calls TCP_DATAREADY as fast as it can??
I put a SetCtrlVal(..) in the TCP_DATAREADY event to display the counter and when it gets into the "bad" state it REALLY! slows down.
Not surprising I guess because the user interface update takes a long time.
The reason I'm polling ClientTCPRead(...) is that I want to respond as quickly as possibly to the incomming TCP data. If I knew how often TCP_DATAREADY events are generated I may be able to "centralize" my data reading in the TCP_DATAREADY event.
I tried putting ProcessSystemEvents() calls in various places. Didn't seem to change the symptoms.
Any more thoughts?
Kirk

TCP/IP server module with EE container

Hello All!
I am developing an EE application that has the following features:
- web app to browse data
- a scheduled server module that sends queries through TCP/IP (with SSH) to the large number of devices. The responses of the client are saving in DB.
My questions are following.
- What kind of API/library/server to use as a TCP/IP server? (Netty, Mina or something else?)
- Which application server is better to use in this case? (I intend to use Glassfish v3.)
I'm going to use MySQL, for back-end - Spring & Hibernate, for front-end Spring MVC & JSTL.
Thanks!
Astrid

I don't see you needing any kind of JEE features other than the web layer, so I would consider adding Tomcat as a possibility for your webserver choice. Cheap, fast and easy to use.
Other than that nobody is going to tell you what you should or shouldn't use - that is your own job. Research my man, research. Perhaps you'll want to share your findings here to get a second opinion, but don't expect the answer to be spoon fed to you. Go dig up which possibilities you have (of course, use Google), compare their features, search for discussions about issues with the individual products and make a weighed and reasoned decision based on all that.

I want better solution for adjusting the Material stock values for the last

my Customer need to adjust( Decrease) the closing stock values for the following materials / plant wise as on 31.03.2006 for meeting statuary compliance.
Material1 : RS: 4149599    QTY : 10181.03 Ltrs
Material 2 : RS: 1318596     QTY: 2152.76   Ltrs
As per my knowledge MM posting periods can open current month and Previous month only. For the reason I proposed the solution as follows:
Step 1 : post FI Journal Entry on 31.03.2006
Opening Balance G/L Account Dr 4149599 + 1318596
Closting Stock a/c                      Cr 4149599 + 1318596
Step 2.
Change the Material Price in MM through T.Code: MR21
( Posting will be allowed in current or previous months)
This makes our CO reports accurate.
Please suggest the better solution if it is possible in MM for adjusting the Material stock values for the last financial year.
WIth Best Regards,
Rajesh
<b></b>

Hi Madhavan,
Unfortunately this forum deals with migrations from non-Oracle
environments to Oracle. You seem to be dealing with migrations in
an Oracle environment mainly.
I would recommend that you contact Oracle Applications and RDBMS
support directly. They will have the most up to date
information/advice on performing these actions.
Regards
John
Madhavan (guest) wrote:
: Hi John
: Thanks for your reply.
: Actually I am planning to upgrade the system.
: 1. I Want to Upgrade Oracle Financials release 10.7 to the
: latest version (11.x)
: 2. Oracle 7 database to oracle 8 or 8i.
: 3. Oracle is running on NT service pack 3. Do I need to upgrade
: this?. If not what is the impact on Windows NT?
: 4. Is the majority still running smart client 10.7 and database
: 7?
: 5. What is the necessary time to implement these upgrades? What
: type of consulting I need to have?
: 6. I have some employees working on it? Will these changes
: affect them?
: What type of precautions I need to take on the whole??
: Thank You
: Madhavan
Oracle Technology Network
http://technet.oracle.com
null

Scale out SSAS server for better performance

HI
i have a sharepoint farm
running performance point service in a server where ANaylysis srver,reporting server installed
and we have anyalysis server dbs and cubes
and a wfe server where secure store service running
we have
1) application server + domain controller
2) two wfes
1) sql server sharepoint
1) SSAS server ( analysis server dbs+ reporting server)
here how i scaled out my SSAS server for better performance
adil

Just trying to get a definitive answer to the question of can we use a Shared VHDX in a SOFS Cluster which will be used to store VHDX files?
We have a 2012 R2 RDS Solution and store the User Profile Disks (UPD) on a SOFS Cluster that uses "traditional" storage from a SAN. We are planning on creating a new SOFS Cluster and wondered if we can use a shared VHDX instead of CSV as the storage that
will then be used to store the UPDs (one VHDX file per user).
Cheers for now
Russell
Sure you can do it. See:
Deploy a Guest Cluster Using a Shared Virtual Hard Disk
http://technet.microsoft.com/en-us/library/dn265980.aspx
Scenario 2: Hyper-V failover cluster using file-based storage in a separate Scale-Out File Server
This scenario uses Server Message Block (SMB) file-based storage as the location of the shared .vhdx files. You must deploy a Scale-Out File Server and create an SMB file share as the storage location. You also need a separate Hyper-V failover cluster.
The following table describes the physical host prerequisites.
Cluster Type
Requirements
Scale-Out File Server
At least two servers that are running Windows Server 2012 R2.
The servers must be members of the same Active Directory domain.
The servers must meet the requirements for failover clustering.
For more information, see Failover Clustering Hardware Requirements and Storage Options and Validate
Hardware for a Failover Cluster.
The servers must have access to block-level storage, which you can add as shared storage to the physical cluster. This storage can be iSCSI, Fibre Channel, SAS, or clustered storage spaces that use a set of shared SAS JBOD enclosures.
StarWind VSAN [Virtual SAN] clusters Hyper-V without SAS, Fibre Channel, SMB 3.0 or iSCSI, uses Ethernet to mirror internally mounted SATA disks between hosts.

Better solution for scaling of value

Hi,
We have a requirement of scaling the values retrieved in reports, We had two solutions,
1) Use EvGTS function to scale vale
2) Use Excel functionality to scale the value
Please let us know which is a better solution.
Thanks & Regards,
Ramanathan

Hi Ramanathan,
You can use EvGTS function, because it retrieves the data and also scales the values.
Regards,
Raghu

Can Oracle run in real time OS(such as PSOS) and communicate with data server by OCI?

Hi, all!
i have a question to get your help! now my oracle client running in SUN solaris communicate with oracle data server by OCI(oracle call interface). In future, my client system will port to embeded system that will use real time OS, such as PSOS, so i'm afraid that is OCI communicating with data server ok in PSOS environment??? Is there a special driver or OCI lib for PSOS?
thanks very much!!!
null

I have no idea which platforms the Oracle client has been ported to. If there exists an Oracle client for PSOS, then you should have no problem with OCI there. If there's no Oracle client for PSOS, then you won't be able to make OCI calls.
Regardless, this probably is a question better addressed to Oracle sales rather than to an ODBC forum.
Justin

Regarding tcp/ip server side

Hello all,
hope its not too irrelevant to the labview.
I have gone through "simple data client.vi" and "simple data server.vi" examples, want to replace simple data server.vi with a simple c program on a different computer.
Can someone please hint me how to form it?? using v8.5. The ultimate need is: c-program sends the required data to client(labview) whenever it is being requested.
The labview and c-program are on different PCs.
Not sure whether simple c-language instructions inport and outport(from dos.h) will do? or do I need to do some socket programming??
Thanking you.
Message Edited by Parny on 12-09-2007 08:10 PM

Hi,
You should be able to find a good TCP example written in C on the internet. Searching on NI's website will most likely only yield LabVIEW examples. Here is one link I found on the internet. I would search google for "tcp" and "C" to see what you might be able to find.
Eric A.
National Instruments
Distributed I/O Product Support Engineer

Legacy data into new UCM Solution

we are implementing new UCM solution to one of my client,
Client is having lots of legacy data(>2TB), and they want to move the complete data into new UCM Solution?
My question is, what is the way to convert the whole data in to UCM Content server?

I assume that you are aware of the productised UCM Siebel integration...are you wanting to load legacy data and make it available through this? Even if you are the approach is much the same.
OK so if on a file system then what you need to do is work out how you can derive metadata either from the directory structure OR the Siebel DB or the content itself - those are in order of difficulty and time taken I would say.
The simplest thing to do is to use this information to create batchloader scripts. Why not try and create some test scripts where you load in 100 items or similar and see if the results/performance are aceptable.
It will take a long time to load 2TB of data - how many separate files is this? So you may need to devise a schedule for doing this in a number of smaller migration runs.
Tim

Initial Deserialization on TCP*Extend Server

Hi Guys,
I have observed something on a TCP*Extend server which I can't quite explain. We've got some hairy custom serialization inside an Externalizable bean. I was under the impression that classes aren't deserialized inside the cluster unless they need to be e.g. to processed by entry processors or value extractors on indexes. However, when I put one of these objects from a TCP*Extend client into the cluster on the tcp*extend server I see some slightly odd behaviour on the server where the deserialization method is called on an empty object and the object I've just send from the client is then serialized.
Can I therefore assume there is an extra deserialization/reserialization loop on a tcp*extend server on data obtained from the client?
Kind Regards,
Max

Hi Max,
Yes, currently the ProxyService must deserialize/serialize data sent from/to clients as part of a POF translation step in order to support non-Java clients. We will be extending POF serialization support "into" the cluster in the next Coherence release. Once this is in place, this extra deserialization/serialization step will not be necessary and will be removed from the ProxyService.
Regards,
Jason

TCP Extend Server - Failed to start Service - Oracle Coherence GE 3.5.2/463

Hello,
We are about to go to production I see Failed to start Service in TCP Extend Server (Storage disable node).
Regards
/AG
My Configuration look like the following
<?xml version="1.0" encoding="windows-1252" ?>
<!DOCTYPE cache-config SYSTEM "cache-config.dtd">
<cache-config>
<caching-scheme-mapping>
</caching-scheme-mapping>
<caching-schemes>
<distributed-scheme>
<scheme-name>distributedCache</scheme-name>
<service-name>distributedCache</service-name>
<backing-map-scheme>
<local-scheme>
<eviction-policy>HYBRID</eviction-policy>
<high-units>500</high-units>
<low-units>375</low-units>
<unit-calculator>BINARY</unit-calculator>
<unit-factor>1048576</unit-factor>
</local-scheme>
</backing-map-scheme>
</distributed-scheme>
<proxy-scheme>
<service-name>ExtendTcpProxyService</service-name>
<thread-count>15</thread-count>
<acceptor-config>
<tcp-acceptor>
<local-address>
<address system-property="proxy.listen.address">....</address>
<port system-property="proxy.listen.port">....</port>
</local-address>
</tcp-acceptor>
</acceptor-config>
<autostart>true</autostart>
</proxy-scheme>
</caching-schemes>
</cache-config>
------------------------------------------------------------------------- And the Log looks like the following ------------------------------------
2009-12-04 16:21:54.056/25821.278 Oracle Coherence GE 3.5.2/463 <D6> (thread=Proxy:ExtendTcpProxyService:TcpAcceptor, member=12): Closed: Channel(Id=193159068
6, Open=false)
2009-12-04 16:21:54.058/25821.280 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:4, member=12): Repeating SizeReques
t due to the re-distribution of PartitionSet{220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242
, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256}
2009-12-04 16:21:54.058/25821.280 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:12, member=12): Repeating SizeReque
st due to the re-distribution of PartitionSet{220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 24
2, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256}
2009-12-04 16:21:54.058/25821.280 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:11, member=12): Repeating SizeReque
st due to the re-distribution of PartitionSet{220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 24
2, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256}
2009-12-04 16:21:54.058/25821.280 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:7, member=12): Repeating SizeReques
t due to the re-distribution of PartitionSet{220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242
, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255, 256}
2009-12-04 16:21:54.175/25821.397 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:10, member=12): An exception occurr
ed while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.ensureRequestTarget(DistributedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.sendPartitionedRequest(DistributedCache.CDB:31)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.size(DistributedCache.CDB:13)
at com.tangosol.util.ConverterCollections$ConverterMap.size(ConverterCollections.java:1470)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$ViewMap.size(DistributedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.size(SafeNamedCache.CDB:1)
at com.tangosol.coherence.component.util.collections.WrapperMap.size(WrapperMap.CDB:1)
at com.tangosol.coherence.component.net.extend.messageFactory.NamedCacheFactory$SizeRequest.onRun(NamedCacheFactory.CDB:7)
at com.tangosol.coherence.component.net.extend.message.Request.run(Request.CDB:4)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.onMessage(NamedCacheProxy.CDB:11)
at com.tangosol.coherence.component.net.extend.Channel.execute(Channel.CDB:28)
at com.tangosol.coherence.component.net.extend.Channel.receive(Channel.CDB:26)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer$DaemonPool$WrapperTask.run(Peer.CDB:9)
at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32)
at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:63)
at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:96)
... 18 more
2009-12-04 16:21:54.175/25821.397 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:9, member=12): An exception occurre
d while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.ensureRequestTarget(DistributedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.sendPartitionedRequest(DistributedCache.CDB:31)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.size(DistributedCache.CDB:13)
at com.tangosol.util.ConverterCollections$ConverterMap.size(ConverterCollections.java:1470)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$ViewMap.size(DistributedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.size(SafeNamedCache.CDB:1)
at com.tangosol.coherence.component.util.collections.WrapperMap.size(WrapperMap.CDB:1)
at com.tangosol.coherence.component.net.extend.messageFactory.NamedCacheFactory$SizeRequest.onRun(NamedCacheFactory.CDB:7)
at com.tangosol.coherence.component.net.extend.message.Request.run(Request.CDB:4)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.onMessage(NamedCacheProxy.CDB:11)
at com.tangosol.coherence.component.net.extend.Channel.execute(Channel.CDB:28)
at com.tangosol.coherence.component.net.extend.Channel.receive(Channel.CDB:26)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer$DaemonPool$WrapperTask.run(Peer.CDB:9)
at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32)
at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:63)
at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:96)
... 18 more
2009-12-04 16:21:54.175/25821.397 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:13, member=12): An exception occurr
ed while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.ensureRequestTarget(DistributedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.sendPartitionedRequest(DistributedCache.CDB:31)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.size(DistributedCache.CDB:13)
at com.tangosol.util.ConverterCollections$ConverterMap.size(ConverterCollections.java:1470)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$ViewMap.size(DistributedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.size(SafeNamedCache.CDB:1)
at com.tangosol.coherence.component.util.collections.WrapperMap.size(WrapperMap.CDB:1)
at com.tangosol.coherence.component.net.extend.messageFactory.NamedCacheFactory$SizeRequest.onRun(NamedCacheFactory.CDB:7)
at com.tangosol.coherence.component.net.extend.message.Request.run(Request.CDB:4)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.onMessage(NamedCacheProxy.CDB:11)
at com.tangosol.coherence.component.net.extend.Channel.execute(Channel.CDB:28)
at com.tangosol.coherence.component.net.extend.Channel.receive(Channel.CDB:26)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer$DaemonPool$WrapperTask.run(Peer.CDB:9)
at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32)
at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:63)
at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:96)
... 18 more
2009-12-04 16:21:54.175/25821.397 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:11, member=12): An exception occurr
ed while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.ensureRequestTarget(DistributedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.sendPartitionedRequest(DistributedCache.CDB:31)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.size(DistributedCache.CDB:13)
at com.tangosol.util.ConverterCollections$ConverterMap.size(ConverterCollections.java:1470)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$ViewMap.size(DistributedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.size(SafeNamedCache.CDB:1)
at com.tangosol.coherence.component.util.collections.WrapperMap.size(WrapperMap.CDB:1)
at com.tangosol.coherence.component.net.extend.messageFactory.NamedCacheFactory$SizeRequest.onRun(NamedCacheFactory.CDB:7)
at com.tangosol.coherence.component.net.extend.message.Request.run(Request.CDB:4)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.onMessage(NamedCacheProxy.CDB:11)
at com.tangosol.coherence.component.net.extend.Channel.execute(Channel.CDB:28)
at com.tangosol.coherence.component.net.extend.Channel.receive(Channel.CDB:26)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer$DaemonPool$WrapperTask.run(Peer.CDB:9)
at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32)
at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:63)
at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:96)
... 18 more
2009-12-04 16:21:54.175/25821.397 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:2, member=12): An exception occurre
d while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.ensureRequestTarget(DistributedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.sendPartitionedRequest(DistributedCache.CDB:31)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.size(DistributedCache.CDB:13)
at com.tangosol.util.ConverterCollections$ConverterMap.size(ConverterCollections.java:1470)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$ViewMap.size(DistributedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.size(SafeNamedCache.CDB:1)
at com.tangosol.coherence.component.util.collections.WrapperMap.size(WrapperMap.CDB:1)
at com.tangosol.coherence.component.net.extend.messageFactory.NamedCacheFactory$SizeRequest.onRun(NamedCacheFactory.CDB:7)
at com.tangosol.coherence.component.net.extend.message.Request.run(Request.CDB:4)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.onMessage(NamedCacheProxy.CDB:11)
at com.tangosol.coherence.component.net.extend.Channel.execute(Channel.CDB:28)
at com.tangosol.coherence.component.net.extend.Channel.receive(Channel.CDB:26)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer$DaemonPool$WrapperTask.run(Peer.CDB:9)
at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32)
at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:63)
at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:96)
... 18 more
2009-12-04 16:21:54.176/25821.398 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:6, member=12): An exception occurre
d while processing a SizeRequest for Service=Proxy:ExtendTcpProxyService:TcpAcceptor: (Wrapped) java.lang.InterruptedException
at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForPartitionRedistribution(DistributedCache
.CDB:107)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.DistributedCache$BinaryMap.waitForRedistribution(DistributedCache.CDB:34)
:$
2009-12-04 16:21:54.259/25821.481 Oracle Coherence GE 3.5.2/463 <D4> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:8, member=12): Daemon caught an unh
andled exception (com.tangosol.net.messaging.ConnectionException: channel is closed) while exiting.
2009-12-04 16:21:54.264/25821.486 Oracle Coherence GE 3.5.2/463 <D4> (thread=Proxy:ExtendTcpProxyService:TcpAcceptorWorker:3, member=12): Daemon caught an unh
andled exception (com.tangosol.net.messaging.ConnectionException: channel is closed) while exiting.
2009-12-04 16:21:54.330/25821.552 Oracle Coherence GE 3.5.2/463 <D5> (thread=Proxy:ExtendTcpProxyService:TcpAcceptor, member=12): Stopped: TcpAcceptor{Name=Pr
oxy:ExtendTcpProxyService:TcpAcceptor, State=(SERVICE_STOPPED), ThreadCount=0, Codec=Codec(Format=POF), PingInterval=0, PingTimeout=0, RequestTimeout=0, Local
Address=[nybc94lxb01/10.12.101.81:21005], LocalAddressReusable=false, KeepAliveEnabled=true, TcpDelayEnabled=false, ReceiveBufferSize=0, SendBufferSize=0, Lis
tenBacklog=0, LingerTimeout=-1, BufferPoolIn=BufferPool(BufferSize=2KB, BufferType=DIRECT, Capacity=Unlimited), BufferPoolOut=BufferPool(BufferSize=2KB, Buffe
rType=DIRECT, Capacity=Unlimited)}
Exception in thread "Thread-2" java.lang.RuntimeException: Failed to start Service "Proxy:ExtendTcpProxyService:TcpAcceptor" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.net.extend.Channel.request(Channel.CDB:10)
at com.tangosol.coherence.component.net.extend.Channel.request(Channel.CDB:1)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer.closeChannel(Peer.CDB:18)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer.closeChannel(Peer.CDB:1)
at com.tangosol.coherence.component.net.extend.Channel.close(Channel.CDB:20)
at com.tangosol.coherence.component.net.extend.Channel.close(Channel.CDB:1)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.run(NamedCacheProxy.CDB:30)
at java.lang.Thread.run(Thread.java:619)
Exception in thread "Thread-3" java.lang.RuntimeException: Failed to start Service "Proxy:ExtendTcpProxyService:TcpAcceptor" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.net.extend.Channel.request(Channel.CDB:10)
at com.tangosol.coherence.component.net.extend.Channel.request(Channel.CDB:1)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer.closeChannel(Peer.CDB:18)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Peer.closeChannel(Peer.CDB:1)
at com.tangosol.coherence.component.net.extend.Channel.close(Channel.CDB:20)
at com.tangosol.coherence.component.net.extend.Channel.close(Channel.CDB:1)
at com.tangosol.coherence.component.net.extend.proxy.NamedCacheProxy.run(NamedCacheProxy.CDB:30)
at java.lang.Thread.run(Thread.java:619)
Edited by: Anand Gupta on Dec 4, 2009 5:10 PM

David,
Thanks for your detailed response. I will try all that you suggested and let you know my observation at the end. To give a back ground of the application I am working on.
Background
Try to replace home grown cache (very well optimized uses custom serialization using NIO bytebuffer etc.,) my mandate is to replace the legacy cache with coherence (I love coherence product (at least 3.4) from my previous job experience). Since all kind of optimization is done in legacy application I am converting NIO byteBuffer generated by legacy serialization to byteArray and converting ByteArray into POF. Also for various other reasons, I have to send entry processor to do even get and put data from the cluster.
Raw Data Set Size
My data size is just 500MB (In Production). I put enough cache nodes so that raw data is just 50MB per node. (Since it is compute heavy with entry processor and the number of clients are going to be ~2500)
What was happening when I got the exception?
I was doing stress testing of the cache. Not sure if that put lot of garbage in some of the node hence may be the garbage collection pause triggered the re-distribution of partition set. Since the stress testing was on the way it might had cascading effect on all the nodes.
Datagram Test result.
Tx summary 4 peers:
life: 96 MB/sec, 68774 packets/sec
now: 100 MB/sec, 71378 packets/sec, packets/burst: 1029, bursts/second: 69.41594
Success rate ranges from 0.87 to 1.0
Is a success rate less than 0.98 a cause for concern?
Regarding Size (to keep the extend client always connected to the proxy)
I do size request every 5 sec. if there is not other request has gone to the cluster in the past 5 sec.
In one of the oracle presentation it was said that "If you have map listener's and no other request from a long period of time extend client has to do a periodic size request to make sure that connection to proxy is alive"
In this regard my question is "Can the same effect achieved by doing member listener on the extend client and on disconnection do the size request?"
Proxy Size guide lines
In production number of extend clients are going to be ~2500 connected all the time.
Of which 2000 clients with few map listener + entry processor gets (Each of the clients will have distinct and disjoint set of data on which they work and listener)
And the remaining ~500 clients will do all kinds of request on the entire data set.
In this circumstance is there any recommendation for Number of extend-client : Number of extend-server : Number of threads ratio?
Regards
/Anand

TCP data server or better solution?

Similar Messages

Maybe you are looking for