Moving large data real-time

Anyone having an idea for moving a large data set from one core's thread to another's thread, in a Real Time system, where it will be put into a DAQ's output buffer? I have an array ,which at the max is 125625 X 23 X I16, which is built column (the 23 dimension) by column (actually it is done in a replace array element mode), that is then is too be "exported" to the other core's thread. There it is to be loaded into the DAQ cards' memory, to be output. I need to be able to do this in a pretty timely manner. When I try to use a Function Global Variable, that is "loaded" one column at a time, it is _slow_ ! Need a faster method!
Thanks,
Putnam
Certified LabVIEW Developer
Senior Test Engineer
Currently using LV 6.1-LabVIEW 2012, RT8.5
LabVIEW Champion

I haven't tried queues for core to core communications before, hadn't considered them, but since some recent revelations have shown that RT lelvel determinism isn't a critical issue I guess that I can examine them as well. Not that some of them necessarily have jitter issues, but I was being conservative. Will put together a trial test case. Thanks, as usual, for your help Ben. Hope the weather in your neck of PA wasn't too bad. Up in Syracuse the are 400% more snow than this time last year, and last year the season had 140+" (norm is closer to 115), and that was in a very truncated winter, not much until third week of January.
Hmm, three stars. Wonder what I said that annoyed someone, or underwhelmed them?
Even weirder is that at the LabVIEW forum level it is showing 4 stars, two voters. Hmmm, too early for me, the coffee isn't hitting (actually not able to drink coffee lately)
Message Edited by LV_Pro on 12-17-2007 09:15 AM
Message Edited by LV_Pro on 12-17-2007 09:19 AM
Putnam
Certified LabVIEW Developer
Senior Test Engineer
Currently using LV 6.1-LabVIEW 2012, RT8.5
LabVIEW Champion

Similar Messages

How to pass data from a C++ program to LV to plot the data real time?

Hello,
I am writing a C++ program in which I need to plot the data in real
time. I would like to pass data from my C++ program to LabView in order
to perfrom the plotting. I was wondering if this is possible. If so,
how can it be done? .
Thank You

There are several C++ examples and application notes here.

Loading Large Data Set Times Out In APEX

I am trying to load a large text file using APEX 3 I am using a 1g file which has about 50,000 rows. After about 5 minutes the browser times out. Any ideas nothing in the alert log so it is not database related. Here is the error in the Apache Log
mod_plsql: Long running URL [pls/apex/wwv_flow.accept] timed out

Steve,
The Apache process is timing out. Most likely this is set to 300 in your httpd.conf (the default).
You can extend it to more than 300, but if I were in your shoes and you had the proper access, I'd use some other means to load 1GB of data (e.g., SQL*Loader).
Joel

TS3920 Date and Time display

The smaller time in the header of my iPad4 is accurate, but the larger date and time in the background at the top is wrong. I think it may be the date I bought the iPad. The calendar app is correct as well as the date and time in settings. How do I change the larger display on the home screen?

The time only appears on the top bar of the iPad's screen, the date is only on the icon of the Calendar app. If the date and time are showing on the screen itself then it might be on the wallpaper that you are using as the background image - try going into Settings > Brightness & Wallpaper and change the wallpaper

Real Time Wallboard

Hello,
I am using Cisco Unified Intelligence Center (CUIC), packaged with UCCX 10.5. I find a Unified CCX Live Data “Real Time Wallboard”, I cannot run it, even I cannot find any information in Admin Guide and Design. Could anybody help me, how to use it? What is it?
Andy

Hi,
take a look at this:
http://docwiki.cisco.com/wiki/Troubleshooting_Tips_for_Unified_CCX_10.0#Live_Data_Reports
And also here:
http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cust_contact/contact_center/crs/express_10_5/user/guide/UCCX_BK_CEEE388B_00_unified-ccx-report-user-guide-10-5.html
G.

Moving spatial data

Hello,
We have large data in two separate schemas source and destinantion. In source are 10 milion records in three tables. One table of them has 5 columns with geometries (sdo_geometry).
I want move data from source to destination in one transation. I can’t use „insert .... select ...”, additionally on the tables in destination are triggers. Is it possible moving large data in one transation. Maybe oracle hint other solution ? How long this process will be executed.
Thanks in advance

STBuffer won't do this (it has only one parameter), and after looking at the "BufferWithTolerance" and "Reduce" methods, I don't think they'll do this either. In a single method call. However, you may be able to produce the same results
with a series of method calls. That is, buffering combined with calls to STCurveToLine/CurveToLineWithTolerence and STIntersection or STDifference. Or one of the spatial aggregates. From your current description it's hard to figure out what you're looking
to do. You're trying to reverse-engineer something in a specific product, so figure a complete description of how it works.
But, unless I missed something, it will take multiple spatial library calls.
Hope this helps, Cheers, Bob

Real time application and large amount of data

Hi,
I've a real-time application that needs to allocate large amount of data in memory (more than 5GB). I'm using 1.6 version of JRE and I'm planning to migrate to 1.8 because the application experiment a lot of "Stop of the world" every day. I spent a lot of time analysing and testing all the parameters and policies of the GC.
The question is, with the 1.8 version dissapears the pauses on the application caused by the GC cleaning process?
Thanks.

Just noting that the GC only really needs to do something when objects are created and then are no longer in use. So if your application needs a large amount of memory then keeping it, rather than discarding it might be a better solution.

Best data provisioning tool for very large amount of data updated real time?

about a few hundred million entries of data a day and it must be replicated to sap hana in real time, what would be the best option?

Hi Wayne,
If you are looking for real time replication, then SLT is the best option. What is the source system for this replication?
Regards,
Chandu.

HOW CAN I ACQUIRE AND DEPLOY DATA IN REAL TIME WITH DAQ 6024E?

HI ENGINEER,
I'M PROGRAMING AN APLICATION WHICH I NEED ACUIRING AND DEPLOYING AN ANALOGOUS SIGNAL IN REAL TIME.
I HAVE:
LabVIEW 7.0
WINDOWS 2000
DAQ CARD 6024E
THE SIGNAL I WANT TO ACQUIRE IS 0-10 Vcd FROM A SENSOR, THE PROBLEM I HAVE, IS THAT I AM ACQUIERING THE DATA AND IT SEEM THAT THEY ARE UPDATING EACH SECOND, BUT I HAVE BEEN MOVING THE PARAMETERS SUCH AS TASK TIMING IN THE DAQ ASSISTANT VI AND NOTHING HAPPENS.
CAN YOU TELL ME WHICH PARAMETERS I HAVE TO MOVE TO AQUIRE AND DEPLOY DATA IN REAL TIME

Hi barron,
If you want to see the data update quicker, you can decrease the value in the "Samples to Read" field of your DAQ Assistant. This number controls when data is transferred from the DAQ buffer to the PC. If the sampling frequency remains the same, but this field decreases, it means the buffered data will be returned more quickly.
Hope this helps.
Thanks,
Lesley Y.

Handling sequences in real time data transfer.

Hi,
We are merging two databases (real time data transfer).
One is oracle 8i and other is 9i.
Both databases are having some tables with same structure.
We want to transfer data from table in one database to table in other database.
We are implementing this functionality by using Adevanced Queueing.
Both side tables are using different sequences for generating primary key values and currently contains large volume of data.
The problem in inserting is, when we will be transferring any record from one table to other, the primary key value (sequence value) generated in both tables will be different.
So, if any particular record is updated in one table, How can we update the same record in other table ?
(As the primary key value would be different).
Thanks,
Shailesh

There must be some common data in the two tables, that identifies the record. That is, ignorng the sequence generated PK, how would you tell that two records referred to the same thing? You need to ignore the PK values, since they are meaningless surrogate keys, and use the natural key in the data to match the two talbes.
HTH
John

Oracle Data Integrator - Real Time Integration

Hi,
I want to know that, is there any possibility of integrating data in real-time using Oracle Data Integrator?
If yes, does it affect the OLTP system performance? (Could it read from db logs,etc..)
Thanks..

Using ODI with Logminer-based CDC will affect performance on the source system more than using Oracle Goldengate, let me explain why:
When using the ODI Logminer-based Journalisation the Logminer functionality will move the primary-key of the affected row into the journal table. When you are then ready to move the changed data, running an interface to move the data reads the Journal-view, which joins the journal table (primary keys) to the source data (and dealing with deleted rows), optimising out duplicate rows in order to bring across the then-current state of the data, which can then be loaded into the target system, on completion, the moved rows can be removed from the journal table. The data will appear in the journal table as soon as Logminer puts it there, which may be a lag of up to two minutes using asynchronous setting, whereas Synchronous Logminer applies "system triggers to the table, with the consequent overhead.
With Oracle Goldengate, the comitted transactions are read from the log as soon as the log-writer puts the commit into the log. All the data is picked up from the log, at that point. It is then written to the trail-file system of Oracle Goldengate which can be propogated to multiple other systems potentially with sub-second latency, and minimal impact on the source system due to the efficient reading and writing mechanisms. One other consequence of using Oracle Goldengate is that you get every change of the data, not the optimised then-current state of the data when moved.
Hope this explanation helps.

Would MobiLink be the appropriate tool for syncing servers which collect near real-time data?

I have a situation which appears to be similar to the some MobiLink configurations, but with only a few large clients.In my case, there would be 5 to 10 remote clients (each with SQL Anywhere) and a central database. Administration and configuration would be done mostly from the central database, but each client also includes a near real time data collection application. The customer would like to have that data available in the consolidated database. In the worst case, there could be about 50MB of data received from each client in a burst each 15 minutes. Fortunately the consolidated site doesn't have a tight time constraint, its data could be up to 15-30 minutes behind. The clients don't need (or want) to see each other's collected data.
I would like to know if MobiLink would be a good choice for this situation. The only other viable alternative I've found so for is the keep the collected data at the remote clients and access it only on demand. And naturally, there's no money in the project for an enterprise level solution.
FYI: My company has on OEM license for SQL Anywhere. We usually just have an application with SQL Anywhere at each site to collect data from the local equipment. This project is for a Fortune 500 company that want's to be able to monitor everything from the corporate office.
John

Hi John,
You should start writing down a few numbers including network speed and hardware specifications of client and server machines. In the worst scenario, you would have 15 clients synchronizing concurrently 750 MB of data in 15 minutes. And on top, there is your real time data collection application that could work while the synchronization is in progress.
You should also workout, how many connections to the consolidated database you will have in addition to Mobilink server and if these connections can create contentions.
The key factors influencing Mobilink performance are listed here DocCommentXchange
and you can tune the performance (more details in the link below)
DocCommentXchange
DocCommentXchange
Mirco

Real Time Clock Error - Check Date and Time settings, System CMOS Checksum bad

Hello everybody,
Can help anyone to resolve my problem.
I have an Thinkpad W520 (42823FG), BIOS 8BET60WW 1.4 When I disconect AC power and remove battery and connect again, I see this message on screen:
"Real Time Clock Error - Check Date and Time settings, System CMOS Checksum bad
Press Esc to continue or F1 to enter Setup"
Is this a system board problem or CMOS battery problem ?
Thank you

Hello and welcome,
It's probably (hopefully) just the CMOS battery. The easiest way to find out is to just replace that battery.
Page 85 of the Hardware Maintenance Manual:
Hardware Maintenance Manual
Here's an example of the battery. I'm not recommending (or not) this vendor:
http://www.ebay.com/itm/New-Lenovo-ThinkPad-W500-W510-W520-W530-W700-W701-W701ds-CMOS-RTC-Backup-BAT...
Z.
The large print: please read the Community Participation Rules before posting. Include as much information as possible: model, machine type, operating system, and a descriptive subject line. Do not include personal information: serial number, telephone number, email address, etc. The fine print: I do not work for, nor do I speak for Lenovo. Unsolicited private messages will be ignored. ... GeezBlog
English Community Deutsche Community Comunidad en Español Русскоязычное Сообщество

How can I get updated data in sub VI in real time?

Hello.
I'm making application using Labview 7.0.
What I want to do is the data acquisition changing some parameters. I get the data each time
I changed variable parameters. I can do it in sub VI by inserting array component into 'for' loop.
As loop iterates, the parameter sets are changed, and new data is inserted into array by 'replace subset array'.
New data fills the array by each iteration.
However, I can't bring this result array to my main.vi. Sub VI gives me the result array only when
its processes are done. I want to display the data while parameters changing is still on
the way.
Are there any solution to get the output of sub VI while the it is not finished yet?

Hi Joewun:
Yes, you can update that data in real time.
It's done using references and property nodes.
You can Create Reference of an array in your main VI
In your SubVI, create a new Input to an array reference, and insert a Property Node function into the For where you update the value, and select Value property.
This way when your array updates in the SubVI you will see the changes in your main VI.
Attatched Image:
Left: Main VI
Right SubVI.
Aitortxo.
Attachments:
Update Array Data from SubVI.png ‏54 KB

Display real time data on a plot in a sub VI and main VI

I am building a program to measure and plot real time data. Program has several steps so I build few Sub VIs to make it simple. My problem is I am plotting real time data in my SUB VI(it works fine), but in my main program when I try to get the same plot its not real time data plot. Plots appear at the end of the program. All tips and help would be greatly appreciated. Thanks
I have attached my main VI and Sub VI
Solved!
Go to Solution.
Attachments:
main VI.jpg ‏116 KB
Sub VI.jpg ‏242 KB

LabVIEW program is based on DATA FLOW, now, until the subVI will finish execution (while loop will be stopped), the execution in Main VI will not proceed any further.
If you can pass the reference of 'XY Graph' inside the subVI, you'll be able to update the plot (placed on MAIN VI) from within subVI.
Find attached example for your reference.
I am not allergic to Kudos, in fact I love Kudos.
Make your LabVIEW experience more CONVENIENT.
Attachments:
Example [LV 90].zip ‏26 KB

Moving large data real-time

Similar Messages

Maybe you are looking for