What's the best way to handle all my data?

I have a black box system that connects directly to a PC and sends 60 words of data at 10Hz (worse case scenario). The black box continuously transmits these words, which contain a large amount of data that is continuously updated from up to 50 participants (again worst case scenario)
i.e. 60words * 16bits * 10Hz * 50participants = 480Kbps. All of this is via a UDP Ethernet connection.
I have LabVIEW reading the data without any problem. I now want to manipulate this data and then distribute it to other PCs on a network via TCP/IP.
My question is what is the best way of storing my data locally on the interface PC so that I can then have clients request the information they require via TCP/IP. Each message that comes in via the Ethernet will relate to one of the participants, so I need to be able to check if I already have data about that participant - if I do then I can just update it, if I don't I need to create a record for the participant, and if I havn't heard from one for a while I will need to delete it. I don't want to create unnecessary network traffic. I also want to avoid global variables if possible - especially considering that I may have up to 3000 variables to play with.
I'm not after a solution, just some ideas about how to tackle this problem... I thought I could perhaps create a database and have labview update a table with the data, adding a record for each participant. Alternatively is there a better way of storing all the data in memory besides global variables?
Thanks in advance.

Hi russelldav,
one note on your data handling:
When each of the 50 participants send the same 60 "words" you don't need 3000 global variables to store them!
You can reorganize those data into a cluster for each participant, and using an array of cluster to keep all the data in one "block".
You can initialize this array at the start of the program for the max number of participants, no need to (dynamically) add or delete elements from this array...
Edited:
When all "words" have the same representation (I16 ?) you can make a 2D array instead of an array of cluster...
Message Edited by GerdW on 10-26-2007 03:51 PM
Best regards,
GerdW
CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
Kudos are welcome

Similar Messages

What's the best way to handle new versions of software?

So we have an Application setup for Adobe Reader (just using Reader as a general example) which is part of our Task Sequence. When Adobe releases a new version of Reader, what's the best way to handle getting the new version into our SCCM setup.
I know I can create a new application and do it all over and select the new file, but can I simply replace the files that the application is pointing to and then somehow tell it to update the DPs with the new files? I'd rather not have to create new
applications every time if I don't have to.
Thanks.

I think continue the way you are doing right now by creating a new application each time there is a version change. Its a clean way to do and this helps with Application life cycle mgmt aswell where you keep track of versions across the environments and
eventually retire an application. Specially where no changes are made without a change control. This is completely process specific and may not be applicable.
i do agree with above posted comments about using supercedence option.
However most of the apps comes with upgrade capabilities from previous versions. So you can upgrade existing version with new one if you do not wish to use supercedence.
Thanks

I had to reset my iphone 5 today because of software issues. what is the best way to restore all my apps?

I had to reset my iphone 5 because of corrupt software issues. now I am trying to restore my apps. So are returning. Some are not. Some are making me pay for them again! What is the best way to restor all the apps?

Sync them from your computer back to the iphone

I have a PPC iMac 10.4.11 and will shortly buy a new i Mac. What is the best way to transfer all my HD date from old to new? Thank you!

I have a PPC iMac 10.4.11 and will shortly buy a new i Mac. What is the best way to transfer all my HD date from old to new? Thank you!

Migrating from PPC Macs to Intel Macs:
https://discussions.apple.com/docs/DOC-2295
How to use Migration Assistant:
http://support.apple.com/kb/HT4413?viewlocale=en_US
http://support.apple.com/kb/TS1963
Troubleshooting Firewire target disk mode:
http://support.apple.com/kb/HT1661

What is the best way to remove all info from a MacBook Pro before passing it along to someone else? passing it on to someone?

What is the best way to remove all info from a MacBook Pro before passing it on to someone else?

Read this: http://www.tuaw.com/2010/09/24/mac-101-preparing-your-old-mac-for-sale-or-recycl ing/

What is the best way to handle input parameter

When writing sub-vi's, what is the best way to handle input parameter range checking? On the front panel I can choose to have numeric values coerced to be within range, but this does not affect constants or controls wired to the vi when used as a sub-vi. I can build range checking into the vi, but this can result in a cluttered looking vi. Do you have any suggestions.

As you discovered, the Range and Coercion properties of controls do not work when used in sub-vis.
Your best option is to go ahead and build your range checking into your sub-vis. If it�s something you will be doing a lot, just make your range checking a sub-vi and drop it where needed. This will keep the clutter to a minimum. You may end up with more than one range checking VI if you need different functionality, but this will still make less clutter and easier re-use.
Ed
Ed Dickens - Certified LabVIEW Architect - DISTek Integration, Inc. - NI Certified Alliance Partner
Using the Abort button to stop your VI is like using a tree to stop your car. It works, but there may be consequences.

What is the best way to transfer all of my data from my iPod touch 3rd generation to my iPhone 4s?

I have a 3rd generation iPod touch, and now I am getting an iPhone 4s. What is the best way to transfer all of my data, including paid-for apps and music, from the iPod to the iPhone without losing anything? Can I just do it through iTunes or the iCloud? I have never used iCloud before.

Follow the directions here:
http://support.apple.com/kb/HT2109

I've been using a flip video camera since 2009 and all of my videos are in the flipshare library. What is the best way to burn all these videos to a DVD that will play on my DVD player/tv?

I've been using a flip video camera since 2009 and all of my videos are in the flipshare library. What is the best way to burn all these videos to a DVD that will play on my DVD player/tv? The flipshare library is taking up too much space on my Macbook and I wanted to delete these videos once they were all tranferred to DVDs.
Any help is greatly appreciated.

Purplehiddledog wrote:
I do backup with iCloud. I can't wait until the new iMac is available so that I can once again have my files in more than 1 location without needing to rely solely on the cloud.
I also rely on iTunes and my MacBook and Time Machine as well as backing up to iCloud. I know many users know have gone totally PC free, but I chose to use iCloud merely as my third backup.
I assume that the restore would result in my ability to open Pages and Numbers and fix the problem with deleting apps, but this would also mean that if my Numbers documents still exist solely within the app and are just not on iCloud for some reason that they would be gone forever. Is that right?
In a word, yes. In a little more detail.... When you restore from an iCloud backup, you must erase the device and start all over again. There is no other way to access the backup in iCloud without erasing the device. Consequently, you are starting all over again. Therefore, it would also be my assumption that Pages and Numbers will work again and that the deleting apps issues would be fixed as well.
If the documents are not in the backup, and you do not have a backup elsewhere, the documents could be gone forever.

What is the best way to kill/stop a data load?

Hi.
What is the best way to kill/stop a data load?
I have a data load from my QA R/3 system that is extracting 115.000.000+ records. The problem is that the selection in the function module used in the data source does not work, and the problem was not detected because of the nature of the data on the development system.
I could kill processes owned by my background user (on both R/3 and BW) but I risk killing other loads, and sometimes the job seems to restart if I just try to kill processes. If I remove transactional RFCs in SM58 the load does not terminate; I only skip one or more datapackages. I have also tried to change the QM-status in the monitor to red, but that does not stop the load either...
So isn't there a nice fool-proof way of stopping a dataload?
Best regards,
Christian Frier

Hi,
There r 2 ways to kill the job.
One is using transation RSMO locate the job and display the status tab double click on the yellow light that is shown on the line total, a pop will come 'set overall status ' is displayed select the desired status that is red and save it. Then return to the monitor page and select the header tab double ckick on the data target right click and then goto 'manage',there should be request sitting there probably with yellow lights , highlight the line with the faulty request click the delete button then click refresh button.
Second is goto SM37 and click on the active selection and enter the jobname and then click excute the particulr job should appear highlight the jobname then click on the stop iconthat appears on the taskbar( 3 rd from left)
hope it is clear.
Regards-
Siddhu

What is the easiest way to export all tables data from Oracle to MS SQL Server?

Hello MS,
I would like to export all tables from Oracle 11.2 to MS SQL Server 2012 R1.
Using the tool "Microsoft SQL Server Migration Assistant v6.0 for Oracle" did not work for me because there are too many warnings and errors regarding the schema creation (MS cannot know it because they are not the schema designer). My idea is
to leave/skip the schema creation to the application designer/supplier and instead concentrate on the Oracle data export and MS SQL data import.
What is the easiest way to export all tables data from Oracle to MS SQL Server quickly?
Is it:
- the „MS SQL Import and Export Data“ Tool
- the “MS SQL Integration Services” Tool
- not Oracle dump *.dmp format because it is a propritery binary format
- flat file *.csv (delimited format)
Thanks!

Hi lingodingo,
If you want to directly export all tables from Oracle database to SQL Server, I suggest you use SQL Server Import and Export Wizard. Because you just need to follow the wizard with GUI, this is the easiest way.
If you want to make some modification for the tables‘ data before loading to SQL Server, I suggest you use SQL Server Integration Services package. For more details, please refer to the following similar thread:
https://social.msdn.microsoft.com/Forums/sqlserver/en-US/38b2bed2-9d4e-48d4-a33f-1d9eed1c062d/flat-file-to-sql-server?forum=sqldatamining
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

(workflow question) - What is the best way to handle audio in a large Premiere project?

Hey all,
This might probably be suitable for any version of Premiere, but just in case, I use CS4 (Master Collection)
I am wrestling in my brain about the best way to handle audio in my project to cut down on the time I am working on it.
This project I just finished was a 10 minute video for a customer shot on miniDV (HVX-200) cut down from 3 hours of tape.
I edited my whole project down to what looked good, and then I decided I needed to clean up all the Audio using Soundbooth, So I had to go in clip by clip, using the Edit in SoundBooth --> Render and Replace method on every clip. I couldn't find a way to batch edit any audio in Soundbooth.
For every clip, I performed similar actions---
1) both tracks of audio were recorded with 2 different microphones (2 mono tracks), so I needed only audio from 1 track - I used SB to cut and paste the good track over the other track.
2) amplified the audio
3) cleaned up the background noise with the noise filter
I am sure there has to be a better workflow option than what I just did (going clip by clip), Can someone give me some advice on how best to handle audio in a situation like this?
Should I have just rendered out new audio for the whole tape I was using, and then edit from that?
Should I have rendered out the audio after I edited the clips into one long track and performed the actions I needed on it? or something entirely different? It was a very slow, tedious process.
Thanks,
Aza

Hi, Aza.
Given that my background is audio and I'm just coming into the brave new world of visual bits and bytes, I would second Hunt's recommendation regarding exporting the entire video's audio as one wav file, working on it, and then reimporting. I do this as one of the last stages, when I know I have the editing done, with an ear towards consistency from beginning to end.
One of the benefits of this approach is that you can manage all audio in the same context. For example, if you want to normalize, compress or limit your audio, doing it a clip at a time will make it difficult for you to match levels consistently or find a compression setting that works smoothly across the board. It's likely that there will instead be subtle or obvious differences between each clip you worked on.
When all your audio is in one file you can, for instance, look at the entire wave form, see that limiting to -6 db would trim off most of the unnecessary peaks, triim it down, and then normalize it all. You may still have to do some tweaking here and there, but it gets you much farther down the road, much more easily.Same goes for reverb, EQ or other effects where you want the same feel throughout the entire video.
Hope this helps,
Chris

What's the best way to handle this?

I'm not sure what APIs/setup to use for this situation:
A company wants to store data projects they do for clients. Each year, the data fields are set (as a result of gov't requirements) and they won't change for any client project for that year. however, the fields required can (and usually do) change every year. So things they require this year, might not be needed the next year and new fields might be introduced.
While there are likely to be many common fields from year to year, there's no way to guarantee which ones will remain consistent. They also want to be able to do searches on the data and fields, for projects within a year and across years.
What's the best framework/API/configuration to handle this? EJB? Simple JDBC? If so, how should the database be handled? Won't it have to constantly create new fields in a table? Or is there another way to handle this?
What's the best way from a "clean architecture" standpoint?

dang, I really have to start over? I finally got all this stuff working again. well, hopefully it won't be as big a pain this time since the data won't be coming from a different machine. After completing the Migration Assistant process, I had to reinput a bunch of serial numbers for apps, reinstall print and mouse drivers, etc... I've finally got the new machine up and running smoothly and now I gotta start over? Sigh.
I was hoping that either I could rename the current account after deleting the other one, or just move everything from one account to the other and then delete the 'RJM' account.
ok, so it sounds like here are the steps I need to take:
- make another full cloned backup of this current machine in Super Duper
- reboot this machine using the advice in the first post, wipe everything clean and reinstall the OS
- create a new account like 'user1' and re-do software update (which is like 2.5 gig worth of stuff) and takes like an hour even on a high speed connection
- then re-do the migration assistant process to the properly named account
- then delete the 'user1' account
does that sound right?

What is the best way to handle .mod files in premiere pro cs4?

I recently got a JVC Everio GZ-MG130u and as I'm sure many of you are aware, it saves footage in the .mod format.
I have googled this and found quite a few different solutions, but I'm just wondering if anything has changed since some of these solutions were posted, or in other words, what is the best way at this current point in time to handle .mod files in premiere pro cs4?
As far as I know, the best thing to do is convert the .mod to .avi and then import it into premiere so it can be edited.. Is there a better way to do it than this? Also, by doing it this way, will I have separate audio and video tracks?
Thanks.

I have just done a bit of reading, here. All of the quotes that follow are from users who have posted in that thread.
It seems that there isn't one solid answer on this subject. The thread that I linked to was started 2 years ago, and replied to just 4 ago, so it's relatively current.
I noticed a couple different interesting statements:
posted by mmontgomery:
In the case of .MOD, you are actually getting a MPEG-2 file. The way
video files work is that there is a codec (COmpressor/DECompressor)
algorithm and a file wrapper (or extension). A JVC .MOD file is a
MPEG-2 encoded file, with a .MOD extension.
You're faced with two
challenges, first the .MOD file type is only recognized and support by a
few applications. I think we covered some of those already. The
interesting thing about wrappers and extensions is that they can be
dealt with in a variety of ways. Sometimes all you need to do to convert
the video file to a compatible video file is to change the extension.
In the case of .MOD files that's not enough. The .MOD wrapper apparently
does a few more things than just bare a unique extension name. It
requires a slightly more complicated method to convert that file. That
is why there is supplied software and that certain third party
applications have .MOD support.
(posted 2 years ago)
This seems to indicate that Ann's solution of simply re-naming the extension is not good enough, unless I am mis-interpreting what she meant.
However, another user said:
posted by futball8:
I edit with Adobe Premiere Pro CS3. All I have to do is simply rename
the .MOD files as .MPG and then import into PP CS3. It takes a small
amount of time to conform the audio, but no file conversion is
necessary. It's a pretty slick workflow and I've never encountered any
problems editing them this way.
(posted 5 months ago)
One can only assume that simply re-naming the extension from .mod to .mpg works in some circumstances, and doesn't work in others. I assume it depends largely on the editing software being used. Perhaps there are still issues that futball8 was simply unaware of or never encountered.
That said, there seems to be a couple of different real solutions to this problem that I have found:
1. Simply use an editing program that supports .mod file format. While pe7 and pe8 supposedly support the .mod format, the following should be noted:
posted by macksgarage:
While Elements 'supports' these files, it is markedly unstable and frequently crashes while using the files, though the application is otherwise reliable. The solution I have arrived at is to repair the container using ffmpeg. (see #3)
(posted 5 months ago)
2. Use a file conversion utility of your choice that will covert .mod to .avi, or another desired format. Import the resulting .avi file into premiere pro cs4.
3. Use FFmpeg. This seems to be the best solution as it does not convert any audio or video:
posted by macksgarae:
If you are not familiar with ffmpeg, it may be a bit of a bear to
learn, but it's not only useful for this, but functions as a video swiss
army knife useful for splicing, muxing/demuxing, and rendering just
about any format into just about any other format.
ffmpeg is an open source project from the linux world, but it has
been ported and is supported on windows. Fetch it here and place it somewhere handy
on your system.
To rewrite the container into a nice, standards compliant .mpg file
that doesn't make applications die, WITHOUT rerendering video or audio
itself, I use this command.
ffmpeg -i INFILE.MOD -acodec copy - vcodec copy OUTFILE.mpg
This not only renames the file, but actually rebuilds the container
around unmodified video and audio data, yielding a file which works much
more stably with Adobe applications, and presumably others as well, as
ffmpeg's open source development goals result in very standards
compliant files.
(posted 5 months ago)
Now, this seems to properly address the issues that can arise from simply renaming .mod to .mpg, as suggested by Ann. So from this point, I assume you can simply import the .mpg into Premiere Pro cs4 (or any other .mpg compliant program) and edit without issue, but it seems like I remember hearing something about Premiere not liking mpegs or something like that, so in that case, maybe it'd be better to skip this and go with option #2. But, it's been awhile since I've touched any NLE, much less premiere pro cs4, so I could be completely wrong and it may have no problems handling mpegs.
All of the things that I've quoted here came from the same thread, so I don't know how accurate any of this is, but the people that have posted these things seem fairly knowledgeable. If someone reads all of this and can confirm or deny any of it, it would be much appreciated.
Option 1 is not really an option for me, because I am sticking with premiere pro cs4 -- I'm not going to get another editor just because it has .mod support. That leaves me with options 2 and 3: Convert to avi, or change the file wrapper/extension properly with FFmpeg and then simply import the resulting .mpg file... Which is better? Or is there yet another solution that I am unaware of that would be even better?

What's the best way to import ALL of my photos (34k +) and then share?

*Part I - importing:*
I've got approximately 34,400 photos on a networked drive that I need to be able to control using iPhoto. I want these files to stay on the network drive, but also be controlled by iPhoto (organized by date). Right now our photos folder on the network drive is a bit of a mess, some folders are named by date only and some are named by the event itself ("birthday 2009", etc.). I want this naming to go away in place of the iPhoto method (by date only). FYI, I am familiar with how to get to the "original" and "modified" folders/files within the iPhoto Library.
Question: Is there a way to get iPhoto to organize the photos (all by date) an leave the original photos on the networked drive? or do I need to:
> Import ALL photos into my iPhoto with the "import photos into iPhoto Library" option checked (iPhoto copies all original files to my laptop hard drive)
> Then manually move the file structure (all new folders created - by date) back to my networked drive
> THEN...remove all photos from the iPhoto Library and re-import the newly organized photos from the network drive but unchecking the "import photos into iPhoto Library" option.
Right now, both of our MacBook Pro's use iPhoto to access those photos independently of one another (each laptop does their own thing). This also creates problems because when files are imported on my laptop they are saved locally (on my laptop) and not on the network drive, same goes for my wife's laptop. Then she's not able to see those new photos.
*Part II - sharing:*
I'm also in the process of trying to figure out the best way to share all of our photos between our different laptops. Using the "sharing" function in iPhoto isn't ideal since that requires both laptops to be on.
My understanding of sharing the iPhoto library itself (having it saved on the networked drive) between two laptops is that only one laptop can access this library at a time, or there's potential of having the files become corrupt (two laptops trying to access the file at the same time).
Question: What's the best way to share photos between two laptops?
Thanks in advance

RONBO
Is there a way to get iPhoto to organize the photos (all by date) an leave the original photos on the networked drive?
Yes there is. But I don't recommend it as a way of working with iPhoto.
Simply go to iPhoto Menu -> Preferences -> Advanced and uncheck 'Copy Files to the iPhoto Library on Import'.
Now iPhoto will not copy the files, but rather simply reference them on your HD. To do this it will create an alias in the Originals Folder that points to your file. It will still create a thumbnail and, if you modify the pics, a Modified version within the iPhoto Library Folder.
However, you need to be aware of a number of potential pitfalls using this system.
1. Import and deleting pics are more complex procedures
2. You cannot move or rename the files on your system or iPhoto will lose track of them on systems prior to 10.5 and iPhoto 08. Even with the later versions issues can still arise if you move the referenced files to new volumes or between volumes.
3. Most importantly, migrating to a new disk or computer can be much more complex.
The problems arise when you change the path to the Files. iPhoto has no way of reconnecting that path and you could find yourself resolving aliases one at a time for all 34k Photos.
Other apps, such as Aperture have a command to re-connect with the master files.
FYI, I am familiar with how to get to the "original" and "modified" folders/files within the iPhoto Library.
Good for you but never, ever access the files this way. Period. Within the iPhoto Package File there are no user sercviceable parts.
All your work gets done in the iPhoto Window. Everything you need to do can be done from there - and must be.
Then manually move the file structure (all new folders created - by date) back to my networked drive
Never, ever break up the internals of the iPhoto Package File. You'll break iPhoto if you do.
Also, what format is that Networked Drive? iPhoto needs to have the Library sitting on disk formatted Mac OS Extended (Journaled). Users with the Library sitting on disks otherwise formatted regularly report issues including, but not limited to, importing, saving edits and sharing the photos.
Question: What's the best way to share photos between two laptops?
If simultaneous sharing is your goal then you need to use a Media Server app. iPhoto isn't one.
The key really is the format of the NAS. IF you can make it Mac OS Extended (Journaled) then you can easily store your Library on it and share it. Otherwise you need to use another application for the job.
Regards
TD

I just bought a new Macbook. What's the best way to transfer all my info from the old one?

Hey everyone! I just got my new retina display Macbook Pro, and I'm trying to figure out the best way to transfer all my music/photos/files/data/etc. from my old Mackbook Pro. I have a 1TB external drive and an 8GB flash drive that I can use if I need to. Any sugestions? Thanks!

What i did with mine, I cloned the drive of my old macbook to my external drive using carbon copy cloner.
Once i was done with the clone - i used migration assistant to transfer my apps/data/pictures/files over my new macbook....
when using migration assistant - do not transfer your old settngs and if you're doing an app transfer, only transfer the ones you need and that you know will work with your Retina...
good luck..

What's the best way to handle all my data?

Similar Messages

Maybe you are looking for