Best strategies for reducing effective data collection rate?

Hi,
I'm writing a VI to collect data from cDAQ modules that have a minimum sampling rate of 1612Hz due to the master timebase (specifically 9237 and 9215 modules). I would like to log data (1D waveform with timestamps) at 100Hz for 12 hours and save this to file. THe data also needs to be displayed during this time, and data logging should be robust so there is minimal risk of data loss.
I've made one attempt at doing this previously - I used the Align and resample expressVI but this was fairly messy, and the problems I ran into were that I had errors about the maximum array size being reached, and also constant buffer overwrite errors. 
I would like to basically start this VI again from scratch, and I'm wondering if there are any suggestions for an overall strategy for this?  I'm not asking for any code to be written for me, just concrete shoves in the right direction regarding things like data file type, how to resample or downsample data, how to clear arrays, etc.
Thanks,
Claire.

Claire,
It appears that you are appending the resampled waveform to an empty array of waveforms and then writing the appended array to the file.   What does appending to an empty array accomplish?  Just write the decimated array directly to the file.
If you want to have an array of all the waveforms, then you need to use shift registers to pass the appended array to the next iteration of the consumer loop. 
You do not need the sequence structure.  Dataflow takes care of making things happen in order.
I do not see how the feedback node will ever change the file name as it only executes once.  I am not sure what you intended, but you may want to move the file path creation inside the loop and put it into a case structure which executes when it is time to create a new file.
The attached image is an example of the way I was thinking of decimating your data.
In both my image and your program the use of build array in a loop is not a good practice it the array can get large due to memory allocation issues.  Better is to initialize an array of the maximum size and use Replace Array Element to put the data into the array. 
Lynn 
Attachments:
Decimate waveform.png ‏83 KB

Similar Messages

  • Measure Formulae for Uploadable and Data collection report

    Hi,
    I have query related to application of measure Formula for Uploadable and Data collection report.
    Consider a scenario where i use a MDX query to create a data collection report and I map these columns from these reports to an rowsource using a loader file. Can I use measure formula feature like onchange to work with Uploadable and Data colection reports such that changes to any one column should take effect in another column.
    Regrads,
    Wesley

    Wesley,
    IOP uploadable reports are used for sending data to the server in batch. They are coupled to the IOP model via a rowsource. You have a lot of flexibility with the spreadsheet you build for staging the upload. It's really just a function of how crafty you are with vb. Cascading changes from one column to another can be easily accomplished this way.
    Onchange formulas are for something else. They are part of the model definition and are used for describing how to cascade changes between IOP data blocks.

  • Table for Job effective date

    Please let me know the table and field for the Effective date the employee moved into the job
    Lisa

    Hi Lisa,
    the fileds BEGDA and ENDDA represent the Effective date and end date of the EE assigned to the Job
    Thanks
    Cheera

  • Best Practice for Initial Load Data

    Dear Experts,
        I would like to know the best practices or factors to be concerned when performing initial load
    For example,
    1) requirement from business stakeholders for data analysis
    2) age of data to meet tactical reproting
    3) data dependency crossing sap  modules
    4) Is there any best practice for loading master data?

    HI ,
    check this links
    Master Data loading
    http://searchsap.techtarget.com/guide/allInOne/category/0,296296,sid21_tax305408,00.html
    http://datasolutions.searchdatamanagement.com/document;102048/datamgmt-abstract.htm
    Regards,
    Shikha

  • Best practice for putting binary data on the NMR

    Hi,
    We're creating a component that will consume messages off the NMR, encode them, and subsequently put them back on the NMR. What's the best practice for sending binary data over the NMR?
    1. setContent()?
    2. addAttachment()?
    3. setProperty()?
    If NormailzedMessage.setContent() is the desired approach, then how can you accomplish that?
    Thanks,
    Bruce

    setContent() is used only for XML messages. The recommended way to accommodate binary data is to use addAttachment().

  • Who is the best app for video effects ?, some one like adobe after effects ? Thank u for ur help.

    Who is the best app for video effects ? Some one like adobe after effects ?

    Tweakers Page - What video card to use?

  • FAQ: What are the best resources for After Effects CS6?

    Listed are select troubleshooting and "how to" resources for After Effects CS6.
    After Effects CS6 troubleshooting resources
    I'm having trouble downloading and installing After Effects. What do I do?See troubleshooting documents, post in the Downloading, Installing, Setting Up forum, or contact support. For details, see this blog post or this FAQ.
    What are the system requirements for After Effects CS6?See this article.
    Does After Effects CS6 work with Mac OS X 10.9 (Mavericks)?Yes, update to After Effects CS6 (11.04) for that capability. More info in this blog post.
    How do I prevent After Effects CS6 from crashing when I use Illustrator files?Prevent this issue by turning off the preference Create Layer Markers from Footage XMP Metadata in the Media & Disk Cache preferences category. More info in this blog post.
    I can't open the composition mini-flow chart. What do I do?See the workarounds in the following blog post.
    Is there a 30 day trial available for After Effects CS6?Yes, subscribe to the free version of Creative Cloud, then download After Effects CS6. More info here.
    I'm getting errors related to QuickTime. What do I do?See this blog post for troubleshooting items related to QuickTime.
    What are the GPU related features in After Effects CS6?See this blog post for details.
    Do I need new plug-ins for After Effects CS6?See this blog post for information.
    I'm getting errors after applying the 3D Camera Tracker or Warp Stabilizer to a long clips in After Effects CS6. What do I do?See this blog post for more information.
    After Effects CS6 Tutorials
    How do I get started with After Effects CS6?See this blog post.
    Where can I find tutorials for learning After Effects CS6?
    See this blog post.
    See also this collection of tutorials.
    Issue: What are the top new and changed features in After Effects CS6?See this blog post.
    Issue: How do I optimize After Effects CS6 for best performance?See this article.

    Hi ..
    GO to website www.Apache.org
    down load Apache tomcat server .
    install it ...
    Go to sun site
    c and download jsp tutorials ...
    Go to
    (www.coreservlets.com)download book core servlets
    u can find lots of nice books supported by sun on sunwebsite ...
    Now u r equipped ....
    start doing everything (R &D) on server ..
    Join This JSP forum and ask any thing u didnt got ..or learn or get confused..
    I thing once u go through this ..it will do all what u want
    Hope it helps
    Best of Luck :)
    regds & take care

  • Best Practice for Using Static Data in PDPs or Project Plan

    Hi There,
    I want to make custom reports using PDPs & Project Plan data.
    What is the Best Practice for using "Static/Random Data" (which is not available in MS Project 2013 columns) in PDPs & MS Project 2013?
    Should I add that data in Custom Field (in MS Project 2013) or make PDPs?
    Thanks,
    EPM Consultant
    Noman Sohail

    Hi Dale,
    I have a Project Level custom field "Supervisor Name" that is used for Project Information.
    For the purpose of viewing that "Project Level custom field Data" in
    Project views , I have made Task Level custom field
    "SupName" and used Formula:
    [SupName] = [Supervisor Name]
    That shows Supervisor Name in Schedule.aspx
    ============
    Question: I want that Project Level custom field "Supervisor Name" in
    My Work views (Tasks.aspx).
    The field is enabled in Task.aspx BUT Data is not present / blank column.
    How can I get the data in "My Work views" ?
    Noman Sohail

  • Best practice for migrating eLearning data from Sol Mgr 3 to 4?

    Greetings,
    What is the recommended method for moving eLearning data when migrating from Solution Manager 3 to version 4?
    Thanks in advance,
         Ken Henderson

    948115 wrote:
    Dear All,
    This is Priya.
    We are using ODI 11.1.1.6 version.
    In my ODI project, we have separate installations for Dev, Test and Prod. i.e. Master repositories are not common between all the three. Now my code is ready in dev. Test environment is just installed with ODI and Master and Work repositories are created. Thats it
    Now, I need to know and understand what is the simple & best way to import the code from Dev and migrate it to test environment. Can some one brief the same as a step by step procedure in 5-6 lines? If this is the 1st time you are moving to QA, better export/import complete work repositories. If it is not the 1st time then create scenario of specific packages and export/import them to QA. In case of scenario you need not to bother about model/datastores. keep in mind that the logical schema name should be same in QA as used in your DEV.
    Some questions on current state.
    1. Do the id's of master and work repositories in Dev and Test need to be the same?It should be different.
    2. I usually see in export file a repository id with 999 and fail to understand what it is exactly. None of my master or work repositories are named with that id.It is required to ensure object uniqueness across several work repositories. For more understanding you can refer
    http://docs.oracle.com/cd/E14571_01/integrate.1111/e12643/export_import.htm
    http://odiexperts.com/odi-internal-id/
    3. Logical Architecture objects and context do not have an export option. What is the suitable alternative for this?If you are exporting topology then you will get the logical connection and context details. If you are not exporting topology then you need to manually create context and other physical connection/logical connection.
    >
    Thanks,
    Priya
    Edited by: 948115 on Jul 23, 2012 6:19 AM

  • Best Practice for disparately sized data

    2 questions in about 20 minutes!
    We have a cache, which holds approx 80K objects, which expired after 24 hours. It's a rolling population, so the number of objects is fairly static. We're over a 64 node cluster, high units set, giving ample space. But.....the data has a wide size range, from a few bytes, to 30Mb, and everywhere in between. This causes some very hot nodes.
    Is there a best practice for handling a wide range of object size in a single cache, or can we do anything on input to spread the load more evenly?
    Or does none of this make any sense at all?
    Cheers
    A

    Angel 1058 wrote:
    2 questions in about 20 minutes!
    We have a cache, which holds approx 80K objects, which expired after 24 hours. It's a rolling population, so the number of objects is fairly static. We're over a 64 node cluster, high units set, giving ample space. But.....the data has a wide size range, from a few bytes, to 30Mb, and everywhere in between. This causes some very hot nodes.
    Is there a best practice for handling a wide range of object size in a single cache, or can we do anything on input to spread the load more evenly?
    Or does none of this make any sense at all?
    Cheers
    AHi A,
    It depends... if there is a relationship between keys and sizes, e.g. if this or that part of the key means that the size of the value will be big, then you can implement a key partitioning strategy possibly together with keyassociation on the key in a way that it will evenly spread the large entries across the partitions (and have enough partitions).
    Unfortunately you would likely not get a totally even distribution across nodes because of having fairly small amount of entries compared to the square of the number of nodes (btw, which version of Coherence are you using?)...
    Best regards,
    Robert

  • Best practice for retraction of data from BPC 10.0 to General Ledger

    Hi All,
    I have the requirement to retract data from BPC 10.0 to General Ledger.
    What is the best practice for doing this?
    I have read the "How To... Retract data from BPC 7.5 NetWeaver to SAP ERP Cost Center Accounting, Part I", but this is prepared to transfer data to Cost Center accounting. Will General Ledger be populated automatically?
    What is your opinion on this?
    Best regards,
    JA

    Hi Rich,
    In BPC 10 NW, the data entered in Input Forms has to be retracted to ECC.
    For this retraction we are following below link.
    http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/c029accf-6d95-2d10-79aa-cc291180bf73?QuickLink=index&overridelayout=true&59180354379512
    In this document, I am unable to get the details of class ZCL_BPC_RTRCT_SUPERCLASS.
    as it is Z class, i am unable to create in my system.
    could you please help me.

  • Strategies for Internationalization - localized data ?

    I am looking for some advice/tips/best practice for working with localized data.
    Java Locales are nice (at least for working with stuff that fits into property files) and JDeveloper's has some of the best support I have seen for multilingual UIs. However, I am a bit at a loss for how to best approach this for localized data. That is, not field names but database stored values.
    For example, for a online store you have a product catalog. For each product you description in various languages. In terms of Java Locale logic, some products might have a description in en, en_US, en_GB, en_CA, fr, fr_FR, fr_CA, others might have just en, fr others might have some other sets of languages. So for a clients locale, there might not be a simple singular locale in the database.
    So then, what's a good approach for Java/BC4J design and database schema?
    Actually storing the data doesn't seem like a big deal.
    I was thinking of doing a table like
    PRODUCT_DESCRIPTION
    product_id PK (FK - PRODUCT)
    local_code PK
    product_description
    then I'd have a LOCAL table that had langauge code, country code, etc. (But maybe there's a better approach for working with the data via BC4J and Java.)
    However, I don't see a good way to work with the data in Java. It could get out of control trying to display a search results of products, where for each product you have to work you way through the logic of LOCALEs from most specific up to default just to get the description.
    If it matters, this would be a webapp, so I'd have the browser settings, servlet2.3 locales, etc to work with. Also, I might have 200,000 products (which actually join up to a few million catalog items for pricing).
    So what would be good approach (simple and performant) for this?
    How would you set up your BC4J entities and views, etc and pull back the right langauage?
    Is there any good info out there on working with database driven internationalized data in Java? Generally, everyone talks about property files and field labels and never mentions a database.
    thanks,
    -S

    I adopted this solution that works fine, but has some disadvantages (I tell about them later).
    I have a lot of Tables with descriptions (like country, products, etc...) in various languages.
    My application is named Weborder, so I created with the wizard the two classes associated with the application module Weborder.java and WeborderImpl.java.
    In WeborderImpl.java I have a variable (lingua, I used an int so I can use then a switch construct) which stores the information about the language (and also a DEBUG flag)
    private boolean DEBUG = true;
    private int lingua = 1;
    * This is the default constructor (do not remove)
    public WeborderImpl() {
    public boolean isDEBUG() {
    return DEBUG;
    public void setDEBUG(boolean newDEBUG) {
    DEBUG = newDEBUG;
    /* GESTIONE LINGUA */
    public int getLingua() {
    return lingua;
    public void setLingua(int ling) {
    //I have 4 languages
    if ( ling>=1 && ling<=4 ) {
    lingua = ling;
    else {
    if (DEBUG) System.err.println("Lingua "+ling+" NON CORRETTA");
    public void setLingua(String s) {
    try {
    setLingua(Integer.parseInt(s));
    catch (Exception e) {
    if (DEBUG) System.err.println("Lingua "+s+" NON AMMESSA");
    /* GESTIONE LINGUA */
    The accessor methods are visible through the Weborder.java interface class (you do this with the edit appl. module wizard, in the "Client Method" tab).
    When the user logs in, I set the language in the Application Module, so it is visible from every View in the Application Module. Here is a method that I call from the jsp page that checks the login:
    public static boolean validSignOn(HttpServletRequest request, ApplicationModule am) {
    setLingua(wo,(String)user.get("lingua"));
    return ok;
    public static void setLingua(ApplicationModule am, String newLingua) {
    Weborder wo = (Weborder)am;
    try {
    wo.setLingua(Integer.parseInt(newLingua));
    catch (Exception e) {
    System.err.println("WOLogin; lingua errata :"+newLingua);
    In the jsp page it is invoked in this way:
    <jbo:ApplicationModule id="Weborder" configname="webord.dm.Weborder.WeborderLocal" releasemode="Stateful" />
    <jbo:DataSource id="loginVo" appid="Weborder" viewobject="LoginView" rangesize="-1" />
    <% boolean ok = WOLogin.validSignOn(request,loginVo.getRowSet().getApplicationModule()); %>
    You can invoke WOLogin.setLingua() from every jsp page to switch the language (and similarly the DEBUG variable).
    Then I have a View (DOrdiniView) that displays the detail of an order, and I want that the products gets the right description.
    - Using the wizard I select the two entities (the first with the order lines "DOrdini", the second with the product description "DArtOrdBol") and there I add a transient Attribute called Description with type String.
    - Using the wizard I create the two java class DOrdiniViewImpl and DOrdiniViewRowImpl
    - In the class DOrdiniViewRowImpl.java I modify the get Description method:
    public String getDescription() {
    // return (String)getAttributeInternal(DESCRIPTION);
    int lingua = ((Weborder)getApplicationModule()).getLingua();
    switch (lingua) {
    case 2: return getDArtOrdBol().getDescrizioneTed();
    case 3: return getDArtOrdBol().getDescrizioneUk();
    case 4: return getDArtOrdBol().getDescrizioneFra();
    default: return getDArtOrdBol().getDescrizioneIta();
    And this is all.
    When I use this ViewObject I have only to call the method
    getAttribute("Description"), which returns the description in the right language. I never have to care about the language, I only have to set it and everything works.
    All this works fine, but there are two problems:
    1. for every view object you create, you have to override the method getDescription() in the ViewRowImpl.java class, but this is not so problematic;
    2. if you have to use that attribute in a SQL statement, you can't! An example is for an ORDER BY clause (for a "SELECT .. WHERE description LIKE ..." statement, I use a column that is composed of all the descriptions).
    It would be a better idea to have such a method directly in the Entity Objects, so you can use the column in the SQL statements and you have to insert java code only once per entity.
    The problem is that the language is specific for the user session, so the better place to store it is (I think) in the Application Module.
    Initially I used another approach, inserting the description as a column like this:
    decode(?,2,DESCR_DE,3,DESCR_UK,4,DESCR_FR,DESCR_IT) AS DESCRIPTION
    and passed the parameter every time I used the view object, using the method setWhereClauseParam(..,..) of the class ViewObject.
    This was not a so good idea because I got a lot of "not all variables bound" SQLException about ViewObjects that I was not using in the particular jsp page I invoked with the browser (view objects that were childs of the view object I was using).
    So, if this can help...
    I hope someone can give some enhancement on this solution, that solves the problems I have just pointed out.
    bye,
    Marco.

  • Best Solution for Archiving Table data

    Hi All,
    I have a table with huge data. It is not partitioned table.
    On an average per day 10000 records will be inserted into this table. Now I want to archive(backup)
    every one years data manually and keep in safe location and hence delete those archived rows
    from the table. Whenever required it should be easily imported back to this table. All this happens through
    Application.
    One appraoch in my mind right now, is transferring the data from table to flat file with comma separted,
    and whenever required again importing back to the table from Flat file using external tables concept.
    Can any body suggest what is best solution for this.
    Thanks

    The best solution would be partitioning.
    Any other solution requires DML - running DELETE and INSERT transactions to remove a data set and to add a data set (if need be) again.
    With partitioning this is achieved (in sub-seconds) using DDL by exchanging a partition's contents with that of a table. Which means that after the archived data has been loaded (SQL*Loaded, Import, etc) into a table (and indexes created), that table (with indexes) is "swapped" into the partition table as a partition.

  • Best practices for submitting CF data to an AJAX page?

    Hi everyone,
    I've got a project I'm working on for work and have hit a
    little problem.
    I am extracting data from my database and then after each
    piece of data (just numbers, usually 10 chunks of numbers), I tack
    a "|" onto the end of each number. Then, I output the data to the
    page. Back on my AJAX enabled page, I get the "responseText" from
    that page, and then split it up using javascript and the
    pre-inserted "|".
    This seems to work fine, but it is quite a bit more messy.
    Also, It would really, really be nice to be able to do sorting and
    various other operations on the data with javascript instead of
    having to rely on CF's icky code logic.
    Can someone please enlighten me as to best practices for this
    type of thing? I get the suspicion that I'll probably be using XML
    somehow, but I'd your opinion.
    Thanks!

    Check out the Samples and Documentation portions of Adobe's
    Spry website for client side use of JSON with Spry.
    http://labs.adobe.com/technologies/spry/home.html
    Here is link to Adobe's Spry Forums:
    http://www.adobe.com/cfusion/webforums/forum/categories.cfm?forumid=72&catid=602
    If you are using CF8 you can use the SerializeJSON function
    to convert a variable to JSON. You might also be interested in the
    cfsprydataset tag. CF 8 documentation:
    http://livedocs.adobe.com/coldfusion/8/htmldocs/
    If you are using a previous version of CF there is 3rd party
    JSON support. You can find links at
    http://json.org.

  • Best tutorial for after effect in net

    hi
    i read a thread in FAQ about how to learn after effect but i want your experience.in the internet there are many tutorials for after effect but can someone tell me where can i download or buy the best and complete after effect tutorial from begining to really professional?

    Once you have a handle on the basics it is important to focus on one area at a time. Compositing, motion graphics, Visual Effects all require completely different skill sets. When you figure out what you want to concentrate on then we can give you a better idea of how to start. If you want a complete course in AE I'd suggest Total Training or Lynda.com Both offer excellent tutorials that take off right after Adobe TV leaves off.

Maybe you are looking for

  • Report for Service for a project

    Hi, I want to have a report which will give service PO qty value, All service line items Qty and value for that PO, total service entry sheet made and total invoice qty and value for a perticular project.Where can i get this.

  • How to update metadata (e.g. keywords, author) for pdf created from spool

    Hi Experts, My requirement is that smart-form spool will be converted into PDF and will be saved on to application server. Now, a third party tool will read the data and print it. I want to update properties of this PDF like author, keywords. These p

  • Do you HAVE to connect appletv to the TV?

    If you have a home theater system, with a receiver, can you connect both audio and video throught the receiver ONLY or must one connect to the TV as well?

  • Where is the delete button on MacBook?

    Hi, this might sound like a ridiculous question but I cant find my delete button. In the manual it says delete is a button with an x in a square but I dont have this button and its not on any second function keys. I know I can delete by backspacing b

  • Jewel Case Inserts - can I have a photo instead of album artwork?

    When making a jewel case insert for a playlist (using iTunes program) - is there a way to put one of my iPhoto photographs on the cover, rather than album artwork? This cover is for an iDVD movie. I'd like a photo on the front cover rather than an al