Test granularity - best practice

We're struggling with a couple issues. We want to write our LabVIEW in a generic fashion such that they simply perform a task, and unless it's a very simple task, they don't make the determination of pass/fail - we want to leave that upto TestStand. We don't want any of our LabVIEW tests to have hard-coded ranges in them. This brings up a number of questions. Since we (mostly) want TestStand to ochestrate the parameter ranges, test sequence, pass/fail, etc.- Is there a best/suggested method of capturing test scenarios. Obviously, at some point, you have to identify the parameters/ranges for the various tests. Is it best to hard-code them into the TestStand sequence file associated with a particular LRU - OR - Is there a nice XML, .ini, .txt format that TestStand can read to populate a series of local variables. Hopefully someone understands my babble and can provide a starting point.

TestStand provides the property loader step type that you can use to modify limits for a particular board type. Whether you use that or hard code limits into a test sequence is really application specific. If you have an LRU (or what I would call a UUT or Unit Under Test) that has a large number of different varieties, it would often be simpler to use the property loader. Doing this, you would only have to write a single sequence file. For a new board, you would then just create a new .txt, .xls, etc. and distribute that. I don't happen to be in that sort of situation. The vast majority of boards that I have to test are unique and the limits are fixed in the sequence file. I do have several board types where stuffing options make certain whole tests optional and I find it more convenient to use pre-conditions in the sequence file for that situation. For example, perform this step if serial number prefix = 'abc'.
You are correct in removing any pass/fail criteria from the LabVIEW code and letting TestStand do that work but the actual mechanics of how TestStand does it should be approached on a case-by-case basis. It helps to be in touch with the product development teams to see what other flavors of a particular product are planned. The extra overhead of loading limits from an external file would not be justified for something that is a one-off and you are trying to optimize the test time.

Similar Messages

Create Test Environment - Best Practice

HI all..
Please, someone know which is the best practice to create a environment test from our company DB for testing purpose?
OUR SCENARIO:
SAP B1 9.1 PL 6
MSSQL 2008 R2
Integration service activated
WINDOWS 2008 R2 Ent Edition for client machine and server machine
Thank's in advance
--LUCA

Hi Manish..
I would like to have a copy of our company DB for testing purpose..
It's not important integration service.
We would like to test 9.1 PL 06 BoM new features without modify the rpoduction environment...
Thank's
--LUCA

ADF Deployment Granularity - Best Practices

Hi People,
If anyone can spare some time to discuss this, I would like some pointers about ADF applications deployment best practices. For example, we have some customers that complain about having to re-deploy the entire application EAR just to add a field "rendered" condition on a single page, and also having to re-deploy the ADF BC model JARs even though the application has only been changed on the view layer.
What level of deployment granularity can we JDeveloper + ADF developers provide to our customers, without the risk of having inconsistency or dependency problems? So far, our strategy is to deploy the BC Model layer to separate JARs and the View Layer in a WAR file, packaging everything in an EAR. Is it feasible to allow the developers to change one single page and generate a deployment archive for just that single page? If not, which arguments can i provide in a discussion to support the single-deployment point of view?
Thanks for your time, and regards!
Thiago

Hi Thiago
Interesting question and one that comes up from time to time with JEE applications. I've been doing some research on this issue, and recently blogged about how OC4J and BEA Weblogic handles this scenario. Hopefully the post and reference to the OTN post gives you more information, though I'd be interested if you're research reveals a different approach.
I'm also hoping this issue comes up at the OOW ADF Methodology chat among the JDev experts, it would be good for the experts to share their different approaches to this common issue.
I know this doesn't give you a direct answer but hopefully will be useful.
Cheers,
CM.

Bundle testing and best practices, bonus introduction

Hi all, I'm new here and to ZenWorks, please be gentle
While I'm aquainted with puppet and reasonably proficient with ansible, I've just taken on a number of Windows desktops. We're using ZCM to deploy software, and I'm testing to get aquainted. Things don't quite work as I expect; for example, I fought with manually launching QuickTasks to my test workstation manually for hours yesterday before I realized I needed to manually refresh the workstation after updating my bundle, I couldn't just push.
So while I'm reading throught the documentation, I thought I'd say hello and ask for some general advice. In particular, I had trouble identifying why my bundle had failed, and where to look for information about the failures. Including a script then expecting STDERR from that script to tell me about the failure seems like an impossible luxury at this point For now, I'd like to just experiment.
What is your workflow for testing new bundles?

Immanetize,
> I fought with manually launching
> QuickTasks to my test workstation manually for hours yesterday before I
> realized I needed to manually refresh the workstation after updating my
> bundle, I couldn't just push.
Yes, refresh is a timed process. When testing, I always do a zac ref
bypasscache on the testing workstation.
> So while I'm reading throught the documentation, I thought I'd say hello
> and ask for some general advice. In particular, I had trouble
> identifying why my bundle had failed, and where to look for information
> about the failures. Including a script then expecting STDERR from that
> script to tell me about the failure seems like an impossible luxury at
> this point For now, I'd like to just experiment.
> What is your workflow for testing new bundles?
It depends. If it fails, then I first look at the ZCM agent log.
Anders Gustafsson (NKP)
The Aaland Islands (N60 E20)
Have an idea for a product enhancement? Please visit:
http://www.novell.com/rms

Best practice standard User Acess Test for WIN2012 AD

What is the Best practice standard User Acess Test for WIN2012 AD

Hello,
as before, add a computer to the domain and log on with a domain user account to the computer.
You should be able from the client machine to open the sharedfolders on the DCseither with:
\\DCName\sysvol
\\DCName\netlogonor \\NetBiosDomainName\sysvol
\\NetBiosDomainName\netlogon
Best regards
Meinolf Weber
MVP, MCP, MCTS
Microsoft MVP - Directory Services
My Blog: http://blogs.msmvps.com/MWeber
Disclaimer: This posting is provided AS IS with no warranties or guarantees and confers no rights.
Twitter:

Best practice on 'from dev to test'move.

Hello.
My Repository 10.2.0.1.0
My client 10.2.1.31
I am writing to ask someone what would be the best practice and most common_sense_oriented way to move OWB from dev to qa/test environment?
I have read a number of recommendations on this forum and other oracle docs and it seem somewhat tedious exercise...
At the moment i am either having to simply copy and paste (ye not very professional but works a treat!) then just re-sync the tables to point to correct location on some of the smaller of my projects.
Now i have a huge project with hundreds of maps with different source locations etc.
I want to move it into test.
My test environment is where we test ETL process before implementing it in live as oppose to UAT test.
I imported the tables into OWB etc from the test, now i want to move my maps from dev to test and this is where my HOW TO comes.
I have different runtime repositories on my test as per oracle recommended (same names apply to dev and test and live repositories for the consistency purposes). Importing the maps from the export of dev to test doesn't really work and i don't really want start tweaking with export files.
for some reasons the import only imports it back to the project the export was taken from.... (which is as useful as a smack on a head, in my humble).
copy and paste the re-sync all tables would be madness, misery and pain all in one!
So what do i need to do?
1) OK i imported all the tables and views from the test environment into OWB
2) How do i move my maps from dev to test?
3) even if i copy them over - would i honeslty have to then resync tables in every single map (i am already crying by the thought of it)?!
It seem a little tidious to me.
I can imagine that there is no silver bullet and everyone have different ideas, but someone please share your experience on how would do it?
Here is something from the user guide and no matter how many times i read this - i just don't get how i can relate it to what i need to achieve.
The following quote is from "OWB User Guide", Chapter 3.
"Each location defined within a project can be registered separately within each Runtime Repository, and each registration can reference different physical information. Using this approach, you can design and configure a target system one time, and deploy it many times with different physical characteristics. This is useful if you need to create multiple versions of the same system such as development, test, and production."
As i said - i have all my tables imported from DB to OWB, now how do i make my maps to appear in repository on test? I can see the relevance of location to deploy maps into the test runtime repository, but before then i somehow have to make them to appear in my test runtime repository in Design and make sure they are referencing correct tables etc.
Any help would be greatly appreciated.
Kind Regards
Vix

Hello Oleg.
Thank you very much for such detailed and very helpful reply.
You are correct - i have my Design Centre and within it two projects - dev and test.
Dev has all the locations pointing to the Development DB and it has it's own runtime repository/control centre configured.
Test has all the locations pointing to the Test DB and it also has it's own runtime repository/control centre configured.
I have one design centre and two runtime environments.
both dev and test have identical tables etc. I moved the logic over form dev to test (all the functions, procedures etc), i have also imported tables and logic from TEST DB to the test project.
All i want to do is now move over the maps from DEv to TEST. Which is not a problem (copy and paste are helpful), but then the copied maps are still point to the tables in Dev. Which means i have to sync it with test tables - i hope i am making sense here!
I was hoping that there is some clever way of just changing something to effectively tell table in the map 'to point to the table in this database'. If the map is already configured - the only way to do it is to sync the tables, which will enable you to select the DB and table you want your table in the map to be pointing to.
The reason i do not use imp/exp between projects - it is not really reliable. Have to then jump through the hoops ensuring all contrains etc are there. It is safer to just import whatever i need from DB - ensuring all my constrains etc are there.
I do regular exports as a means of 'having a backup copy of the project', but never managed to import anything from one project to another (was easier with OWB 9 where it was possible to amend the .mdl file). It works fine to import back to the project the export was taken from.
I don't have problems with the location etc - took me hours to set everything the way i wanted it to be and now all the deployments are going to the right schemas, DBs etc.
Is there are any other way re-pointing the tables in the map to another DB? Like in the falt files - there is an option to choose the location of the file. So once the location is define/registered etc - you can choose whatever one is needed fromm the drop down on the left of the map.
I hoped there would be something similar for the tables. Like a big bulk option for 'tick here if you want all tables in the maps to be pointing to identical tables in another DB) type thing. Guess something like bulk sync option...
Oh well, guess i just have to stick with sync option (sobbing uncontrolably) and it hasn't stopped raining here for days!
Once again - thank you very much for all your kind help and advice.
Kind Regards
Vix

Best practice on test region setup...

We want to set up our dev environment to a test database and our prod to our production database, the reason being we transform our data and also build our star schema ourselves. So any changes we make on brininging in new data, we want to be able to test using our test repository. Any best practices on how to do this? We have noticed issues when we change the physical layer tables of rpd from one db to other. Basically we have crashed the system doing this during test....If we have one dedicated repository for test pointing to the test db, and one to prod pointing to our prod db...what is the easiest and fool proof way to copy rpd changes from one environment to the other? If any of you have done this, please do drop in a line on what how you accomplished this.
Thanks much!
Arch

Right now we are doing entire rpd copies as we are pointing to the production database from both rpd's.......
..but the problem is our dev environment physical layer is schema A and prod env has db schema B. we want to make changes to underlying table data in schema A, test using the rpd pointing to that schema and then once everything is ok, move changes to production db and make changes to prod repository....So I just want to merge business process and presentation layer.....We will try it the oracle suggestion but as I have been reading....merging is error prone....and we did not have much luck with it the one time we tried....

Best practice for the test environment & DBA plan Activities Documents

Dears,,
In our company, we made sizing for hardware.
we have Three environments ( Test/Development , Training , Production ).
But, the test environment servers less than Production environment servers.
My question is:
How to make the best practice for the test environment?
( Is there any recommendations from Oracle related to this , any PDF files help me ............ )
Also please , Can I have a detail document regarding the DBA plan activities?
I appreciate your help and advise
Thanks
Edited by: user4520487 on Mar 3, 2009 11:08 PM

Follow your build document for the same steps you used to build production.
You should know where all your code is. You can use the deployment manager to export your configurations. Export customized files from MDS. Just follow the process again, and you will have a clean instance not containing production data.
It only takes a lot of time if your client is lacking documentation or if you re not familiar with all the parts of the environment. What's 2-3 hours compared to all the issues you will run into if you copy databases or import/export schemas?
-Kevin

What is the best practice to deploy the SharePoint site from test to production environment?

We are beginning to start a new SharePoint 2010 and 2013 development projects, soon developing new features, lists, workflows, customizations to the SharePoint site, customization to list forms and would like to put good practice (that will help in deployment)
in place before going ahead with development.
What is the best way to go about deploying my site from Development to Production?
I am using Visual Studio 2012 and also have Designer 2013...
I have already read that this can be done through powershell, also through visual studio and also via designer. But at this point I am confused as to which are best practices specifically for lists, configurations; workflows; site customizations; Visual studio
development features; customization to list forms etc. You can also provide me reference to links/ebook covering this topic.
Thanks in advance for any help.

Hi Nachiket,
You can follow below approach where the environments has been built in similar fashion
http://thesharepointfarm.com/sharepoint-test-environments/
if you have less data then you can use http://spdeploymentwizard.codeplex.com/
http://social.technet.microsoft.com/Forums/sharepoint/en-US/b0bdb2ec-4005-441a-a233-7194e4fef7f7/best-way-to-replicate-production-sitecolletion-to-test-environment?forum=sharepointadminprevious
For custom solutions like workflows etc you can always build the WSP packages and deploy across the environments using powershell scripts.
Hope this helps.
My Blog- http://www.sharepoint-journey.com|
If a post answers your question, please click Mark As Answer on that post and Vote as Helpful
Hi, can you answer me specifically with regards to the foll:-
lists
configurations
workflows
site customizations like changes to css/masterpage
Visual studio webparts
customization to list forms
Thanks.

Best practice for test reports location -multiple installers

Hi,
What is recommended best practice for saving test reports with multiple installers of different applications:
For example, if I have 3 different teststand installers: Installer1, Installer2 and Installer3 and I want to save test reports of each installer at:
1. C:\Reports\Installer1\TestReportfilename
2. C:\Reports\Installer2\TestReportfilename
3. C:\Reports\Installer3\TestReportfilename
How could I do this programatically as to have all reports at the proper folder when teststand installers are deployed to a test PC?
Thanks,
Frank

There's no recommended best practice for what you're suggesting. The example here shows how to programmatically modify a report path. And, this Knowledge Base describes how you can change a report's filepath based on test results.
-Mike
Applications Engineer
National Instuments

Best Practice - Hardware requirements for exchange test environment

Hi Experts,
I'm new to exchange and I want to have a test environment for learning, testing ,batches and updates.
In our environment we have co-existence 2010 and 2013 and I need to have a close scenario on my test environment.
I was thinking of having an isolated (not domain joined) high end workstation laptop with (quad core i7, 32GB RAM, 1T SSD) to implement the environment on it, but the management refused and replied "do it on one of the free servers within the live production
environment at the Data Center"... !
I'm afraid of doing so not to corrupt the production environment with any mistake by my configuration "I'm not that exchange expert who could revert back if something wrong happened".
Is there a documented Microsoft recommendation on how to do it and where to do so to be able to send it to them ??
OR/ Could someone help with the best practice on where to have my test environment and how to set it up??
Many Thanks
Mohamed Ibrahim

I think this may be useful:
It's their official test lab set up guide.
http://social.technet.microsoft.com/wiki/contents/articles/15392.test-lab-guide-install-exchange-server-2013.aspx
Also, your spec should be fine as long as you run the VMs within their means.

PHP/MySQL Test/Production Server best practices

Hello,
I am currently learning PHP/MySql and have setup a test server to develop on and a production server to go live with. I wanted to know what are the best practices for synchronizing the test server with the production. Should I export the database from the test server and import it to the production server each time I make a change or is there better way to incrementally sync the databases. I am using Dreamweaver to design the web site.
Thanks,
Nick

Thanks, but does this mean that after I go live I should make changes on the production database only and not use the development database, if say I need to add a new table or record(s)?
Procedure
1. Take production web site down
2. Export/Save current database
3. Make changes to production database
4. Export/Save new database
5. Bring production web site up
Is this correct?

Best practice for maintaining URLs between Dev, Test, Production servers

We sometimes send order confirmations which include links to other services in requestcenter.
For example, we might use the link <href="http://#Site.URL#/myservices/navigate.do?query=orderform&sid=54>Also see these services</a>
However, the service ID (sid=54) changes between our dev, test, and production environments. Thus we need to manually go through notifications when we deploy between servers.
Any best practices out there?

Your best practice in this instance depends a bit on how much work you want to put into it at the front end and how tied to the idea of a direct link to a service you are.
If your team uses a decent build sheet and migration checklist then updating the various URL’s can just be part of the process. This is cumbersome but it’s the least “technical” solution if you want to continue using direct links.
A more technical solution would be to replace your direct links with links to a “broker page”. It’s relatively simple to create an asp page that can accept the name of the service as a parameter and then execute an SQL query against the DB to return the ServiceID, construct the appropriate link and pass the user through.
A less precise, but typically viable, option would be to use links that take advantage of the built in search query functionality. Your link might display more results than just one service but you can typically tailor your search query to narrow it down. For example:
If you have a service called Order New Laptop or Desktop and you want to provide a link that will get the user to that service you could use: http://#Site.URL#/RequestCenter/myservices/navigate.do?query=searchresult&&searchPattern=Order%20New%20Desktop%20or%20Laptop
The above would open the site and present the same results as if the user searched for “Order New Desktop or Laptop” manually. It’s not as exact as providing a direct link but it’s quick to implement, requires no special technical expertise and would be “environment agnostic”.

Is oil - best practice documents or test cases

hi
i have got new project , and that is a oil and gas IS solution project. i want to learn oil and gas from scratch. can any body help me in understanding this project. did any body got any test case or blue print documents of any test case ? actually i have searched in SAP market place , thee is a best practice for almost all OS solution, but not for is oil and gas,
can any body help me with white papers are some personal stored documents , or suggesting me any text book which has got literature on domain knowledge of oil and gas.business
thanks in advance
akhil

Hi Akhil,
It better to seaching in SAP Market, you find some useful documents, more over you get related documents in SAP Solution map for IS SAP Oil industry value chain.
if you have user ID and password, you will get excess to the Solution map by selecting cltr and click the link and find all the documents in different module of SAP IS Oil.
check also this link.
http://www.sap.com/industries/oil-gas/pdf/0119mySAPOilGas-Upstream-v3.pdf.
Best Regards
Satish

Best practice for EBS Testing

Hello Friends - We are doing EBS Configuration and it includes Search strings also. These changes are applicable to around 40-50 Bank accounts.
Is it that I should ask Bank to send us test Bank statements for all these accounts.
Can you pls share Best practices to test EBS set up.
Thanks

Hello!
You don't have to test EBS for each bank account. The best approach to testing is to identify the typical bank statement cases and test them. For instance, if you have bank statements from five banks with several bank accounts in each bank, you need to test the one bank statement for one bank account from each bank. Similarly, if you have different types of bank accounts (e.g. current account, deposit account, transfer account etc.), you will have different operation types in bank statements for these accounts. Therefore, you also have to test bank statement from different account types.
To sum up, test typical bank statements from each bank and different bank statements from each account type if applicable.
Hope this will help you!
Best regards!

Test granularity - best practice

Similar Messages

Maybe you are looking for