Pass/fail status (UUT Result) of my main sequence

I would like to have my last step in my test sequence to be a DLL passing to my SQL database a part number, a serial number from “RunState.Caller.Locals.UUT.SerialNumber” and Pass/Fail status of my Test Sequence.
Can I pass pass/fail status of my test sequence to my DLL before execution is completed?
Thank you,
Henry
Solved!
Go to Solution.

Access Pass/Fail status by using RunState.SequenceFailed. It will be True if the test failed.
Hope this helps,
jigg
CTA, CLA
teststandhelp.com
~Will work for kudos and/or BBQ~

Similar Messages

What is property that contains the pass/fail status(UUT Result) of my main sequence ?

Test Engineering
Empower RF Systems Inc.

Hi Mal,
In general, in TestStand you use a step type that can use the Sequence Adapter in order to call a sequence (named subsequence in this context). The MainSequence is called from within the ProcessModel execution entry-points ('Test UUTs' and 'Single Pass' sequences in the TestStandModel.seq) when you launch the execution from "Execute->Test UUTs" or "Execute->Single Pass" menu or directly by the engine when you start an Interactive execution by selecting "Execute->Run MainSequence" menu option.
In the first case, after the sequence call step executes, the Sequence Adapter can set the step status. So, finally the property that contains the status of Main Sequence is a subproperty of the SequenceCall step that in the ProcessModel execution entry-points is named "MainSeque
nce Callback". The lookup string for this property depends from where you want to access it. For example :
a) if it's from a step you add as part of the Execution entry-points customization, then the lookup string for the property should be "RunState.Sequence.Main["MainSequence Callback"].Result.Status"
b) if it's from a step in the MainSequence, then the lookup string for the property should be "RunState.Caller.RunState.Sequence.Main["MainSequence Callback"].Result.Status" but special consideration should be taken if the MainSequence is run in Interactive mode, since the "RunState.Caller" property doesn't exist in this case.
In the second case the sequence status isn't available (see above).
Regards,
Silvius
Silvius Iancu

Why does captivate 5 scorm 2004 change the pass/fail status when using complete/incomplete

SUMMARY: I am trying to use SCORM 2004 reporting but I am finding out ADOBE does not diffentiate between COMPLETE/INCOMPLETED and PASSED/FAILED variables in the SCORM 2004.
RESULT: I can not accurately get the passing/failing status from the course.
QUESTION: Is their anything I can do or does ADOBE have a patch they have release which will accurately report the passed/failed STATUS as well as the completed/incompleted status.
OTHER RESEARCH: I even attempted to post these "proofs" on scorm.com and they have something called "SATISFACTION TRACKED" to accomodate content creation systems (CAPTIVATE 5) which does not follow the standards of SCORM 2004.
BACKGROUND: the report status "Incomplete/Complete" and "Pass/Fail" under the publishing options for SCORM 2004 essentially mean the same thing when the CAPTIVATE COURSE sends setvar commands to the SCORM API... In other words the SCORM API receives the same exact commands when publishing in both modes. "THIS IS WRONG"
why is the wrong? IF REPORTING; incomplete/complete ; the CAPTIVATE 5 COURSE SHOULD NOT "change" the STATUS OF PASS/FAIL when attempting to report COMPLETE/INCOMLETE with 100% slide views.
DEMO #3> SHOWS THE PROBLEM
About DEMO #1 and DEMO #2> these are other reporting options I attempted with other problems arrising..so these images are just for supporting my original problem which is shown in DEMO #3...
DEMO 1 (REPORT STATUS has no affect on reporting):SETTINGS:
PASS: (PROBLEM)
Anything above Passing Score is not recorded to LMS (once passing is reached...no more bookmarks are recorded)
FAIL: (CORRECT)
Failure gets sent to the database on the last screen with "completed"
DEMO 2 (Report status [Complete/Incomplete Pass/Fail] has no impact on commands sent to scorm api):
SETTINGS:
PASS: (CORRECT)
Very Last page gets sent to the Database
FAIL: (PROBLEM)
NOTHING GETS SENT TO DATABASE (stuck in final score screen forever)...because it says "INCOMPLETE"
DEMO 3:
Report status [Complete/Incomplete Pass/Fail] has no impact on commands sent to scorm api
SETTINGS:
PASS: (CORRECT)
Very Last page gets sent to the Database with a 90% passing with "completed"
FAIL: (PROBLEM)
LAST SLIDE SENDS "completed" but GETS SENT AS A PASSING SCORE??? even when it is a failure
(IN OTHER WORDS ADOBE CHANGES THE PASS/FAIL STATUS based on slide views...
this is WRONG ....REALLY WRONG becuase I am trying to report
"COMPLETE/INCOMPLETE" for 100% slide views
PASS/FAIL OPTIONS:
OPTION I CAN PURSUE?
SO WHAT CAN I DO? YES, I CAN TELL THE LMS...to COMPARE THE SCORE RECEIVED DURING A "COMPLETE" status...and then change the grade in the LMS based on the SCORE IN THE LMS...BUT THAT WOULD MEAN THE LMS COULD REPORT ONE GRADE and the COURSE COULD REPORT A DIFFERENT GRADE....and that would not be good.
ALL OF OUR COURSES SHOW THE STUDENT THE FINAL SCORE WITHIN EACH COURSE..
QUESTION TO ADOBE?
SO ADOBE when are you going to differentiate these two reporting options so that the PASS/FAIL OPTIONS ARE ACCURATELY REPORTED WHEN USING COMPLETE/INCOMPLETE?
MORE INFORMATION
HERE IS THE SCORM.COM "Satisfaction" adjustment (very last line) to accomodate inconsistent reporting in CAPTIVATE 5.
Thanks,
DOUG LUBEY OF LOUISIANA
www.douglubey.com
OTHER WEBSITES:
http://forums.adobe.com/message/3332035
http://forums.adobe.com/message/3122315
http://forums.adobe.com/thread/712502?start=50&tstart=0
http://forums.adobe.com/thread/800570
http://forums.adobe.com/thread/720121
SEARCH ENGINE REFERENCE:
CAPTIVATE SCORM SUCCESS_STATUS
captivate 5 scorm 2004 pass/fail is dependent on complete/incomplete
scorm 2004 captivate cs5 success_status incorrect
scorm 2004 captivate cs5 reports success_status incorrectly
scorm 2004 captivate incorrectly reports pass/fail
scorm 2004 captivate 5 incorrectly reports pass/fail
scorm 2004 "captivate 5" incorrectly reports pass/fail
captivate 5 sends a pass even when a failure is issued by the course using scorm 2004.
captivate does not work properly when working with completed status.
CAPTIVATE SCORM SUCCESS_STATUS COMPLETE STATUS SHOULD BE INDEPENDENT
CAPTIvATE 5 cmi.completion_status
and cmi.success_status does not work independently with scorm 2004. they both share the same definition. These two field were designed to help differentiate the difference between a passing or failing score and when the course is actually completed. WITH CAPTIVATE 5 they do not differentiate the two. COMPLETE means PASS and INCOMPLETE means fail..
I was trying to use "completion_status" as a way to determine when all slides were shown. So that I can send the final score (PASS/FAIL) the LMS after all slides were viewed and this was the absoluted score the student recieved.
2011 CAPTIVATE CHANGES cmi.success_status TO PASSING WHEN COURSE REPORTS FAILURE
2010 CAPTIVATE CHANGES SUCCESS TO PASSED WHEN COURSE REPORTS FAILURE
CAPTIVATE 5 CHANGES cmi.success_status TO PASSING
CAPTIVATE 5 CHANGES cmi.success_status TO PASSING WHEN COURSE REPORTS FAILURE
CPTX CAPTIVATE CHANGES cmi.success_status TO PASSING
CP5 WHY DOES CAPTIVATE SCORM SUCCESS_STATUS
CPTX WHY DOES CAPTIVATE CHANGE PASSING STATUS
CPTX CAPTIVATE SCORM CHANGES FAILING SCORE TO PASSING SCORE
CAPTIVATE SCORM SUCCESS_STATUS COMPLETE STATUS MEANS THE SAME THING
CAPTIVATE SCORM SUCCESS_STATUS COMPLETE STATUS SHOULD BE INDEPENDENT

Hi,
Here's something I found in a similar situation... hope this helps!
After publishing your CP5 project as a SCORM 2004 zip file, unzip the file so you can get into the separate files. Open the imsmanifest.xml file with a text editor; I like using Notepad++. Search for the line starting with <imsss:minNormalizedMeasure>. The complete line will probably look like <imss:minNormalizedMeasure></imss:minNormalizedMeasure>, this is the line that is supposed to contain your passing score (at least for our LMS). So, if your passing score is supposed to be 80%, edit this line to be: <imsss:minNormalizedMeasure>0.80</imsss:minNormalizedMeasure> and save the file. Then select all the files and re-zip them, I use 7-zip for that.
I found one other weird thing that doesn't happen 100% of the time, so test it. In the example above, try to get a score of exactly 80% (or whatever passing grade you are using) and see if you get the correct status reported. I found I sometimes have to re-edit that line in the manifest file to be 0.79 so it correctly includes an exact 80% score. No idea why and you have to watch the number of questions in your quiz to make sure that works for you mathematically.
If this works or not, I'd recommend posting your results so others can get some ideas. Good Luck!!

Can the sequence pass/fail status be controlled in Test Stand?

I have a sequence that contains a DoWhile loop. Within the loop are 5 or 6 steps that are executed. If the result of those steps is a fail the loop runs again until it passes or meets its allowable number of iterations. My problem is that if an iteration fails and then passes the result for the sequence is failed. Can the pass/fail status be controlled via an expression etc? I know I can create a subsequence and loop in it with the properties. I am just curious to know if there is a way it can be done like I have explained.
Thanks in advance for any help,
Troy

Troy,
You might be able to use the RunState.ThisContext.SequenceFailed property. Set this equal to False after your loop runs, and the sequence should report as if it passed.
John B.
Applications Engineer
National Instruments

How to get sequence name and pass/fail status?

HI,
I need your assistance in order to achieve the following goal:
I have about 10 sub-sequence steps in the main sequence.
For those steps only, I'd like to print out in a window the name of the sequence and the resutl.
I meet dificulties since i have the sub-seq result, only after it ends. It means that i can print its status only in the following step.
is there a way around it?
I wish to be able to write all this information in the clean up of the sub-seq step.
Thanks
Rafi

Hi Rafi,
You will not be able to print the result of a subsequence call in the same step as the subsequence call, because both post-step substeps and post-expressions are run before the status is evaluated. As you mentioned, you can do this in the following step, or you can use the SequenceFilePostStep callback to specify some customized behavior to follow your sequence call steps. This callback will run after every step, so you would have to put some extra logic into this callback if you are using multiple step types.
So, are you trying to print the result of each subsequence call separately? How do you intend to display the status? Let me know if you have any other questions about how to implement this.
Regards,
Marty H.
National Instruments

Lms reporting success status=pass/fail, where it should give unknown while running on saba 5.3

I am trying to run my content on SABA 5.3 , After exiting the content the lms displays success status as Pass or Fail where it should show Unknown. My content does not contain any quiz, so on which basis lms is calculating the success status.

Yes I know you said your content had no quiz, but please try to remember that we answer hundreds of these enquiries and it's not uncommon for people to tell us one thing when their settings say another. So I have the habit of asking to see the actual screenshot.
Each LMS interprets the SCORM standard a little differently. In SCORM 2004 a course module can have both a status for Complete or Incomplete, as well as a separate status for Pass or Fail. (Under SCORM 1.2 the overall status was tracked by a single element - cmi.core.lesson_status - allowing for only a single status value that would boil down to Complete vs Incomplete or Pass vs Fail values.
Under SCORM 2004 there are two separate elements tracking completion and success.
The SCORM 2004 element cmi.completion_status is designed to indicate whether the learner has completed the SCO and can take the following status values:
completed,
incomplete,
not attempted,
unknown
Your Pass/Fail status in SCORM 2004 falls under the element called cmi.success_status. This one indicates whether the learner has mastered the objective and can take the following values:
passed,
failed,
unknown
So while it is possible for a value of "unknown" to be set for either cmi.completion_status or cmi.success_status, I don't think this would be very commonly done for a Captivate module that actually has interaction data being sent to the LMS. If the user is interacting with the content at all it would seem more likely that you'd be getting a 'completed' or 'incomplete' status value in the completion element and a 'pass' or 'fail' value in the success_status element.
The bit I don't understand is why are you particularly keen to see a value of 'unknown' showing up here?
Check this page for information about getting SABA to work with Captivate: http://www.infosemantics.com.au/adobe-captivate-learning-managment-system-lms-guide/saba
Perhaps one of the threads it links to will provide more help for you.

Get overall Pass/Fail from custom User Interface

Hi Guys
I’m working on a custom user interface for operators and I would like to check and display the overall Pass/Fail result of the test at certain time intervals during execution.
I added a sequence called ‘GetOverallResult’ to the ‘FrontEndCallbacks.seq’ which checks the Pass/Fail status of the sequence and I’m calling it form a SubVI within the User Interface written in LabVIEW (Check status.vi).
The problem is that I’m getting the Pass/Fail status of the CallBack sequence not the test sequence I’m running.
Could anyone please help me in this?
Attachments:
Check status.vi ‏17 KB
FrontEndCallbacks.seq ‏5 KB

Hi Attila,
Have you instead tried reading the value directly from the main sequence? Have a look at the attached VI; pass the sequence context in and the Get Property Value VI will read the sequence's state.
Is this suitable for what you had in mind?
Regards,
Tom
Applications Engineering, NI UK
Attachments:
check.vi ‏10 KB

How do i configure a FOR loop to have the behavior of the step Loop Type: Pass/Fail count?

Hello,
I'm using the Pass/Fail count set to one Pass to capture an event generated by my DUT. I originally used a numerical compare step with the Looping type of Pass/Fail count to accomplish this. Unfortunately the implementation changed and now I need to execute a few steps that can not be combined within one code module as before. Nor can these steps be put into a subroutine. One of the steps executes a .NET asembly and I haven't figured out how to pass the reference to the subroutine. When the subroutine is intered the reference is lost and the methode does not execute correctly.
I have an evaluation function the exits the loop when the expected conditions are met. Everything works except for the Overall Pass/Fail result of the For loop. If the loop exits due to the first numerical compare test passing, I want the loop overall execution to report as "Passed". If the loop reaches it's predetermined number of iterations, the overall result needs to report as "Failed". It would also be nice to have the radio button functionality of "Record Result of Each iteration". Some conditions require a wait over a minute for the event to occur and I don't want to generate needless data for the report.
Currently I get the pass/fail status for each For loop iteration, but only "Done" for each loop iteration. I don't want the initial few failures to cause the test to fail.
Does anyone know how to do this? Suggestions?
Thanks,

I have 2 steps in the loop that can not be combined into one step. This forces me to implement the behavior in some form of loop. A While Loop could be an option. I would need to pass the Step.Result.Status from the Multiple Numerical compaire step to the condition of the While Loop. I tried to use the Step.TS.ID without success. Some form of reference to the numerical compare step would be needed. I'm using a For Loop as I do want to limit the number of iterations of the loop. In the case where the loop iterations are reached, the event I am trying to detect did not occur at the correct time and a failure needs to be reported.
I came up with something based on my comments in the second post:
1) To start with I configured a Locals.ForLoop_5 variable. This is used to set the limit on the loop iterations and for comparison after the loop has finished executing. More on that later.
2) The first step inside the loop invokes a method within a .NET assembly that has been packed in a DLL This method gets the required data from the DUT and stores it to a text file.
3) The next step is the Multiple Numeric Limit step. This step invokes a VI that extracts the data from the text file. This step has been customized in several ways.
i) In Run Options, the Results Recording Option was disabled. This prevents recording of "Failed" while the loop executes when waiting for the event to happen.
ii) In Run Options, the Step Failure Causes Sequence Failure is unchecked. Same reasoning as i) These steps are not true failures.
iii) A Post Action is configured to go to the nexxt step after the For Loop End step On Condition True with the logic of Step.Result.Status == "Passed". This causes the loop to exit when the first "Passed" is encountered which corrolates with the event I'm trying to detect. On Conditon Fail remains set to default.
4) The step after the For Loop End is an expression step with everythin set to default except for the Status Expression logic set to: Locals.Loopindex < Locals.ForLoop_5 ? (Step.Result.Status = "Passed") : (Step.Result.Status = "Failed"). This step performs the overall Pass/Fail reporting for the For Loop. If the number of loop iterations is less than the maximum it could have only gotten there by the previous logic triggered by the numerical compare passing, therefore "Passed". If the loop index has reached the limit, then the event was not detected, therefore Failed.
I have tested this work around with success, it just a pain to now have to implement this on my 40 some odd For Loops.
If there is a better way, I'd still like to hear it.

How can I include results of a subsequence, which runs in a new thread, in the main sequence test report

Hi!
I', m working with TestStand Version 4.2.1. I have a main sequence, which calkls different subsequences. All these steps are properly reported. One of subsequences runs as "new thread". How can I include its results in common test report of the main sequence?
I have markes variables of the subsequence as it is requred for test report (it works OK if it is not a new thread). If the the numerical test, which is executed in this subsequence is correct, I get no results at all. If the numeric test failed I get somewhere in the main sequence report a "red message", that test failed whithout any reference to the step or values of vaiables which were not correct.
I tried an option "On the fly" in the Report Configuration , but haven' got any useful results. What shall I do?
Best regards
Solved!
Go to Solution.

Hi,
I tried it but without success:
1) I got a reference to the Thread as "Locals.Step1=RunState.Thread" for every of 2 steps which start a thread
2) I put both "Waits" after steps with (and without) threads, at the same place, where they were before
3) The sequence run OK, but when it came to Wait for Thread 1 it waited for ever, I had to terminate sequence
Does it mean, that I got a false reference (suppose No - please, have a look at attached pic)?
Or does it mean, that Waits are badly placed in the sequence (threads are already terminated)? Here is a pic of sequeces calls with Wait after them.
Regards
Attachments:
Thread.JPG ‏34 KB
SequenceCall.JPG ‏32 KB

How do I return to Main Sequence cleanup using Post Actions?

Since I am quite new to this I have a question that I hope you can help me with. When a subsequence fails I want to return to Main Sequence cleanup immediately and not continue to the next step. Do you know of a way to do this using Post Actions?

Set the On Fail post action of the subsequence to Goto destination and set the destination to Cleanup.

TestStand Lookup String for UUT Result Passed/Failed

When I am in CleanUp group,what is the lookup string for UUT Result=Passed or Failed. That is all steps in main group passed = UUT Result=Passed. I am using Labview.

Using RunState.SequenceFailed called from Cleanup step in TestStand sequence seems to work reliably for me but using RunState. ErrorReported does not. It seems as though the sequence context becomes invalid or something (although I get no error when accessing this property). It does not always come back true when a runtime error has occurred. Any ideas?
Thanks, Roger Owens [email protected]

Where the string "failed" is created in steps in the main sequence to fill into Parameter.Result PostUUT in the NI teststand II courese example 4-1 Modifying callback.seq

For PostUUT in the NI teststand II courese example 4-1 Modifying callback.seq, there are two steps, one is Test Passed,
the other is Test Failed, both set each preconditions, for example, Parameters.Result.Status == "Failed" in the test failed step, if the step failed in the main sequence,the string "failed " is filled into Parameters.Result.Status
but I can't find where the string "failed" is created in steps in the main sequence.
Because I can't find any expression in any steps to fill into Parameters.Result of the test failed step in the PostUUT.
In fact, when running if step fails, the string "failed " is filled into Parameters.Result.Status
Would you please explain for it ?
thanks,

Hi,
Look at the Sequential Model Sequence File, and either the sequence SinglePass of Test UUTs for the step that invokes the step Post UUT.
Then look at the Parameter List for the SequenceCall for that step. you will find your answer.
Regards
Ray Farmer

[LV - TS] How to execute a SEQ file, get the result (PASS/FAIL) and the report file ?

Hello,
I'm looking for the most obvious and simple way to, from Labview :
1- Start the Teststand engine : DONE
2- Get a list of SEQ files to execute : DONE
3- Loop through the list to execute each SEQ file : <- found some examples but I have some trouble with the UIMessage stuff
http://zone.ni.com/reference/en-XX/help/370052N-01/tsexamples/infotopics/executing_sequences_using_api_labview/
4- Get the result of the SEQ execution : <- unsure
5- Get the XML path+name of the report file generated : <- obviously not easy
http://digital.ni.com/public.nsf/allkb/3D3B2358DF9B786B8625789500549A3B
http://forums.ni.com/t5/NI-TestStand/Getting-Report-File-Path-location-at-execution-in-TestStand-2012/td-p/3041789
Here is my current implementation :
David Koch

Hello,
I tried to work from this example :
http://forums.ni.com/t5/NI-TestStand/Execution-of-TestStand-Sequence-in-LabVIEW-via-TS-API-Different/td-p/2939616/page/2#M46686
However it remains unclear about how to get a simple
answer from just running a sequence file out of any
model so far (Simple Pass). Like I told you, all what
I need, once the TS engine is started, is a VI with the
following interface :
INPUT
1- TS engine reference
2- SEQ file path (path or string)
3- Sequence name to execute
4- UUT string (optional, but yeah)
5- error in
OUTPUT
1- Result boolean (PASS/FAIL)
2- Path to XML report
3- error out
It would be so cool to just have this
About the surrounding UI, I'm working on it. The LV
code is not really important at this point, it's running
a SEQ file that matters to me.
David Koch

Sequence call with Pass/Fail Test always returns Passed result

In TestStand 2.0, I use Sequence Adapter with Pass/Fail Test step to call a subsequence, I always receive a Passed result, even as I force fail a step in the subsequence and enabled the Step Failure Causes Sequence Failure option.
Attachments:
Example1.seq ‏17 KB

Tan -
The status expression for the Pass/Fail step type does not look to see if the status has been previously set by the code module in this case the sequence call.
Step.DataSource != "Step.Result.PassFail" ?
Step.Result.PassFail = Evaluate(Step.DataSource) :
False, Step.Result.PassFail ? "Passed" : "Failed"
It just set it to Passed or Failed even if the status is already "Failed".
You could either,
1) Change the Pass/Fail expression to the following for the step,
Step.Result.Status == "Done"? Step.Result.PassFail : False
or
2) Use two steps, a Sequence Call and a Pass/Fail that uses the None Adapter. The Pass/Fail could operate on the previous step if necessary.
Scott Richardson - NI"
Scott Richardson
National Instruments

How can I copy test plan WITH ITS RESULTS (PASS/FAIL) to other project in MTM??

How can I copy test plan WITH ITS RESULTS (PASS/FAIL) to other project in MTM??

Hi odedn,
Thank you for posting in MSDN forum.
Based on your issue, you mean that you want to copy the test plan with test results from the current team project
to other team project, am I right?
If yes, as far as I know that when we copy test plan with test results to other team proejcts. It is default that
there just will not copy the test plan with test results (pass/fail) to other team project in MTM.
You can refer the following MSDN document’s
what gets cloned, it explained that which objects are copied from the source test plan to the destination test plan.
Reference:
http://msdn.microsoft.com/en-us/library/hh543843.aspx
If you still want to this feature, I suggest you can
submit this feature request:
http://visualstudio.uservoice.com/forums/121579-visual-studio. The Visual Studio product team is listening to user voice there. You can send your idea there and people can vote. If
you submit this suggestion, I hope you could post that link here, I will help you vote it.
Thanks for your understanding.
Best Regards,
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Pass/fail status (UUT Result) of my main sequence

Similar Messages

Maybe you are looking for