Error results in UUT Test Pass

[jimbobaggies]

When running a test sequence in Operator mode, if a step fails for "Error, visa[...]" or "Error, LabView[...]", the test will exit and in the test result file UUT Result shows the error. However we send the result to our own database and it is showing these as a TEST_PASS, the data is coming from "FileGlobals.TestResult".

My Main Sequence Cleanup is as follows.

Any help greatly appreciated.

[Oli_Wachno]

What is your error handling strategy? Terminate on error?

[jimbobaggies]

I have three levels of login setup, with operator mode when this happened they only had the option to terminate on error.

[Oli_Wachno]

Can you describe, how the FileGlobal Value is logged into the database? 

[jimbobaggies]

At the end of main sequence the following cleanup is run...

I then have a PostUUT sequence that calls an executable, the exe sends the test result file to our database along with the result from Cleanup - str(FileGlobals.TestResult) which will be either TEST_PASS, TEST_WARN, or TEST_FAIL.

[Oli_Wachno]

If you are sure, the data is passed correctly from TestStand to the executable, the issue can probably be found somewhere between the exe and the database.

Is there any conversion involved form string to enum? Maybe sth goes wrong there

[jimbobaggies]

Thanks for your response, but I am sure it is happening prior to this as all that happens in this step is the test status is retrieved from TestStand and passed to the database, the test status is set during the cleanup. I believe it is being incorrectly set when a test is terminated.

[Oli_Wachno]

When trying to debug this, make sure to have SeqEdit configured correctly

[jimbobaggies]

So I never resolved this issue, even after some support from NI via video call it ended up completely breaking my TestStand setup and I had to uninstall from my system and completely reinstall to get it working again.

To recap, during test of a UUT if there is a Fail then SequenceFilePostStepFailure is set to offer "Retry, Ignore, Terminate". If there is an error in the vi rather than pass or fail the "Run-Time Error" box appears. If Ignore is selected then the test will carry on, and at the end a TEST_PASS is recorded.

So I surmise this is from one of two places that this happens either in one of the following.

"SequenceFilePostStepFailure"

or the "MainSequence" Cleanup.

Any help would be greatly appreciated.

[Oli_Wachno]

Trying to understand your issues:

On StepFail

If a step fails, the User shall be given the opportunity to

- re-run the test --> Question: do you want to discard the failed result? It's in the result list after all

- ignore the fail --> Question: is the UUT Failed in this case? Guess so

- terminate --> Terminate Question: what Status do you expect here?

On Runtime Error

Even if you click "Ignore" in the dialog box, the UUT Status is Error. DIfferent behaviour must be implemented by the user

I am referring to the Status as defined in TestStand: Passed/ Failed / Error / Terminated