Test Results show the outcome and progress of a Test Case execution. Use them to identify what passed, what failed, what still needs testing, and what is blocked.
Review the result in its execution context: the Jira work item, Test Folder, or Test Plan iteration. The same Test Case can have different results across separate executions.
Progress status and test outcome
A result combines two ideas:
Status tells you whether testing is Untested, In Progress, Done, or Blocked.
Outcome tells you whether the tested behavior passed, failed, or was not applicable.
For example, FAILED In Progress means a failure has been recorded while the execution is still incomplete.
Default Test Results
These are Vansah’s built-in result names. Your workspace may use renamed labels.
Result | Status | Meaning |
UNTESTED | Untested | No execution outcome has been recorded yet. |
PASSED | Done | Testing is complete with a passing outcome. |
FAILED | Done | Testing is complete with a failing outcome. |
N/A | Done | The tested step or scenario is not applicable. |
PASSED In Progress | In Progress | A passing outcome has been recorded, but testing is incomplete. |
FAILED In Progress | In Progress | A failure has been recorded, but testing is incomplete. |
N/A In Progress | In Progress | An N/A outcome has been recorded while other testing remains incomplete. |
BLOCKED | Blocked | Testing cannot proceed because of an obstruction, such as an unavailable environment or dependency. |
How step results affect the overall result
For a multistep Test Case, Vansah combines the step logs to calculate the Test Run’s overall result. A blocked step makes the overall result Blocked. Otherwise, a failure takes priority over a pass or N/A, and remaining Untested or In Progress steps keep the execution incomplete.
Step results | Overall result |
Passed and Untested | PASSED In Progress |
Failed and Untested | FAILED In Progress |
Passed and Failed, with all steps complete | FAILED |
All steps N/A | N/A |
At least one step Blocked | BLOCKED |
Use the individual Test Logs to investigate the outcome. Record the actual reason and supporting evidence when a step fails or is blocked.
Custom results
Create a custom result when your team needs an additional label, such as Retest Required. Assign its status and outcome so Vansah can include it in execution progress and overall results.
For example, Retest Required can use a Done status and Failed outcome. The label describes your workflow while the underlying values keep the result meaningful in summaries.
Creating custom results requires Vansah Advanced and Jira administrator access.
Open Vansah Settings, select Space, and open Test Results.
Select Add custom result.
Enter a unique name and choose its Status and, where available, Result.
Under Apply to, choose All spaces or Selected spaces.
Select Create custom result.
Control where a result is available
The Enabled setting and Scope control whether a result appears as an available choice.
Scope | Availability |
All spaces | Available across the Jira workspace where Vansah is used, when the result is enabled. |
Selected spaces | Available only in the selected Jira spaces, when the result is enabled. |
To change a result’s scope, select Edit beside its Scope, choose All spaces or Selected, select the relevant spaces, and click Apply. When using Selected, choose at least one space.
The built-in Passed and Failed results remain enabled for all spaces. Other settings depend on your administrator permissions.
Rename a result without changing its meaning
A Jira administrator can rename a result to match your team’s terminology. Renaming applies across the Jira workspace and keeps the underlying status, outcome, and existing execution records. See Renaming Test Results.
If a result is missing
Ask an administrator to check that the result is enabled and includes the Jira space in its scope. If an overall result still shows In Progress, open the Test Run and review its remaining steps.