Test results are the core indicators of your testing process in Vansah. They tell you and your team the outcome of every test case, at every step, across every execution cycle.
What Are Test Results?
Every Test Case in Vansah is associated with a result that reflects its current state. Results update as testers execute test steps, giving you a real-time picture of quality across your Jira projects.
Key points:
Each Test Case carries one overall result at any point in time.
If a Test Case has a Test Script (a sequence of Test Steps), the overall result is determined by the outcomes of individual steps.
Results fall into the following categories: DONE, IN PROGRESS, UNTESTED and BLOCKED for cases where progress is obstructed.
Teams can now define custom results to reflect their own workflow states.
Default Test Result Statuses
Vansah uses the following default statuses for Test Results:
Result | Description |
N/A | The test case has been executed but the result is not applicable |
FAILED | The test case has failed |
PASSED | The test case has passed successfully |
UNTESTED | The test case has not been executed yet |
N/A-IN PROGRESS | The test is ongoing, no pass/fail status yet |
FAILED-IN PROGRESS | The test is ongoing but currently failing |
PASSED-IN PROGRESS | The test is ongoing and currently passing |
BLOCKED | Testing Progress is obstructed. |
Understanding “In Progress” Statuses
"In Progress" statuses indicate the test is still running with a current Result.
PASSED-IN PROGRESS: The test case is still running but is Passing up to the current point.
FAILED-IN PROGRESS: The test case is still running but is Failing up to the current point.
N/A-IN PROGRESS: The test case is running, but no test step has Passed or Failed however one or more steps have a N/A result.
These statuses update automatically as steps are completed. Once all steps are done, the result resolves to the final status.
The "Blocked" Result
Blocked is a dedicated built-in result type, separate from the In Progress statuses.
Use it when a test case cannot proceed due to an external dependency or environment issue.
How it works:
Marking a step or test case as Blocked automatically updates the overall test run status to reflect the block.
Other test steps in the same run are not affected. Testers can continue executing remaining steps while the blocked item is outstanding.
Blocked is distinct from FAILED it signals an obstruction, not a failure of the test logic itself.
This gives teams accurate reporting without forcing them to mark obstructed tests as failures or abandon a test run entirely.
Custom Test Result Management
Teams can now create custom test result statuses to reflect their own testing vocabulary and workflow stages beyond the defaults Vansah provides.
Scoping Custom Results by Space
Custom results can be scoped to control where they appear.
Scope | Behaviour |
All spaces | The custom result is available across every Jira project connected to Vansah. |
Specific spaces | The custom result only appears in the selected Jira projects. |
When creating or editing a custom result, locate the Scope section.
Select All spaces to make it universally available, or choose Selected spaces from the list.
Click Apply to save your changes
Renaming Default Results
You can rename the default result labels to match your team's terminology for example, changing "PASSED" to "Verified" without altering the underlying result logic. Learn more