Use the Vansah – Test Summary Report gadget to review execution progress for selected Jira work items, Test Folders, or Test Plans. Expand its sections to compare counts, coverage, pass/fail rates, and linked Test Run issues.
Add and configure the gadget
Open the Jira dashboard you want to use. Make sure you can edit its gadgets.
Choose Add gadget, search for Test Summary, and add the Vansah gadget.
Select the Jira space and choose the reporting type: work items and Test Folders, or Test Plans.
Select the requirements or plans to include. Review any child-work-item option so the scope matches your report.
Use More + or an available saved filter to narrow the cases.
Select Save and check the resulting rows.
The screenshot below shows work item and folder selection in an earlier layout. Customer-facing Jira terminology has since changed from projects to spaces.
Read the overview counts
Metric | Meaning |
Planned | Cases counted within the selected reporting scope. |
Completed | Cases with completed execution results in that scope. |
In Progress | Cases with an unfinished execution. |
Blocked | Cases treated as blocked in that context. |
Outstanding | Planned minus Completed and Blocked. This includes work still in progress, rather than only unstarted tests. |
Expand Overview to compare the requirements or plans. Select a linked count to inspect contributing cases.
Overall totals add the report rows. A reused case can contribute in more than one requirement context, so the total is not necessarily a count of unique cases across the entire Jira space.
Understand coverage and pass/fail rates
Measure | How to read it |
Completed coverage | Completed divided by Planned, shown as a percentage. |
In Progress coverage | In Progress divided by Planned, shown separately. |
Completed pass rate | Passed divided by Completed after excluding completed N/A results. |
Completed fail rate | The failed share of those completed, non-N/A results. |
In Progress rates | Separate calculations for unfinished executions. Review the counts and any N/A outcomes alongside the percentages. |
Completed and In Progress columns are separate. Do not combine them into one pass rate or treat in-progress coverage as completed testing. When there is no applicable denominator, the calculated rate is zero.
For example, 10 completed cases out of 20 planned cases gives 50% completed coverage. If 6 of those completed cases passed, 2 failed, and 2 were N/A, the completed pass rate is 75%: 6 ÷ (10 − 2).
A high pass rate describes the reported executions. Review requirement coverage and remaining risks separately before making a release decision.
Review Test Run Issues
Expand Test Run Issues to inspect Jira work items linked to the applicable runs. The table can show the work item, current Jira status, execution time, and related case/run link.
This section includes linked work items such as defects. It is separate from the execution result and does not guarantee a list of every defect on your Jira site.
Export or reuse the report settings
Use the gadget’s More menu to export the report. See Export Vansah Reports for XLSX, HTML, and browser PDF guidance.
Use Configuration History to review saved settings. If you can edit the gadget, select a version and choose Restore to reuse that configuration. Restoring settings does not restore old Test Runs or recreate a historical result snapshot.
If the totals look unexpected
Check the Jira space, selected requirements or plans, child-work-item choice, filters, and applicable case versions or iterations. Compare reports only after matching their scope. Refresh the gadget after changes and inspect the linked cases behind a count before changing test data.