Coming Soon: A product to beat these Agile testing odds

Vishalsinh Jhala
June 28, 2019

Agile development is now mainstream as more organizations adopt the Agile and DevOps framework each year. So, it is important to understand its impact on testing.

You may have already read our blog post on whether Agile is killing the QA function as we know it. Because of key differences in the Agile and Waterfall way of testing and the introduction of DevOps, software testing has undergone an evolution of sorts. Whether it is the processes, tools or culture, the old order has given way to the new. With these changes there are some common challenges and gaps that have emerged because of the following trends:

1. Testing inside Jira

Most Agile teams are familiar with the Atlassian Ecosystem and notably Jira. Since they are already using Jira for issue tracking and agile project management, it makes sense to extend that use for test management. Its popularity is only rising because Jira truly enables the agile approach of working.

Yet, Jira was not designed for the purpose of testing and as such it presents limitations.

Such as sharing of test cases or workflows with external tools and frameworks (CI/CD, automation etc.).

While you can use Jira’s brilliant reporting, dashboard and charts functions, you can’t access these to design a traceability matrix.

What testers need:

Testers need a solution that lets them optimize the features and benefits of Jira all the while making the testing independent of Jira.

The ideal test management tool builds on top of the inherent Jira experience so there is zero learning curve. Yet, extending the customization beyond what Jira offers.

This means a structured approach to test management. Tailoring the hierarchy and the linkages how testers want it.

2. Test Plan and Strategy

Different teams use varying approaches for test management based on their workflow and requirement. Sometimes the test flow is intuitive and ad-hoc but at other times there is need for execution planning.

A more structured test process demands planning the test execution in advance. This requires setting up test cycles to build and execute the tests as per the plan.

There are many benefits of doing this. It enables your testers to group tests logically and execute them in a controlled fashion.

The test plan is in effect a combination of several test cycles that allow QA managers to plan and track their progress.

In fact, the same test case can be reused in multiple test cycles.

As an example, let’s see there is a function called “Login”. You have a test cycle comprising 5 test cases for “Login”. However, there is another feature called “Registration”. The test cycle for “Registration” will also have a few test cases of the “Login” module.

Implementing test cycles makes the process easy as pie.

What testers and QA managers want is:

An easy to set up way of planning and executing test cycles, ability to drill down to the folder structures inside the test plans, ability to clone test cycles and folders for ease of use.

3. Parameterized tests

Test Data Parameterization enables testers to execute the same test case multiple times using different data inputs without creating duplicate test cases.

This replaces the traditional practice of entering hard-coded input values with parameters. It enables QA teams to collect reusable test data in one centralized location.

Parametrization of test data is necessary to make tests consistent and manageable. It also enables automated data-driven tests quickly. you can add more on repeatability.

What testers want is:

A tool that supports test data parameterization function to execute the same case multiple times with varying inputs. These are the benefits:

  • No need to duplicate test steps simply to change test data
  • Increases reusability of tests by separating test actions from test data
  • Generates separate test results for each set of test data.

4. Traceability

One requirement across the board that makes everyone’s life easy is full requirements traceability. QA teams need to verify test coverage and test execution of requirements and get in-depth information on test cases and defects. If you get this information directly on the requirement issue view, it is even better.

By establishing traceability among requirements, test cases, and defects, testers can link user requirements to the test cases. This allows key decision makers to evaluate the effects of fixing defects or postponing the fix until a later release.

With the help of traceability and traceability reporting, QA teams can ensure that

  • They cover the most important requirements and don’t leave them off by chance
  • They assign severity levels by considering the requirement priorities
  • They meet the project deadlines and scope as per user expectations within time and budget

What QA managers demand:

Traceability reporting that provides a trail of the requirements – test cases and issues. Testers benefit if the report can be generated based on requirements of each sprint/project. The ability to create Traceability reports by customizing/filtering search for specific test cases or requirements using the test management tool.

5. Actionable Quality Analytics

Need custom reporting using category-based analysis? Testers and QA managers require an easy UI and advanced report types to generate best fit charts for data automatically.

Can you access visual analysis of real time data using your own customized requirement, right inside the Jira environment?

Reports like Test Run Report, Executive coverage Report, Top Defects Report, Reusability and Traceability report offer real-time insights into the state of the build. This allows teams to take informed decisions and strategize on the next steps and priorities.

What teams want:

Advanced and easy to use test management interface that has both built-in reports as well as dashboard gadgets to customize and filter their reports based on requirement. Each organization has varying information needs and their tool must allow them to filter that data and present it in an easy to understand format in real time, right inside Jira.

Bridging the gap

Wouldn’t it be great if you could resolve all these demands using a single test management for Agile testing right inside the familiar ecosystem of Jira? A tool that builds on Jira but provides you the flexibility, reusability and traceability you desire. A tool brings the best of both worlds – the familiarity of Atlassian ecosystem and the independence of a comprehensive test management tool.

We have a big announcement coming up that will help you beat these Agile testing odds. Stay tuned to QMetry channels for more news on this.

0 0 vote
Article Rating

Let’s get you started with QMetry®

Get Started
Notify of
Newest Most Voted
Inline Feedbacks
View all comments
1 year ago

I love your blog.this all provided knowledge are unique than other testing blog.good explain.
keep updating

Jasmine Chokshi
1 year ago
Reply to  misha

Thank you Misha for your kind words and encouragement. It is our sincere intention to publish more informative and interesting posts on our blog.

Trusted by teams across the globe for 10+ years

The QMetry brand is trusted by 1000+ customers globally across Finance, Healthcare, Travel, Hospitality, Retail, Education and many more.
These are just some of our customers.