TestRail reviews

If you are executing manual test cases on a large scale then Test Rail is for you

Opmerkingen: Having using various test management suites TestRail does excel in that it was built to run manual test cases and display results in an easy glance for the whole team. Linking to defects is simple, generating a report when the test run is complete. I feel like reusing regression suites could be improved, it does what it is meant to however you have to repeat several steps each time you want to generate a regression suite.
Some areas for improvement would be a test case type for API tests, I am sure everyone needs this but struggles to find a way to record this data.

Pluspunten:

I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal. Integration with Jira is excellent, although some room for improvement.

Minpunten:

Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal. Trying to duplicate cases can be tedious, let's say you have a lot of cases, trying to copy paste them in to various projects is a lot of hassle, it is surprising they have not addressed issues like this after so many years.

Quality Assured

Opmerkingen: TestRail was a huge step up from our previous process which was a Google Sheet.

Pluspunten:

It helps our QA team with managing regression testing between multiple remote QA engineers. Adding new test cases is easy, and being able to go back and see who tested each case is extremely valuable.

Minpunten:

Getting all of our test cases moved over to TestRail was a huge undertaking, but once done, maintaining has been easy.

Unfortunately, disappointing experience.

Opmerkingen: When I started to use it it was a relatively good test management tool, but in the second year it turned into a day-to-day struggle, I was wasting a lot of time writing and editing test cases - one of the key job characteristics of the QA. It's important to mention that I am not using TestRail for almost two years, and I hope the things got better. But honestly, I wouldn't risk to go back again.

Pluspunten:

The test suites and test case structure were good and easy to navigate.

Minpunten:

The small tiny bugs that appeared every day and bothered our work. Things like the inability to open a screenshot in full-screen with 1 click.. To do that I had to open it on a new browser tab which was very annoying. And plenty of other similar issues that were arising day by day. This was the reason for switching to another test management system.

Everything we needed at half the cost

Opmerkingen: We are better able to track our software testing and coverage with this tool.

Pluspunten:

I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility! Another thing I like a lot are the UI Scripts, where you can customize the instance adding in or removing features and functionality. They are very powerful and super useful for us.

Minpunten:

It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library. I also do not like the way you add and remove tests from a run. It is a bit awkward and hard to see exactly what tests you're adding and removing.

Testcase Management

Opmerkingen: We enjoy using this tool because it takes little time to train new members and easy of using. SImple and faster.

Pluspunten:

Ease of use. Simple and intuitive flow for the workflows that can be customized based on your work.

Minpunten:

Traceability is based on how you configure. Little confusing if you try to explain to users not familiar with the tool.

Eerder overwogen alternatieven: Zephyr

Redenen om voor TestRail te kiezen: Ease of use and less maintenance work. No need to worry about managing the infrastructure and secure.

Used to be great, now it is horrible

Opmerkingen: I've been told their team was decimated after it was bought out. They have only 20 people to handle 11,000 customers. A product that is supposed to be for QA, is not QA'd before releases. If you are considering this product my advice is to run in another direction. You will be disappointed if you invest in TestRail.

Pluspunten:

I loved it before it was sold. It was solid, easy to use, and made our work flow simple and efficient. That is no longer the case

Minpunten:

Since it was bought out, it is now horrific. Test data disappears or is inaccessible. Test runs disappear. EVERY single release is extremely buggy. And knowing that, they still continue to push the release in waves to other customers instead of fixing high priority issues first. Tickets are opened and we get the canned "we're working on it" but rarely are bugs fixed correctly the first time (if at all). We have had months of work disappear with a single release. We've had things break where we were unable to access our tests for days or even weeks at a time. I went from convincing my entire company to join in to use this product, to now only having 3 of us left who will touch it. It's just sad how far it has fallen.

Good for new eployees

Opmerkingen: In my company TestRail work a bit slow (because of the VPN probably), so I do not enjoy really using it, but as a tool it is simple and useful. If I had a choice, I would be still using it with no doubt.

Pluspunten:

Although some functions should be clearly left for more experienced workers, new employees should have no problems with filling the test cases. They need a few minutes to get used to the UI, but in general it easy to learn.

Minpunten:

Not being able to delete some of the elements I added (admin status was needed). Blocking this for elements added by other users would be justified, but if I make a mistake, I should be able to fix it myself.

great tool to manage tests

Opmerkingen: great tool to manage testcases, testruns and create reports for interested parties.

Pluspunten:

easy to use, very intuitive interface, quick sharing of testcases/runs with colleagues

Minpunten:

If I have to offer a point of criticism it's the navigation between some parts of the software can be finicky at times and not logic to my mind but that's entirely a personal opinion.

Amateur-Software without quality

Opmerkingen: wouldn't buy again

Pluspunten:

the people want it.

Minpunten:

Nothing works correctly, many security-issues, support is like a chatbot but isn't.

TestRail: Great for companies willing to pay for it!

Opmerkingen: Working on a Global team, TestRail enabled everyone to have a seat at the Test Case management/creation table. Editing existing test cases was very easy to do, and the GUI makes it easy to find any existing Test Case you are looking for.

Pluspunten:

First of all, TestRail is an extremely smarter way to track and maintain test cases than using Excel. I like how easy it is to create new projects, create custom fields, create test runs, and generate good looking reports to submit to your managers. The GUI takes a little bit to get used to, but once you get a hand of all of the key-shortcuts moving around the application is easy!

Minpunten:

My least favorite part about this software is the JIRA plug in. In order to see the linked test cases from TestRail in JIRA, you need to have a TestRail account. In my company only the testing team had TestRail accounts, while the rest of R&D didn't. While it was helpful for me as a tester to see the linked test cases on a JIRA bug, when we started off with TestRail we had assumed everyone in the R&D department would be able to see this information so we could be more transparent in our testing. My company was not willing to pay for 100 TestRail accounts, so this was a bummer. If yours is then TestRail might be right for you!

TestRail

Pluspunten:

I enjoyed using the free trial (non enterprise) version. I think it one of the best test case management tools out there. Simple in use, intuitive, functional.

Minpunten:

I didn't encounter any major issues with TestRail.

TestRail - test management better than competitors.

Opmerkingen: I used TestRail in my previous company and I am using it in my current one. Firstly, it is easy to use, and all options and settings are close at hand. The structure of test management is also pretty clear. Projects -> Suites -> Sections -> Test cases. Easy to handle and maintain. The whole system is quite simple to integrate with e.g. Jenkins, Cypress, or Jira through the TestRail API. Some products are seamlessly integrated - like Jira, but for some products, scripts have to be written from scratch. Also, thanks to the fact that TR is widely used, there is plenty of help on the internet. Reporting and analysis can be adjusted to the user's needs and set to execute automatically, which can reduce the amount of work. Charts and analyses are easy to understand and can be expanded with the data you need. A big advantage is test parametrization and the ability to recognize and use test data sets. That allows having significantly fewer test cases to maintain. Product is being constantly developed and the customer service is good.
As for the downsides, sometimes minor bugs appear e.g. for some time there were duplicated input fields during test case creation/edition - nothing crucial, but it could be annoying. It was fixed two months later and now everything works correctly. The price is quite high and depends on the number of users.
All in all, in my opinion, TestRail is the best on the market providing user-friendly testing management.

Pluspunten:

The product is constantly developing. A lot of functionalities - API, test structure, reports, bug integrations, milestones, etc. Ease of use. Customizability. Integration with other software (e.g. Jira, Cypress, etc.)

Minpunten:

Minor bugs. Quite a high price. Rather plain design (not really intuitive)

Very mature test management tool

Opmerkingen: I'm very happy with it, it's stable, has a slick UI and overall it's a well-built product.

Pluspunten:

It can cover all of my needs in the entire test life cycle, it's very customizable - I've been adding a lot of my own custom fields to test case templates, for instance. It supports adding shared steps to make your tests more concise, lot of reporting options, milestones, test planning. Pretty much everything a tester needs.

Minpunten:

I would like to see an option to add data parameters for my tests.

Eerder overwogen alternatieven: Zephyr Enterprise

Redenen om voor TestRail te kiezen: A recommendation from a co-worker, haven't regretted it!

Redenen om over te stappen op TestRail: Pricing, support, and a variety of features.

Stellar Feature Rich Platform

Pluspunten:

The ease of use for maintaining, connecting and sharing test cases are unrivaled. The platform is so feature rich every time I think of a feature I want to request they already have it!

Minpunten:

Takes a good amount of time to spin up a valuable framework. I think this can be mitigated by some test case best practices or maybe a super-user demo within the platform.

Eerder overwogen alternatieven: Zephyr Enterprise

Easy to use Test Management tool

Pluspunten:

Its very easy to add the test scenarios in the existing Test Run. We can create multiple Test runs and could create a lot many reports with different filters. As an admin too its very easy for me to give specific access to different members in my team.

Minpunten:

There should be some report format where I could show the Stories, linked Test scenarios, linked defects and their status in more readable way. As of now its there but I feel their is a need of more clarity in the reports.

Easily modified to work with your testing methodology

Opmerkingen: We were able to import our large set of tests in just a few short days and be up and running with a more robust tool that offered us an agile transformation.

Pluspunten:

*customized for any project * easy to get reports from * web based * can import from variety of other tools * good forums for help and ideas

Minpunten:

* can easily make it complex for others depending on how you setup * a few known issues that can cause data loss

Excellent Test Management Software

Opmerkingen: Excellent manual test management with the ability to integrate with our automated test software. Overall, we have a feature-rich and fully functional tool for our test management needs.

Pluspunten:

The ease of use for this software has allowed our company to transfer from paper test sheets to logins for our end users. This test software had an answer and feature for every question we had.

Minpunten:

There's very little to dislike about this software. The report extract is a bit clunky. When a report is emailed to an email address, it's sent as a zip file with an html file. The extra steps required to view a report eliminate the usefulness of this feature.

Qualit Assurance Manager

Opmerkingen: I test software builds for a system which is installed into Taxis around the US. Each city has it's own configuration, rules and templates for printing & displaying info. There are several hardware configurations any taxi might have. By creating Projects based on functionality, I can copy/paste each required Project into a master Project then as a Test Run is created, check on/off individual Sections as needed and then test each build accordingly.
Having a report for each test Run allows management to go back & view each build's tes Run results when any "issue" is complained about by fleets/drivers to verify whether it was working or not in that build - as drivers are sometimes worse lairs than Lawyers or Politicians

Pluspunten:

1- versatility to create Projects which allow base line Test Cases to be used in a variety of different test runs for different products. 2- ease of being able to import test cases from existing methods

Minpunten:

The main issue I have is the Projects are listed as a flat-file. We have several different groups which have created Projects and even though they might be testing a given entity from different sides, they have to name their Projects differently. We prefix each project with a Group Name so the Projects can be "grouped" and easily referenced from the main dashboard. Another less important issue is there isn't really an easy way to make a backup of our entire Dashboard. We can Export each Project but I don't see any way to make backups of anything else outside of offloading each individual entity which really isn't all that hard.

Great tool

Opmerkingen: Has enough good functionality to use it daily for our business. It simplified our everyday life.

Pluspunten:

All the test cases at one place. Easy to create and execute runs. Simple reports are easy to add and use as test evidence. Ability to use runs for multiple releases at the same time

Minpunten:

Pre-built reports. Can not customize much . No multi-select for the test cases ( cannot use shift select). Unable to update test definition from the test runs

TestRail Review:

Pluspunten:

It's easy to use and you can get moving on your test library pretty much right after sign up. There's not much of a learning curve.

Minpunten:

The only complaint I have is that when writing a test case by steps, adding a next step is a little cumbersome. It would be nice it there was an alternate command like shift + arrow down to add another step rather than selecting the tiny "add step" link.

Test Management Ease

Opmerkingen: Managing multiple releases is easy going. Folder Tree Structure is well organized.

Pluspunten:

User Friendly, Simple UI. Report creation is easy.

Minpunten:

Searching ability can be expanded to include more parameters. Sometimes cannot find a test case.

TestRail and JIRA

Opmerkingen: Works well for our enterprise!

Pluspunten:

The software's very integrated with JIRA

Minpunten:

They could improve testing matrixes, reporting like KPIs, Test Coverage, and really need a link between requirements/stories and code coverage.

Great Test Management platform

Pluspunten:

User friendly, easy to use and to customize, fast and available as a service.

Minpunten:

It's getting more expensive, especially when comparing 2018 to 2019 costs (47% increase)

TestRrail Case managment

Pluspunten:

TestRail Case managment software helps a lot with manage of the testing process.

Minpunten:

Missing possibility to set default tester per test case.

light & friendly test case mgmt. tool

Pluspunten:

easily use, friendly UI, open API for integration and fast customer response.

Minpunten:

performance issue for large company & heavy users