We performed a comparison between CucumberStudio and TestRail based on real PeerSpot user reviews.
Find out what your peers are saying about Microsoft, Oracle, OutSystems and others in Rapid Application Development Software."The best thing is that a person without knowledge about the program can easily understand what happened in our testing process."
"The data table that helps in converting a single script to multiple test cases is very helpful."
"The solution is very stable. We've never had any issues with it."
"This is a user friendly solution."
"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"The feature that I have found most valuable is the dashboard."
"Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it."
"The reporting needs to be improved."
"I think it would be better if we could also do the reporting with CucumberStudio."
"The test suite management has room for improvement as well as better reporting."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"Reporting could be more flexible regarding repeating reports."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
CucumberStudio is ranked 27th in Rapid Application Development Software with 8 reviews while TestRail is ranked 3rd in Test Management Tools with 21 reviews. CucumberStudio is rated 8.2, while TestRail is rated 8.0. The top reviewer of CucumberStudio writes "An easy -to -use scalable cloud-based solution which needs some improvement with programming automation and stability". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". CucumberStudio is most compared with GitHub CoPilot, whereas TestRail is most compared with Zephyr Enterprise, TFS, Tricentis qTest, Tricentis Tosca and Sealights.
We monitor all Rapid Application Development Software reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
