We performed a comparison between SpecFlow and TestRail based on real PeerSpot user reviews.
Find out in this report how the two Test Management Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The initial setup is easy."
"The most valuable feature of the solution is unit testing...It is also an easy-to-use and user-friendly product that can easily adapt to any framework."
"One of the most valuable features of SpecFlow for us is its risk identification capabilities."
"SpecFlow's best feature is the ability to add additional layers to the programming."
"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."
"I use the solution for test management."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
"I use the product to create test cases and share them with my team and manager."
"The product helps us create test cases and reports."
"The most valuable features are the flexibility, ease of use for writing new test cases, the test plans, and the composition."
"You don't need to follow complex procedures to create a test run, test case, etc."
"This is a user friendly solution."
"SpecFlow's installation and configuration can be a bit challenging due to its flexibility as an open-source tool."
"Regarding improvement, it would be good if SpecFlow could provide chain testing, which it currently doesn't allow."
"SpecFlow would be improved with the addition of functionality reporting, which would be really helpful for automation testing."
"I'd prefer in TFS if we could be writing test cases, not in the old classical version. We should be writing in Gherkin and then automatically have it convert that Gherkin test case into SpecFlow feature files."
"The platform needs improvement regarding performance and creating links."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"I've encountered at some point, some difficulties on the administration side, but I don't remember exactly what they were."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"TestRail should improve its pricing."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
SpecFlow is ranked 9th in Test Management Tools with 4 reviews while TestRail is ranked 2nd in Test Management Tools with 21 reviews. SpecFlow is rated 7.2, while TestRail is rated 8.0. The top reviewer of SpecFlow writes "Ensures efficient testing and validation of both business and technical requirements". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". SpecFlow is most compared with Tricentis Tosca and Tricentis qTest, whereas TestRail is most compared with Zephyr Enterprise, TFS, Tricentis qTest, Tricentis Tosca and IBM Engineering Test Management. See our SpecFlow vs. TestRail report.
See our list of best Test Management Tools vendors.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.