We performed a comparison between SmartBear TestComplete and TestRail based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"The database checkpoints detect problems which are difficult for a human resource to find."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"It is a strong automation tool for desktop, browser, and API testing."
"When compared to other tools, it is very simple."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"This is a user friendly solution."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
"The feature that I have found most valuable is the dashboard."
"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."
"The most valuable features are the flexibility, ease of use for writing new test cases, the test plans, and the composition."
"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"Integration with Confluence and JIRA."
"One notable drawback is the absence of native integration with Git."
"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"Error handling features in the tool are a little limited."
"Increased performance with less memory and CPU usage."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"The reports should be more user-friendly."
"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"Reporting could be more flexible regarding repeating reports."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"Better prediction of text."
"TestRail should improve its pricing."
SmartBear TestComplete is ranked 7th in Test Automation Tools with 71 reviews while TestRail is ranked 2nd in Test Management Tools with 21 reviews. SmartBear TestComplete is rated 7.6, while TestRail is rated 8.0. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas TestRail is most compared with Zephyr Enterprise, Tricentis qTest, TFS, Tricentis Tosca and Visual Studio Test Professional. See our SmartBear TestComplete vs. TestRail report.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.