We performed a comparison between SmartBear TestComplete and TestRail based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The product has many features."
"The reporting is ready to use and doesn't require any setup."
"The database checkpoints detect problems which are difficult for a human resource to find."
"Runs in different remote machines. We have multiple versions of the software being tested."
"TestComplete is simple, it's a very easy-to-use tool."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"Selenium integration."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"The feature that I have found most valuable is the dashboard."
"This is a user friendly solution."
"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."
"The integration with Jira and the ability for extra configurations are the most valuable features."
"The solution is very stable. We've never had any issues with it."
"I haven't faced any stability issues using the solution. Stability-wise, I rate the solution a ten out of ten."
"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."
"What is currently missing from this solution is better support for mobile testing."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"The licensing costs are a little bit high and should be reduced."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"Increased performance with less memory and CPU usage."
"The integration tools could be better."
"Product is not stable enough and it crashes often."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"The platform needs improvement regarding performance and creating links."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"The reports should be more user-friendly."
"Reporting could be more flexible regarding repeating reports."
"Better prediction of text."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews while TestRail is ranked 3rd in Test Management Tools with 21 reviews. SmartBear TestComplete is rated 7.6, while TestRail is rated 8.0. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas TestRail is most compared with Zephyr Enterprise, TFS, Tricentis qTest, Tricentis Tosca and IBM Rational Quality Manager. See our SmartBear TestComplete vs. TestRail report.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
