SmartBear TestComplete vs. TestRail

SmartBear TestComplete is ranked 4th in Test Management Tools with 15 reviews vs TestRail which is ranked 8th in Test Management Tools with 6 reviews. The top reviewer of SmartBear TestComplete writes "Allows us to test both desktop and web applications". The top reviewer of TestRail writes "Gives the tester the ability to compare calculated times to actual times it takes for a test case to run". SmartBear TestComplete is most compared with UFT (QTP), Ranorex and Selenium HQ. TestRail is most compared with Zephyr Enterprise, Hiptest and qTest. See our SmartBear TestComplete vs. TestRail report.
Cancel
You must select at least 2 products to compare!
+Add products to compare
Most Helpful Review
Find out what your peers are saying about SmartBear TestComplete vs. TestRail and others in Test Management Tools.
295,561 professionals have used our research since 2012.

Quotes From Members Comparing SmartBear TestComplete vs. TestRail

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
Pros
The database checkpoints detect problems which are difficult for a human resource to find.Customer service and technical support responsiveness are high. Everyone is very professional.Test items, project variables helps in managing automation suite and scheduling execution.Selenium integration.It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.The ability to run a whole suite of tests automatically (which we did overnight).TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications.Runs in different remote machines. We have multiple versions of the software being tested.

Read more »

Integration with Confluence and JIRA.The API to support integration of the homemade automated testing tool.Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it.You don't need to follow complex procedures to create a test run, test case, etc.The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run.Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database.

Read more »

Cons
Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work.Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.Increased performance with less memory and CPU usage.Error handling features in the tool are a little limited.The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses.TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.Product is not stable enough and it crashes often.

Read more »

Better prediction of text.The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry.There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum.It would be nice if they would add an export to Word.It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be.Reporting could be more flexible regarding repeating reports.

Read more »

Pricing and Cost Advice
The license price for a physical machine is cheap, and for virtual machine, it is very expensive.Our ROI is about $10,000 a year.TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module.Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day.The price is less, compared to other products, such as QTP.My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it.The product is becoming more and more expensive.

Read more »

Pricing for small teams seems correct with respect to competitors.Negotiate the best deal you can.My advice to others is to shop around for the best deal. Some options out there are free in cyberspace.Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time.

Read more »

report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
295,561 professionals have used our research since 2012.
Ranking
RANKING
Views
30,821
Comparisons
12,784
Reviews
15
Followers
1,337
Avg. Rating
7.8
Views
5,569
Comparisons
4,191
Reviews
6
Followers
268
Avg. Rating
8.5
Top Comparisons
Top Comparisons
Compared 22% of the time.
Compared 18% of the time.
See more SmartBear TestComplete competitors »
Compared 34% of the time.
Compared 21% of the time.
Compared 13% of the time.
See more TestRail competitors »
Website/Video
Website/VideoSmartBear Software
Gurock
Overview
Overview

TestComplete is a powerful and robust automated testing tool for mobileweb and desktop  applications. Quickly and easily create accurate and repeatable tests across multiple devices, platforms and environments – regardless of experience level. It supports multiple languages, modern control sets and integrates with open source frameworks and tools like Selenium, SoapUI and Jenkins.

TestRail helps you manage and track your software testing efforts and organize your QA department. Its intuitive web-based user interface makes it easy to create test cases, manage test runs and coordinate your entire testing process.

Easily track and follow the status of individual tests, milestones and projects with dashboards and activity reports. Get real-time insights into your testing progress and boost productivity with personalized todo lists, filters and email notifications. Efficient test management, get started today!

OFFER
Learn more about SmartBear TestComplete
Learn more about TestRail
Sample Customers
Sample CustomersCisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Top Industries
Top Industries
REVIEWERS
Software R&D Company
13%
Retailer
13%
Comms Service Provider
13%
Manufacturing Company
13%
VISITORS READING REVIEWS
Financial Services Firm
13%
Manufacturing Company
13%
Retailer
10%
Transportation Company
9%
No Data Available
Company Size
Company Size
REVIEWERS
Small Business
15%
Midsize Enterprise
37%
Large Enterprise
49%
VISITORS READING REVIEWS
Small Business
16%
Midsize Enterprise
27%
Large Enterprise
58%
No Data Available
Find out what your peers are saying about SmartBear TestComplete vs. TestRail and others in Test Management Tools.
Download now
295,561 professionals have used our research since 2012.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.

Sign Up with Email