Most Helpful Review
Our automation engineers can create tests more easily, but the code editor gives poorly formatted code.
We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
The database checkpoints detect problems which are difficult for a human resource to find.
Customer service and technical support responsiveness are high. Everyone is very professional.
Test items, project variables helps in managing automation suite and scheduling execution.
It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems.
The ability to run a whole suite of tests automatically (which we did overnight).
TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications.
Runs in different remote machines. We have multiple versions of the software being tested.
Integration with Confluence and JIRA.
The API to support integration of the homemade automated testing tool.
Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it.
You don't need to follow complex procedures to create a test run, test case, etc.
The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run.
Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database.
Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work.
Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.
Increased performance with less memory and CPU usage.
Error handling features in the tool are a little limited.
The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools.
We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses.
TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services.
Product is not stable enough and it crashes often.
Better prediction of text.
The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry.
There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum.
It would be nice if they would add an export to Word.
It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be.
Reporting could be more flexible regarding repeating reports.
Pricing and Cost Advice
The license price for a physical machine is cheap, and for virtual machine, it is very expensive.
Our ROI is about $10,000 a year.
TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module.
Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day.
The price is less, compared to other products, such as QTP.
My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it.
The product is becoming more and more expensive.
Pricing for small teams seems correct with respect to competitors.
Negotiate the best deal you can.
My advice to others is to shop around for the best deal. Some options out there are free in cyberspace.
Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time.
out of 32 in Test Management Tools
out of 32 in Test Management Tools
Compared 17% of the time.
Compared 13% of the time.
Compared 7% of the time.
Compared 24% of the time.
Compared 22% of the time.
Compared 11% of the time.
TestComplete is a powerful and robust automated testing tool for mobile, web and desktop applications. Quickly and easily create accurate and repeatable tests across multiple devices, platforms and environments – regardless of experience level. It supports multiple languages, modern control sets and integrates with open source frameworks and tools like Selenium, SoapUI and Jenkins.
TestRail helps you manage and track your software testing efforts and organize your QA department. Its intuitive web-based user interface makes it easy to create test cases, manage test runs and coordinate your entire testing process.
Easily track and follow the status of individual tests, milestones and projects with dashboards and activity reports. Get real-time insights into your testing progress and boost productivity with personalized todo lists, filters and email notifications. Efficient test management, get started today!
Learn more about SmartBear TestComplete
Learn more about TestRail
|Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.||Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung|
Comms Service Provider13%
Software R&D Company13%
Financial Services Firm13%
Financial Services Firm28%
No Data Available