We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."We are using this for performance testing and some automation."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"It's very easy to install, and it's very easy to code and develop the script."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"We appreciate that the solution is free to use, as an open-source tool."
"The new version of the solution is stable."
"The ease-of-use and quality of the overall product are above average."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"It is a strong automation tool for desktop, browser, and API testing."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"Test items, project variables helps in managing automation suite and scheduling execution."
"I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"The initial setup is pretty easy and it's quick to deploy."
"The interface could be made more user-friendly."
"The plug-ins make the reports heavy and they have to be run in non-GUI mode."
"The UI of the solution needs to be better. The UI takes up a lot of our bandwidth."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The tool should be made a bit more robust, and better support should be made available."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"Until now, JMeter is not supporting most of the protocols."
"The user interface is a little bit tricky."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"The pricing is the constraint."
"Increased performance with less memory and CPU usage."
"What is currently missing from this solution is better support for mobile testing."
"Product is not stable enough and it crashes often."
"Error handling features in the tool are a little limited."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.