We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
"The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"It is easy to set up."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"It's very easy to install, and it's very easy to code and develop the script."
"We are using it just for load testing. We are using its free version, and it is scalable."
"We like that Apache JMeter has different features and different plugins and that they are free of charge."
"The performance of the solution is excellent."
"It allows us to test both desktop and web applications."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The most valuable feature of this solution is regression testing tools."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"The reporting is ready to use and doesn't require any setup."
"This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful."
"The solution needs more metrics for reporting."
"The user interface is a little bit tricky."
"In future releases, it would be helpful if there was an integration with ALM Octane."
"Automation is difficult in JMeter."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."
"It should be easier to combine multiple scripts. If you have multiple scripts, you need to write a new script to combine those scripts. The virtual user generator is slow."
"The stability could be a bit better."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools."
"Right now, the product only supports Windows."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"Error handling features in the tool are a little limited."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.