We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The most valuable feature of this solution is that it is free."
"The solution is scalable."
"JMeter's most valuable feature is the RegEx Extractor."
"The solution helps by detecting bottlenecks."
"This solution is very user-friendly, and allows for a lot of data capture when testing."
"JMeter is basically the art of the entire performance testing process."
"Apache JMeter is quite flexible."
"The most valuable features are the integration with Jenkins and the reporting."
"The most valuable feature is the integration with Azure DevOps."
"The most valuable feature of this solution is regression testing tools."
"The solution has a very nice interface."
"The product has many features."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The product is stable for what we are currently using it for, and it is sufficient for us."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"There is some work to be done with the integration."
"It should be easier to combine multiple scripts. If you have multiple scripts, you need to write a new script to combine those scripts. The virtual user generator is slow."
"Until now, JMeter is not supporting most of the protocols."
"The solution needs more metrics for reporting."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"The integration tools could be better."
"What is currently missing from this solution is better support for mobile testing."
"To bring it up to a 10, I would be looking for the addition of some key functional API testing."
"The artificial intelligence needs to be improved."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
Apache JMeter is ranked 1st in Performance Testing Tools with 81 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with Postman, BlazeMeter, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio and OpenText UFT One.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.