We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."We are using it just for load testing. We are using its free version, and it is scalable."
"API testing, Database Testing, and MQ testing can be done with ease."
"User-friendly and open source."
"The performance of the solution is excellent."
"The most valuable feature of this solution is that it is free."
"JMeter is basically the art of the entire performance testing process."
"We like that Apache JMeter has different features and different plugins and that they are free of charge."
"The thread groups, samplers, and listeners, which are all determined by the script's requirements, are the most valuable features of this solution."
"Selenium integration."
"The most valuable feature of this solution is regression testing tools."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"You can record your actions and play them back later."
"This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The initial setup is pretty easy and it's quick to deploy."
"Report generation needs to be improved. It is quite difficult to get to."
"I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"The reporting section of the solution can be better."
"If JMeter could integrate with the EPM solution, it would be great. It could also be improved by offering more integrations for security. For example, most applications are secure with OpenID Connect protocols."
"One of the drawbacks of JMeter is that it can't handle a large amount of load, which forces us to switch to other tools when we need to load more than a 5,000 or 10,000 user load."
"The solution's setup could be easier and security could be improved to minimize vulnerabilities."
"The memory utilization in JMeter is very poor."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"Right now, the product only supports Windows."
"Product is not stable enough and it crashes often."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"Error handling features in the tool are a little limited."
"Increased performance with less memory and CPU usage."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.