We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
"To me, what's most valuable in Apache JMeter is that it's a lightweight tool for application testing. It's the best load-testing tool for my company because Apache JMeter simulates your application during testing. Apache JMeter also creates threads with good server utilization. Apache JMeter allows you to focus on analyzing the situation, looking into measurements, response time, and client-server responses, which I find valuable."
"The distributed load testing is very good with Apache JMeter."
"The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
"The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
"The ease of use is the solution's most valuable feature. Also, the ability to easily create test cases is also very good. It's easy to just ramp up on the solution."
"JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"It allows us to test both desktop and web applications."
"Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"The solution has a very nice interface."
"Test items, project variables helps in managing automation suite and scheduling execution."
"The most valuable features are the desktop and mobile modules."
"Runs in different remote machines. We have multiple versions of the software being tested."
"The installation needs some work. It could be simplified."
"At times when we overload the application, it gets stuck...After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing."
"The reports in Apache JMeter could improve."
"You really need a technical team in order to really utilize the product."
"If the solution was GUI based, I believe that it would be more versatile."
"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"There could be API interfaces with this tool."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
Apache JMeter is ranked 1st in Performance Testing Tools with 81 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with Postman, BlazeMeter, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio and OpenText UFT One.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.