We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The solution offers a lot of plug-ins and a huge continuously developing community that is regularly offering new features and plug-ins."
"The solution has good transition controllers and distributed testing."
"It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium."
"The new version of the solution is stable."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"The most valuable feature of Apache JMeter is its popularity. It is the best open-source tool with all the features needed."
"The distributed load testing is very good with Apache JMeter."
"Test items, project variables helps in managing automation suite and scheduling execution."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"You can record your actions and play them back later."
"The product has many features."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"The initial setup is pretty easy and it's quick to deploy."
"The reporting is ready to use and doesn't require any setup."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"Apache JMeter's UI can be made more colorful."
"At times when we overload the application, it gets stuck...After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"It's not easy to get the data from one place or to do customizations."
"The tool should be made a bit more robust, and better support should be made available."
"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
"Report generation needs to be improved. It is quite difficult to get to."
"The initial setup of SmartBear TestComplete was complex."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"One notable drawback is the absence of native integration with Git."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.