We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The most valuable features are the ability to capture the entire traffic of particular pages and the proper readability of entire pages and entire APIs."
"The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"The reporting features are really good. There's a lot less latency than other solutions."
"It's very easy to install, and it's very easy to code and develop the script."
"The solution has good transition controllers and distributed testing."
"The new version of the solution is stable."
"It's a powerful tool that is open source."
"The recording and playback functionality is helpful."
"The solution is mainly stable."
"The product is stable for what we are currently using it for, and it is sufficient for us."
"The most valuable feature of this solution is regression testing tools."
"The most valuable features are the desktop and mobile modules."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"It allows us to test both desktop and web applications."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"One of the drawbacks of JMeter is that it can't handle a large amount of load, which forces us to switch to other tools when we need to load more than a 5,000 or 10,000 user load."
"If JMeter could provide a web version of editing, that would be good."
"We're like the solution to be more user-friendly."
"The memory utilization in JMeter is very poor."
"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."
"They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"It has some proxy-based dependencies which require specific proxies to be set up or disabled, which causes problems."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"Right now, the product only supports Windows."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription."
"Product is not stable enough and it crashes often."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.