We performed a comparison between Apache JMeter and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The recording and playback functionality is helpful."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"It is cost-effective and simple to use."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
"JMeter's most valuable feature is the RegEx Extractor."
"It's stable and reliable."
"A lot of things are valuable. It is free. It has a lot of features, such as report generation and integration with CI/CD, which makes it very competitive with the other paid solutions available in the market. It is a good solution."
"The ease-of-use and quality of the overall product are above average."
"You can record your actions and play them back later."
"The database checkpoints detect problems which are difficult for a human resource to find."
"Selenium integration."
"The reporting is ready to use and doesn't require any setup."
"Test items, project variables helps in managing automation suite and scheduling execution."
"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms."
"Apache JMeter could be a more user-friendly product from the end user's perspective."
"Apache should have a graphic interface."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"If the solution was GUI based, I believe that it would be more versatile."
"The user interface is a little bit tricky."
"Apache JMeter's UI can be made more colorful."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"What is currently missing from this solution is better support for mobile testing."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"The initial setup of SmartBear TestComplete was complex."
"The integration tools could be better."
"Right now, the product only supports Windows."
Apache JMeter is ranked 1st in Performance Testing Tools with 82 reviews while SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews. Apache JMeter is rated 7.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, Katalon Studio and OpenText LoadRunner Professional, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
