Akamai CloudTest vs Apache JMeter comparison

Cancel
You must select at least 2 products to compare!
Akamai Logo
706 views|481 comparisons
Apache Logo
8,484 views|6,833 comparisons
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Akamai CloudTest and Apache JMeter based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools.
To learn more, read our detailed Performance Testing Tools Report (Updated: March 2024).
763,955 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"This is an awesome performance testing tool for web based applications, able to generate load multiple geographies, dynamic ramp-up to any levels of virtual users.""The solution is very stable.""From my own experience, if you're talking about load testing and performance testing then definitely you should go for CloudTest. Because when we compared CloudTest with Performance Center, cost wise it was a better solution. It is easy to use as well, and you can definitely get an automation engineer or a performance engineer with very little exposure to any programming or scripting language such as JavaScript. I would definitely recommend this solution and would rate it at eight on a scale from one to ten.""The level of support is quite good and the integration is also very flexible."

More Akamai CloudTest Pros →

"The most valuable features are the integration with Jenkins and the reporting.""We are using this for performance testing and some automation.""Scripting with the solution is good.""Due to process automation, I don't have to prepare reports, making it the perfect solution.""The recording and playback functionality is helpful.""It's very easy to install, and it's very easy to code and develop the script.""When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations.""This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."

More Apache JMeter Pros →

Cons
"Akamai cloud test integration into our current CI/CD pipelines (i.e.) identify and resolve the issues during the sprint phase which helps in delivering an absolute product and reduces time to market/release.""It's a manual process to whitelist respective internal IPs in coordination with web operations team to access Soasta. Availability of any standardized tool from Soasta will make setup process easy.""In terms of improvement, I think integration of these tools with the leading EPM tools would be good. It would help to seamlessly integrate to Dynatrace or AppDynamics to understand what the profiling looks like when generating a load.""The test clip should be more user-friendly."

More Akamai CloudTest Cons →

"Its reporting could be improved. There should be a better visual representation. That would be helpful for easy consumption of the reports.""They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution. In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports. They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available.""Apache JMeter could use improvement in reporting. Currently, it isn't easy to generate reports in PDF format. While receiving reports in PDF format is possible, it requires a lot of customization. Additionally, when comparing the load test to others solutions it could improve.""It's not easy to get the data from one place or to do customizations.""JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases.""What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter.""The solution is not user-friendly, there is no framework for autocorrelation or parameterization.""Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."

More Apache JMeter Cons →

Pricing and Cost Advice
  • "Running cost is very low."
  • "We have a yearly license, and I would give it a rating of three out of five."
  • More Akamai CloudTest Pricing and Cost Advice →

  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
    763,955 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:From my own experience, if you're talking about load testing and performance testing then definitely you should go for CloudTest. Because when we compared CloudTest with Performance Center, cost wise… more »
    Top Answer:In terms of improvement, I think integration of these tools with the leading EPM tools would be good. It would help to seamlessly integrate to Dynatrace or AppDynamics to understand what the profiling… more »
    Top Answer:We use this solution mostly for generating loads for a couple of our retail clients, especially for holiday readiness. We want to get our system up and running to get ready for unpredicted loads. So… more »
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer:JMeter is basically the art of the entire performance testing process.
    Ranking
    12th
    Views
    706
    Comparisons
    481
    Reviews
    1
    Average Words per Review
    745
    Rating
    8.0
    Views
    8,484
    Comparisons
    6,833
    Reviews
    47
    Average Words per Review
    475
    Rating
    7.6
    Comparisons
    Also Known As
    SOASTA CloudTest
    JMeter
    Learn More
    Overview

    Soasta's CloudTest rapidly builds realistic test scenarios using real user data, then tests, analyzes and repairs faster. CloudTest's visual test environment and real-time analytics test your website, mobile app and api backend to give you a streaming view of all your performance data while tests run from back-end systems to front end performance.

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Sample Customers
    Chester Zoo
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Top Industries
    VISITORS READING REVIEWS
    Financial Services Firm23%
    Computer Software Company14%
    Insurance Company11%
    Energy/Utilities Company10%
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Educational Organization4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company7%
    Government6%
    Company Size
    VISITORS READING REVIEWS
    Small Business11%
    Midsize Enterprise10%
    Large Enterprise78%
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise51%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise13%
    Large Enterprise70%
    Buyer's Guide
    Performance Testing Tools
    March 2024
    Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools. Updated: March 2024.
    763,955 professionals have used our research since 2012.

    Akamai CloudTest is ranked 12th in Performance Testing Tools with 1 review while Apache JMeter is ranked 1st in Performance Testing Tools with 46 reviews. Akamai CloudTest is rated 7.6, while Apache JMeter is rated 7.8. The top reviewer of Akamai CloudTest writes "Is easy to use and quick to setup, and does not require much resource capacity for medium instances". On the other hand, the top reviewer of Apache JMeter writes "It's a free, scalable tool that's good for checking backend services". Akamai CloudTest is most compared with OpenText LoadRunner Professional, OpenText LoadRunner Enterprise, Tricentis NeoLoad, BlazeMeter and k6 Open Source, whereas Apache JMeter is most compared with Postman, BlazeMeter, Tricentis NeoLoad, OpenText LoadRunner Professional and SmartBear LoadNinja.

    See our list of best Performance Testing Tools vendors and best Load Testing Tools vendors.

    We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.