it_user380010 - PeerSpot reviewer
Senior Load Test Engineer at a tech vendor with 501-1,000 employees
Vendor
several key features: Jenkins integration, infrastructure monitoring, and results analysis.
Pros and Cons
  • "There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis."
  • "It needs improvements in the UI. It's currently not as friendly as it should be."

What is most valuable?

There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis.

How has it helped my organization?

Implementing this product has allowed us to increase the number of projects that get load testing, and the frequency by which we re-test our performance.

What needs improvement?

It needs improvements in the UI. It's currently not as friendly as it should be.

For how long have I used the solution?

We've used it for seven years.

Buyer's Guide
Tricentis NeoLoad
April 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,976 professionals have used our research since 2012.

What was my experience with deployment of the solution?

We haven't had any issues with deployment.

What do I think about the stability of the solution?

We have never experienced any isuses with stability.

What do I think about the scalability of the solution?

The product has scaled very well up until this point.

How are customer service and support?

The support from Neotys is very good. Responses are timely and come from experienced, knowledgeable load testing professionals.

Which solution did I use previously and why did I switch?

We previously, and still use JMeter for some projects, in addition to Neoload.

How was the initial setup?

The initial setup is straightforward for basic usage. The setup for higher volume load testing is more involved, but I wouldn't say complex, as should be expected for an enterprise class load testing tool.

What about the implementation team?

We implemented it with our in-house team.

What's my experience with pricing, setup cost, and licensing?

It's priced based on the numbers of VUs, virtual users, that your needs require. The free edition gives you 50 VUs. The pricing is fair for high-volume licensing. Cloud VUs can be rented on-demand for bursts of higher capacity testing needs without permanent purchase.

Which other solutions did I evaluate?

We looked at JMeter and Webload.

What other advice do I have?

I highly recommend understanding load testing concepts before using any automation tool.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user200979 - PeerSpot reviewer
it_user200979Owner and Managing Director at a tech services company with 51-200 employees
Real User

I basically agree with this review. The 'Other Advice' is one of the most valuable parts. Whatever you are using, you need to understand what you are doing. A representative load test environment and sufficient coverage of the application being tested are often ignored, producing test results that will not predict the performance of your production environment.

it_user356646 - PeerSpot reviewer
Senior Manager Online Performance Engineering at Dell
Vendor
It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions. We also want to monitor applications within various environments, which NeoSense will soon allow.

Valuable Features

It is convenient to be able to keep up the pace in which the application code was delivered to us. Since we manage nearly 500-600 applications and we need to make sure they are tested, we wanted something robust with an option to check against previous baselines with minimal human intervention without sacrificing criteria.

We wanted something with less risk when incorporating or shifting scripts.

The fact that it loads from an external cloud is a plus as well.

It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions.

Room for Improvement

They are coming out soon with NeoSense. It's a hybrid between app management tools and a testing tool. This will be helpful for us because we'll be able to monitor applications within various different environments. This is precisely what we have wanted.

Use of Solution

We've been using it for a year.

Deployment Issues

We had no issues with deployment.

Scalability Issues

We used to have only 50 online users. Later we moved to where we are.

Customer Service and Technical Support

We have used their gold support option. Yes, we have been happy. They usually answer between 36 and 48 hours for non-critical issues, and with critical issues they hold your hand.

Implementation Team

We did it in-house.

Pricing, Setup Cost and Licensing

We didn't negotiate the price. To give perspective, we went from spending three million dollars to 160 thousand dollars, which is a huge saving and good value.

Other Solutions Considered

One of our goals was to find a platform that would have the functionalities that we were used to while incorporating in other ones. ProLoad was a competitor, and one other (can't make out name).

We wanted it to support agile and devops, while being able to upgrade to a number of releases over the course of a day, so it was a fit.

Other Advice

The company really strives on experience, always making sure that I as a customer am happy. For example, my team at Dell had an issue with our new version, which we had just updated to. Another team used a different version which required different protocols, and there were discrepancies between the versions. The company found out that our errors were user errors, and helped us fix the problem.

I helped them in terms of product development since we at Dell told them requirements and they added that to product life cycles. So we are a customer, but told them some requirements we'd like to see.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Tricentis NeoLoad
April 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,976 professionals have used our research since 2012.
Ujwal Gaikwad - PeerSpot reviewer
Associate Software Engineer at Nts automation labs pvt ltd
Real User
Top 10
An easy-to-use solution that can be used for performance testing purposes, like load testing and stress testing
Pros and Cons
  • "Tricentis NeoLoad is quite easy to use as compared to JMeter."
  • "Tricentis NeoLoad crashes if an application contains more than 1,000 scripts."

What is our primary use case?

We use Tricentis NeoLoad for performance testing purposes, like load testing and stress testing.

What is most valuable?

Tricentis NeoLoad is quite easy to use as compared to JMeter. The other valuable features of Tricentis NeoLoad include correlation, parameterization, load testing, and file parsing.

What needs improvement?

Tricentis NeoLoad crashes if an application contains more than 1,000 scripts. Tricentis needs to improve in this area, and the solution should run smoothly even if thousands of scripts are imported into it.

For how long have I used the solution?

I have been using Tricentis NeoLoad for one and a half years.

What do I think about the stability of the solution?

I rate Tricentis NeoLoad a nine out of ten for stability.

What do I think about the scalability of the solution?

Around 10 to 12 users are using Tricentis NeoLoad in our organization.

I rate Tricentis NeoLoad an eight out of ten for scalability.

How was the initial setup?

The solution’s initial setup was easy.

What about the implementation team?

Tricentis NeoLoad can be installed in ten minutes.

What's my experience with pricing, setup cost, and licensing?

Tricentis NeoLoad is not an expensive solution, but it can be quite expensive if we need a license for load testing, depending on the organization level.

On a scale from one to ten, where one is expensive, and ten is cheap, I rate Tricentis NeoLoad's pricing a seven out of ten.

What other advice do I have?

I would recommend Tricentis NeoLoad to other users.

Overall, I rate Tricentis NeoLoad a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
PeerSpot user
Senior Performance Engineer at Ascend Learning
Real User
Best tool for testing in production without making many changes to the script or solution
Pros and Cons
  • "It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty."
  • "NeoLoad is best tool for testing in production without making many changes to the script or solution."
  • "NeoLoad does not support Citrix-based applications."

What is our primary use case?

Used for performance testing of applications on QA environments as well as production environments. NeoLoad is best tool for testing in production without making many changes to the script or solution.

How has it helped my organization?

It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty.

What is most valuable?

  • Integration of all components in one place.
  • GUI-based requests
  • Ease of use compared with other performance tools.

What needs improvement?

NeoLoad does not support Citrix-based applications. Neotys should take a look into this protocol.

For how long have I used the solution?

One to three years.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues. As far as Neotys NeoLoad, it is excellent in scalability.

How are customer service and technical support?

The support is good. 

Which solution did I use previously and why did I switch?

We started with NeoLoad.

How was the initial setup?

The initial setup is easy.

What about the implementation team?

The implementation was done in-house.

What was our ROI?

Our ROI is 100%.

What's my experience with pricing, setup cost, and licensing?

The licensing cost is less compared to other licensing performance testing tools.

Which other solutions did I evaluate?

We tried JMeter, but due to its support (which we found subpar), we had to switch to NeoLoad.

What other advice do I have?

You will love NeoLoad moving from open source and code-based performance tools.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Load Test Engineer at a government with 10,001+ employees
Consultant
All-in-one product with load generators deployed globally.

What is most valuable?

All-in-one product (design, runtime, results), easy scripting and variable correlation, and load generators deployed all around the world to simulate global traffic.

How has it helped my organization?

It is easier to do load tests using NeoLoad.

What needs improvement?

The only improvement that I wanted is support for load tests in agile mode. Neoload 5.2 makes this possible by updating the old versions of scripts with data from the new HTTP requests.

For how long have I used the solution?

I have 4 years of experience.

What was my experience with deployment of the solution?

The only issue that I had was with network virtualization on load generators installed on Windows Server 2008 R2. The link is sometimes cut between the controller and the load generators.

How are customer service and technical support?

10/10. Support is available, they handle issues very quickly, and they are very skillful.

Which solution did I use previously and why did I switch?

I used HPE LoadRunner. I think that NeoLoad is more user-friendly.

How was the initial setup?

NeoLoad is easy to deploy using the install wizard.

What about the implementation team?

Well, first I got trained by a vendor team. After that, I implemented more projects using NeoLoad.

My advice is that there should be a minimum of 4GB of memory on the servers on which you are installing NeoLoad.

What's my experience with pricing, setup cost, and licensing?

Neotys provides a free evaluation licence to use NeoLoad with up to 50 virtual users and all protocols included.

The product licence remains cheaper than HP LoadRunner, for example.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are a partner of Neotys. We do consulting for them.
PeerSpot user
it_user61302 - PeerSpot reviewer
IS QA Manager with 1,001-5,000 employees
Vendor
It's provided a faster turnaround on load-testing creation and the ability to use the team servers so multiple people can use this at once, which we couldn't do before.

Valuable Features

It makes it easy to create load tests. We used HP LoadRunner previously, and this is far better.

Improvements to My Organization

It's provided a faster turnaround on load-testing creation and the ability to use the team servers so multiple people can use this at once, which we couldn't do before.

Room for Improvement

It would be nice if this could be cheaper.

Use of Solution

I've used it for one-and-a-half years.

Stability Issues

It's been 100% stable, which we are very happy about.

Scalability Issues

Some of the additional modules can be pricey, but it is scalable.

Customer Service and Technical Support

Compared to support at our previous product, they're more responsive and they're more knowledgeable. Overall, it's three times better than our previous solution.

Initial Setup

The initial setup was very straightforward.

Implementation Team

We implemented it in-house.

Other Solutions Considered

We looked at JMeter, but NeoLoad had what we needed. We were using LoadRunner for six years and then we replaced it with NeoLoad.

Other Advice

Everyone's needs are a little bit different, so make sure you do a good POC.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user464934 - PeerSpot reviewer
Technical Test Specialist, Performance Test Lead at a tech services company with 10,001+ employees
Consultant
Executable binaries made life easier during the implementation. They need to update their online documentation.

What is most valuable?

The support for HTTP, JMS, REST API, and XBAP protocols is good. NeoLoad is very user friendly and works well with HTTP and REST AO’s. It's very effective during cloud based testing and the cost is a fraction of LoadRunner. v5.1.4 introduced the JMS testing protocol which is a copy of SOAP UI. I was pleasantly surprised that with a little tweaking and support from Neotys, NeoLoad worked with XBAP applications very efficiently.

How has it helped my organization?

It comes with new features, notably JMS which enables us to be on top of our performance testing tool list.

What needs improvement?

The documentation for the new JMS protocol is in its initial stages and Neotys needs to update their online support documentation with more information about it.

For how long have I used the solution?

I've been using it for over three years.

What was my experience with deployment of the solution?

We've not experienced any deployment issues.

What do I think about the stability of the solution?

There were a couple of times during a load run where NeoLoad crashed out but they were due to issues with our virtual machines rather than NeoLoad.

How are customer service and technical support?

Customer Service:

9/10

Technical Support:

9/10 - the Neotys support team is superb and very efficient.

Which solution did I use previously and why did I switch?

I have used LoadRunner for web, web services and Siebel protocols, but running and licensing costs were very high.

How was the initial setup?

It's very straightforward.

What about the implementation team?

Executable binaries made life easier during the implementation and do not require any advice.

What's my experience with pricing, setup cost, and licensing?

Compared to LoadRunner, NeoLoad licensing of users is very cost effective. The cost is very simple and well defined and you can check it on the Neotys site.

What other advice do I have?

You should attend a three day training course to fully understand the functioanlity of NeoLoad.

Screenshots:


Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user371331 - PeerSpot reviewer
Chief Technical Officer at PA Department of Human Services
Vendor
The real time performance monitoring allowed us to find out the troublesome queries and increase resource efficiency.

What is most valuable?

The ability to test mobile applications, support cloud based testing, real-time monitoring during a test, advanced auto-correlation feature, infrastructure monitoring, detailed results reporting etc. It also gives the ability to manipulate the script by inserting JavaScript. It's one of the features that very few other tools have.

How has it helped my organization?

First and foremost, it took out the painful resource hours out that went in to manually correlate each and every action of the script while using LoadRunner. NeoLoad does not require much of scripting efforts, and correlation and parameterization are fairly easy.

What needs improvement?

We would like the product to be able to handle large project suits with large number of test scripts. Currently, we are not able to upload/publish huge projects back and forth from the team server to the NeoLoad controller. There is no support for VT3270 terminal emulation to support mainframe-hosted applications. There is no summary graph that shows the distribution of all of the response times on a single graph. We currently export the data as a coma separated variable (CSV) file and import into Excel to generate this summary graph.

For how long have I used the solution?

4 years.

What do I think about the stability of the solution?

A small number of times, when load testing huge projects with huge number (~10,000) of vUsers, we have seen that it completely froze. We had to recover from the previously saved version of the project.

How are customer service and technical support?

Customer Service:

Very good, the vendor has been very accommodating with the ebb and flow of our business needs. Neotys is a partner.

Technical Support:

Good. (They decommissioned the support for 4.2 though)

Which solution did I use previously and why did I switch?

LoadRunner. Cost effective and with almost same features that are required for our project.

How was the initial setup?

Straightforward and the technical support folks will be available to help.

What about the implementation team?

We utilized a vendor team. They were fairly knowledgeable and knew how to quickly troubleshoot the issues or contact Neotys.

What was our ROI?

A great deal of improvement in application performance happened because we could pin point the bottlenecks. The real time performance monitoring allowed to find out the troublesome queries and tune them. Increased resource efficiency.

What's my experience with pricing, setup cost, and licensing?

Low in cost when compared to tools like HP LoadRunner. Talking about licensing, they offer a cool feature that enables us to split the Vuser bundle across multiple machines. In other words, we can have multiple controllers running multiple load tests at the same time.

Which other solutions did I evaluate?

JMeter. Figured that it would not be suitable tool for our project and requirements.

What other advice do I have?

NeoLoad is the performance testing solution for Web and Mobile applications that can also be used to run the tests from cloud by having load generator’s from various locations. If there is a strong performance team that can analyze and correlate the test results with the raw data, then NeoLoad would be the right solution.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.