PeerSpot user
Non Functional Test Manager at a government with 5,001-10,000 employees
Vendor
It enables my team to quickly record and modify test scripts.

What is most valuable?

Wasted time in low-end work (scripting) is greatly reduced with NeoLoad. It enables my team to record and modify test scripts very quickly. This reduces the effort for testing and enables the team to do more high-value work like analysis of results. We use external data analytics tools (Tableau) for result analysis. The export raw data feature in NeoLoad provides the extension with Tableau.

How has it helped my organization?

Performance testing is done by testing frameworks in which NeoLoad is the driver of load. The ability to extend the tool is crucial for organisations. Our test framework is composed out of NeoLoad as a centralised component surrounded by Tableau for analytics and AppDynamics for deep-dive diagnostics. This load test framework enables the team to more quickly test, find and resolve issues and system bottlenecks.

What needs improvement?

The weakest feature of most of the load test tools is result analysis. It is important we can customise graphs to visualise results in such a way that stakeholders can understand the outcome of testing. To be able to visualise results better, we extended NeoLoad with Tableau Software.

With Tableau, you can centralize performance related data in a database. Data can come from any tool, from log files or RUM tools and system utilities. Tableau provides you with the ability to connect to any data source, analyse patters and find bottlenecks more easily.  NeoLoad has made huge improvements over the last few years and finally has the ability to view the raw data (and not only aggregated results). This is fundamental for any type of performance engineering.  Aggregated results hide bottlenecks. 

How are customer service and support?

Customer support is very good.

Buyer's Guide
Tricentis NeoLoad
April 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
772,679 professionals have used our research since 2012.

What's my experience with pricing, setup cost, and licensing?

The price of the tool is competitive.

What other advice do I have?

The features introduced in the recently released new version of NeoLoad fit really well into the DevOps way of working, further reducing the time for rescripting. This enables rapid delivery and lean ways of working.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user371118 - PeerSpot reviewer
Software Engineer at a healthcare company with 1,001-5,000 employees
Real User
Easy to implement and you can start using it fairly quickly.

What is most valuable?

It gives us the ability to quickly create a script.

How has it helped my organization?

We are able to create load test scripts quickly in a fast paced environment, which in turn helps us identify performance issues.

What needs improvement?

The support needs to be improved, especially when you are looking for a quick turnaround because of the fast-paced environment we work in.

For how long have I used the solution?

We've used it for five years.

What was my experience with deployment of the solution?

We've had no issues with deployment.

What do I think about the stability of the solution?

It's rare, but sometimes the application will shut down.

What do I think about the scalability of the solution?

We've had no issues with scalability. You just have to add additional hardware as you increase the number of users.

How are customer service and technical support?

Customer Service:

8/10.

We have a very good partnership. They are always willing to work with us and help resolve any issues or concerns we have. They keep us updated on new releases and features that will be delivered.

Technical Support:

7/10.

Which solution did I use previously and why did I switch?

We previously used HP LoadRunner, but it was not easy to create scripts for a flex application.

How was the initial setup?

The initial setup was very easy.

What about the implementation team?

We implemented it with our in-house team.

What's my experience with pricing, setup cost, and licensing?

As you add more protocols and monitoring it does get expensive.

Which other solutions did I evaluate?

We looked at HP LoadRunner, SmartBear LoadComplete, and Appvance.

What other advice do I have?

It is very easy to implement and you can start using it fairly quickly.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
Tricentis NeoLoad
April 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
772,679 professionals have used our research since 2012.
it_user380010 - PeerSpot reviewer
Senior Load Test Engineer at a tech vendor with 501-1,000 employees
Vendor
several key features: Jenkins integration, infrastructure monitoring, and results analysis.
Pros and Cons
  • "There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis."
  • "It needs improvements in the UI. It's currently not as friendly as it should be."

What is most valuable?

There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis.

How has it helped my organization?

Implementing this product has allowed us to increase the number of projects that get load testing, and the frequency by which we re-test our performance.

What needs improvement?

It needs improvements in the UI. It's currently not as friendly as it should be.

For how long have I used the solution?

We've used it for seven years.

What was my experience with deployment of the solution?

We haven't had any issues with deployment.

What do I think about the stability of the solution?

We have never experienced any isuses with stability.

What do I think about the scalability of the solution?

The product has scaled very well up until this point.

How are customer service and technical support?

The support from Neotys is very good. Responses are timely and come from experienced, knowledgeable load testing professionals.

Which solution did I use previously and why did I switch?

We previously, and still use JMeter for some projects, in addition to Neoload.

How was the initial setup?

The initial setup is straightforward for basic usage. The setup for higher volume load testing is more involved, but I wouldn't say complex, as should be expected for an enterprise class load testing tool.

What about the implementation team?

We implemented it with our in-house team.

What's my experience with pricing, setup cost, and licensing?

It's priced based on the numbers of VUs, virtual users, that your needs require. The free edition gives you 50 VUs. The pricing is fair for high-volume licensing. Cloud VUs can be rented on-demand for bursts of higher capacity testing needs without permanent purchase.

Which other solutions did I evaluate?

We looked at JMeter and Webload.

What other advice do I have?

I highly recommend understanding load testing concepts before using any automation tool.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user200979 - PeerSpot reviewer
it_user200979Owner and Managing Director at a tech services company with 51-200 employees
Real User

I basically agree with this review. The 'Other Advice' is one of the most valuable parts. Whatever you are using, you need to understand what you are doing. A representative load test environment and sufficient coverage of the application being tested are often ignored, producing test results that will not predict the performance of your production environment.

it_user356646 - PeerSpot reviewer
Senior Manager Online Performance Engineering at Dell
Vendor
It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions. We also want to monitor applications within various environments, which NeoSense will soon allow.

Valuable Features

It is convenient to be able to keep up the pace in which the application code was delivered to us. Since we manage nearly 500-600 applications and we need to make sure they are tested, we wanted something robust with an option to check against previous baselines with minimal human intervention without sacrificing criteria.

We wanted something with less risk when incorporating or shifting scripts.

The fact that it loads from an external cloud is a plus as well.

It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions.

Room for Improvement

They are coming out soon with NeoSense. It's a hybrid between app management tools and a testing tool. This will be helpful for us because we'll be able to monitor applications within various different environments. This is precisely what we have wanted.

Use of Solution

We've been using it for a year.

Deployment Issues

We had no issues with deployment.

Scalability Issues

We used to have only 50 online users. Later we moved to where we are.

Customer Service and Technical Support

We have used their gold support option. Yes, we have been happy. They usually answer between 36 and 48 hours for non-critical issues, and with critical issues they hold your hand.

Implementation Team

We did it in-house.

Pricing, Setup Cost and Licensing

We didn't negotiate the price. To give perspective, we went from spending three million dollars to 160 thousand dollars, which is a huge saving and good value.

Other Solutions Considered

One of our goals was to find a platform that would have the functionalities that we were used to while incorporating in other ones. ProLoad was a competitor, and one other (can't make out name).

We wanted it to support agile and devops, while being able to upgrade to a number of releases over the course of a day, so it was a fit.

Other Advice

The company really strives on experience, always making sure that I as a customer am happy. For example, my team at Dell had an issue with our new version, which we had just updated to. Another team used a different version which required different protocols, and there were discrepancies between the versions. The company found out that our errors were user errors, and helped us fix the problem.

I helped them in terms of product development since we at Dell told them requirements and they added that to product life cycles. So we are a customer, but told them some requirements we'd like to see.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Ujwal Gaikwad - PeerSpot reviewer
Associate Software Engineer at Nts automation labs pvt ltd
Real User
Top 10
An easy-to-use solution that can be used for performance testing purposes, like load testing and stress testing
Pros and Cons
  • "Tricentis NeoLoad is quite easy to use as compared to JMeter."
  • "Tricentis NeoLoad crashes if an application contains more than 1,000 scripts."

What is our primary use case?

We use Tricentis NeoLoad for performance testing purposes, like load testing and stress testing.

What is most valuable?

Tricentis NeoLoad is quite easy to use as compared to JMeter. The other valuable features of Tricentis NeoLoad include correlation, parameterization, load testing, and file parsing.

What needs improvement?

Tricentis NeoLoad crashes if an application contains more than 1,000 scripts. Tricentis needs to improve in this area, and the solution should run smoothly even if thousands of scripts are imported into it.

For how long have I used the solution?

I have been using Tricentis NeoLoad for one and a half years.

What do I think about the stability of the solution?

I rate Tricentis NeoLoad a nine out of ten for stability.

What do I think about the scalability of the solution?

Around 10 to 12 users are using Tricentis NeoLoad in our organization.

I rate Tricentis NeoLoad an eight out of ten for scalability.

How was the initial setup?

The solution’s initial setup was easy.

What about the implementation team?

Tricentis NeoLoad can be installed in ten minutes.

What's my experience with pricing, setup cost, and licensing?

Tricentis NeoLoad is not an expensive solution, but it can be quite expensive if we need a license for load testing, depending on the organization level.

On a scale from one to ten, where one is expensive, and ten is cheap, I rate Tricentis NeoLoad's pricing a seven out of ten.

What other advice do I have?

I would recommend Tricentis NeoLoad to other users.

Overall, I rate Tricentis NeoLoad a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
PeerSpot user
Senior Performance Engineer at Ascend Learning
Real User
Best tool for testing in production without making many changes to the script or solution
Pros and Cons
  • "It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty."
  • "NeoLoad is best tool for testing in production without making many changes to the script or solution."
  • "NeoLoad does not support Citrix-based applications."

What is our primary use case?

Used for performance testing of applications on QA environments as well as production environments. NeoLoad is best tool for testing in production without making many changes to the script or solution.

How has it helped my organization?

It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty.

What is most valuable?

  • Integration of all components in one place.
  • GUI-based requests
  • Ease of use compared with other performance tools.

What needs improvement?

NeoLoad does not support Citrix-based applications. Neotys should take a look into this protocol.

For how long have I used the solution?

One to three years.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues. As far as Neotys NeoLoad, it is excellent in scalability.

How are customer service and technical support?

The support is good. 

Which solution did I use previously and why did I switch?

We started with NeoLoad.

How was the initial setup?

The initial setup is easy.

What about the implementation team?

The implementation was done in-house.

What was our ROI?

Our ROI is 100%.

What's my experience with pricing, setup cost, and licensing?

The licensing cost is less compared to other licensing performance testing tools.

Which other solutions did I evaluate?

We tried JMeter, but due to its support (which we found subpar), we had to switch to NeoLoad.

What other advice do I have?

You will love NeoLoad moving from open source and code-based performance tools.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Load Test Engineer at a government with 10,001+ employees
Consultant
All-in-one product with load generators deployed globally.

What is most valuable?

All-in-one product (design, runtime, results), easy scripting and variable correlation, and load generators deployed all around the world to simulate global traffic.

How has it helped my organization?

It is easier to do load tests using NeoLoad.

What needs improvement?

The only improvement that I wanted is support for load tests in agile mode. Neoload 5.2 makes this possible by updating the old versions of scripts with data from the new HTTP requests.

For how long have I used the solution?

I have 4 years of experience.

What was my experience with deployment of the solution?

The only issue that I had was with network virtualization on load generators installed on Windows Server 2008 R2. The link is sometimes cut between the controller and the load generators.

How are customer service and technical support?

10/10. Support is available, they handle issues very quickly, and they are very skillful.

Which solution did I use previously and why did I switch?

I used HPE LoadRunner. I think that NeoLoad is more user-friendly.

How was the initial setup?

NeoLoad is easy to deploy using the install wizard.

What about the implementation team?

Well, first I got trained by a vendor team. After that, I implemented more projects using NeoLoad.

My advice is that there should be a minimum of 4GB of memory on the servers on which you are installing NeoLoad.

What's my experience with pricing, setup cost, and licensing?

Neotys provides a free evaluation licence to use NeoLoad with up to 50 virtual users and all protocols included.

The product licence remains cheaper than HP LoadRunner, for example.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are a partner of Neotys. We do consulting for them.
PeerSpot user
it_user61302 - PeerSpot reviewer
IS QA Manager with 1,001-5,000 employees
Vendor
It's provided a faster turnaround on load-testing creation and the ability to use the team servers so multiple people can use this at once, which we couldn't do before.

Valuable Features

It makes it easy to create load tests. We used HP LoadRunner previously, and this is far better.

Improvements to My Organization

It's provided a faster turnaround on load-testing creation and the ability to use the team servers so multiple people can use this at once, which we couldn't do before.

Room for Improvement

It would be nice if this could be cheaper.

Use of Solution

I've used it for one-and-a-half years.

Stability Issues

It's been 100% stable, which we are very happy about.

Scalability Issues

Some of the additional modules can be pricey, but it is scalable.

Customer Service and Technical Support

Compared to support at our previous product, they're more responsive and they're more knowledgeable. Overall, it's three times better than our previous solution.

Initial Setup

The initial setup was very straightforward.

Implementation Team

We implemented it in-house.

Other Solutions Considered

We looked at JMeter, but NeoLoad had what we needed. We were using LoadRunner for six years and then we replaced it with NeoLoad.

Other Advice

Everyone's needs are a little bit different, so make sure you do a good POC.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.