OpenText LoadRunner Cloud Room for Improvement

Richard Dachowski - PeerSpot reviewer
Senior Quality & Test Architect at a government with 1,001-5,000 employees

Enterprise is the next level up for professionals. But if you have the cloud version, you are almost there. Because that was the way it used to be. They didn't previously have the cloud version. You had LoadRunner Enterprise, and you had LoadRunner Professional. 

Since the cloud has become more and more important, they have now expanded that, and they have now the cloud version as well. We use both.

There are always areas that can be improved.

One area of improvement in the software's support is the replaying of captured data within the development environment. 

It would be beneficial if the replay feature could accurately mimic what the actual application is doing for better analysis and testing.

As web technologies have evolved rapidly in the past few years, the software has included a runtime viewer to debug scripts along with other logging features.

However, the additional logging can be expensive, and the runtime viewer needs to be updated to better support newer web technologies.

The logging feature itself is not problematic, but the discrepancy lies in the outdated runtime viewer's inability to effectively support newer web 2.0 technologies, leading to a less visually appealing and potentially less informative display. 

Despite this deficiency, users can still access all the necessary logging information and tailor it to their needs.

In summary, although the logging feature in LoadRunner Cloud is useful, there is a discrepancy in the runtime viewer when dealing with newer web 2.0 technologies. However, you can still access all the necessary logs and set them according to your needs. The main issue is the lack of ease of use in the runtime viewer, which needs to be modernized to better support newer technologies.

There is a reporting component of the cloud that could be improved, but it could simply be different from what I'm used to. I'm more accustomed to using the analysis program included with the on-premise software, whether LoadRunner Enterprise or LoadRunner Professional. 

The analysis engine, one of three major components of the entire software package, examines the data collected by the load test, or performance test, I am not familiar with what it is referred to as and produces a variety of reports. 

They do that on the cloud as well, but I'm not sure if it's as detailed, and we may not have as much control over what you want.

They do that on the cloud as well, but I don't know if it's as and it seems to be pretty detailed, but we maybe not have such much control as to what you want to get, but I think it's still more than adequate in the in most cases.

View full review »
DP
Cloud Manager at a financial services firm with 5,001-10,000 employees

Initially, there were a couple of things, but they got resolved. When they released it three years back, they were not supporting multifactor authentication. We use Okta. In my business unit, we are using Okta integration or authentication. They were not supporting that earlier, but we requested them, and they implemented it. At this time, I do not see anything that they need to improve in existing features.

In terms of new features, they can natively integrate with Chaos engineering tools such as Chaos Monkey and AWS FIS. With LoadRunner, we can generate load, and if Chaos tools are also supported natively, it will help to get everything together.

View full review »
Aurobindo Sahoo - PeerSpot reviewer
VP at Deloitte

We're interested in leveraging the scriptless automation capabilities available in several tools. Some of our less technically inclined manual QA testers find them insufficient. They crave drag-and-drop functionalities or more intuitive scriptless automation options. Scriptless automation is an area that can be improved.

View full review »
Buyer's Guide
OpenText LoadRunner Cloud
March 2024
Learn what your peers think about OpenText LoadRunner Cloud. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.
PH
Performance & Analytics Team Lead at a financial services firm with 10,001+ employees

While evaluating tools and saying that this is the tool we are going to go with, one of the biggest challenges that I faced was related to our previous experience with Micro Focus. LoadRunner and Silk Performer used to be under Micro Focus before OpenText bought it. Towards the end, Micro Focus did a big money grab where they went around and harshly audited all the companies. My company got hit with millions of dollars for the software that should have been removed. Even though no one was using it, we still got hit. It left a horrible taste and a horrible reputation for Micro Focus at my company. I know OpenText is a different company, but OpenText needs to somehow address and show former Micro Focus clients or LoadRunner clients, Silk Performer clients, and ALM clients that they are not the same company. I come to this conference and I get this message, but I have to try and sell that to my manager. The manager who got hit hard with the charge is not going to believe me. He still has that bad taste. They are influential people, and they remember that, so OpenText somehow has to overcome that.

Their documentation is not technical enough for us. We would like to have much deeper technical documentation so that we can self-serve without constantly having to go back to them and ask.

View full review »
VP
Senior Manager - Performance Architect at Publicis Sapient

If you get a raw file on a standalone instance, you are on your own to splice and dice the results. I want to see errors versus response time, and I want to see how throughput was performing when there was a spike in error or response time at a certain period of time. These type of options are not available on LoadRunner Cloud, and they would make the user's life easier and would help him drill down to the exact time.

In the next release, it would be nice to have more coverage in terms of load generators. Then, you would be able to drill down on the raw research and analyze more in terms of response time spikes or errors.

CI/CD integration could be a little bit better. When there's a test and if you see that there are high response times in the test itself, it would be great to be able to send an alert. It would give a heads-up to the architect community or ops community.

View full review »
SN
Performance Test Lead at HTC

We encounter hurdles while running the professional version for on-premise setup. They should work on this particular area of improvement.

View full review »
SamirPatle - PeerSpot reviewer
Senior Performance Analyst at EPAM Systems

The product must provide agents to monitor servers. If we want to monitor our servers, we should be able to do it by integrating the servers with LoadRunner Cloud’s dashboards. The added feature will enable us to see exactly what is happening in the servers at a particular time.

View full review »
GA
- at a financial services firm with 10,001+ employees

One area for improvement in LoadRunner Cloud, especially for agile models, is its limited support for functional testing alongside its robust non-functional testing capabilities. Unlike some other tools in the market that offer both functional and non-functional testing within a single platform, LoadRunner requires separate test scripts for each, doubling the testing effort.

View full review »
Rachit Raj - PeerSpot reviewer
Head -Consulting and Delivery at Avekshaa Technologies

There are two features that I would want MicroFocus to work on.

1. It should have a feature to report with a 99.9 percentile success rate.

2. We should be creating a performance dashboard with InfluxDB OR ElasticSearch integration with Micro Focus Cloud LR. We need Micro Focus Cloud LR to send feeds to InfluxDB OR ElasticSearch for each run for:

1) Realtime PT result publishing
2) Trending between runs
3) Data mashing with Grafana/Chronograf
4) Live alerting

The feed from the Micro Focus Cloud LR instance to InfluxDB should be configured, or an integration touch point should be available for sending real-time feeds into the DBs.

View full review »
AB
Lead Performance Test Engineer at bol.com BV

Reporting and analysis need improvement. Compared to the old school LoadRunner Windows application, the reporting and analysis are mediocre in LoadRunner Cloud.

View full review »
CM
Senior Performance Engineer at City of New York

There are three modules in the system that are different products packaged into one, and they can sometimes be difficult to figure out, so they should be better integrated with each other.

The current support model is something that can be improved.

View full review »
PavanKumar2 - PeerSpot reviewer
Sr Consultant at a computer software company with 501-1,000 employees

While executing the test it automatically refreshes and I need to see the downwards component, however, it's not allowing me to see that. since it's automatically refreshing, I'm unable to see all the lines in that tool that we are seeing in the editor window.

We did have some challenges with the initial implementation.

View full review »
MD
Sr. Technical Test Analyst at a educational organization with 1,001-5,000 employees

When it comes to the CI pipeline, there were some limitations initially, but the latest version of LoadRunner is very helpful. They can integrate into the CI/CD pipeline. We are trying to put it into a complete CI/CD pipeline, but there are still some challenges when you try to run it through different protocols. The challenges are around how you can containerize applications. There are some limitations to some protocols, such as desktop. And when it comes to database testing, there are some things that we can't do through CI/CD.

For CI/CD, the previous versions may not be the right ones, but the latest version is definitely a step ahead. We are aiming for 100 percent, but we have achieved around 60 to 70 percent in CI/CD. Still, it's very good to have that capability.

Also, it would be helpful if Loadrunner Cloud had the same kind of enterprise environment where we had multiple models and options while creating the load profile. Not all the options are available in the LoadRunner Cloud. If they could be added, it would be good.

View full review »
Abbasi Poonawala - PeerSpot reviewer
Chief Enterprise Architect at a financial services firm with 10,001+ employees

The performance has really improved in terms of running test cycles. The product used to crash on-premises and when it had a lot of trades being pumped in. Because it is memory intensive, it used to crash if it was running out of memory. That was the limitation of the on-premises thing. Running those states and cycles in the cloud is much faster. 

Everything is frozen in the cloud. The RAM, CPU, compute, and storage are provisioned in the cloud, which is becoming easier for running these test cycles. Test cycles are highly effective. Of course, you need to have a test strategy, like volume-based load testing. Configure some test cases and run those test cases in cycles. Cloud performance is much faster. Volume-based endurance testing is easier in the cloud.

View full review »
AK
Senior Performance Engineer at a retailer with 1,001-5,000 employees

More insight into test results and allowances. It might be a tailor-made requirement for me, but I would like to download them offline and do my own customizations on the reports. Right now, we have some standard templates that generates reports. But if I had to do some customizations, include something else and create a report, it's not easy. So, if I can an order to download the raw data I can make custom report. That would be the case with every customer because even though they tested one product it might be part of a big project and they need to have other information included in it along with the report, so feasibly it is good to have.

Also, it's evolving, where there's too many features for me to handle and it's too much on my plate to any make ROI out of it.

There is a steep learning curve for the product, too.

View full review »
AK
Supervisor, Quality Assurance at a financial services firm with 10,001+ employees

The product must improve support. The support team provides delayed responses. Many times, there are a lot of conversations between the support team and the technical team without any conclusions.

View full review »
HM
Lead Software Engineer ( Performance Engineering Salesforce) at a tech company with 10,001+ employees

They should minimize the use of coding for the solution. Also, they should include features to import other scripts without rewriting them.

View full review »
PL
Performance Diagnostic Engineer at a tech vendor with 10,001+ employees

The product price could be more affordable compared to similar products.

View full review »
CS
IT Project Analyst at a tech services company with 10,001+ employees

An area for improvement is analytics on why response times are slow from certain countries. Slowness can be caused by the laptop, the connection, the VPN, the internal network, the country's internet, etc.

View full review »
it_user468114 - PeerSpot reviewer
Senior Performance Analyst at a educational organization with 1,001-5,000 employees

I think the reporting could be better. I think you could have a little more variety of reports. Right now, you get an email saying, "Here's your report". You can't put in the analysis tool. You can't export it to Excel. Those are the things that would make it a little better. That's probably my biggest pain point, it is the reporting.

View full review »
it_user230619 - PeerSpot reviewer
Performance Architect at Gallop Solutions

Custom load patterns for the performance tests: Currently StormRunner Load supports only linear ramp up of the user load and doesn’t provide the user load to follow a step incremental load pattern or any other pattern that a performance tester wants to.

Load distribution among on premise LGs: StormRunner Load currently supports load generation from only one of the On premise load generators and the user load cannot be distributed to multiple on premise LGs.

Simulation of latencies: There is no provision to simulate network latencies to simulate realistic geographical locations and mobile networks.

Ability to create custom reports: StormRunner Load provides only the default reports and there is no provision available currently to generate the custom reports

Backward compatibility: StormRunner Load expects the LoadRunner scripts that are generated from LR 12.00 and above. Any scripts developed using the older versions are not supported.The work around to overcome this problem is to open the scripts in LR 12.00 or higher and save it again before uploading to StormRunner Load..

View full review »
it_user273663 - PeerSpot reviewer
QA Load Tester with 1,001-5,000 employees

The monitoring abilities were lacking. The reporting didn’t present the information in a clear manner for me. It took me four days to understand why I couldn’t upload the scripts from my computer to the cloud, and I discovered I was missing an important feature that StormRunner Load is missing, called Corver, and this converts the script for the tests.

View full review »
it_user671397 - PeerSpot reviewer
Test manager at a financial services firm with 10,001+ employees

I'd like to see more ability to dive more deeply into the configuration.

View full review »
it_user426591 - PeerSpot reviewer
Lead Performance Architect at a tech company with 1,001-5,000 employees

Monitoring and sample access to servers needs to be provided, so that we can explore this and keep up-to-date.

The licensed version / free edition needs to be configured with SiteScope or AppDynamics, which many customers might not have. The LoadRunner feature of Windows Resource Monitor should come in handy in such scenarios. It is not only for Windows-based monitoring but also for UNIX-based monitoring. Dependency on the other tools or HP tools (SiteScope) would be reduced.

It needs to be more mature.

The client breakdown is a separate report and is not part of the existing load test report. The client breakdown is basically the response time observed from different browsers. We need to take a snapshot and place it in the load test report and that is not available when the load test report is generated from StormRunner.

Also, for the VuGen Web protocol, it supports only 12.50 and above, which is tough and compatibility is lost.

View full review »
it_user468132 - PeerSpot reviewer
Consultant/Partner at a tech consulting company with 501-1,000 employees

I'm a consultant and this was used for a small project. My customer bought around five consulting days from me. We ran into some undocumented limits around the number of concurrent users. It was really just set up to keep the guys out that wanted to do denial of service using the demo account. It was not clear that this was the limit it would hit. That's expensive for a company. Out of five days, maybe half a day. That's 20% of the budget went into trying to run a test. The test fails, contact support, ask what's going on. Make them move the limit and then re-run. That was bad. It should just be upfront - these limits exists, be sure before you start that you don't want to move them.

View full review »
it_user251874 - PeerSpot reviewer
Performance Analyst at a educational organization with 1,001-5,000 employees
  • Improved PDF reports and creating custom reports
  • Real world- custom scenario setup
  • Update existing scripts online without uploading them again
  • Run time settings update in scenario
View full review »
it_user567969 - PeerSpot reviewer
Test Architect at a engineering company with 1,001-5,000 employees

It needs more features; a lot more features. Everything that's in LoadRunner Analysis should be built up in StormRunner; so we can use everything, every functionality and every feature all together.

View full review »
it_user469167 - PeerSpot reviewer
Solution Architect at a tech company with 501-1,000 employees

I think the biggest issues that I've seen, and this is a personal view of mine, is that most of the HPE products have a common look and feel to them. I'd really like to see it be a little more customizable to a use and user standpoint. For example. I happen to be colors blind, so I'd like to see more vivid colors on the UI, and things like that. It would make it a little more flexible from the customer standpoint.

View full review »
it_user232020 - PeerSpot reviewer
Senior Test Analyst with 1,001-5,000 employees

At the moment, its a bit early for us to tell - does everything we need it to. HP is looking to expand to see what exactly it can be used for.

View full review »
it_user197508 - PeerSpot reviewer
Performance Test Architect and HP ALM Expert at a tech services company with 10,001+ employees

It needs the ability to execute other protocols, especially the TruClient for Firefox without having to convert them.

View full review »
it_user272247 - PeerSpot reviewer
Software Team Lead with 501-1,000 employees

I think the report page could be improved, although we have used the reporting feature. It wasn’t accurate enough to use as a report that I could send my managers. I had to take additional screenshots to help fill in the reporting. I actually, ultimately, generated a report on my own.

View full review »
it_user232248 - PeerSpot reviewer
Strategic Account Manager with 51-200 employees

The documentation could absolutely be improved and scripts. For example, during a performance test, the monitoring graph is not very clear as to what its representing. I wasn’t sure what the graphs represented so my guess is a lot of customers feel the same way.

View full review »
it_user739593 - PeerSpot reviewer
Snr Performance engineer

Sometimes, you are utilizing one of the low generators, then all of a sudden if you discontinue from one project, it actually deletes the entire low generator. You have to go through all the setup again. This kind of problem is on and off. It comes and goes.

View full review »
JI
Database Leader at Skupos Inc.

Improvements to the reporting would be good.

Technical support can be improved.

View full review »
it_user739599 - PeerSpot reviewer
Support director of academic systems

Right now, we are just starting to use it. I don't have any comments on that.

View full review »
it_user54837 - PeerSpot reviewer
Sr. Director - Quality Assurance at a educational organization with 501-1,000 employees

Out of the box reporting could be improved.

View full review »
it_user368772 - PeerSpot reviewer
Technical Sales at a tech services company with 501-1,000 employees

It doesn't provide custom reports. You can only use the default reports which contain irrelevant data or is missing data that we need.

Also, a lot of our customers have issues logging into the cloud.

View full review »
it_user240087 - PeerSpot reviewer
CEO and Co-Founder with 51-200 employees

When you start a test, it takes times to initiate.

View full review »
SP
Technical Architect at a tech services company with 51-200 employees

I don't know of any features that should be added. The solution isn't lacking anything at this point. We're happy with what is on offer.

View full review »
Buyer's Guide
OpenText LoadRunner Cloud
March 2024
Learn what your peers think about OpenText LoadRunner Cloud. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,386 professionals have used our research since 2012.