We performed a comparison between OpenText LoadRunner Cloud and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."The solution can scale."
"The reports are very relevant to the customers’ expectations."
"Keeping up with DevOps, thus the best feature of StormRunner is that we don't have to build and maintain infrastructure anymore."
"It's fast, easy to use, has a user-friendly UI, and you can split users."
"The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it."
"This solution is SaaS based so we can utilize cloud technology, which is less time consuming and saves a lot of of money."
"It is feature-rich. It supports most protocols, which is important because I am in charge of a team at the bank, and we do performance testing for all kinds of different applications. We have tons of them. We even do video streams."
"The fact that the solution supports multiple protocols such as open source, VuGen, TruWeb, TruClient, and SAP is very important because these protocols help us to concentrate on what is really needed to produce performance tests. If something is not supported, you have to use other tools or find other ways of assimilating loads."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"It has significantly enhanced our testing accuracy by approximately 50%."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"I never faced any issues with the stability."
"Sauce Connect gave us ability to test an application that was hosted locally."
"Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"In terms of new features, they can natively integrate with Chaos engineering tools such as Chaos Monkey and AWS FIS. With LoadRunner, we can generate load, and if Chaos tools are also supported natively, it will help to get everything together."
"It should have a feature to report with a 99.9 percentile success rate."
"The support team provides delayed responses."
"Scriptless automation is an area that can be improved."
"I would like for there to be better integration with other tools so that when you do load testing you can also do a security check."
"There is a steep learning curve for the product, too."
"I don't know of any features that should be added. The solution isn't lacking anything at this point."
"The product must provide agents to monitor servers."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"Running tests in the SauceCloud can take longer than running in a local environment."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
OpenText LoadRunner Cloud is ranked 6th in Performance Testing Tools with 39 reviews while Sauce Labs is ranked 11th in Functional Testing Tools with 113 reviews. OpenText LoadRunner Cloud is rated 8.2, while Sauce Labs is rated 8.8. The top reviewer of OpenText LoadRunner Cloud writes "Supports multiple protocols and helps to ensure that our applications are stable at any given point". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". OpenText LoadRunner Cloud is most compared with OpenText LoadRunner Enterprise, Tricentis NeoLoad, OpenText LoadRunner Professional, BlazeMeter and Apache JMeter, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Bitbar and Tricentis Tosca.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
