We performed a comparison between Katalon Studio, Sauce Labs, and Visual Studio Test Professional based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Regression Testing Tools."This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"It is a good tool and provides all the essential features for our business requirements."
"The functionality of the data is very good. You can upload and disperse data using the solution."
"It is easy for a non-technical person to use and adopt."
"The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
"The scalability of the product is good."
"User-friendly and a good solution."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"Testing subscription videos for on-demand software, making them better quality and bug free for our customers."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"It runs on the cloud, so you don't have physical setups to run all of this."
"There is a huge amount of open source, community provided resources."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"It is a good and user-friendly tool."
"Visual Studio Test Professional is a scalable solution."
"The tool has highly detailed debugging features."
"Easy to use and easily scalable."
"The most valuable features are tools like IntelliSense and ReSharper."
"I was satisfied with the support given by customer service."
"The most valuable features of the solution are its ease of use and availability."
"Performance-wise, it is a great tool."
"The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."
"The Object Spy is rather frustrating to work with, so I tend not to use it."
"I've seen that our clients are not truly aware of the power behind Katalon."
"Katalon doesn't support testing of hybrid applications. It's a limitation."
"During parallel execution, some reports are randomly switched."
"I can say that in my company, we struggle a lot with iOS automation."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"There is not much support offered for the free version, which is something that could be improved."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"I would like to see improved network connectivity and it should allow playback for native apps."
"This product is not super scalable, because you have a very specific number of VMs that you can use."
"It should provide more examples of script code."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"One of the problems with this solution is you need to be highly technically skilled to operate it, it is not for everyone."
"The documentation is limited."
"The pricing of this solution should be lowered."
"The server that we use is very slow so that is concerning for us."
"The tool crashes and has high memory consumption."
"It could be available for multiple platforms and other operating systems like Mac with a native port."
"It would be great to support other languages and applications, and that is one of the things we can improve."
"Sometimes Visual Studio is slow. It uses a lot of resources like memory and processing power. You should optimize the performance by only installing what you need on your machine. Don't install unnecessary things that will slow your machine."
More Visual Studio Test Professional Pricing and Cost Advice →
