We performed a comparison between Sauce Labs, Selenium HQ, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"It has significantly enhanced our testing accuracy by approximately 50%."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place."
"It supports multiple processes, which is great."
"The ability to present your tests on a wiki page and hooking them up to the scripts/fixtures."
"The most valuable feature is the Selenium grid, which allows us to run tests in parallel."
"There are many useful features in Selenium that I like, and of the new features I particularly enjoy the Selenium Grid. With this, we can run many test cases in one go, and in one suite we can extract multiple results."
"The tool is easy to use and log in with respect to other tools. It is open-source. We can customize the product. I also like its security."
"I am impressed with the product's ability to catch content from website."
"The most valuable feature of Selenium HQ is it provides support for third-party tools, such as screenshots, and automates Windows-based applications."
"It is a scalable solution."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"An image comparison would be a nice feature to include in the Sauce Labs product."
"I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"Running tests in the SauceCloud can take longer than running in a local environment."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"There are some tiny issues with SeleniumHQ. For example, with respect to the scraping tests. Sometimes, a website will have some hidden items or blockages that inhibit us from extracting data directly. It would be beneficial if Selenium could extract that information."
"We do not have enough resources or enough people to employ and hire. So, I'm hiring whoever I find, and they don't always have enough technical knowledge to operate Selenium."
"Katalon has built a UI on top of Selenium to make it more user-friendly, as well as repository options and the ability to create repositories for objects, among other things. It would be helpful if this type of information could be included in the Selenium tool itself, so people wouldn't have to do filing testing."
"I continuously see failures in threads when it is running in parallel."
"The solution is open-source, so everyone relies on the community to assist with troubleshooting and information sharing. If there's a complex issue no one has faced, it may take a while to solve the problem."
"One limitation of Selenium is that it is purely focused on web application testing."
"It takes such a long time to use this solution that it may be worth looking into other free solutions such as TestProject or Katalon Studio, or paid solutions to replace it."
"Shadow DOM could be improved and the handling of single page applications. Right now, it's a bit complicated and there are a lot of additional scripts required if you want to handle a single page application in a neat way."
"I would like to see an improvement in the User Interface."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
Earn 20 points