We performed a comparison between CrossBrowserTesting and Sauce Labs based on real PeerSpot user reviews.
Find out in this report how the two Functional Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."I am able to continuously test my new releases across browser versions without issues."
"It has increased the speed of our regression testing."
"The ability to choose from many devices is the best feature."
"I have found CrossBrowserTesting to be scalable."
"This solution helps lower the overhead cost associated with buying multiple devices."
"It was the perfect solution that saved us time and money to perform web viewing tests on real devices, which allowed our team to correct multiple failures in devices."
"The support team is top-notch. I have a great relationship with them. They are extremely honest and responsive."
"Record and Replay is the most used functionality for us, as we can record the test cases and play them on multiple combinations of platforms."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"So far, the stability has proven to be quite good."
"As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side."
"Easy to integrate with the other platform for tracking purposes."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"A wider range of physical devices with more browser versions in the Selenium Grid would be great to insure users with out-of-date devices are able to interact with our sites."
"The five minute timeouts can cause irritation if you have just popped away to consult some supporting documentation."
"The "Getting Started" documentation for Selenium testing could be improved."
"Being able to test on real devices via the virtual connection is wonderful, but it can cause some lag and load time issues while testing."
"The screenshot tool defaults to a screen layout instead of a full page test. I find it a bit cumbersome that I can't have it run a full screenshot as my default."
"The speed connection in mobile devices could be improved, because sometimes the load time is uncertain."
"I have had quite a few issues trying to use a virtual machine to test our application on."
"Elements of 'real' mobile/tablet testing could be sped up."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
Earn 20 points
CrossBrowserTesting is ranked 28th in Functional Testing Tools while Sauce Labs is ranked 11th in Functional Testing Tools with 113 reviews. CrossBrowserTesting is rated 9.0, while Sauce Labs is rated 8.8. The top reviewer of CrossBrowserTesting writes "Static screenshots are the feature most often used, because they are a simple method of detecting problems". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". CrossBrowserTesting is most compared with BrowserStack, Bitbar, Tricentis Tosca, LambdaTest and Automai AppVerify, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Bitbar and Tricentis Tosca. See our CrossBrowserTesting vs. Sauce Labs report.
See our list of best Functional Testing Tools vendors.
We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
