We performed a comparison between Bitbar and Sauce Labs based on real PeerSpot user reviews.
Find out in this report how the two Functional Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Ability to use different frameworks."
"Game testing and the API for apps are good."
"As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"There is a huge amount of open source, community provided resources."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"The insights section provides a great overall state of the automation suite and can identify trends relatively quickly. If we see a dip in our passing rate over time, we can look at what changed when the test started failing to find the root cause rather than doing a quick fix to find that the test fails a short time later."
"It has a wide assortment of platforms."
"Lacking capability options that can be directly integrated."
"Their pricing structure is complicated and can be improved."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"I would like to see improved network connectivity and it should allow playback for native apps."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
Earn 20 points
Bitbar is ranked 27th in Functional Testing Tools while Sauce Labs is ranked 11th in Functional Testing Tools with 113 reviews. Bitbar is rated 7.0, while Sauce Labs is rated 8.8. The top reviewer of Bitbar writes "It's helped me when I've been short of devices and want to test whether the application will work on a specific device or not". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Bitbar is most compared with BrowserStack, SmartBear TestComplete, CrossBrowserTesting, LambdaTest and Perfecto, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Katalon Studio. See our Bitbar vs. Sauce Labs report.
See our list of best Functional Testing Tools vendors.
We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.