Sauce Labs Review

Enables faster execution of regression tests without having to support the software needed to validate regressions against different devices

What is most valuable?

  • Running tests in parallel
  • Sauce Connect Proxy tunnel
  • JIRA/Bamboo plugins

How has it helped my organization?

Enables faster execution of regression tests without having to support/maintain the software needed to validate regressions against different devices, OS, and browsers.

What needs improvement?

Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs).

For how long have I used the solution?

Less than a year.

What was my experience with deployment of the solution?

None yet.

What do I think about the stability of the solution?

Not yet.

What do I think about the scalability of the solution?

Not yet.

How are customer service and technical support?

Customer Service:

Excellent, so far.

Technical Support:

Excellent, so far.

Which solution did I use previously and why did I switch?

Yes. We built and managed all of our testing infrastructure in-house.

How was the initial setup?

Pretty straightforward, except when you begin working within an enterprise organization that operates nearly all of its web applications behind a firewall. To get our automation running inside Sauce Labs's infrastructure, we first have to install and configure the Sauce Connect Proxy server. The complexity of setting up the tunnel comes mainly from the protocols our organization has for getting the approval to implement Sauce Labs behind our firewall. Explaining the details of the tunnel, why we need Sauce Labs for regression testing, and facilitating the connection between our Server's team with a Sauce Labs technical resource were all fairly complex.

What about the implementation team?


What was our ROI?

It is difficult to estimate at this time.

What's my experience with pricing, setup cost, and licensing?

Start small, even if you are a large-to-enterprise level organization. The setup cost, if you're an enterprise-sized organization, is negligible. Establish a few quick and easy "wins" for one or two product teams. Hold a post-Sauce review with all the stakeholders within each team with the goal of reaching a consensus on whether the product is a good long-term fit. If the answer is yes, then calculate ROI, and if it makes sense, scale up and spend the money so every product that should use Sauce has access and the correct bandwidth.

Which other solutions did I evaluate?

SmartBear, Perfecto, and Ranorex.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Add a Comment
Sign Up with Email