Director at a tech services company with 1,001-5,000 employees
Real User
Top 5
Good visibility, easy installation, and helpful technical support that offers professional services
Pros and Cons
  • "The most valuable features of Catchpoint are basically the transaction monitors on the API and UI."
  • "There are essentially a lot of quotas. Nobody wants to sit and manually create monitors for someone who uses synthetic monitoring."

What is our primary use case?

Catchpoint is used for synthetic monitoring. For example, if you have a URL, you may want to ensure that your customer's journey is monitored from a user-experience standpoint. 

In Catchpoint, you can enter the user action, and that user action can then be configured as a script. Catchpoint will then continue to emulate that user's steps every 5 minutes or 10 minutes, as it is defined by you.

If you have a service product and have just exposed the API in your data. In those cases, you can perform API monitoring by passing sample data contracts and validating whether your API is responding to the query or not. It can also tell you what the time is, what the response score is, and so on.

What is most valuable?

That is the function of features. The most valuable features of Catchpoint are basically the transaction monitors on the API and UI.

What needs improvement?

Because these transaction monitors also monitor your product's entry-point URLs, there are numerous things it can do to improve. Assume you have a SaaS for a company, and they want to add a status page as a feature. When a company decides to set up monitors for their entry-point URLs, that status page can be exposed to customers as well.

Catchpoint can display downtime as the status whenever it detects it. And can be used by the company to demonstrate to their customers that there is a downtime occurring and that we are working on it, from the standpoint of customer communication.

That is the other issue, in that their API is extensive but also a lot. There are essentially a lot of quotas. Nobody wants to sit and manually create monitors for someone who uses synthetic monitoring.

With the direction of the industry, many people want to work in automation. Creating monitors as automation is an important aspect of their growth, which I did not see when I used it because they did not have an API for which you could actually create monitors.

For how long have I used the solution?

I have been working with Catchpoint for approximately five or six years.

As Catchpoint is a SaaS provider, we would be working with the latest version.

Catchpoint is a SaaS product that serves as a central monitoring tool. Catchpoint provides virtual agents, but you can also have your own nodes in your environment. 

In my experience, we have used a combination of the two. The nodes were set up on AWS in the cloud to monitor the health of internal URLs. Then, for the public, for example, for region-specific monitoring, we wanted to use a German monitor. Then, using Catchpoint, publish your virtual monitors and agents.

Buyer's Guide
Catchpoint
April 2024
Learn what your peers think about Catchpoint. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,857 professionals have used our research since 2012.

What do I think about the stability of the solution?

Catchpoint is a very stable solution.

What do I think about the scalability of the solution?

Scalability, I believe, is a perspective. From a scalability standpoint, it is good at times and bad at others, in my opinion. Assuming I have a single node, I'll show an example of Catchpoint hosted in my own environment.

If I host a Catchpoint node on my own and that node fails for whatever reason, there is no way for me to create nodes in a cluster so that if one node fails, the monitor picks up the other node and so on. On the UI, that is a manual configuration. I need to make a node group or something similar by grouping three nodes together.

If the load on a single node is high, Catchpoint does not distribute the load across the node group that was created. If they can handle it, it will be very, very good for scalability. Otherwise, their public nodes, such as the virtual agents that they provide, are sufficiently scalable. They can handle them on their own. The only issue with scalability arises when you deploy your own node in your environment.

It's our team, the observability team, which consists of about 5 to 10 people. We are in charge of setting up the transaction monitors.

Everyone who owns the product. They are used by product teams. Overall, in the company, there are approximately 5,000 users.

How are customer service and support?

Technical support is good.  They also provide professional services, which are good.

How was the initial setup?

It is fairly easy to set up.

We had it up and running in a day.

What's my experience with pricing, setup cost, and licensing?

In terms of licensing fees, I believe they were slightly higher. I believe their primary market is large enterprises, but from a licensing cost standpoint, I believe there are other tools available that provide the same functionality at a lower cost, such as Pingdom and others.

There are numerous sites available 24 hours a day, seven days a week. There are numerous other synthetic monitoring tools that compete with Catchpoint. However, I believe Catchpoint positions itself as a tool for large enterprises with money to spend, which is why they are expensive.

What other advice do I have?

I would advise them to use this product if they can afford it.

I would rate Catchpoint an eight out of ten.

They only lose two points for the cost; otherwise, the insights they provide are really good. There are not many competitive tools that don't provide them.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user7647 - PeerSpot reviewer
Director of Development with 51-200 employees
Vendor
Catchpoint Domain Override

In my previous blog A/B testing on CDN improvement we shared how to use A/B test to demonstrate the webpage performance brought by CDN. No matter what tool we used, it required customers to change their webpages to insert some JavaScript codes.

What if our goal is to minimize customer changes during the demonstration/proof of concept stage? I am going to demonstrate Catchpoint performance measurement service to achieve this goal.

Well, let’s take one step further to avoid ANY customer changes!

Catchpoint is one of the popular performance monitoring services. Many enterprises and cloud service providers buy Catchpoint solutions to monitor their websites and Internet services.

One cool Catchpoint feature is domain sharding/override. When it does page load test, Catchpoint can be configured to change the hostnames, say from A to B, in the HTML codes. By doing so Catchpoint will GET the HTTP objects from host B instead of A.

Let’s use this original webpage as an example. 82% of the page size comes from four images. I am going to do an A/B test on it. Original webpage is Test A. In Test B the four images will be delivered from EdgeCast CDN rather than the customer origin server in Singapore. This simulates actual CDN deployment on this webpage.

Step 1: I set up EdgeCast CDN services to cache the four images from the customer origin.

Step 2: I set up Catchpoint to test the original webpage from several Asia countries. This is Test A.

Step 3: I configure another test to test the original webpage again and use the domain override feature to change the original hostname (of the host of the four images) to the EdgeCast CNAME I set up in Step 1. This is Test B.

Step 4: This step is not a must-have and I use it for Control only. I add a new webpage in the customer origin. The new webpage is the same as the original webpage but in the HTML code I change the hostname of the four images to the EdgeCast CNAME I set up in Step 1. This is Test C.

I run the tests for 24 hours. Online reports: Test A vs B, Test A vs B vs C.

Below screen capture shows the page load time, response time and availability test results of Test A and B in the last two days. It shows Test B performed much better than Test A, Average Webpage Responses are 3962ms vs 5131ms, a 23% reduction. We did the test WITHOUT any customer changes!

Test A vs B
Test A vs B

You may wonder if Test B is a good simulation. Below screen capture shows the test results of all Test A, B and C. Test B and C results are similar (Average Webpage Responses are 3959ms & 4089ms respectively). I find the Catchpoint domain override feature is a good simulation of CDN deployment.

Test A vs B vs C
Test A vs B vs C

Disclosure: My company is partners with several vendors

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Catchpoint
April 2024
Learn what your peers think about Catchpoint. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,857 professionals have used our research since 2012.
it_user2544 - PeerSpot reviewer
Developer at a media company with 501-1,000 employees
Vendor
Easy to use, full of features, outstanding support

Valuable Features:

Catchpoint is clearly the leader in the industry on pretty much every metric you look at (aside from market share...for now), and blows Keynote/Gomez out of the water when it comes to features and support. Mehdi (the CEO) is accessible at all hours of the day and night for any and all questions, and his average response time must be under an hour. Catchpoint has everything you could want in a synthetic tool, and many things that you didn't know you wanted but you are ecstatic to have. I can't say enough good things about the people that work at Catchpoint and their commitment to building the best product in their space.

Room for Improvement:

The only thing that occasionally bugs me about Catchpoint is some aspects of the UI. It's not an easy problem, and I don't know how I would solve it, but because of the large volume of data that they are presenting and the various ways to slice it, you can end up with a proliferation of windows when debugging an issue. This is something that I expect to improve in the near future, since Catchpoint has rapid releases and is extremely receptive to customer feedback.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user7953 - PeerSpot reviewer
VP of Systems Engineering at a tech company with 51-200 employees
Vendor
We use both pingdom and catchpoint, by far my favorite is Catchpoint

The transition to Real User metrics is not at all related to using an average. All recording and instrumentation processes will benefit through using more sophisticated and nuanced tools than a simple average. Real user metrics are an important data point, but they lack certain information you can get from external monitoring systems. We use both pingdom and catchpoint, by far my favorite is Catchpoint because I can see things like what ISP is involved with a slow request, what geographic region, etc. I can also get scatter plots and nice statistical graphs around median, geometric mean, 75th, 95th, 99th percentile.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user7773 - PeerSpot reviewer
it_user7773Operations Expert at a tech vendor with 10,001+ employees
Vendor

I can say that I have been using Anturis to monitor the application performance as this very tool is compatibale a lot with the apps i am using.As for Pingdom, I don't think that they offer ggood support to their numerous customers.

Buyer's Guide
Download our free Catchpoint Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Catchpoint Report and get advice and tips from experienced pros sharing their opinions.