Easily map between transaction and method recall
Useful automatics alerts
Easily understand graphics
Easily map between transaction and method recall
Useful automatics alerts
Easily understand graphics
The way these tools show the information is very useful. this is a tool that records information from Java and .NET applications, and obtain information about how many times an method has been call in a period of time (usually 30 sec), how many times respond in this span of time or is delayed or stall.
Usually you can map the java / .NET method to some type of transaction, so the graphic shows how the transaction is working (or not working) then you can establish a base line and alerts when the behavior is not that is expected.
The graphic display that shows the variables in the time is very intuitive and almost everyone is able to obtain useful information.
You can add other standard monitors like SNMP or even personalized monitors that are integrated with the platform. the platform itself is easily integrated whit the manager of manager (CA Spectrum or others) or even you can access the database with affect the tool behavior. We have been integrating the tool with splunk in a way to obtain deep correlation.
Release new features, but in an intelligent way. We need more capabilities to analyze the information that tools collects; for example, using artificial intelligence, or something like that. There is a lot of artificial intelligence, for example, in cars, and other things. These technological advances has not been translated to the monitoring tool yet. We would like something like AI in monitoring tools. There is a lot of information to correlate and useful information to obtain about what is happening in the company's systems.
Some few times the agents lost connection whit the manager, but usually for changes made in the java / . net server.
The solution is technically scalable, but it is very expensive for our business especially it the way that CA calculates the price, that is based on the number of processors. If we use it too much, it will be too expensive.
Customer Service:
It is fairly good.
Technical Support:
We have the solution in a SaaS schema with a local partner, they give us the first and second level support then the partner used the CA support. I have not worked directly with the CA service or with technical support but I fell it is not the best.
Nope similar, there was a tool from IBM but was not as good as this one.
Initial setup was very fast. It was very easy to deploy.
We need to be able to obtain new solutions for full feet new necessities . When there is a new technology, if the application is not able to monitoring it, we must research new technologies to enable monitoring these new technologies. Now we are looking for a news solutions.
This was the model we used when we made the change a five years ago. We also considered IBM and HPE. We chose CA APM. They do the most for us.
Ensure use the tools to develop good instrumentation and to make the best use of its capabilities; for example, to define correlations and setting the levels when alarms must be sent.
Detailed alert settings give more control on when they should or should not appear.
The tree-structure tracing shows where we are spending the most time in a call-by-call sequence. But the tracing capabilities of other APM tools are more advanced than CA.
APM tools are essential for finding performance bottlenecks and pervasive issues. It gives a high level point of view on where there is a problem. This tool, in particular, is not as good at deep dive analysis. Newer versions, like 10.5 with AXA, Dynatrace, and AppDynamics may be better at going deeper into root-cause analysis.
Deep dive analysis and performance need improvement. Introscope scalability performance lags behind for our team, which looks after 3,000 JVMs and millions of metrics.
I have used this product for a half a year.
The product is stable most of the time. However, like any software out there, there are bugs. Few crashes have been experienced, but incorrect metrics and improper collector behaviours have been observed.
We have had scalability issues. Performance slows down with the number of JVMs our team supports.
I would give technical support a rating of 7/10. Few people are available to support the product. However, good, proper attention is given to urgent matters.
We didn’t have a previous solution.
I was not involved in the initial setup.
This is out of my scope.
Other alternatives are being actively considered.
It's for monitoring application performance and end user experience.
It secures traffic through the HTTPS. There are a huge number of cipher suites which are enabled. Unfortunately, some of the cipher suites are not being recognized by the APM tools. However, we are able to manage with the other cipher suites in the market, apart from ones offered by CA APM.
We have had a tough time getting these topics monitored.
In terms of end user experience, it is very useful. We use it to organize our client requirements, for example:
We receive good transactions from it with good graphs, as well, documenting the activities of total visitors on the site. We can pull the reports and provide them to the client, as required.
In terms of application performance, we are able to identify the memory leaks within applications. We have been able to identify how an application is behaving in terms of a custom method of classes and how well the response is being solved. We can find the KPIs of the application along with its performance indicators.
The custom classes, suchs as hybrid net performance, we are able to identify and fix, accordingly. The solution is proactive. We can monitor how the application is connecting to the database and what queries are being requested, then how well those are being respond to by the solution.
Users no longer need to depend upon the console for a compatible Java version. Now, users can directly learn the version, perform all their actions, and see all of those performance-related issues.
Our users lag how to identify the root cause with this solution. If they could come up with a more user-friendly version, that would be a good thing, since other vendors currently have better features and more user-friendly products than CA APM.
As applications move to the cloud, we need more cloud-based solutions from CA APM. This is currently unavailable. I know that this is something that they are looking to do in the future, but I am not sure how with the current solution.
The stability is very good. CA APM is far more stable than any of the other tools available, though we have seen memory leaks with the solution.
Scalability is good. We haven't faced any issues.
We have about 50 users in our organization, from directors to analysts. Around 60 to 70 percent of our organization is using the solution.
We monitor more than 400 applications, which is done with two people who are system engineers (myself included).
The technical support has performed very well. We receive good information in a very quick and polite manner. They have very good technical personnel and have been very happy with them. Sometimes. I contact them when CA APM introduces new things.
The initial setup is very straightforward; it is not complex. It is well-documented. I can follow the documentation to get the tool working.
For a simple install, the deployment can take about a day, then I can monitor any application.
A complex install will need requirements to be gathered for how things are done and how deep the data is to be implemented and instrumented. If they are a huge number of classes to be monitored, then we need to collect all that information from the application team or client. Afterwards, we have to instrument the system. This may take a week or ten days based on the requirements.
I'm not involved in the pricing.
We evaluated CA APM vs AppDynamics and CA APM vs BMC.
Consider the compatibility first, then consider the resources required, finally consider the applications that you will be monitoring. Then, you can go deploy them.
We used the Five-Pack when onboarding services. We also used SiteMinder and introduced synthetic monitoring, integrating with CA Spectrum and CA Service Desk. We use several CA applications. Everything is interconnected to get triggered and tickets routed to a particular thing automatically.
I'm checking customer experience, how they experience our website and how they use the systems inside the company. Customer experience, outside and inside.
It performs okay.
It helps me know everything. When I know everything, like when there is a problem, I can find it very quickly. It reduces the time for solving problems in the website.
Seeing what the customer is doing on our website. This is important for us to understand that they use the website as we planned.
I would like to see intelligence, deep intelligence or deep analytics.
Great. No problem.
Everything is okay. I have no problems.
Their technical support is great.
I have always used CA APM.
Dynatrace and CA, these are the best vendors that we checked. They're at the top.
The most important criteria when selecting a vendor are support and wide use of the product. Not that the product is there in one company or two companies, but worldwide. We want the company to invest money to improve it. So I'm looking for a product that is worldwide and used widely by customers.
I give it an eight out of 10 because it does not include all the features that I mentioned above, like intelligence.
Do a significant PoC, and in the PoC including something very difficult, not something light. See if in the most cases, the product is giving you the answers, and not just for the easy ones.
In many organizations I've seen this product working in, SEV1s have been reduced quite a bit. One particular organization, within the first 12 months, reduced their SEV1s by 90% just by introducing this product. They had previously been using a competing product, so it really speaks to the value provided by this one that they weren't getting out of the other products they were using.
Suddenly, we were able to evaluate based off how code was being traced. In one incident, it saved us 18 hours in finding the actual problem in the logic for that application once we had a problem.
The most valuable features I believe would actually be two things I would go into: The insight it gives into the applications that it's actually applied to, and the flexibility to do many things with those metrics, and also feed your own metrics from external sources.
I think as we're all moving forward to automated deployments, it'd be nice to have that out-of-the-box with this product.
Also, scaling it, the data nodes writing automatically would be a very nice feature.
We have had large environments, many millions of metrics feeding in, and never have we had to dedicate a single resource to maintaining it.
Actually coming in once in a while for maintenance, we do have to put some work into it once in a while, but there is nothing to the magnitude of having to have somebody dedicated to it.
It is scalable. We can keep adding collectors that store the data, as needed. We haven't had any issues with that so far.
Technical support has always been very happy to help us. They offer a community, which is often very helpful, where one can go to find their own answers if they'd like.
We already had a competing solution. We weren't getting the value we needed out of it. We were still having problems. We couldn't find the actual root cause very easily with that solution, so we started evaluating others.
We looked at many others and this seemed to be the best fit for our organization.
Really, the most important criteria when selecting a vendor is value for dollar. As any business, we're looking for values and it's not just, "Is it better?" But, "Is it better enough to be worth the cost?" Or, if it's cheaper, that's also great.
The initial setup is actually pretty straightforward. The install is very easy. I don't think one would even need a document for it. It's pretty straightforward and the questions it's asking are kind of self-explanatory.
My rating just reflects some of the features we'd like to see. I don't think I'd ever give anybody a perfect rating. There's always room for improvement, but my rating is definitely higher than any other competing products that I've used, against it.
It has provided application teams with another tool in the tool box to diagnose complex performance and availability issues. It also allows for the early detection of an issue before we hear about it from our customers. CA APM reduces our time to resolution and improves our customer confidence.
While calculators are present, they don’t support the ability to create a custom calculation on a metric. To do this, a custom JavaScript calculator must be built.
The dashboard functionality is what one might expect from the early 2000s. The dashboard tools need a significant update in terms of the widgets that are available, usability, and ability to modify how data points are labeled.
The custom report functionality also needs to be updated with the ability to apply different widgets, rather than just a line graph, and the ability to modify how data points are labeled.
The capability to execute a shell command on an alert condition is present. However, the implementation makes it difficult to find potential use cases. In our environment, it’s unfortunately something we are unable to make use of, at least directly. In short, CA APM is not a tool I would recommend for implementation of self-healing. However, it can be used to automatically advertise that a condition under which self-healing should be kicked off exists.
.NET agents are not at par with Java agents and there is a gap that needs to be closed.
We’ve been actively using CA APM 10.2 in non-production and production environments since March 2016.
We have had stability issues, but we have worked out the major issues with CA and are working towards resolution of the minor stability issues. The fixes for the stability issues we experienced have been implemented in versions of CA APM following APM 10.2.
We have not had any scalability issues. I will note that it is important to have an understanding of how APM works and, if you’re new to the product, to work closely with CA on environment sizing, optimizing the configuration, and understanding how much load an environment can handle.
Initial technical support is excellent for common, easy to identify and medium complexity issues. For difficult, complex, issues it’s necessary to escalate things to get the experts from development and engineering involved to get traction on resolution. Otherwise, things can get stuck and drawn out.
Initial setup is moderate to complex (there are a number of factors in the complexity of setup) and needs to be done with someone who has experience setting up and configuring CA APM environments.
No other products were evaluated prior to using CA APM.
Having expertise from CA to help you with implementing CA APM is essential. It is also essential to understand that deep-dive instrumentation can have a significant impact on an application and even enabling or disabling certain agent features can cause significant impact. It is critical to understand how to configure the agent, what to configure, and test out a configuration before deploying to production. Also, any updates to applications must be tested with the agent in place, before deploying to production. If there are issues, it’s important to know how to start tuning down the level of instrumentation.
I will note that CA has, and continues, to bend over backwards in responding to our needs and requirements in ways that few vendors do.
Hello ITTechni9ef4,
Thank you for taking the time to provide your feedback!
I am glad to hear that your CA APM 10.2 stability issues have been addressed. Our Engineering and Support teams have worked hard to systemically address any stability issues that crop up, and they work hard to incorporate those improvements into new releases. Hopefully, as you continue to upgrade and try out new features, you will find that our previous work stabilizes your new trials.
Speaking of new things to try out, you are not alone in voicing concerns about our .NET agent. We have greatly increased our investment in .NET, and we plan to release a great new set of .NET agent features soon. If you get the chance, please join us as one of our customer design partners as we develop features, or try them out at release and provide your feedback. (New .NET features are in Beta today for design partners)
Assuming you get the chance to check out the new .NET agent, you will no doubt end up putting even more metrics on a dashboard. I appreciate your use of APM’s metric openness to use your expert knowledge to pull together the perfect dashboard for your teams. However, if you are like most customers we hear from, you will no doubt lament missing Event data in your dashboard. For example, listing out specific user events or error events in a table next to API performance metric time slices.
Momentum for addressing this Event shortcoming has gained speed as we continue to deepen our focus on user experience and user journey within AXA. AXA uses another open technology under the hood, Elastic, to store event data, and AXA comes with a product called APM Data Studio to visualize Event data.
This Event data is just part of the story, and we have been busy architecting the stitching of all our data into APM Data Studio via APMSQL. APMSQL gives you the power of SQL to sift through the mounds of APM timeslice data to easily find something like “the number of agents that saw response times over 5 seconds last week”. We believe that Elastic and APMSQL together will supercharge your dashboards. Should you decide AXA is not something you can embark on today, we do plan to offer APM Studio directly in CA APM.
Lastly, I’ll mention that we recognize the desire to strengthen APM’s self-healing assistance, but we are not yet comfortable with APM’s (industry wide) ability to correctly interpret application conditions. Triage and diagnosis are sensitive areas, and automation that improperly acts has serious financial impact. APM 10.5 is the first prescriptive APM that attempts to truly lead you through triage to actionable diagnosis in as little as five seconds. If you get the chance to check out 10.5, I hope you will agree that we are working hard to put real world first-of-its-kind smarts behind diagnosing application issues.
We call these diagnosing smarts Assisted Triage, and after we gather data on its performance in the field, we’ll have a much better sense of how close we are to accurately understanding application status. When we have the appropriate confidence that we can do more good than harm with auto-heal features, you will see us invest heavily in helping you take advantage of them.
Thanks again,
Nate Isley
The product helps us to identify code problems very quickly. It can also help us identify other problems with the application as it's running. That's a significant for us because application failures can impact revenue and customer satisfaction. This product allows us to do even more. For instance, we've recently added CA Application Performance Management (APM). Prior to that, we were only able to look at the infrastructure stack. From the box perspective, this gives us additional ways to help us troubleshoot. Having tools with some level of intelligence can more accurately pinpoint the problems. This helps us cut down that whole blame game and helps us get to the root of the issue faster.
From the application speed perspective, we can install it in both the development and production environment for the applications. In the development environment, they're able to test and capture long-running transactions, database issues, too many threads, or memory leaks. We are able to identify those, in theory, before they make it to production. This gives us a much cleaner application when it goes up with potentially less issues from a newly deployed piece of code. That’s the kind of the big play that we're going for and we have yet to generate tickets because we're still working to capture the right level of noise. This is a better process then flooding application teams with a lot of details.
We have pretty much every tool we need. What I need for this tool to be able to demonstrate is that it totally surpasses the competition.
My partners are not just concerned about the back end of the system, they're are concerned about the users and what is happening to them. The user experience is everything. And it’s not fully baked into the equation. We are potentially going to buy a different product.
Stability has been good so far from my current experience and previous experience of APM. We are using an earlier version, 9.7. We're about to upgrade to 10.3. What is very important is making sure that you evaluate your application and what you want to measure and capture, in a development environment before you go to production. If you attempt to capture too much information in production it can lead to issues. Teams need to know what they're doing, because it can impact performance if you're looking for too many things you don't really care about.
We haven't hit the wall yet with finding the upper ends of the scalability. What we've been told is that we can deploy up to 60 apps in the current infrastructure without having some sort of performance degradation. We haven't experienced it yet, so that's still to be determined.
Technical support is usually the same in any big company. They tend to play the log game. I typically contact our support contact. I just reach out and we escalate. The account executives can help with that process as well. We ran into problems where my team was complaining, support wasn’t responding, or they were taking too long for issue resolution. I spoke with the account team, and then we were able to get the right connections so we can escalate more effectively and efficiently.
I was not part of the initial setup. I'm involved in the upgrade and the new Implementation.
Make sure the staff who runs, manages, and implements the tool with their customers or their partners has a middleware background or WebSphere experience. These individuals should understand how that all works, because that will shorten the learning curve. A person with these skills can really translate between the app team and the infrastructure. This can make adaption go a lot faster and gain the benefit and value faster.
The Introscope feature is the most valuable for us, specifically the part that shows us errors in the application.
We are a government IT company that provides services to the government. Because of that, we're required to use a very wide range of products and applications. We also need to have a multitude of interconnections with diverse systems, and one of the biggest difficulties we had was how these interconnections were made. CA APM has provided us a solution for this, allowing us to discover the root cause of some speed issues we had in the systems that were very difficult to diagnose.
I've used it since January 10, 2014.
We can't implement the TIM in our environment because we have issues with a virtualized environment. VMware and TIM was not thought of in a way that could receive the data in a cloud environment.
There were issues, but we have fixed them now.
There have been no issues scaling it.
10/10
Technical Support:10/10
It's very simple, as we are an IT company and we are accustomed to new system implementations.
We did it through a sales team, and without their support we would not be as we evolved in APM as we are today.
We did tests with AppDynamics, but had to discard the use of this software because to do analysis of a user experience we had to submit the data to the US, and then only return with the answer.
Prepare a team to manage this tool, as if you don't have a full team to review the APM data, it will not work as it should.
Feliz,
It's probably better to look into MTP which will give you a better exposure on the networks side as well as provide TIMaaS (built into it). Also, totally agree with you that you need a separate team just to admin and maintain this tool on a daily basis.
Agree Thanx for sharing