Tidal Automation Scalability

Reviewer957656
Tidal Administrator at a retailer with 5,001-10,000 employees
From what I've seen, the scalability is very good. There are companies that I know that run millions of jobs a day. I've been through some user groups that have some people running nine different instances of Tidal, and they're running a lot of different things. So, the 7.7 million a year we run here, coming from where I was beforehand where we were running about 400,000 a year, seems like a lot. But we're still a small fish in the barrel compared to how other Tidal customers are using it. So the scalability is phenomenal. We're always looking for that next hook and working on trying to tie into other things. We're keeping our versions updated as much as we can, in regard to OS compatibility. Take Informatica, as an example: We're making sure that we're as up-to-date as we can be with the versions that are out on the market. View full review »
EmmetWagle
Sr System Engineer at a financial services firm with 5,001-10,000 employees
I don't think we've ever pushed a limit of the schedulers, the masters. We haven't really had any kind of scalability issue with regard to the scheduler or the agents. The only thing that we've run into as far as scalability goes would maybe be the web interface, which can get pretty slow at times, so we've got to cycle it. The web client is just sluggish and has an issue where that performance degrades over time. That's why we do the recycle and we notice it helps quite a bit to recover it. View full review »
LeeAnn McLennan
Application Engineer at Columbia Sportswear
Tidal does a good job. We periodically have them do a performance review every six to nine months by sending them our logs. I open a ticket, then send them a bunch of logs. They take a look at them and we do any necessary tuning. We have discovered over the years, going from a small to medium to high-medium organization, that Tidal is very responsive in terms of helping us figure out how to tune systems so we have the best performance. It can handle very large scale organizations job-wise. It is just how you tune your servers, and they're very willing to help with that. The best thing that a person can do is work with Tidal support to find out exactly what is necessary on the back-end to have their system scaled out correctly. It can be done. We run about 8,000 jobs in production, but I know there are some systems which run tens of thousands of jobs of production. We haven't hit a scalability issue at all. Regularly, 20 to 30 people use it in our organization on a week by week basis. We have about 100 users in the system. Their roles are developing, creating jobs, QA, testing job scenarios, events, and actions; everything around developing a job or job stream. Then, we have our service desk people who do the transports from QA into production. There are about four people who do this. In production, people from each scheduling team are responsible for the health of their jobs, which can include if there are issues with the jobs running, maintenance that they have planned, setting those jobs on hold, asking me to put an outage on an adapter, rerunning jobs, or disabling/enabling jobs. It is general job development and job management. View full review »
Learn what your peers think about Tidal Automation. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
419,052 professionals have used our research since 2012.
JonFredrickson
JDE Manager at Oshkosh
It's very scalable. We haven't seen a limit yet with Tidal. The one limit we saw was actually caused by a third-party design issue. It wasn't a Tidal issue, it was a J.D. Edwards issue. We plan on using this as our only job scheduler. This will replace other solutions on multiple boxes, including our Robot scheduler. This will cross four different J.D. Edwards implementations, including production and non-production scheduling of jobs. View full review »
JasonJavitz
Tidal Administrator at a financial services firm with 1,001-5,000 employees
Our usage of Tidal goes up every year. That's not even from planning to increase usage. We have a few holdouts, people who still use Task Scheduler or cron, but over time they've all been folding into the Tidal space to have a better overview and a cross-platform way to see everything and rerun everything and be alerted. They've come to the conclusion that it's a better method, especially for overnight. We have an operations team that manages things overnight, so that if something fails in the middle of the night, that team can handle it, which they would not be able to do if it wasn't in Tidal, along with thousands of other jobs. In terms of the number of jobs in Tidal, it's been increasing at between 10 and 20 percent a year. It's going up. It's definitely not going down. Initially, it was probably 50 percent a year because everyone was adopting it. Over the past five years, since it was already utilized by everyone, there has been a general 10 percent a year increase because of new jobs that need to be created and new processes that need to be started and stopped. We're somewhere around 95 percent in terms of adoption of Tidal. There a few small groups that like to do their own thing and use open-source products, but those are groups that maybe only run Unix and that's it. They're happy with Jenkins or something open-source that only needs to run a few hundred jobs. It's only one platform, and it does what they need to do a little bit better than Tidal. But for groups that need an all-in-one solution, they've all gone to Tidal. If they need to do what Tidal offers, they're going through Tidal to do so. It's pretty accepted here. View full review »
reviewer1275663
Team Lead at a manufacturing company with 10,001+ employees
You can scale. Today, you can easily scale Client Manager, which controls access to the web client. I sometimes complain about this to Tidal. For example, you can add one or two to the HA, which has a master backup. However, the only way you can scale there is vertically. So, you can make the system bigger. But with the Client Manager, you can scale horizontally as much as you like depending on the volume of people that you have, though I usually find that for us one Client Manager works just fine. The reason we have it down to just one Client Manager is because they use the Java clients, so there are different ways of getting to the system. It would be a good idea to have a second Client Manager in place so you have HA if the Client Manager goes down, then you could just go to the other one. We haven't really had an enormous increase of jobs that has caused us to scale drastically, short of increasing memory. The CPU has not been an issue at all. We did expand it to non-SAP, but it's not huge yet. It is being expanded to things like running Windows and Unix jobs. There are a good number of jobs that it runs from a volume perspective, but not as much as SAP. Most people use the web client. There are 40 to 50 active users in the system. What we call super users use the Java client, so there are five to 10 people now using the Java client with the rest of the people using the web client. We have three different types of users: * We have the administrative team. Those are the people who maintain the system, do the training, and set up different components of the application layer, such as user groups or server groups. This is more on the technical side. * The super users usually are the most knowledgeable and capable of using some of the more complex features of the product. * The regular users are the people who set up regular, simple, straightforward jobs with some dependencies. They maybe set up some calendars, but nothing overly complicated. View full review »
AndrewGriffin
Lead Control Analyst at Central States Funds
The scalability is pretty good. We've used Tidal only for our main application which is our health and welfare system. We do a lot of reports and off of that, but we don't use it in any other areas. We've never scaled it extensively across too many different platforms. The only thing we have right now is a SQL Server platform and an Oracle Database that we go against. We're only in one location. I don't see us expanding our use of it for now. We're pretty stable. View full review »
reviewer1283868
Production Control Analyst at a healthcare company with 1,001-5,000 employees
We haven't hit any roadblocks with volume, but I think we've been sized properly too, behind the scenes, with each upgrade that we've done. It's been scaling fine. That's the bottom line. There are systems out there that are larger than ours. We try to get to the user conference, here in Boston once a year, to do some comparisons to other organizations and the way they're using the tools. It's an information-sharing session. Whenever we go for an upgrade, we look for an assessment of whether we need to provide more horsepower or not. If any of the configuration has to change, we watch that carefully with each upgrade. There's a formula that Tidal provides on whether you should have a small, medium, or large installation, based on the number of definitions that you have. They help with calibrating that. We consider Tidal to be an enterprise scheduling application, so any new process that comes along is first looked at to see if it can be run from Tidal, whether that would involve purchasing another adapter or whatever else would make it work from here. We want it to be an automated function as opposed to being run manually and not integrated with the scheduler. View full review »
DavidCorbishley
Senior Consultant at Corbishley Consulting
The scalability has been very strong. We haven't been able to hit any limits. I feel like with this technology the speed of systems and networks increases, and what might've been a problem 10 years ago, is not a problem now. The role of the end user depends on the team, but some of them can create their own jobs. In other cases, they will give us the specifics and another team will create the jobs for them. So, it depends on how involved your team wants to be. We'll give anybody read access, so they can see the output of their jobs, for example. But other teams, who have a little more knowledge, might give more access where they could rerun or create their own jobs. I don't know about specific plans to increase it other than bringing in those cron jobs which are not using it. View full review »
reviewer1271571
Sr. Platform Engineer at a software R&D company with 10,001+ employees
If you have enough memory, it is scalable. We are running 20,000 jobs. We just increased our memory. It scales really well. View full review »
reviewer1275831
Data Platforms Operations Lead Managed Hosting at a marketing services firm with 1,001-5,000 employees
Scaling is easy. You could run these in VMS. We happen to have physical boxes. We haven't scaled it out, such as creating a remote master. In instances where we thought we may have to kick off jobs from our Maryland data center or jobs in our Denver data center, over MPLS, we thought we would have issues but we didn't have any issues. We were fine. We've been able to run things centrally. The databases scale the way SQL scales, either by giving it more memory or more CPU. As we have brought on clients we've grown over the years. We have a tendency to overbuy for the Client Managers. Our Client Managers are coming up on four years now. In 2021 we'll likely do a tech refresh. We'll stand it up with another version of Tidal and we'll do the migration onto the new platform. At that time we'll look at scaling up the boxes a little bit. You can put a lot more workload, a lot more Tidal jobs, on these without having to increase CPU or memory. View full review »
MosesGujjarlapudi
Tidal Administrator at Devon Energy
There are close to 10 other teams using Tidal, and I'm not sure how extensively they are using it as of now. People login to Tidal when they need to check the status of their jobs. When it comes to developers, there are close to 20 users. We do have business folks who use Tidal when they just want to monitor or operate their jobs. We are still expanding day by day. We do get requests to create new jobs, and the developers will take care of those. We receive those requests once in a while. We are still expanding but it will not be a drastic increase. View full review »
reviewer1323876
Automation Manager at a financial services firm with 1,001-5,000 employees
We have had no scalability complaints. It is all pretty straightforward. We're looking at rolling this out a bit more globally. We have some people in India, North America, and elsewhere. The rate that the skills get picked up can depend on the region, but it also depends on the skill sets that you already have. If you already have some knowledge of an automation tool or orchestration tools, then it's quite intuitive. However, if you have somebody who has never seen it before with no knowledge on the information system, then it might take them a bit longer. We have about 100 DBAs, testers, business analysts, and automation developers using it. At one point, we had nine live environments. View full review »
Shahaan Dalal
Production Control Engineer at a healthcare company with 201-500 employees
It's very scalable. As the company grows you increase the resources. I've worked at a small company that has Tidal and I'm now working at a pretty big company that uses Tidal and it all works pretty seamlessly. It's pretty extensively used in our company. We have 25,000 jobs in production, and we keep growing. We keep adding jobs. We have about eight engineers who create jobs and we have about 10 people who are operators who monitor the production schedule. And we have 200 to 300 other users who are developers. They create code that integrates with Tidal and they work with the engineers to create the jobs in Tidal. They access Tidal to view and check their jobs. We have an architect and two admins to keep the environments up and running. We have the eight engineers who create, monitor, and edit the jobs and the general environment. They are on-call as well. That's the core team for Tidal. And the NOC manages alerts if something happens, to reach out to the on-call people View full review »
DianeMiller
IT Vendor Manager at a paper AND forest products with 5,001-10,000 employees
We don't have it open to our users and don't actually see a need to do that at this point. The system administrator is the regular user of the solution. They do the maintenance of the solution, if needed. We have jobs that run every 2 minutes all throughout the day as well as hourly jobs that run. View full review »
Learn what your peers think about Tidal Automation. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
419,052 professionals have used our research since 2012.