If you were talking to someone whose organization is considering Spring Cloud Data Flow, what would you say?
How would you rate it and why? Any other tips or advice?
While the deployment is on-premises, the data center is not on-premises. It's in a different geographical location, however, it was the client's own data center. We deployed there, and we installed the CDF server, then the Skipper server, and everything else including all the microservices. We used the PCF Cloud Foundry platform and for the bank, we deployed in Kubernetes. Spring Cloud Data Flow server is pretty standard to implement. The year before it was a new project, however, now it is already implemented in many, many projects. I think developers should start using it if they are not using it yet. In the future, there could be some more improvements in the area of the data pipeline ETF process. That said, I'm happy with the Spring Cloud Data Flow server right now. Our biggest takeaway has been to design the pipeline depending on the customer's needs. We cannot just think about everything as a developer. Sometimes we need to think about what the customer needs instead. Everything needs to be based on customer flow. That helps us design a proper data pipeline. The task mechanism is also helpful if we can run some tasks instead of keeping the application live 24 hours. Overall, I'd rate the solution nine out of ten. It's a really good solution and a lot cheaper than a lot of infrastructure provided by big companies like Google or Amazon.
We used this product with Kubernetes, which had been recently introduced and we liked it. It was very good, compared to Maven. We did try it with Maven; however, the server took 15 or 16 minutes to start. This is when we switched to Kubernetes and it was very good. They provide a lot of different configurations and environment types. We use Kafka on Kubernetes, as well. The configured was proved by SCDF. I would rate this solution a seven out of ten.
I would rate this product (or set of technologies) a solid eight out of 10. The things that would keep me from giving it a full 10 are the fact that the graphic user interface portion of the toolset still needs some polishing and performs somewhat slowly. However, I have not had an opportunity to run this tool set on higher performing machines, and have been limited to simply running it within a set of virtual machines on my own workstation.
What do you like most about Spring Cloud Data Flow?
Thanks for sharing your thoughts with the community!