I have worked with Hadoop a lot in my career and you need to do a lot of things to get it to Hello World. But in Spark it is easy. You could say it's an umbrella to do everything under the one shelf. It also has Spark Streaming. I feel the… more»
What needs improvement?
I think for IT people it is good. The whole idea is that Spark works pretty easily, but a lot of people, including me, struggle to set things up properly. I like contributions and if you want to connect Spark with Hadoop its not a big… more»
What's my experience with pricing, setup cost, and licensing?
I would suggest not to try to do everything at once. Identify the area where you want to solve the problem, start small and expand it incrementally, slowly expand your vision. For example, if I have a problem where I need to do streaming… more»
Which solution did I use previously and why did I switch?
I have used MapReduce from Hadoop previously. Otherwise, I haven't used any other big data infrastructure. In my work previously, not in this company, I was working with some big data, but I was extracting using a single-core off my PC. I… more»
What other advice do I have?
On a scale of 1 to 10, I'd put it at an eight. To make it a perfect 10 I'd like to see an improved configuration bot. Sometimes it is a nightmare on Linux trying to figure out what happened on the configuration and back-end. So I think… more»