Apache Spark Room for Improvement

Karthikeyan R
Principal Architect at a financial services firm with 1,001-5,000 employees
The search could be improved. Usually, we are using other tools to search for specific stuff. We'll be using it how I use other tools - to get the details, but if there any way to search for little things that will be better. It needs a new interface and a better way to get some data. In terms of writing our scripts, some processes could be faster. In the next release, if they can add more analytics, that would be useful. For example, for data, built data, if there was one port where you put the high one then you can pull any other close to you, and then maybe a log for the right script. View full review »
reviewer1046250
Senior Consultant & Training at a tech services company with 51-200 employees
When you first start using this solution, it is common to run into memory errors when you are dealing with large amounts of data. Once you are experienced, it is easier and more stable. When you are trying to do something outside of the normal requirements in a typical project, it is difficult to find somebody with experience. View full review »
Snrsecengin567
Snr Security Engineer at a tech vendor with 201-500 employees
The management tools could use improvement. Some of the debugging tools need some work as well. They need to be more descriptive. View full review »
Find out what your peers are saying about Apache, Pivotal, Informatica and others in Hadoop. Updated: September 2019.
372,622 professionals have used our research since 2012.
Abhijit Nayak
Manager | Data Science Enthusiast | Management Consultant at a consultancy with 5,001-10,000 employees
Include more machine learning algorithms and the ability to handle streaming of data versus micro batch processing. View full review »
reviewer894894
User
I would suggest for it to support more programming languages, and also provide an internal scheduler to schedule spark jobs with monitoring capability. View full review »
Sumanth Punyamurthula
Director - Data Management, Governance and Quality with 10,001+ employees
It is like going back to the '80s for the complicated coding that is required to write efficient programs. View full review »
Rosemary Walsh
Portfolio Manager, Enterprise Solutions Architect with 10,001+ employees
Better data lineage support. View full review »
Find out what your peers are saying about Apache, Pivotal, Informatica and others in Hadoop. Updated: September 2019.
372,622 professionals have used our research since 2012.
Sign Up with Email