2019-07-16T05:40:00Z

What needs improvement with Spark SQL?


Please share with the community what you think needs improvement with Spark SQL.

What are its weaknesses? What would you like to see changed in a future version?

Guest
44 Answers

author avatar
Top 5LeaderboardReal User

I would like to have the ability to process data without the overhead. To use the same API to process both terabytes data and be able to process one GB of data.

2020-04-26T06:32:00Z
author avatar
Top 10Real User

Anything to improve the GUI would be helpful. We have experienced a lot of issues, but nothing in the production environment.

2020-03-18T06:06:00Z
author avatar
Top 5LeaderboardReal User

The service is complex. This is due to the fact that it's a combination of a lot of technology. The solution needs to include graphing capabilities. Including financial charts would help improve everything overall.

2020-02-09T08:17:05Z
author avatar
Real User

In the next release, maybe the visualization of some command-line features could be added.

2019-07-16T05:40:00Z
Find out what your peers are saying about Apache, Informatica, VMware and others in Hadoop. Updated: September 2020.
442,194 professionals have used our research since 2012.