We performed a comparison between IBM Analytics Engine and Spark SQL based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop."The best part was that we could make minor changes in the way we were bifurcating the data, even at a very small scale. The accuracy of conversion was also very high."
"The performance is one of the most important features. It has an API to process the data in a functional manner."
"I find the Thrift connection valuable."
"Offers a variety of methods to design queries and incorporates the regular SQL syntax within tasks."
"Certain data sets that are very large are very difficult to process with Pandas and Python libraries. Spark SQL has helped us a lot with that."
"This solution is useful to leverage within a distributed ecosystem."
"The team members don't have to learn a new language and can implement complex tasks very easily using only SQL."
"Overall the solution is excellent."
"The solution is easy to understand if you have basic knowledge of SQL commands."
"One area for improvement would be the initial setup stage, which took longer than expected."
"It would be beneficial for aggregate functions to include a code block or toolbox that explains its calculations or supported conditional statements."
"I've experienced some incompatibilities when using the Delta Lake format."
"There should be better integration with other solutions."
"In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper."
"This solution could be improved by adding monitoring and integration for the EMR."
"In terms of improvement, the only thing that could be enhanced is the stability aspect of Spark SQL."
"SparkUI could have more advanced versions of the performance and the queries and all."
"Anything to improve the GUI would be helpful."
IBM Analytics Engine is ranked 8th in Hadoop with 1 review while Spark SQL is ranked 4th in Hadoop with 14 reviews. IBM Analytics Engine is rated 8.0, while Spark SQL is rated 7.8. The top reviewer of IBM Analytics Engine writes " Good solution for small and medium-sized businesses and highly stable". On the other hand, the top reviewer of Spark SQL writes "Offers the flexibility to handle large-scale data processing". IBM Analytics Engine is most compared with HPE Ezmeral Data Fabric, whereas Spark SQL is most compared with Apache Spark, IBM Db2 Big SQL, Netezza Analytics, SAP HANA and HPE Ezmeral Data Fabric.
See our list of best Hadoop vendors.
We monitor all Hadoop reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.