We just raised a $30M Series A: Read our story

Compare AWS Batch vs. Apache Spark

Cancel
You must select at least 2 products to compare!
Apache Spark Logo
9,837 views|7,910 comparisons
AWS Batch Logo
5,507 views|5,289 comparisons
Featured Review
Find out what your peers are saying about Apache, Amazon, Zadara and others in Compute Service. Updated: November 2021.
554,873 professionals have used our research since 2012.
Quotes From Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pricing and Cost Advice
"Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."

More Apache Spark Pricing and Cost Advice »

Information Not Available
report
Use our free recommendation engine to learn which Compute Service solutions are best for your needs.
554,873 professionals have used our research since 2012.
Questions from the Community
Top Answer: I don't think using Apache Spark without Hadoop has any major drawbacks or issues. I have used Apache Spark quite successfully with AWS S3 on many projects which are batch based. Yes for very high… more »
Top Answer: The solution has been very stable.
Top Answer: We use the open-source version. It is free to use. However, you do need to have servers. We have three or four. they can be on-premises or in the cloud.
Top Answer: AWS Lambda is a serverless solution. It doesn’t require any infrastructure, which allows for cost savings. There is no setup process to deal with, as the entire solution is in the cloud. If you use… more »
Ranking
1st
out of 14 in Compute Service
Views
9,837
Comparisons
7,910
Reviews
10
Average Words per Review
487
Rating
8.6
7th
out of 14 in Compute Service
Views
5,507
Comparisons
5,289
Reviews
0
Average Words per Review
0
Rating
N/A
Comparisons
Also Known As
Amazon Batch
Learn More
Overview

Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted. With AWS Batch, there is no need to install and manage batch computing software or server clusters that you use to run your jobs, allowing you to focus on analyzing results and solving problems. AWS Batch plans, schedules, and executes your batch computing workloads across the full range of AWS compute services and features, such as Amazon EC2 and Spot Instances.

Offer
Learn more about Apache Spark
Learn more about AWS Batch
Sample Customers
NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
Hess, Expedia, Kelloggs, Philips, HyperTrack
Top Industries
REVIEWERS
Financial Services Firm40%
Computer Software Company20%
Marketing Services Firm10%
Non Profit10%
VISITORS READING REVIEWS
Computer Software Company23%
Comms Service Provider20%
Financial Services Firm11%
Media Company9%
VISITORS READING REVIEWS
Media Company28%
Computer Software Company19%
Comms Service Provider17%
Financial Services Firm8%
Company Size
REVIEWERS
Small Business38%
Midsize Enterprise21%
Large Enterprise41%
No Data Available
Find out what your peers are saying about Apache, Amazon, Zadara and others in Compute Service. Updated: November 2021.
554,873 professionals have used our research since 2012.

Apache Spark is ranked 1st in Compute Service with 10 reviews while AWS Batch is ranked 7th in Compute Service. Apache Spark is rated 8.6, while AWS Batch is rated 0.0. The top reviewer of Apache Spark writes "Good Streaming features enable to enter data and analysis within Spark Stream". On the other hand, Apache Spark is most compared with Spring Boot, Azure Stream Analytics, AWS Lambda, SAP HANA and Cloudera Distribution for Hadoop, whereas AWS Batch is most compared with AWS Lambda, AWS Fargate, Oracle Compute Cloud Service, Apache NiFi and Amazon Elastic Inference.

See our list of best Compute Service vendors.

We monitor all Compute Service reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.