2020-01-26T16:04:00Z

Which is the best RDMBS solution for big data?

it_user1272297 - PeerSpot reviewer
  • 2
  • 64
PeerSpot user
4

4 Answers

CD
Real User
2020-01-27T14:43:01Z
Jan 27, 2020

I haven't used SQream personally. However, if you are only considering GPU based rdbms's please check the following
https://hackernoon.com/which-gpu-database-is-right-for-me-6ceef6a17505

Product comparison that may be of interest to you
YK
Real User
2020-04-19T07:30:24Z
Apr 19, 2020

SQreamDB is a GPU DB. It is not suitable for real-time oltp of course.

Cassandra is best suited for OLTP database use cases, when you need a scalable database (instead of SQL server, Postgres)
SQream is a GPU database suited for OLAP purposes. It's the best suite for a very large data warehouse, very large queries needed mass parallel activity since GPU is great in massive parallel workload.

Also, SQream is quite cheap since we need only one server with a GPU card, the best GPU card the better since we will have more CPU activity. It's only for a very big data warehouse, not for small ones.

Tristan Bergh - PeerSpot reviewer
Real User
Top 10
2020-01-28T07:40:47Z
Jan 28, 2020

Your best DB for 40+ TB is Apache Spark, Drill and the Hadoop stack, in the cloud.

Use the public cloud provider's elastic store (S3, Azure BLOB, google drive) and then stand up Apache Spark on a cluster sized to run your queries within 20 minutes. Based on my experience (Azure BLOB store, Databricks, PySpark) you may need around 500 32GB nodes for reading 40 TB of data.

Costs can be contained by running your own clusters but Databricks manage clusters for you.

I would recommend optimizing your 40TB data store into the Databricks delta format after an initial parse.

Russell Rothstein - PeerSpot reviewer
Vendor
2020-01-27T06:44:39Z
Jan 27, 2020

Morten, the most popular comparisons of SQream can be found here: https://www.itcentralstation.com/products/sqream-db-alternatives-and-competitors
The top ones include Cassandra, MemSQL, MongoDB, and Vertica.

Compare products