Amazon EMR Initial Setup

Quan Vu - PeerSpot reviewer
Data Governance Manager at VPBFC

We need to have a data pipeline tool to ensure consistent data processing for the initial setup. We create a framework, read the code, and execute it in a data catalog. The size of the maintenance team depends on the project and the use cases. Usually, one backup team of four or five DevOps executives takes care of the backend and database.

We need to separate our environments into production and development. We use GitHub for source control, Jenkins for the deployment pipeline, and a standard CI/CD tool to deploy code changes into production.

We need to develop a deployment framework so developers only need to provide the code for their projects. The underlying engine then deploys the code, reads it, addresses the EMR filter, executes it, and completes the data processing.

View full review »
Ilya Afanasyev - PeerSpot reviewer
Senior Software Development Engineer at Yahoo!

You don't need to deploy anything. You just start. You go to the computer and start using EMR.

Sometimes we found some strange things. We've had some exceptions. Various versions can be used, however.

View full review »
Prashant  Singh - PeerSpot reviewer
Vice President -Product Management at a computer software company with 1,001-5,000 employees

The initial setup was very easy. It's not overly complex or difficult. 

We can deploy the solution in a single day. It's very fast to get up and running. 

There's a team of ten people that can handle the setup and maintenance of the product.

View full review »
Buyer's Guide
Amazon EMR
April 2024
Learn what your peers think about Amazon EMR. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
767,319 professionals have used our research since 2012.
RahulJadhav - PeerSpot reviewer
Hadoop Administrator at Capgemini

The initial setup of Amazon EMR is very easy. The time it takes for the full deployment of the solution depends on our Terraform script. However, it typically takes a maximum of 30 minutes to deploy any cluster.

View full review »
CG
AWS / Big Data Engineer at Waste Management, Inc.

The initial setup is straightforward. 

View full review »
VinayKumar2 - PeerSpot reviewer
Lead Data Engineer at Seven Lakes Enterprises, Inc.

The initial setup of Amazon EMR is straightforward if you know the basics and have knowledge of big data and architecture. The AWS documentation also helps with the deployment. Initially, the deployment takes a few hours and then it becomes easy. 

The maintenance depends on your application and specific requirements, but for deployment, you don't need a much bigger team, probably a team of one cloud guy should be enough.

View full review »
ArnabChatterjee - PeerSpot reviewer
Development Engineer at Signify

The initial setup is straightforward, and deployment takes between 15 and 20 days.

View full review »
Atif Tariq - PeerSpot reviewer
Cloud and Big Data Engineer | Developer at Huawei Cloud Middle East

The installation is easy. It can be set up with a few clicks.

View full review »
AO
Lead Data Scientist at a manufacturing company with 10,001+ employees

The initial setup was time-consuming, and deployment took approximately 30 minutes. In addition, one person was required for deployment and maintenance.

View full review »
Atif Tariq - PeerSpot reviewer
Cloud and Big Data Engineer | Developer at Huawei Cloud Middle East

The solution's initial setup is very easy since it's all about cloud service deployment.

View full review »
VV
Technology Analyst at Proodlehospitatilityservicesltd

The platform's initial setup process is easy. The time taken for deployment depends on specific project requirements. It takes approximately an hour to complete.

View full review »
AG
Engineering Manager/Solution architect at a computer software company with 201-500 employees

The installation is straightforward because you can do it from the AWS Console or with Terraform. You can do it yourself. 

View full review »
it_user744720 - PeerSpot reviewer
Data Science Engineer

It was one of those things where once you figured it out, you've got it. With this big data stuff, you put in a lot of work, trying to set something up and then you sort of set it and forget it.

Amazon has made it much easier since I first started with it. Once you get the cluster set up, if you set it up in the graphical interface, just point and click, you can actually copy a script that you could run from the command line to create that cluster. That is extremely helpful and that's the way that most people do it in production. You have a script and you run and it comes up. So it's a one-button kind of thing.

They tried to make it easy. It was fairly simple once you got through the complexity of everything that was involved with it.

View full review »
CR
Deputy CTO at a tech company with 51-200 employees

The initial setup is simple when you know the tool, but when you don't know the tool you need to look through the documentation. One of our team carried out deployment. We recently rebuilt our data lake and it took a day to get the right configuration.

View full review »
CG
Senior Chief Engineer (Enterprise System Presales/Postsales) at a comms service provider with 10,001+ employees

The initial setup of Amazon EMR is easy.

View full review »
FN
Responsable sofware factory at BOX AFRICA

The initial setup is pretty straightforward. It's not extremely complex.

However, it's difficult to reset the multi-factor authentication once it is set up. This was an issue for me when we lost the phone.

View full review »
it_user334827 - PeerSpot reviewer
Big Data Specialist at a media company with 501-1,000 employees

It was straightforward.

View full review »
it_user347568 - PeerSpot reviewer
Big Data Architect at a tech services company with 1,001-5,000 employees

It was complex to configure.

View full review »
Buyer's Guide
Amazon EMR
April 2024
Learn what your peers think about Amazon EMR. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
767,319 professionals have used our research since 2012.