Databricks Primary Use Case

Data Scientist at a energy/utilities company with 10,001+ employees
I am a data scientist here and that is my official role. I own the company. Our team is quite small at this point. We have around five people on the team and we are working with about five different businesses. The projects we get from them are massive undertakings. Each of us on the team takes multiple roles in our company and we use multiple tools to help best serve our clients. We are trying to look at creative ways that different solutions can be integrated and we try to understand what products we can use to create solutions for client companies that will be effective in meeting their needs. We are personally using Databricks for certain projects where we want to consider creating intelligent solutions. I have been working on Databricks as part of my role in this company, trying to see if there are any kind of standard products that we can use with it to create solutions. We know that Databricks integrates with Airflow, so that is something that we are exploring right now as a potential solution for enabling a creative response. We are exploring the cloud as an option. Databricks is available in Azure and we are currently figuring out the viability of using that as a cloud platform. So we are exploring the way Databricks and Azure integrate at the same time to give us this type of flexibility. What we use it for right now is more like asset management. If we have a lot of assets and we get a lot of real-time data, we certainly want to do some processing on some of this data, but you do not want to have to work on all of it in real-time. That is why we use Databricks. We push the data from Azure through Databricks and work on the data algorithm in Databricks and execute it from Azure with probably an RPA (Robotic Process Automation) or something of that sort. It intelligently offloads real-time processing. View full review »
Sr. BigData Architect at ITC Infotech
We work with clients in the insurance space mostly. Insurance companies need to process claims. Their claim systems run under Databricks, where we do multiple transformations of the data. View full review »
Tristan Bergh
Data Scientist at iOCO
We are using this solution to run large analytics queries and prepare datasets for SparkML and ML using PySpark. We ran on multiple clusters set up for a minimum of three and a maximum of nine nodes having 16GB RAM each. For one ad hoc requirement, a 32-node cluster was required. Databricks clusters were set for autoscaling and to time out after forty minutes of inactivity. Multiple users attached their notebooks to a cluster. When some workloads required different libraries, a dedicated cluster was spun up for that user. View full review »
Learn what your peers think about Databricks. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
442,141 professionals have used our research since 2012.
Abhijith Dattatreya
Business Intelligence and Analytics Consultant at a tech services company with 201-500 employees
I am a developer and I do a lot of consulting using Databricks. We have been primarily using this solution for ETL purposes. We also do some migration of on-premises data to the cloud. View full review »
Alexandre Akrour
CEO at Inosense
Our primary use case is really DevOps, for integration and continuous development. We've combined our database with some components from Azure to deploy elements in Sandbox for our data scientists and for our data engineers. View full review »
Yuval Klein
Pre-sale Leader, Big Data Enterprise Solutions at Ness Technologies
My division works with Big Data and Data Science, and Databricks is one of the tools for Big Data that we work with. We are partners with Microsoft and we began working with this solution for one specific project in the financial industry. View full review »
Data Science Consultant at Syniti
We are building internal tools and custom models for predictive analysis. We are currently building a platform where we can integrate multiple data sources, such as data that is coming from Azure, AWS, or any SQL database. We integrate the data and run our models on top of that. We primarily use Databricks for data processing and for SQL databases. View full review »
Engineer at a tech services company with 10,001+ employees
We use the solution for multiple items. We use lots of data crunching, development, and algorithms on it. View full review »
Machine Learning Engineer at a tech vendor with 51-200 employees
We primarily use the solution to run current jobs; to run the spark jobs as the current job. View full review »
Chief Research Officer at a consumer goods company with 1,001-5,000 employees
Our primary use case of Databricks is for advanced analytics. I'm the chief research officer of the company and we're customers of Databricks. View full review »
Data Science Developer at a tech services company with 501-1,000 employees
We use this solution for streaming analytics. We use machine learning functions that output to the API and work directly with the database. View full review »
Vice President, Business Intelligence and Analytics at a tech services company with 10,001+ employees
We are still exploring the solution. We utilize it much, much better than their star schema models that they are trying to replace it with. We bring in Databricks and then see how they can leverage the additional analytical functionalities around the Databricks cloud. It's more in exploratory ways. We recommend Databricks, especially with the Azure cloud frameworks. View full review »
Data Architect at a tech services company with 201-500 employees
We specialize in project consulting for our clients. Whenever we get the opportunity, we recommend Databricks to them. View full review »
IT Manager: User Support at a financial services firm with 10,001+ employees
Our primary use case is to decrease costs and prevent any security press on data. I'm an IT manager and we are customers of Databricks. View full review »
Learn what your peers think about Databricks. Get advice and tips from experienced pros sharing their opinions. Updated: April 2020.
442,141 professionals have used our research since 2012.