GCP Dataproc

GCP Dataproc is a fast, easy-to-use, fully managed cloud service for running Apache Spark, Apache Hadoop, Apache Flink, and other open-source Big Data tools. It simplifies the deployment and management of clusters, allowing users to focus on data processing and analysis rather than…

Key facts

First appeared: 2015
Category: technology
Problem solved: GCP Dataproc was created to address the significant operational complexities and cost inefficiencies associated with deploying, scaling, and managing self-hosted or IaaS-based Apache Hadoop and Spark clusters. It removes the burden of cluster provisioning, configuration, monitoring, and scaling, enabling data professionals to execute big data workloads faster and more reliably.
Platforms: Google Cloud Platform

Related technologies

Apache Spark
Jupyter Notebooks
Google BigQuery
Google Cloud Storage
Apache Pig
Google Cloud Pub/Sub
Apache Hadoop
Terraform
Apache Flink
Google Cloud AI Platform
Apache Hive

Notable users

Target
Spotify
The Home Depot
Sky
Niantic, Inc.