Google Cloud Dataproc
Google Cloud Dataproc is a fully managed, highly scalable service for running Apache Hadoop, Apache Spark, Apache Flink, Presto, and other open-source big data frameworks on Google Cloud Platform. It allows users to quickly and cost-effectively provision and manage clusters, significantly…
Key facts
- First appeared
- 2016
- Category
- technology
- Problem solved
- Google Cloud Dataproc was created to address the significant operational complexity and cost associated with deploying, managing, scaling, and patching large-scale Apache Hadoop and Spark clusters. Before Dataproc, organizations had to dedicate substantial engineering resources to cluster administration, resource provisioning, and ensuring high availability for their big data workloads. Dataproc abstracts away this infrastructure management, allowing data professionals to focus on data processing and analytics rather than cluster operations.
- Platforms
- Google Cloud Platform
Related technologies
Notable users
- Various enterprises leveraging Google Cloud for big data analytics and machine learning.
- AT&T
- PayPal
- Spotify
- The New York Times