AWS Glue

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. It provides a managed Apache Spark-based environment for ETL (Extract, Transform, Load) jobs and an integrated Data Catalog…

Key facts

First appeared: 2017
Category: technology
Problem solved: AWS Glue was created to simplify and automate the complex and time-consuming processes of data ingestion, transformation, and cataloging in a big data environment. It addresses the challenge of setting up and managing distributed computing clusters (like Apache Spark or Hadoop) for ETL, maintaining a centralized metadata repository, and integrating disparate data sources, enabling data engineers to focus on data logic rather than infrastructure.
Platforms: AWS_Cloud

Related technologies

Amazon Athena
Python
AWS Lambda
Apache Spark
Amazon Redshift
Amazon S3
AWS Lake Formation
Amazon EMR

Notable users

Netflix
Siemens
Verizon
Expedia
Johnson & Johnson