AWS Glue Data Catalog
The AWS Glue Data Catalog is a centralized, serverless metadata repository that stores descriptive information, or metadata, about data across various sources in your data lake. It acts as a persistent store for table definitions, schema, and location of your data, enabling various AWS analytics…
Key facts
- First appeared
- 2017
- Category
- technology
- Problem solved
- The AWS Glue Data Catalog was created to solve the significant operational burden and complexity of managing metadata for vast and diverse datasets within data lakes. Before its advent, organizations struggled with inconsistent schema definitions, manual data discovery, and the high cost of maintaining self-managed metadata stores like Apache Hive Metastore, which required dedicated infrastructure, scaling, and operational expertise.
- Platforms
- Amazon Web Services (AWS)
Related technologies
Notable users
- Enterprises leveraging AWS for data lakes and analytics
- Companies seeking to simplify data governance and discovery
- Organizations building serverless data pipelines