Apache Pignus
Apache Pig is a high-level platform for analyzing large datasets that consists of a high-level data flow language, Pig Latin, and an execution environment. It was designed to simplify the programming of complex data analysis tasks on Hadoop, allowing users to write data transformations in a more…
Key facts
- First appeared
- 2006
- Category
- database
- Problem solved
- Apache Pig was created to alleviate the significant complexity and verbosity of writing data processing applications directly using Java-based Apache Hadoop MapReduce. Before Pig, data analysts and engineers had to write low-level, procedural Java code for each MapReduce step, which was time-consuming, error-prone, and required deep programming expertise, hindering rapid iterative analysis on large datasets.
- Platforms
- JVM (Java Virtual Machine), Apache Hadoop ecosystem (Linux-based servers)
Related technologies
Notable users
- Netflix
- Other companies with legacy Hadoop infrastructure
- Yahoo!