Apache Arrow
Cross-language open-source columnar data format and compute infrastructure for high-performance data exchange.
- Main category
- Data engineering
- Cost
- See the official site for cost
- Licence type
- Open source
- Platforms
- Windows / macOS / Linux
Visit Apache Arrow Quick start Code repository
Version-watched: add it to favourites and confirmed new releases will show on your favourites page (stored in this browser only).
Details
Apache Arrow is an open-source columnar in-memory format and data processing infrastructure enabling efficient data exchange between languages. In research data engineering it can improve data processing efficiency between Python, R, databases and big data tools.
Use cases: high-performance data exchange, columnar data, Python/R data bridging, big data processing, data engineering
Note: Arrow is low-level infrastructure; most users use it indirectly via pandas, Polars, DuckDB or Parquet.