Skip to main content

Apache Arrow

Cross-language open-source columnar data format and compute infrastructure for high-performance data exchange.

Main category
Data engineering
Cost
See the official site for cost
Licence type
Open source
Platforms
Windows / macOS / Linux
Visit Apache Arrow Quick start Code repository

Version-watched: add it to favourites and confirmed new releases will show on your favourites page (stored in this browser only).

Details

Apache Arrow is an open-source columnar in-memory format and data processing infrastructure enabling efficient data exchange between languages. In research data engineering it can improve data processing efficiency between Python, R, databases and big data tools.

Use cases: high-performance data exchange, columnar data, Python/R data bridging, big data processing, data engineering

Note: Arrow is low-level infrastructure; most users use it indirectly via pandas, Polars, DuckDB or Parquet.