Skip to main content

Dask

Open-source Python parallel computing tool for larger datasets and distributed data analysis.

Main category
Data engineering
Cost
See the official site for cost
Licence type
Open source
Platforms
Windows / macOS / Linux
Visit Dask Quick start Code repository

Version-watched: add it to favourites and confirmed new releases will show on your favourites page (stored in this browser only).

Details

Dask is an open-source Python parallel computing library that extends NumPy, pandas and scikit-learn patterns to handle larger datasets and parallel tasks. Researchers can use it for large tables, remote sensing data, simulation output and batch computation.

Use cases: Python parallel computing, big data analysis, batch tasks, processing simulation output, data engineering

Note: Small datasets usually don't need Dask; pandas, Polars or DuckDB are simpler to start with.