vaex
Use this skill for processing and analyzing large tabular datasets (billions of rows) that exceed available RAM. Vaex excels at out-of-core DataFrame operations, lazy evaluation, fast aggregations, efficient visualization of big data, and machine learning on large datasets. Apply when users need to work with large CSV/HDF5/Arrow/Parquet files, perform fast statistics on massive datasets, create visualizations of big data, or build ML pipelines that do not fit in memory.
- Version
- 1.1
- License
- MIT license
- Compatibility
- Requires Python 3.10+ (3.12+ recommended with vaex 4.19.0). Install with uv pip install vaex. Optional s3fs/gcsfs/adlfs for cloud I/O.
Pinned to revision 70a605012eee, so it is the text this page describes rather than whatever the author pushed since.
Pre-approved tools experimental
Experimental field. Support varies between clients, so this list is what the author declared, not what your client will enforce.
- Read
- Write
- Edit
- Bash
- Grep
- Glob
Files
- skills/vaex/SKILL.md
- skills/vaex/references/core_dataframes.md
- skills/vaex/references/data_processing.md
- skills/vaex/references/io_operations.md
- skills/vaex/references/machine_learning.md
- skills/vaex/references/performance.md
- skills/vaex/references/visualization.md
Every link opens the file at its source, pinned to the revision this page describes.