Data Processing

csv [ crate · repo · docs ]

Fast CSV parsing with support for serde.

arrow [ crate · repo · docs ]

Rust implementation of Apache Arrow

datafusion [ crate · repo · docs ]

DataFusion is an in-memory query engine that uses Apache Arrow as the memory model

polars [ crate · repo · docs ]

DataFrame library based on Apache Arrow

tokenizers [ crate · repo · docs ]

Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.

hdf5 [ crate · repo · docs ]

Thread-safe Rust bindings for the HDF5 library.

timely [ crate · repo · docs ]

A low-latency data-parallel dataflow system in Rust

ai-dataloader [ crate · repo · docs ]

Rust implementation to the PyTorch DataLoader

cuticula [ crate · repo · docs ]

Data Preprocessing library for Machine Learning

rettle [ crate · repo · docs ]

A multithreaded ETL with inspiration drawn from Keras.

arff [ crate · repo · docs ]

ARFF file format serializer and deserializer

rusty-data [ crate · repo · docs ]

A data handling library (designed for machine learning).

openml [ crate · repo · docs ]

A rust interface to [OpenML](http://openml.org/).

opendifferentialprivacy/whitenoise-core [ repo ]