Modern Data Science with Vaex - A new approach to DataFrames and pipelines

Applying the combined benefits of computational graphs, which are common in neural network libraries, with delayed (a.k.a lazy) evaluations to a DataFrame library enables efficient memory and CPU usage. Together with memory-mapped storage (Apache Arrow, HDF5) and out-of-core algorithms, we can process considerably larger data sets with fewer resources. As an added bonus, the computational graphs โ€˜rememberโ€™ all operations applied to a DataFrame, meaning that data processing pipelines can be generated automatically.

Presented by

Jovan Veljanoski
Jovan Veljanoski
Founder of vaex.io 51 mins

Liked this video? Subscribe to receive notifications of new videos.

* indicates required