Michele Vigilante — Serverless Data Pipelines in Rust
At the Rust Vienna Meetup in November 2023
Michele, explores Rust in the field of data engineering, where you are usually stuck with writing Python code. Luckily, this does not always have to be the case, as we'll explore in this talk! The focus of this talk is building data pipelines in Rust
using crates like DataFusion, object store and deploying + orchestrating this on an AWS Lambda-based architecture. We'll see how these concepts can be scaled to quite complex pipelines and how they can be applied in a production environment.
About the Speaker: Michele Vigilante (https://github.com/zZKato, https://www.linkedin.com/in/michele-vigilante-6b3760132/)
Get the Slides here: https://github.com/zZKato/serverless-pipelines-in-rust