Automate CSV to Parquet with Hugging Face Buckets, Webhooks & Jobs

Описание

Files keep landing in your Hugging Face Storage Bucket. Here is how to process each one automatically, without downloading anything. In this live-coding video we set up a webhook on a bucket that triggers a Hugging Face Job whenever a new file arrives. The Job runs the `optimize-parquet.py` uv script, converts the new CSV to optimized Parquet, and writes it to a second bucket. We upload a 10,000-row slice of the NYC taxi dataset, and the triggered Job finishes in about 8 seconds. For data engineers already using Buckets who want to automate what happens next. Topics covered: - Hugging Face S