AI product Open source

HFlow

HFlow is an open-source SDK from Hebbian Robotics for multimodal data pipelines in robotics and physical AI. It lets teams implement transformations, quality checks, labels, and enrichments as plain Python functions while HFlow handles orchestration, provenance, storage, versioning, and dataset curation.

View repository Mentioned in 2 videos ↓

Overview

The pipeline accepts supported MCAP episodes and can import LeRobot Dataset v3 repositories. It runs code in-process for development or generates Airflow 3 DAGs for scheduled execution, producing canonical MCAP episodes, artifacts, provenance records, and a Parquet catalog. DuckDB SQL creates version-pinned manifests for curation, while a queryable catalog records metadata and quality evidence without requiring the underlying recordings to be loaded.

What HFlow is used for

2 uses taken from transcripts — each links to the moment in the video.

  • A pipeline SDK for robot demonstration data. Users provide quality checks and transformations as plain Python functions while it handles orchestration, versioning, cataloging, and MCAP-chunked episode storage.

  • An open-source SDK for scalable multimodal data pipelines in robotics and physical AI. It handles orchestration, storage, versioning, provenance, curation, quality checks, and reproducible dataset processing locally or through Airflow.

Videos mentioning HFlow

2 in the library.