turbopuffer

Vortex is an open-source columnar file format for streaming compressed analytical and machine-learning training data from object storage such as S3 to CPUs and GPUs. It separates logical and physical types and uses layouts, zone maps, cascading encodings, and byte coalescing to reduce unnecessary I/O, decompression, and memory copies; its encodings include dictionary arrays, run-end encoding, and bit-packing, allowing computation on compressed data. The format is designed for zero-copy execution with Apache Arrow and integration with DataFusion, DuckDB, and Polars, with scan paths that can use buffer pools, kTLS, and RDMA to move data toward CPU or GPU execution.

A Kubernetes-native storage and data-management platform developed by Pure Storage that provides persistent volumes and resilient storage for stateful applications without relying on host-path mounts. It supports storage provisioning, replication, high availability, snapshots, backup, and disaster recovery across Kubernetes environments.

Tiger Data is a PostgreSQL data platform for combining transactional and analytical workloads in one database. It uses hybrid row and columnar storage, compression, and continuous aggregates, and is positioned for time-series workloads at scale. Tiger Cloud provides a fully managed PostgreSQL service with separated reads and writes through replica sets, plus tiered SSD and S3 storage.

Qdrant is an open-source vector search engine written in Rust for storing vectors with JSON payloads and querying them through an API. It performs vector similarity search using HNSW traversal, applies metadata filters during retrieval, and supports dense, sparse, hybrid, and multivector search, along with reranking methods such as ColBERT and maximum marginal relevance. Qdrant can run on-premises, in hybrid or private deployments, at the edge through Qdrant Edge, or as the fully managed Qdrant Cloud service. The project is used for AI retrieval and supports synchronization between local or edge deployments and cloud-based memory.