AI product Open source

Renfield

Renfield is a self-hosted, voice-first AI household assistant built with FastAPI, React, and Ollama. It uses Raspberry Pi Zero 2 W voice satellites with ReSpeaker HATs for local wake-word detection, Whisper speech recognition, Piper text-to-speech, and SpeechBrain speaker recognition. The system can track room presence through BLE scanning, voice recognition, and web authentication, and integrates with Home Assistant and DLNA for multi-room control.

View repository Mentioned in 1 video ↓

Overview

Its ReAct agent chains tools through 10 MCP servers covering weather, web search, news, calendars, Jellyfin, DLNA, n8n workflows, Home Assistant, Paperless, email, and related services. It also provides conversational long-term memory with contradiction detection, a knowledge graph with validated entity-relation triples, and a RAG knowledge base that combines dense pgvector embeddings with BM25 full-text search using reciprocal-rank fusion. Documents can be uploaded from formats including PDF, DOCX, PPTX, XLSX, HTML, Markdown, and TXT, with Tesseract or EasyOCR available for scanned or poor-quality PDFs.

The project is designed to run entirely on local hardware without cloud dependencies and includes a web interface, satellite monitoring, proactive notifications, plugin hooks, and Paperless document-audit workflows. The repository describes more than 100 available tools and supports Docker-based self-hosting.

What Renfield is used for

1 use taken from transcripts — each links to the moment in the video.

  • A self-hosted household assistant with Raspberry Pi voice satellites for wake-word detection, speech recognition, and text-to-speech. Its agent works across Home Assistant, calendars, email, media, and documents, with a RAG knowledge base and long-term memory.

Videos mentioning Renfield

1 in the library.