AI product Open source
Simple Jev is an open-model classifier and scoring server from Featherless AI. It accepts shared context or chat messages plus questions, then reads the model's next-token logits for predefined answer labels instead of generating a prose or JSON completion. The server constructs JSON responses for choice classification, ordered rubric scores, and truth or support judgments, including confidence and label distributions.
Its Hugging Face Transformers implementation identifies the exact common token prefix across questions, evaluates that prefix once, reuses its KV cache for question-specific suffixes, and batches the suffixes before scoring the allowed answer tokens. The response-scoring code normalizes the selected logits; shared context is counted once for usage purposes, and no output tokens are generated. The API provides non-streaming /v1/classifier and /v1/systemone endpoints, with local execution supported through Python, PyTorch, and Transformers. A public demo API is available, while production deployments can use Featherless paid plans or run the server themselves. The repository also includes RFDT, which fine-tunes models directly on allowed answer-token logits using the same prompt structure.
1 use taken from transcripts — each links to the moment in the video.
Reads model logits directly to return choices, scores, and truth judgments as JSON without generating text, while caching shared document prefixes across questions.
1 in the library.