Constrained Decoding Python Packages

oc-sidememory

Exact semantic memory for schema-constrained token generation - enforces uniqueItems, contains and cross-field constraints during LLM decoding.

oc-earley

Let JSON nest as deeply as its schema allows. The backend (DFA, LALR(1), Earley) is chosen to match, never approximated.

maskforge

Schema-guided token masking for reliable structured generation in Rust and Python, with JSON Schema, Pydantic, and Hugging Face support.

grammar-guide

Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

rectokens

[Pytorch] Efficient tokenization for recommendations and generative retrieval. Inspired by STATIC decoding from "Vectorizing the Trie"

refactx

ReFactX: Scalable Reasoning with Reliable Facts via Constrained Generation