Program Synthesis Python Packages

evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

geneticengine

Program Synthesis framework that features heuristics methods (e.g., Genetic Programming) and grammars are defined in Python dataclasses

bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

asts

Programmatic modification and evaluation of software

o1op

Deterministic code synthesis operator — zero LLM in the loop. 8-color algebraic type system, 7-pass causal inference, 7-layer verification, 9-phase autonomous engagement. Substrate validated across 9 IEEE 2026 papers + IBM z/OS production assessment.

autogoal

A Python framework for program synthesis with a focus on Automated Machine Learning.

psynlp

Python module with Program Synthesis Techniques for NLP

arcle

A Gymnasium-based Environment of the Abstraction and Reasoning Corpus (ARC)

leeroo-kapso

A Knowledge-grounded framework for Autonomous ML/AI Program Synthesis and Optimization

evoeval

"EvoEval: Evolving Coding Benchmarks via LLM"

tcgen

Program synthesis tool. Read a list of strings and create a generator that sample strings from the same distribution as input strings. Focused on test cases of competitive programming problems.

program-synthesis

NEAR Program Synthesis: models, tools, and datasets for program synthesis tasks

popper-ilp

An inductive logic programming system