Program Synthesis Python Packages

multilspy

multilspy is a lsp client library in Python intended to be used to build applications around language servers.

44K 574 105

evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

26K 2K 198

bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

17K 500 72

geneticengine

Program Synthesis framework that features heuristics methods (e.g., Genetic Programming) and grammars are defined in Python dataclasses

8K 51 11

asts

Programmatic modification and evaluation of software

1K 197 25

autogoal

Automatic Generation Optimization And Learning

1K 216 66

psynlp

Python module with Program Synthesis Techniques for NLP

666 10 1

arcle

An ARC Learning Environment built on Gymnasium

639 71 9

leeroo-kapso

A Knowledge-grounded framework for Autonomous ML/AI Program Synthesis and Optimization

278 90 7

tcgen

Program synthesis tool. Read a list of strings and create a generator that sample strings from the same distribution as input strings. Focused on test cases of competitive programming problems.

167 6 0

evoeval

EvoEval: Evolving Coding Benchmarks via LLM

106 82 12

program-synthesis

Program Synthesis

81 150 26

popper-ilp

An inductive logic programming system

1 287 51