PyRank

Ml Infra Deployments Python Packages

Python packages with the GitHub topic ml-infra-deployments. Sorted by relevance, with stars and monthly downloads.
ddickmann
vllm-factory

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

698 59 6