serving-ml
A streaming action runtime for AI agents, model serving, and multimodal APIs
SecretFlow-Serving is a serving system for privacy-preserving machine learning models.
ClearML - Model-Serving Orchestration and Repository Solution