Chatbot Testing Python Packages

chatbot-tracer

An automated approach for exploring and testing conversational agents using large language models. TRACER discovers chatbot functionalities, generates user profiles, and creates comprehensive test suites for conversational AI systems.

chatbot-connectors

A Python library to connect and interact with chatbots.

longprobe

Sub-second RAG regression testing. Define golden questions, detect lost chunks in CI. pytest for your RAG pipeline.

chatbot-test-framework

An open-source framework for robust, LLM-powered testing and tracing of conversational AI applications.

ccheck

A human-friendly framework for testing and evaluating LLMs, RAGs, and chatbots.

chatbot-auditor

Quality auditor for AI chatbots. Analyzes your conversation logs to show where the bot is underperforming.