Chatbot Testing Python Packages

chatbot-connectors

A Python library to connect and interact with chatbots.

chatbot-tracer

An automated approach for exploring and testing conversational agents using large language models. TRACER discovers chatbot functionalities, generates user profiles, and creates comprehensive test suites for conversational AI systems.

chatbot-test-framework

An open-source framework for robust, LLM-powered testing and tracing of conversational AI applications.

ccheck

A human-friendly framework for testing and evaluating LLMs, RAGs, and chatbots.

longprobe

Sub-second RAG regression testing. Define golden questions, detect lost chunks in CI. pytest for your RAG pipeline.

chatbot-auditor

Detect the 7 ways AI chatbots silently fail customers