Adversarial Python Packages

alibi-detect

Algorithms for outlier, adversarial and drift detection

pyabsa

Sentiment Analysis, Text Classification, Text Augmentation, Text Adversarial defense, etc.;

pdfhell

Adversarial PDFs that break AI document readers. Procedural ground truth, not LLM-as-judge.

agentgate-eval

E2E behavioral testing for AI agents — grounded in 24 research papers. pip install agentgate-eval

palisade-scanner

Scan web content for prompt injection, hidden instructions, and adversarial content targeting AI agents

preclinical

Preclinical is an open-source healthcare AI safety testing platform. It simulates realistic adversarial patient interactions against your agent, stores transcripts, and grades outcomes against safety rubrics.

redteam-arena

AI vs AI adversarial security testing platform. Red team agents attack, blue team agents defend. Fully automated.

cospgd

A tool for benchmarking adversarial robustness of pixel-wise prediction tasks.

ocarinalabs-harbor-ext

Ocarina Labs' Harbor extension — adversarial probes for benchmark integrity.