Web Extraction Python Packages

agentcrawl-ai

Self-hosted web scraping and Markdown extraction for AI agents

web-search-plus-mcp

Give your agent the web as real sources, never made-up answers — an MCP server with 15 search and 9 extract providers plus an optional local, key-free DonSeTch integration.

sluicer

Turn any web page, or a whole site, into structured data, with no model in the loop: every record a page declares with where each value came from, fields learnt from one example and checked on every page, crawls, feeds and archives.

kitchensink4web

Read websites and extract data with your AI assistant, read-only by default, with clicking and typing when you allow it.

langchain-wellmarked

The official langchain integration for WellMarked.io!

webweavex

Deterministic runtime cognition infrastructure for humans and AI agents — the same input yields the same SHA-256 across Python, JavaScript, Dart, Java and Kotlin.

public-source-extractor

CLI for turning one public web page into reviewable Markdown or JSON for AI research (experimental provider).

axetract

Low-Cost Cross-Domain Web Structured Information Extraction using specialized LoRA adapters.