Html To Markdown Python Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

firecrawl-py

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

spider-client

Python, Javascript, and Rust libraries for the Spider Cloud API.

context-dev

Context.dev Python SDK: scrape any URL to LLM-ready markdown, crawl sites, search the web and extract structured JSON with one API key.

confluence-markdown-exporter

Export Atlassian Confluence pages as markdown files.

pyhtml2md

Transform your HTML into clean, easy-to-read markdown with html2md.

lexidown

Fast native HTML-to-Markdown for Python, compatible with Turndown.

crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

all2md

Convert PDF, Word, PowerPoint, HTML, email & 40+ formats to clean Markdown — and back. Built for LLMs, RAG & Python pipelines, with a built-in MCP server.

chromerag

HTML to RAG-ready Markdown. A 150 KB learned filter removes nav, footers, cookie banners, related links and comments; beats Trafilatura on held-out WCXB (F1 0.902 vs 0.860). CPU-only, ~36 ms/page.

gnosis-markdown

Web scraper & crawler → clean Markdown with byte-level SHA-256 provenance + WARC archival for LLM/RAG knowledge bases

octocrawl-client

Octocrawl: readable Markdown and checked fields from public web pages, for AI agents, RAG and research. Failures come back with a reason. Self-host with REST, SDK or MCP.

view-as-ai

Preview website content as AI web browsers and LLM agents see it, calibrated against ChatGPT web browsing.

bytecrawl

The focused-crawling MCP server for AI agents. Rank a whole site by your topic, read any page as clean Markdown, extract anything

file2txt

Turn a supported list of filetypes (e.g. .docx) into a markdown structured text file. Also optionally defangs indicators and extract texts from images. Built for threat intel use-cases.

urlpipe

Official Python client for the URLpipe API: Markdown, screenshots, metadata, Lighthouse and more from any URL, rendered in real Chrome. Sync and async.

llama-index-readers-urlpipe

LlamaIndex reader for URLpipe: load any web page as clean Markdown, rendered in real Chrome, ready to index.

article-extractor

Pure-Python article extraction library and HTTP API - Extract clean content from web pages as Markdown or HTML

llm-data-converter

Convert any document format into LLM-ready data format (markdown) with advanced intelligent document processing capabilities powered by pre-trained models.

markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

netlens-mcp

MCP server for AI agents to read any web page in full — past the robots.txt and bot blocks that stop native fetch — as clean, ad-stripped Markdown. Plus web search.

markmaton

Lightweight HTML-to-Markdown parser for AI agent workflows — Python CLI and API around a fast Go engine, available on PyPI.

htomd

Extract main content and metadata from HTML as Markdown. Available in Python, TypeScript, Go, and Rust, with native APIs and CLIs.