Article Extractor Python Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

open-news-api

open-news is a Python library for news discovery and extraction. It fetches live news via DuckDuckGo, searches Google News, discovers RSS feeds, crawls websites, and extracts article text. Features filtering, deduplication, ranking, and optional JavaScript rendering. Includes Python API, CLI, and terminal UI.

article-parser

Extract article or news by url or html, parse the title and content, output in markdown format.

mineru-html

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

llmparser

Turn any website into clean, structured content that language models can actually read.

markdown-tool

Parse markdown article, download images and replace images URL's with local paths

newshound

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.

arachnio

Arachnio client library for Python 3.10+