Article Extraction Python Packages

open-news-api

open-news is a Python library for news discovery and extraction. It fetches live news via DuckDuckGo, searches Google News, discovers RSS feeds, crawls websites, and extracts article text. Features filtering, deduplication, ranking, and optional JavaScript rendering. Includes Python API, CLI, and terminal UI.

mdfetch

Python library that extracts article content from Medium and dev.to and returns it as clean, well-structured Markdown.

article-extractor

Pure-Python article extraction library and HTTP API - Extract clean content from web pages as Markdown or HTML

wanish

Summarize web articles: extract clean content, title, image, language, and generate text summaries

pipescraper

A pipe-based news article scraping and metadata extraction library for Python