PyRank

News Crawler Python Packages

Python packages with the GitHub topic news-crawler. Sorted by relevance, with stars and monthly downloads.
adbar
trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

8.9M 6K 371
fhamborg
news-please

news-please - an integrated web crawler and information extractor for news that just works

15K 2K 453
flairNLP
fundus

A very simple news crawler with a funny name

8K 455 109
james20140802
argos-scout

Argos: Tech Scout - AI 기술 동향 자동 추적 슬랙봇

2K 0 0
lumyjuwon
koreanewscrawler

A korean news crawler built to ingest large amounts of news data.

528 225 105
thinh-vu
shutterstock-analysis

A Python package that helps capture news updates from top Vietnamese news sites

420 1 0
thinh-vu
ur-gadget

A Python package that helps capture news updates from top Vietnamese news sites

167 1 0
divkakwani
webcorpus

Generate large textual corpora for almost any language by crawling the web

154 9 11
johnbumgarner
newshound

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.

101 34 3
thinh-vu
vnnews

A Python package that helps capture news updates from top Vietnamese news sites

1 1 0