trafilatura has 10.5M monthly downloads and 6K GitHub stars. Version 2.1.0 supports Python 3.10+, first published in 2019.
It is actively maintained under a permissive license, last released in Jun 2026.
It is built on top of certifi, charset-normalizer and courlan. It is used by 464 tracked packages, including kimi-cli, letta and stirrup.
GitHub topics include web-scraping, text-extraction and nlp.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- certifi
- charset-normalizer >=3.4.0
- courlan >=1.4.0
- htmldate >=1.10.0
- justext >=3.0.2
- lxml >=6.1.1
- urllib3 <3,>=1.26
31 optional dependencies
- beautifulsoup4[eval]
- boilerpy3[eval]
- brotli[all]
- docutils[docs]
- faust-cchardet[all]
- goose3[eval]
- html-text[eval]
- html2text[eval]
- htmldate[all]
- inscriptis[eval]
- mypy[dev]
- news-please[eval]
- newspaper3k[eval]
- pandas[eval]
- py3langid[all]
- pycurl[all]
- pydata-sphinx-theme[docs]
- pytest[dev]
- pytest-cov[dev]
- readability-lxml[eval]
- resiliparse[eval]
- ruff[dev]
- sphinx[docs]
- sphinx-sitemap[docs]
- tabulate[eval]
- tqdm[eval]
- types-lxml[dev]
- types-pycurl[dev]
- types-urllib3[dev]
- urllib3[all]
- zstandard[all]
Used By
- kimi-cli
- letta
- stirrup
- langroid
- websearch-kit
- research-os
- mag-agent
- hound-mcp
- local-deep-research
- application-pipeline
- pythinker-code
- arifos
- lingtai
- sovyx
- morning-paper
- openkb
- kolega-code
- meshagent-scrapy
- lynx-mcp
- omniscout
- igrep-tme
- chibi-bot
- pyseoanalyzer
- liteauto
- entari-plugin-hyw
- maru-deep-pro-search
- knowledge-storm
- klaude-code
- codex-agent-framework
- minet
- trillim
- clovis
- docmancer
- thirdai
- zytools-fs
- pptagent
- agentic-concierge
- quant-llm-wiki
- langrepl
- ws-bom-robot-app
- ntrp
- pagetomd
- jobjob
- myxagent
- bogo-llm-tools
- kohakuterrarium
- searchts
- smart-bot-factory
- vocast
- koco-product-sqlmodel