PyRank

data-prep-toolkit-transforms

Data Preparation Toolkit Transforms using Ray
PyPI
More links
Download Stats
Monthly downloads
4.9K
Weekly downloads
1.7K
GitHub stars
-

Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.

Package Information

Latest Version
1.1.8
Requires Python
<3.14,>=3.10
Licence
Apache-2.0
Last Release
3 months ago
First Release
August 11, 2024
Total Releases
56
No reported malware or high/critical advisories · Details

The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.

Package Insights

What's this?
Score based on PyPI data only - no linked source repository
N/A
Health Score
Not available
requires GitHub data
How the maintenance status was determined
Last release
116 days ago
Monthly downloads
4,883
Active
Activity within 30 days
• Stable
Activity within 31-180 days
Minimal
Activity within 181-365 days, or no activity data
At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
4,883
Stars
Unknown
Stars per 1k downloads
—
Industry Standard
> 10,000,000 monthly downloads
Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
Community Favorite
> 5 stars per 1k downloads
Rising Star
Balanced ratio of stars to downloads
• Unknown
Fewer than 1,000 monthly downloads, or no star data
No star data — can't compute stars-to-downloads ratio.
How download momentum is calculated
Week daily avg
249
Month daily avg
163
Momentum
—
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
Momentum not reported for packages with < 5,000 monthly downloads — percentages are noisy at low volume.
More insights and metrics
Python version support tiers
requires_python
<3.14,>=3.10
Cutting Edge
Minimum supported version is 3.14 or newer
Modern
Minimum supported version is 3.11 to 3.13
• Legacy
Supports 3.10 or older (or Python 2)
Unknown
No requires_python specified or unparseable
License categories
License
Apache-2.0
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
116 days ago
Total releases
56
Releases/year
25.7
• Rapid
Last release within 365 days and > 12 releases/year
Regular
Last release within 365 days
Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
Unknown
Monthly downloads
4,883
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
Balanced
Enough contributors for the package's popularity
• Unknown
No contributor data available
Contributor count is missing — this usually indicates the package has no linked GitHub repository.
Engagement
0
 
Issue Burden
-
per 1k stars
Discussions
-
per 1k stars
Fork Ratio
-
contrib / forks
Stale Release
No
 
PR Velocity
-
 
Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 53
Windows 4

Python Versions

3.12
68.4% 39
3.11
28.1% 16
3.10
1.8% 1
3.13
1.8% 1

Top Countries

1. US US
104
2. DE DE
4
3. HK HK
4
4. GB GB
3
5. IN IN
3
6. CA CA
1

Weekly Downloads

GitHub Stars

Dependencies

1
343 optional dependencies
  • boto3[code]
    extra == "code"
  • boto3[all]
    extra == "all"
  • boto3[fdedup]
    extra == "fdedup"
  • boto3[language]
    extra == "language"
  • bs4>=0.0.2[code]
    extra == "code"
  • bs4>=0.0.2[code-quality]
    extra == "code-quality"
  • bs4>=0.0.2[all]
    extra == "all"
  • clamd==1.0.2[code]
    extra == "code"
  • clamd==1.0.2[all]
    extra == "all"
  • click[code]
    python_version <= "3.12" and extra == "code"
  • click[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • click[all]
    python_version <= "3.12" and extra == "all"
  • cmudict<=1.0.32[gneissweb]
    extra == "gneissweb"
  • cmudict<=1.0.32[language]
    extra == "language"
  • cmudict<=1.0.32[readability]
    extra == "readability"
  • cmudict<=1.0.32[all]
    extra == "all"
  • colorlog==6.8.2[code]
    extra == "code"
  • colorlog==6.8.2[ray]
    extra == "ray"
  • colorlog==6.8.2[repo-level-order]
    extra == "repo-level-order"
  • colorlog==6.8.2[all]
    extra == "all"
  • data-prep-connector>=0.2.3[all]
    extra == "all"
  • data-prep-connector>=0.2.3[code]
    extra == "code"
  • data-prep-connector>=0.2.3[language]
    extra == "language"
  • data-prep-connector>=0.2.3[web2parquet]
    extra == "web2parquet"
  • data-prep-toolkit>=1.1.8[ray]
    extra == "ray"
  • datatrove[all]
    extra == "all"
  • datatrove[enrichment]
    extra == "enrichment"
  • datatrove[language]
    extra == "language"
  • disjoint-set>=0.8.0[all]
    extra == "all"
  • disjoint-set>=0.8.0[code]
    extra == "code"
  • disjoint-set>=0.8.0[fdedup]
    extra == "fdedup"
  • disjoint-set>=0.8.0[language]
    extra == "language"
  • docling[all]
    extra == "all"
  • docling[docling2parquet]
    extra == "docling2parquet"
  • docling[language]
    extra == "language"
  • docling-core==2.50.1[all]
    extra == "all"
  • docling-core==2.50.1[doc-chunk]
    extra == "doc-chunk"
  • docling-core==2.50.1[docling2parquet]
    extra == "docling2parquet"
  • docling-core==2.50.1[language]
    extra == "language"
  • docling-ibm-models[docling2parquet]
    extra == "docling2parquet"
  • docling-ibm-models[all]
    extra == "all"
  • docling-ibm-models[language]
    extra == "language"
  • docling-parse[all]
    extra == "all"
  • docling-parse[docling2parquet]
    extra == "docling2parquet"
  • docling-parse[language]
    extra == "language"
  • duckdb<=1.2.2,>=0.10.1[all]
    extra == "all"
  • duckdb<=1.2.2,>=0.10.1[code]
    extra == "code"
  • duckdb<=1.2.2,>=0.10.1[filter]
    extra == "filter"
  • duckdb<=1.2.2,>=0.10.1[gneissweb]
    extra == "gneissweb"
  • duckdb<=1.2.2,>=0.10.1[language]
    extra == "language"
  • easyocr[all]
    extra == "all"
  • easyocr[docling2parquet]
    extra == "docling2parquet"
  • easyocr[language]
    extra == "language"
  • emerge-viz==2.0.0[all]
    extra == "all"
  • emerge-viz==2.0.0[code]
    extra == "code"
  • emerge-viz==2.0.0[ray]
    extra == "ray"
  • emerge-viz==2.0.0[repo-level-order]
    extra == "repo-level-order"
  • fasttext-predict[all]
    extra == "all"
  • fasttext-predict[enrichment]
    extra == "enrichment"
  • fasttext-predict[gneissweb]
    extra == "gneissweb"
  • fasttext-predict[gneissweb-classification]
    extra == "gneissweb-classification"
  • fasttext-predict[lang-id]
    extra == "lang-id"
  • fasttext-predict[language]
    extra == "language"
  • filetype<2.0.0,>=1.2.0[all]
    extra == "all"
  • filetype<2.0.0,>=1.2.0[docling2parquet]
    extra == "docling2parquet"
  • filetype<2.0.0,>=1.2.0[language]
    extra == "language"
  • flair>=0.14.0[all]
    extra == "all"
  • flair>=0.14.0[language]
    extra == "language"
  • flair>=0.14.0[pii-redactor]
    extra == "pii-redactor"
  • ftfy[all]
    extra == "all"
  • ftfy[enrichment]
    extra == "enrichment"
  • ftfy[language]
    extra == "language"
  • func-timeout==4.3.5[all]
    extra == "all"
  • func-timeout==4.3.5[code]
    extra == "code"
  • func-timeout==4.3.5[ray]
    extra == "ray"
  • func-timeout==4.3.5[repo-level-order]
    extra == "repo-level-order"
  • gputil[all]
    extra == "all"
  • gputil[code]
    extra == "code"
  • gputil[gneissweb]
    extra == "gneissweb"
  • gputil[language]
    extra == "language"
  • gputil[rep-removal]
    extra == "rep-removal"
  • hf-xet>=1.1.1[text-encoder]
    extra == "text-encoder"
  • hf-xet>=1.1.1[all]
    extra == "all"
  • hf-xet>=1.1.1[language]
    extra == "language"
  • httpx-sse[all]
    python_version <= "3.12" and extra == "all"
  • httpx-sse[code]
    python_version <= "3.12" and extra == "code"
  • httpx-sse[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • huggingface-hub<1.0.0,>=0.21.4[all]
    extra == "all"
  • huggingface-hub>=0.25.2[bloom]
    extra == "bloom"
  • huggingface-hub>=0.25.2[code]
    extra == "code"
  • huggingface-hub<1.0.0,>=0.21.4[gneissweb]
    extra == "gneissweb"
  • huggingface-hub<1.0.0,>=0.21.4[gneissweb-classification]
    extra == "gneissweb-classification"
  • huggingface-hub<1.0.0,>=0.21.4[lang-id]
    extra == "lang-id"
  • huggingface-hub<1.0.0,>=0.21.4[language]
    extra == "language"
  • ibm-generative-ai[all]
    python_version <= "3.12" and extra == "all"
  • ibm-generative-ai[code]
    python_version <= "3.12" and extra == "code"
  • ibm-generative-ai[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • kubernetes>=30.1.0[all]
    extra == "all"
  • kubernetes>=30.1.0[code]
    extra == "code"
  • kubernetes>=30.1.0[fdedup]
    extra == "fdedup"
  • kubernetes>=30.1.0[language]
    extra == "language"
  • lancedb>=0.21.2[all]
    extra == "all"
  • lancedb>=0.21.2[language]
    extra == "language"
  • lancedb>=0.21.2[text-encoder]
    extra == "text-encoder"
  • langcodes>=3.3.0[all]
    extra == "all"
  • langcodes>=3.5.0[gneissweb]
    extra == "gneissweb"
  • langcodes>=3.5.0[gneissweb-classification]
    extra == "gneissweb-classification"
  • langcodes>=3.3.0[lang-id]
    extra == "lang-id"
  • langcodes>=3.3.0[language]
    extra == "language"
  • llama-index-core<0.12.0,>=0.11.22[all]
    extra == "all"
  • llama-index-core<0.12.0,>=0.11.22[doc-chunk]
    extra == "doc-chunk"
  • llama-index-core<0.12.0,>=0.11.22[language]
    extra == "language"
  • markupsafe==2.0.1[dev]
    extra == "dev"
  • matplotlib[all]
    python_version <= "3.12" and extra == "all"
  • matplotlib[code]
    python_version <= "3.12" and extra == "code"
  • matplotlib[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • matplotlib>3.10[language]
    extra == "language"
  • matplotlib>3.10[pii-redactor]
    extra == "pii-redactor"
  • matplotlib-inline[all]
    python_version <= "3.12" and extra == "all"
  • matplotlib-inline[code]
    python_version <= "3.12" and extra == "code"
  • matplotlib-inline[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • mlx-vlm[all]
    (sys_platform == "darwin" and python_version < "3.13") and extra == "all"
  • mlx-vlm[docling2parquet]
    (sys_platform == "darwin" and python_version < "3.13") and extra == "docling2parquet"
  • mlx-vlm[language]
    (sys_platform == "darwin" and python_version < "3.13") and extra == "language"
  • mmh3>=4.1.0[all]
    extra == "all"
  • mmh3>=4.1.0[code]
    extra == "code"
  • mmh3>=4.1.0[ededup]
    extra == "ededup"
  • mmh3>=4.1.0[fdedup]
    extra == "fdedup"
  • mmh3>=4.1.0[language]
    extra == "language"
  • mmh3>=4.1.0[profiler]
    extra == "profiler"
  • moto==5.0.5[dev]
    extra == "dev"
  • networkx[all]
    python_version <= "3.12" and extra == "all"
  • networkx[code]
    python_version <= "3.12" and extra == "code"
  • networkx[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • networkx==3.3[ray]
    extra == "ray"
  • networkx==3.3[repo-level-order]
    extra == "repo-level-order"
  • nltk>=3.9.1[all]
    extra == "all"
  • nltk==3.9.1[code]
    extra == "code"
  • nltk[enrichment]
    extra == "enrichment"
  • nltk>=3.9.1[fineweb-quality-annotator]
    extra == "fineweb-quality-annotator"
  • nltk>=3.9.1[gneissweb]
    extra == "gneissweb"
  • nltk>=3.9.1[gopher-repetition-annotator]
    extra == "gopher-repetition-annotator"
  • nltk==3.9.1[hap]
    extra == "hap"
  • nltk>=3.9.1[language]
    extra == "language"
  • nltk>=3.9.1[rep-removal]
    extra == "rep-removal"
  • nltk>=3.9.1[similarity]
    extra == "similarity"
  • normality<=2.6.1[all]
    extra == "all"
  • normality<=2.6.1[code]
    extra == "code"
  • normality<=2.6.1[header-cleanser]
    extra == "header-cleanser"
  • numpy<=1.26.4[all]
    python_version <= "3.12" and extra == "all"
  • numpy<=1.26.4[code]
    python_version <= "3.12" and extra == "code"
  • numpy<=1.26.4[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • numpy<=1.26.4[docling2parquet]
    python_version < "3.13" and extra == "docling2parquet"
  • numpy<1.29.0[faces]
    extra == "faces"
  • numpy<=1.26.4[fdedup]
    python_version < "3.13" and extra == "fdedup"
  • numpy<1.29.0[images]
    extra == "images"
  • numpy<1.29,>=1.22[language]
    python_version < "3.13" and extra == "language"
  • numpy<1.29.0[nsfw]
    extra == "nsfw"
  • numpy<1.29.0[people]
    extra == "people"
  • numpy<1.29,>=1.22[pii-redactor]
    python_version < "3.13" and extra == "pii-redactor"
  • omegaconf==2.3.0[faces]
    extra == "faces"
  • omegaconf==2.3.0[images]
    extra == "images"
  • omegaconf==2.3.0[nsfw]
    extra == "nsfw"
  • omegaconf==2.3.0[people]
    extra == "people"
  • opencv-python==4.11.0.86[faces]
    extra == "faces"
  • opencv-python==4.11.0.86[images]
    extra == "images"
  • opencv-python==4.11.0.86[nsfw]
    extra == "nsfw"
  • opencv-python==4.11.0.86[people]
    extra == "people"
  • opensearch-py==3.0.0[opensearch]
    extra == "opensearch"
  • opensearch-py==3.0.0[all]
    extra == "all"
  • opensearch-py==3.0.0[code]
    extra == "code"
  • opensearch-py==3.0.0[language]
    extra == "language"
  • pandas[all]
    python_version <= "3.12" and extra == "all"
  • pandas[bloom]
    extra == "bloom"
  • pandas[code]
    python_version <= "3.12" and extra == "code"
  • pandas[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • pandas==2.3.2[faces]
    extra == "faces"
  • pandas[filter]
    extra == "filter"
  • pandas[gneissweb]
    extra == "gneissweb"
  • pandas[hap]
    extra == "hap"
  • pandas==2.3.2[images]
    extra == "images"
  • pandas[language]
    extra == "language"
  • pandas==2.3.2[nsfw]
    extra == "nsfw"
  • pandas==2.3.2[people]
    extra == "people"
  • pandas[pii-redactor]
    extra == "pii-redactor"
  • pandas[readability]
    extra == "readability"
  • pandas[rep-removal]
    extra == "rep-removal"
  • pandas[repo-level-order]
    extra == "repo-level-order"
  • pandas[similarity]
    extra == "similarity"
  • pillow==11.3.0[faces]
    extra == "faces"
  • pillow==11.3.0[images]
    extra == "images"
  • pillow==11.3.0[nsfw]
    extra == "nsfw"
  • pillow==11.3.0[people]
    extra == "people"
  • plotly[all]
    python_version <= "3.12" and extra == "all"
  • plotly[code]
    python_version <= "3.12" and extra == "code"
  • plotly[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • polars>=1.9.0[all]
    extra == "all"
  • polars!=1.10.0,!=1.11.0,!=1.12.0,<1.33,>=1.9.0[code]
    extra == "code"
  • polars>=1.9.0[extreme-tokenized]
    extra == "extreme-tokenized"
  • polars==1.33.1[faces]
    extra == "faces"
  • polars!=1.10.0,!=1.11.0,!=1.12.0,<1.33,>=1.9.0[fdedup]
    extra == "fdedup"
  • polars>=1.9.0[gneissweb]
    extra == "gneissweb"
  • polars==1.33.1[images]
    extra == "images"
  • polars>=1.9.0[language]
    extra == "language"
  • polars==1.33.1[nsfw]
    extra == "nsfw"
  • polars==1.33.1[people]
    extra == "people"
  • polars<1.18.0,>=1.9.0[readability]
    extra == "readability"
  • pre-commit>=3.3.2[dev]
    extra == "dev"
  • presidio-analyzer>=2.2.355[all]
    extra == "all"
  • presidio-analyzer>=2.2.355[language]
    extra == "language"
  • presidio-analyzer>=2.2.355[pii-redactor]
    extra == "pii-redactor"
  • presidio-anonymizer>=2.2.355[all]
    extra == "all"
  • presidio-anonymizer>=2.2.355[language]
    extra == "language"
  • presidio-anonymizer>=2.2.355[pii-redactor]
    extra == "pii-redactor"
  • psutil[all]
    extra == "all"
  • psutil[code]
    extra == "code"
  • psutil[gneissweb]
    extra == "gneissweb"
  • psutil[language]
    extra == "language"
  • psutil[rep-removal]
    extra == "rep-removal"
  • pyarrow[all]
    python_version <= "3.12" and extra == "all"
  • pyarrow>=16.1.0[bloom]
    extra == "bloom"
  • pyarrow[code]
    python_version <= "3.12" and extra == "code"
  • pyarrow[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • pyarrow>=16.1.0[gneissweb]
    extra == "gneissweb"
  • pyarrow>=16.1.0[language]
    extra == "language"
  • pydantic>=2.8.2[all]
    extra == "all"
  • pydantic>=2.0.0[doc-chunk]
    extra == "doc-chunk"
  • pydantic>=2.8.2[language]
    extra == "language"
  • pydantic>=2.8.2[pii-redactor]
    extra == "pii-redactor"
  • pygtrie>=2.5.0[all]
    extra == "all"
  • pygtrie>=2.5.0[blocklist]
    extra == "blocklist"
  • pygtrie>=2.5.0[code]
    extra == "code"
  • pygtrie>=2.5.0[language]
    extra == "language"
  • pylance>=0.25.0[all]
    extra == "all"
  • pylance>=0.25.0[language]
    extra == "language"
  • pylance>=0.25.0[text-encoder]
    extra == "text-encoder"
  • pytest>=7.3.2[dev]
    extra == "dev"
  • pytest-cov>=4.1.0[dev]
    extra == "dev"
  • pytest-dotenv>=0.5.2[dev]
    extra == "dev"
  • pytest-env>=1.0.0[dev]
    extra == "dev"
  • pytest-mock>=3.10.0[dev]
    extra == "dev"
  • python-dotenv[all]
    extra == "all"
  • python-dotenv[code]
    extra == "code"
  • python-dotenv[gneissweb]
    extra == "gneissweb"
  • python-dotenv[language]
    extra == "language"
  • python-dotenv[tokenization]
    extra == "tokenization"
  • python-dotenv[tokenization2arrow]
    extra == "tokenization2arrow"
  • pyyaml[all]
    extra == "all"
  • pyyaml>=6.0.2[code]
    extra == "code"
  • pyyaml>=6.0.2[fdedup]
    extra == "fdedup"
  • pyyaml[language]
    extra == "language"
  • pyyaml[ml-filter]
    extra == "ml-filter"
  • rbloom>=1.5.2[all]
    extra == "all"
  • rbloom>=1.5.2[bloom]
    extra == "bloom"
  • rbloom>=1.5.2[code]
    extra == "code"
  • rbloom>=1.5.2[gneissweb]
    extra == "gneissweb"
  • rbloom>=1.5.2[language]
    extra == "language"
  • requests[all]
    extra == "all"
  • requests[code]
    extra == "code"
  • requests[gneissweb]
    extra == "gneissweb"
  • requests[language]
    extra == "language"
  • requests[rep-removal]
    extra == "rep-removal"
  • requests[similarity]
    extra == "similarity"
  • scancode-toolkit==32.1.0[all]
    platform_system != "Darwin" and extra == "all"
  • scancode-toolkit==32.1.0[code]
    platform_system != "Darwin" and extra == "code"
  • scancode-toolkit==32.1.0[header-cleanser]
    platform_system != "Darwin" and extra == "header-cleanser"
  • scipy[all]
    extra == "all"
  • scipy[code]
    extra == "code"
  • scipy[fdedup]
    extra == "fdedup"
  • scipy[language]
    extra == "language"
  • sentence-transformers[all]
    python_version <= "3.12" and extra == "all"
  • sentence-transformers[code]
    python_version <= "3.12" and extra == "code"
  • sentence-transformers[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • sentence-transformers>=2.2.2[language]
    extra == "language"
  • sentence-transformers>=2.2.2[text-encoder]
    extra == "text-encoder"
  • sentencepiece>=0.2.0[all]
    extra == "all"
  • sentencepiece>=0.2.0[code]
    extra == "code"
  • sentencepiece>=0.2.0[fdedup]
    extra == "fdedup"
  • sentencepiece>=0.2.0[language]
    extra == "language"
  • setuptools<82.0.0[all]
    extra == "all"
  • setuptools<82.0.0[gneissweb]
    extra == "gneissweb"
  • setuptools<82.0.0[language]
    extra == "language"
  • setuptools<82.0.0[readability]
    extra == "readability"
  • spacy[all]
    extra == "all"
  • spacy[enrichment]
    extra == "enrichment"
  • spacy[language]
    extra == "language"
  • streamlit[all]
    python_version <= "3.12" and extra == "all"
  • streamlit[code]
    python_version <= "3.12" and extra == "code"
  • streamlit[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • textstat<=0.7.5[all]
    extra == "all"
  • textstat<=0.7.5[gneissweb]
    extra == "gneissweb"
  • textstat<=0.7.5[language]
    extra == "language"
  • textstat<=0.7.5[readability]
    extra == "readability"
  • timeout-timer==0.2.0[all]
    extra == "all"
  • timeout-timer==0.2.0[code]
    extra == "code"
  • timeout-timer==0.2.0[header-cleanser]
    extra == "header-cleanser"
  • torch>=2.2.2[all]
    extra == "all"
  • torch>=2.2.2[code]
    extra == "code"
  • torch>=2.2.2[hap]
    extra == "hap"
  • torch>=2.2.2[language]
    extra == "language"
  • trafilatura==1.12.0[html2parquet]
    extra == "html2parquet"
  • transformers>=4.38.2[all]
    extra == "all"
  • transformers>=4.38.2[code]
    extra == "code"
  • transformers>=4.38.2[code-quality]
    extra == "code-quality"
  • transformers==4.56.2[faces]
    extra == "faces"
  • transformers>=4.38.2[gneissweb]
    extra == "gneissweb"
  • transformers>=4.38.2[hap]
    extra == "hap"
  • transformers==4.56.2[images]
    extra == "images"
  • transformers[lang-id]
    extra == "lang-id"
  • transformers[language]
    extra == "language"
  • transformers==4.56.2[nsfw]
    extra == "nsfw"
  • transformers==4.56.2[people]
    extra == "people"
  • transformers[rep-removal]
    extra == "rep-removal"
  • transformers>=4.38.2[similarity]
    extra == "similarity"
  • transformers>=4.35.2[text-encoder]
    extra == "text-encoder"
  • transformers>=4.38.2[tokenization]
    extra == "tokenization"
  • transformers>=4.38.2[tokenization2arrow]
    extra == "tokenization2arrow"
  • tree-sitter==0.21.3[all]
    python_version <= "3.12" and extra == "all"
  • tree-sitter==0.21.3[code]
    python_version <= "3.12" and extra == "code"
  • tree-sitter==0.21.3[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • tree-sitter-languages==1.10.2[all]
    python_version <= "3.12" and extra == "all"
  • tree-sitter-languages==1.10.2[code]
    python_version <= "3.12" and extra == "code"
  • tree-sitter-languages==1.10.2[code-profiler]
    python_version <= "3.12" and extra == "code-profiler"
  • twine[dev]
    extra == "dev"
  • tzlocal==5.3.1[html2parquet]
    extra == "html2parquet"
  • ultralytics==8.3.203[faces]
    extra == "faces"
  • ultralytics==8.3.203[images]
    extra == "images"
  • ultralytics==8.3.203[nsfw]
    extra == "nsfw"
  • ultralytics==8.3.203[people]
    extra == "people"
  • unicategories[all]
    extra == "all"
  • unicategories[enrichment]
    extra == "enrichment"
  • unicategories[language]
    extra == "language"
  • unicodedataplus[all]
    extra == "all"
  • unicodedataplus[enrichment]
    extra == "enrichment"
  • unicodedataplus[language]
    extra == "language"
  • xxhash>=3.4.1[all]
    extra == "all"
  • xxhash>=3.4.1[code]
    extra == "code"
  • xxhash>=3.4.1[ededup]
    extra == "ededup"
  • xxhash>=3.4.1[language]
    extra == "language"
  • xxhash>=3.4.1[profiler]
    extra == "profiler"
  • yara-python>=4.0.0[all]
    extra == "all"
  • yara-python>=4.0.0[code]
    extra == "code"
  • yara-python>=4.0.0[yara]
    extra == "yara"

Used By

2

Repository details

Forks
-
Issues
-
Last Commit
-
Contributors
-
Open PRs
-
Archived
-

Data and sources

Tracking Since
September 26, 2026
Data Updated
October 11, 2026
Data Freshness
Fresh
Keywords
transforms data preprocessing data preparation llm generative ai fine-tuning llmapps
Sources and methodology