S3 Python Packages

s3transfer

Amazon S3 Transfer Manager for Python

649.3M 239 162

smart-open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

58M 3K 395

moto

A library that allows you to easily mock out tests based on AWS infrastructure.

38M 9K 2K

cloudpathlib

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

24.2M 629 87

pathy

pathlib.Path style classes for local and cloud bucket storage

1.3M 176 22

airbyte-source-declarative-manifest

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

316K 22K 5K

opendal

Apache OpenDAL: One Layer, All Storage.

213K 5K 830

fs-s3fs

Amazon S3 filesystem for PyFilesystem2

134K 157 56

remotezip

Python module to access single members of a zip archive without downloading the full content from a remote web server.

133K 137 29

aioaws

Asyncio compatible SDK for aws services.

128K 180 15

synapse-s3-storage-provider

Synapse storage provider to fetch and store media in Amazon S3

73K 207 59

tiledb

Python interface to the TileDB storage engine

58K 201 38

yolov5

Packaged version of ultralytics/yolov5 + many extra features

57K 293 69

ministack

Ministack: Free, open-source local AWS emulator - 60+ services, Terraform compatible, real databases. Free forever. MIT licensed.

56K 5K 496

django-s3direct

Directly upload files to S3 compatible services with Django.

51K 666 235

taskiq-aio-sqs

SQS/S3 Broker for TaskIQ using Aiobotocore

40K 17 2

airbyte-source-s3

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

36K 22K 5K