Data Transfer Python Packages

py-sharedmemory

Optimized Python IPC: Uses shared memory to bypass multiprocessing queue I/O bottlenecks, ideal for large data (1MB+) in scientific computing, RL, etc. Reduces system load and improves latency

skyplane-nightly

🔥 Blazing fast bulk data transfers between any cloud 🔥

pyremotedata

This repository contains the python module "pyRemoteData" which handles high-bandwidth data transfer with LFTP.

azcopy-wrapper

An AzCopy Wrapper for python

fasttransfer-mcp

MCP server for fastTransfer

speedtorch

Library for faster pinned CPU <-> GPU transfer in Pytorch

airshare

Cross-platform content sharing in a local network.

databus-keremkoseoglu

Databus is a middleware framework

skyplane

Skyplane efficiently transports data between cloud regions and providers.

databay

Databay is a Python interface for scheduled data transfer. It facilitates transfer of (any) data from A to B, on a scheduled interval.

skyplane-dev

Skyplane efficiently transports data between cloud regions and providers.

securedatatransfer

The Secure Data Transfer device combines Raspberry Pi-based hardware with user-friendly Python scripts for seamless and secure file encryption and transfer, enhancing data privacy.

sqlacrossover

SQLAlchemy-based cross-database migration tool

foxpipe

Secure • Simple • Reliable data streaming. End-to-end encrypted Unix pipes.

kraken-pyds

Kraken - A distributed data transfer tool.

tanit

Kraken - A distributed data transfer tool.