Data Synchronization Python Packages

diffsync

A utility library for comparing and synchronizing different datasets.

crdt-merge

Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.

dbmerge

A database-agnostic Python library for simple and fast UPSERT (Insert/Update/Delete) operations via SQLAlchemy.

onecdc

Выгрузка данных 1С по технологии CDC (загрузка изменений данных)

aiosafeconsumer

Safely consume and process data.

datalore

Data Interface Abstraction Library

django-kafka-streamer

Stream data from Django application to Apache Kafka

operandomerge

Synchronize heterogeneous experimental instrument data onto one auditable timeline.

simpledht

A Python-based Distributed Hash Table (DHT) implementation enabling cross-network key-value storage, automatic node discovery, and data replication with a simple CLI and library interface.

pupillib

Event extraction library for Pupil Labs eye tracker data.