Data Synchronization Python Packages

diffsync

A utility library for comparing and synchronizing different datasets.

dbmerge

A database-agnostic Python library for simple and fast UPSERT (Insert/Update/Delete) operations via SQLAlchemy.

datalore

Data Interface Abstraction Library

crdt-merge

Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.

aiosafeconsumer

Safely consume and process data.

django-kafka-streamer

Stream data from Django application to Apache Kafka

simpledht

A simple distributed hash table implementation

pupillib

Event extraction library for Pupil Labs eye tracker data.