Taking a cue from Prometheus, we invert typical replication from push to pull.
Concretely, all ingest and storage nodes join a cluster, and gossip knowledge of each other.
All storage nodes consume segments regularly and randomly from all ingest nodes.
Consumed segments are merged and, after they reach a certain age or size, replicated across other storage nodes.
Only once they are successfully replicated are the original segments confirmed and cleared from the ingest nodes.