Skip to main content

Home/ Arquitectura?/ Group items tagged teaching

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Pablo Lalloni

Peter Bourgon · OK Log - 1 views

peter.bourgon.org/ok-log

infrastructure devops operations logging development log

shared by Pablo Lalloni on 05 Aug 17 - No Cached
  • Taking a cue from Prometheus, we invert typical replication from push to pull. Concretely, all ingest and storage nodes join a cluster, and gossip knowledge of each other. All storage nodes consume segments regularly and randomly from all ingest nodes. Consumed segments are merged and, after they reach a certain age or size, replicated across other storage nodes. Only once they are successfully replicated are the original segments confirmed and cleared from the ingest nodes.
  • Pablo Lalloni on 05 Aug 17
     
    "OK Log is a distributed and coördination-free log management system for big ol' clusters. I built it from first principles, to teach myself the gory details of shuffling logs around. This is the story of the prototype."
1 - 3 of 3
Showing 20▼ items per page