Mesos Tech Report - 0 views
distributed computing - Persistent storage for Apache Mesos - Programmers Stack Exchange - 0 views
-
Short answer: Apache Mesos doesn't provide distributed FS. So, apps have to work with local FS on slaves or you may run any distributed FS alongside Mesos. Mesos is typically deployed together with HDFS, and most of the frameworks that run on top of Mesos can work with HDFS (Hadoop, Spark, Storm, etc.) And in case your app doesn't support any distributed fs, it has to work with local FS on each slave. I run ElasticSearch on top of Mesos: I specified local directories for ES data in the config file that each mesos slave take when I start framework. So if I restart ES framework, each ES slave will use the specified directories, and if there's some data, that data will be used. I run multiple instances of ES, and they replicate data between each other, so I don't need to worry about losing data. However, there may be a problem at some point: let's say, I have 4 mesos slaves, I run ES on 2 of them. Then I stop ES framework and start some other framework on 2 slaves, then I start ES framework again on 2 slaves, but mesos doesn't guaranty that 2 new slaves are the same 2 slaves that I was running ES on previously. So there'll be no previous copy of data. I run ES on majority of Mesos slaves and I never stop the framework, so I've never encountered this problem.
mesosphere/kubernetes-mesos - 0 views
mesos/CHANGELOG at master · apache/mesos - 0 views
-
* Docker support in Mesos: * Users now can launch executors/tasks within Docker containers. * Mesos now supports running multiple containerizers simultaneously. The slave can dynamically choose a containerizer to launch containers based on the configuration of executors/tasks. * Container level network monitoring for mesos containerizer: * Network statistics for each active container can be retrieved through the /monitor/statistics.json endpoint on the slave. * Completely transparent to the tasks running on the slave. No need to change the service discovery mechanism for tasks.
Setting up a Multi-Node Mesos Cluster running Docker, HAProxy and Marathon with Ansible... - 0 views
papers-we-love/papers-we-love - 0 views
mlafeldt/chef-runner - 0 views
Vessel - 0 views
Collins - Infrastructure Management for Engineers - 0 views
-
"Collins exists to drive infrastructure automation. Someone recently asked me to describe collins in a sentence. At Tumblr, it's the infrastructure source of truth and knowledge. Everything about Tumblr production environments is stored and encoded in Collins, and that data is used to drive all of our automation. Sometimes people refer to systems like this as a CMDB, or Configuration Management DataBase. Collins started as a system to manage all of the physical servers, switches, racks, etc in Tumblr production environments. As we started to inventory hardware, IP addresses, software, and so on, we found the API and data gave us an excellent way to drive automation processes. Today Collins can do push button cluster (HBase, Hadoop, web, etc) deployment, drive configuration generation when hardware cluster topologies change, drive infrastructure updates when software configuration changes, and help manage software deploys. Because of the loosely coupled design of Collins, consistently applied conventions are a system requirement. This document serves as a guide to those conventions as well as the basic core concepts of the collins system. If you're just interested in the basic howto or screenshots, click here."
Announcing Bosun, our new open source monitoring & alerting system - 1 views
‹ Previous
21 - 35
Showing 20▼ items per page