Skip to main content

Home/ Groups/ SpringerPE
simonjohansson

Mesos Tech Report - 0 views

  •  
    Interesting paper about mesos.
Hector Rivas

distributed computing - Persistent storage for Apache Mesos - Programmers Stack Exchange - 0 views

  • Short answer: Apache Mesos doesn't provide distributed FS. So, apps have to work with local FS on slaves or you may run any distributed FS alongside Mesos. Mesos is typically deployed together with HDFS, and most of the frameworks that run on top of Mesos can work with HDFS (Hadoop, Spark, Storm, etc.) And in case your app doesn't support any distributed fs, it has to work with local FS on each slave. I run ElasticSearch on top of Mesos: I specified local directories for ES data in the config file that each mesos slave take when I start framework. So if I restart ES framework, each ES slave will use the specified directories, and if there's some data, that data will be used. I run multiple instances of ES, and they replicate data between each other, so I don't need to worry about losing data. However, there may be a problem at some point: let's say, I have 4 mesos slaves, I run ES on 2 of them. Then I stop ES framework and start some other framework on 2 slaves, then I start ES framework again on 2 slaves, but mesos doesn't guaranty that 2 new slaves are the same 2 slaves that I was running ES on previously. So there'll be no previous copy of data. I run ES on majority of Mesos slaves and I never stop the framework, so I've never encountered this problem.
    • Hector Rivas
       
      Answer to how use Storage with messos
Hector Rivas

Apache Mesos? PaaS? What the BOSH? | CloudCredo - 1 views

  •  
    Explaining how bosh and mesos can be a good idea
Hector Rivas

mesos/CHANGELOG at master · apache/mesos - 0 views

  • * Docker support in Mesos: * Users now can launch executors/tasks within Docker containers. * Mesos now supports running multiple containerizers simultaneously. The slave can dynamically choose a containerizer to launch containers based on the configuration of executors/tasks. * Container level network monitoring for mesos containerizer: * Network statistics for each active container can be retrieved through the /monitor/statistics.json endpoint on the slave. * Completely transparent to the tasks running on the slave. No need to change the service discovery mechanism for tasks.
  •  
    Mesos 0.20.0 comes with docker support by default
Hector Rivas

Thoughts on the Future of Resource Managers, Schedulers and Containers in the Cloud (So... - 0 views

  •  
    Recently Andrew Spyker blogged about his thoughts on the emergence of open-source schedulers and resource managers in parallel with the rise of Docker containers. I'd like to give a point of view to some of the issues that were raised.
Hector Rivas

mlafeldt/chef-runner - 0 views

  •  
    Chef-runner is a tool for executing chef recipes on remote machines, over SSH. It features vagrant integration and is built to be much faster than the in-built provisioning for this use-case.
Hector Rivas

Vessel - 0 views

  •  
    Vessel is another tool for automating the setup and use of docker based development environments. It integrates Vagrant, CoreOS, Consul, docker and Atom into a slick opinionated package. The user interface looks particularly impressive from the screenshots.
Hector Rivas

Collins - Infrastructure Management for Engineers - 0 views

  •  
    "Collins exists to drive infrastructure automation. Someone recently asked me to describe collins in a sentence. At Tumblr, it's the infrastructure source of truth and knowledge. Everything about Tumblr production environments is stored and encoded in Collins, and that data is used to drive all of our automation. Sometimes people refer to systems like this as a CMDB, or Configuration Management DataBase. Collins started as a system to manage all of the physical servers, switches, racks, etc in Tumblr production environments. As we started to inventory hardware, IP addresses, software, and so on, we found the API and data gave us an excellent way to drive automation processes. Today Collins can do push button cluster (HBase, Hadoop, web, etc) deployment, drive configuration generation when hardware cluster topologies change, drive infrastructure updates when software configuration changes, and help manage software deploys. Because of the loosely coupled design of Collins, consistently applied conventions are a system requirement. This document serves as a guide to those conventions as well as the basic core concepts of the collins system. If you're just interested in the basic howto or screenshots, click here."
Josef Hoerandtner

Announcing Bosun, our new open source monitoring & alerting system - 1 views

  •  
    If trees could scream, would we be so cavalier about cutting them down? We might, if they screamed all the time, for no good reason. - Deep Thoughts, by Jack Handey A big part of scaling up an engineering team is getting serious about monitoring and alerts.
‹ Previous 21 - 35
Showing 20 items per page