Skip to content

Latest commit

 

History

History
67 lines (54 loc) · 4.16 KB

README.md

File metadata and controls

67 lines (54 loc) · 4.16 KB
Raw

ROCED

Responsive On-Demand Cloud-enabled Deployment is a tool which can interface with different batch systems (Torque, HTCondor) and cloud sites (Eucalyptus, OpenNebula, OpenStack, Amazon EC2, etc.). It monitors demand of computing resources in the batch system(s) and dynamically manages Virtual Machines (starting and terminating them) on different cloud sites.

Build Status

Announcement

ROCED can manage hundreds of VMs. However, to improve the scheduling for multiple heterogeneous resources, we decided to follow a new approach to schedule resources based on their utilization. Our new resource manager TARDIS (Transparent Adaptive Resource Dynamic Integration System), follow this approach and shows good results to manage resources at multiple resource providers. Therefore, we concentrate on the development of TARDIS and stop further development on ROCED. We think that this is the correct way to go and invite you to follow us on GitHub (https://github.com/tardis-resourcemanager/tardis). TARDIS also uses the adapter concept to manage resources from different resource providers and support different batch system.

Design

ROCED periodically runs a management cycle, where it performs three steps:

  • Monitor batch system's queue and determine demand for machines
  • Boot machines
  • Integrate booted machines into batch system

Visualisation of management cycle

ROCED consists of five components; everything except the core has a modular structure, in order to offer a maximum of flexibility.
Users can freely combine different adapters to fulfill their requirement or even write their own.

ROCED needs at least one of each component to be in any way useful and we advice to use Requirement Adapter and Integration Adapter for the same batch system.

  • Core
  • Requirement Adapters
    Monitor batch system(s) to determine the demand for machines.
  • Site Adapters
    Request machines at cloud site(s)
  • Integration Adapters
    (Dis-)Integrate running machines from/into batch system(s)
  • Broker
    Balance demand across different cloud sites, depending on different metrics (e.g.: cost)

Visualisation of modular components

Requirements/Installation

  • Python 2.7 or 3.3+
    • Python 2 requires the future and the configparser package
    • Various adapters have system/site dependant packages.
      We follow the PEP 8 guideline when listing module imports, so you you can easily identify the needed modules for each adapter.
  • Correctly set up batch system
  • VM image(s) which can integrate into batch system(s) as worker node(s).

Contributors

ROCED was developed at the Institut für Experimentelle Kernphysik at the Karlsruhe Institute of Technology.
Further information can be found in the doc folder.

License

ROCED is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

ROCED is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with ROCED.  If not, see <http://www.gnu.org/licenses/>.