Changes between Version 10 and Version 11 of OTM-PlanetLabInstall


Ignore:
Timestamp:
03/08/11 20:17:02 (14 years ago)
Author:
Prasad Calyam
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • OTM-PlanetLabInstall

    v10 v11  
    11= !OnTimeMeasure Installation Procedure on !PlanetLab =
    2 '''Prasad Calyam, Rohit Patali, Kunpeng Zhu'''[[BR]]
    3 '''Nov 18, 2010'''[[BR]]
    4 ''Software License:'' [http://www.geni.net/wp-content/uploads/2009/02/geniprojlic.pdf ''GENI Project License (GPL)'']
     2'''Prasad Calyam, Yingxiao Xu, Rohit Patali, Kunpeng Zhu'''[[BR]]
     3'''Mar 08, 2011'''[[BR]]
     4
    55
    66== 1. Overview ==
    7 This document describes the installation, configuration and usage of !OnTimeMeasure-v1.0 on !PlanetLab. !OnTimeMeasure is a prototype measurement service for the GENI facility users. The measurement service can be used to perform centralized and distributed orchestration and provisioning of active measurements within experiment slices for purposes such as:
     7This document describes the installation, configuration and usage of !OnTimeMeasure on !PlanetLab. !OnTimeMeasure is a measurement service for the GENI facility users. The measurement service can be used to perform centralized and distributed orchestration and provisioning of measurements within experiment slices for purposes such as:
    88
    99 * Network paths monitoring
    … …  
    1212 * Network-bottleneck fault-location diagnosis
    1313
    14 The [http://ontime.oar.net ''OnTimeMeasure researcher web-portal''] enables a ProtoGENI/Emulab and !PlanetLab user to register, create and monitor experiment slices on a geographically distributed resources in the GENI facility. [[BR]]
     14The [http://ontime.oar.net ''OnTimeMeasure researcher web-portal''] enables a ProtoGENI/Emulab and !PlanetLab user to register, create and monitor experiment slices on geographically distributed resources. [[BR]]
    1515
    16 Before proceeding further, we highly recommend reading the [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure_Tutorial.pdf OnTimeMeasure Tutorial] and [https://www.planet-lab.org/tutorial PlanetLab Tutorial].
     16Before proceeding further, we highly recommend reading the [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure_Tutorial.pdf Experimenter Tutorial].
    1717
    1818For details regarding !OnTimeMeasure, please visit [http://groups.geni.net/geni/wiki/OnTimeMeasure OnTimeMeasure Wiki].[[BR]]
    … …  
    2020For details regarding !PlanetLab, please visit [http://groups.geni.net/geni/wiki/PlanetLab PlanetLab Wiki]
    2121
    22 == 2. !OnTimeMeasure Installation Steps on !PlanetLab: ==
     22== 2. Requirements ==
    2323
    24 === 2.1 Requirements ===
    2524The !OnTimeMeasure software package has the following requirements:
    2625
    2726A. ''Operating System:'' Fedora 8
    2827
    29 B. ''Pre-requisite Software:'' MySQL, Graphite, Perl, Python, Iperf, Ruby, Bwctl-server, Bwctl-client, Cairo, Python_Twisted, Python_Piddle, perl-CPAN
     28B. ''Open Ports:'' For !RootBeacon server: MySQL TCP/3306, Graphite TCP/2003 and TCP/17280, Collector TCP/7777, HTTP TCP/17290, Supervisor TCP/17291; For !NodeBeacon server: Nodescheduler TCP/17249, HTTP TCP/17290, Supervisor TCP/17291  ('''Note:''' These ports are opened by default)
    3029
    31 C. ''Perl Modules:'' Config::Natural, POSIX, Sys::HostIP, DBI, IO::Socket::SSL, Log::Log4perl, Net::SSLeay, Math::Random, YAML, HTTP::Daemon
     30C. ''User Accounts:'' User must have registered accounts in the [http://ontime.oar.net OnTimeMeasure Researcher Web-portal] and [https://www.planet-lab.org/ PlanetLab].
    3231
    33 '''Note:''' The Pre-requisite Software and Perl Modules installation is handled by the scripts delivered in the !OnTimeMeasure-v1.0 package. See following sections for details.
     32D. ''!PlanetLab slice:'' A !PlanetLab slice with at least 3 nodes.
    3433
    35 D. ''Open ports:'' For !RootBeacon server: MySQL TCP/3306, Graphite TCP/2003 and TCP/17280, Collector TCP/7777, HTTP TCP/17290; For !NodeBeacon server: BWCTL TCP/4823, Nodescheduler TCP/17249, HTTP TCP/17290
     34'''Note 1:''' !PlanetLab slice can be created using the web interface by logging into your account or by using the sfi-client (CLI). To obtain detailed information about !PlanetLab slice creation, please refer to the [https://www.planet-lab.org/tutorial ''PlanetLab Tutorial'']
    3635
    37 E. ''User Accounts:'' User must have registered accounts in the [http://ontime.oar.net OnTimeMeasure Researcher Web-portal] and [https://www.planet-lab.org/ PlanetLab].
     36'''Note 2:''' Typically, two or more Node Beacons and one Root Beacon need to be installed on separate dedicated nodes in a slice; it is however possible to install Root Beacon on one of the Node Beacon nodes.
    3837
    39 === 2.2 !PlanetLab Slice Creation and Configuration ===
    40 '''Note:''' To obtain detailed information about !PlanetLab slice creation, please refer to the [https://www.planet-lab.org/tutorial ''PlanetLab Tutorial''][[BR]]
     38'''Note 3:''' Following are the pre-requisite software and Perl modules, which will be installed automatically by the scripts delivered in the !OnTimeMeasure release package.
    4139
    42 !PlanetLab slice can be created using the web interface by logging into your account or by using the sfi-client (CLI).
     40''Pre-requisite Software:'' Iperf, MySQL, Graphite, Perl, Python, Ruby, Python-setuptools, Supervisor
    4341
    44 === 2.3 Software Installation ===
     42''Perl Modules:'' Config::Natural, POSIX, DBI, IO::Socket::SSL, Log::Log4perl, Net::SSLeay, Math::Random
    4543
    46 Download the latest OnTimeMeasure release package at http://ontime.oar.net/download/OnTimeMeasure_latest.php.
     44
     45
     46== 3. Centralized Case Installation ==
     47
     48=== 3.1 Software Installation ===
     49
     50Download the latest !OnTimeMeasure release package at http://ontime.oar.net/download/OnTimeMeasure_latest.php.
     51 
     52For example, you can run the following command in an empty folder:
     53{{{
     54wget http://ontime.oar.net/download/OnTimeMeasure_latest.php
     55tar xzf *.gz
     56}}}
    4757
    4858Once you have downloaded the tar file, untar/unzip to see that it contains:
    4959
    50     * !NodeBeacon.tar.gz
    51     * !RootBeacon.tar.gz
    52     * README.txt
     60 * !NodeBeacon.tar.gz
     61 * !RootBeacon.tar.gz
     62 * README.txt
    5363
    54 Next, login using SSH to each of the servers, copy the appropriate tar files over, and run the following commands to install the measurement service:
     64Next, login using SSH to each of the servers, run the following commands to install the measurement service. You will be prompted to set a supervisor account during the Graphite installation, and also will be prompted to set a password of an automatically created database user: ''collector''.
    5565
    56 __'''''On the Root Beacon:'''''__
     66'''Note:'''  Note that the ''collector'' password will apply to both centralized and distributed measurement cases of !OnTimeMeasure.
    5767
    58 __Software installation__
     68__'''''On the Root Beacon Server:'''''__
     69
    5970{{{
    6071tar xzf RootBeacon.tar.gz
    6172cd RootBeacon/InstallScript
    62 chmod +x ontime_software_install.sh
    63 ./ontime_software_install.sh
    64 }}}
    65 
    66 __'''''On a Node Beacon:'''''__
    67 
    68 __Software installation__
    69 {{{
    70 tar xzf NodeBeacon.tar.gz
    71 cd NodeBeacon/InstallScript
    72 chmod +x ontime_software_install.sh
    7373./ontime_software_install.sh
    7474}}}
    7575
    7676
    77 === 2.4 Software Configuration ===
    78 
    79 '''Centralized Case:'''
    80 
    81 __'''''On the Root Beacon:'''''__
    82 
    83 __MySQL configuration__
     77__'''''On a Node Beacon Server:'''''__
    8478
    8579{{{
    86 cd RootBeacon/InstallScript
    87 mysql -u root -p < BuildWebServicesDatabase.sql
    88 mysql -u root -p < BuildMeasurementDatabase.sql
    89 mysql -u root –p
     80tar xzf NodeBeacon.tar.gz
     81cd NodeBeacon/InstallScript
     82./ontime_software_install.sh
    9083}}}
    91 At the mysql prompt, type
    92 {{{
    93 CREATE USER 'collector'@'%' IDENTIFIED BY '<collector password>';
    94 GRANT ALL PRIVILEGES ON `Measurements` .  * TO 'collector'@'%';
    95 GRANT ALL PRIVILEGES ON `WebServices` .  * TO 'collector'@'%';
    96 exit
    97 }}}
    98 '''Note 1:''' Please use the <collector password> provided as part of the Slice information at Step 2 in the Researcher Web-portal.
    9984
    100 '''Note 2:''' If remote access to MySQL on the Root Beacon is disabled, please open the port TCP/3306 and follow the tutorial at http://www.cyberciti.biz/tips/how-do-i-enable-remote-access-to-mysql-database-server.html
     85=== 3.2 Software Configuration and Invocation ===
    10186
    102 __Invocation options configuration__
     87==== Through !OnTime Beacon web-portal ====
     88
     89Login to the [http://ontime.oar.net OnTimeBeacon]. Setup resources (provide RSpec information) and control Node/Root Beacons within slice in an ''interactive'' manner. Video demos of these steps can be viewed at [http://ontime.oar.net/demo/]
     90
     91
     92==== Through !OnTime Control command-line tools ====
     93
     94Follow the [https://svn.osc.edu/trac/activemon/wiki/OnTimeControlManual ''OntimeControl Manual''] to control Node/Root Beacons within slice in an ''automated'' manner.
     95
     96== 4. Distributed Case Installation ==
     97
     98=== 4.1 Software Installation ===
     99
     100The ''Centralized Case Installation'' will install distributed version automatically.
     101If you want to only install the distributed version, do the following steps:
     102
     103Download the latest !OnTimeMeasure release package at http://ontime.oar.net/download/OnTimeMeasure_latest.php.
     104
     105Once you have downloaded the tar file, untar/unzip to see that it contains:
     106
     107 * !NodeBeacon.tar.gz
     108 * !RootBeacon.tar.gz
     109 * README.txt
     110
     111
     112Only the !NodeBeacon.tar.gz is needed. Run the following commands to install the measurement service:
    103113
    104114{{{
    105 perl config_wizard.pl
    106 }}}
    107 Follow the steps as directed by the wizard script.
    108 
    109 __'''''On a Node Beacon:'''''__
    110 
    111 __Invocation options configuration__
    112 
    113 {{{
    114 perl config_wizard.pl
    115 }}}
    116 Follow the steps as directed by the wizard script.
    117 
    118 '''Note:''' If you want to customize the parameters on invoking measurement tools, you can manually modify the "runtool.conf" which locates in the "NodeBeacon/etc" folder.
    119 
    120 __'''''On the Web-portal:'''''__
    121 
    122 Login to the [http://ontime.oar.net OnTimeMeasure Researcher Web-portal] and provide the Slice RSpec information.
    123 
    124 === 2.5 Software Invocation ===
    125 
    126 '''Centralized Case:'''
    127 
    128 __'''''On the Root Beacon:'''''__
    129 
    130 Go to "Collector/" and run
    131 {{{
    132 nohup perl collector.pl &
    133 }}}
    134 Then, go to "../!RootScheduler/"
    135 {{{
    136 nohup /opt/graphite/bin/run-graphite-devel-server.py /opt/graphite &
    137 nohup perl file_server.pl &
    138 nohup perl action_script.pl &
     115tar xzf NodeBeacon.tar.gz
     116cd NodeBeacon/InstallScript
     117./ontime_software_install.sh
    139118}}}
    140119
    141 __'''''On a Node Beacon:'''''__
    142120
    143 Go to 'Datagen/' run
    144121
    145 {{{
    146 nohup perl file_server.pl &
    147 nohup perl node_scheduler.pl &
    148 }}}
     122=== 4.2 Software Configuration and Invocation ===
    149123
     124==== Through !OnTime Beacon web-portal ====
     125
     126Login to the [http://ontime.oar.net OnTimeBeacon]. Setup resources (provide RSpec information) and control Node/Root Beacons within slice in an ''interactive'' manner. Video demos of these steps can be viewed at [http://ontime.oar.net/demo/]
     127
     128
     129==== Through !OnTime Control command-line tools ====
     130
     131Follow the [https://svn.osc.edu/trac/activemon/wiki/OnTimeControlManual ''OntimeControl Manual''] to control Node/Root Beacons within slice in an ''automated'' manner.