| Version 2 (modified by , 14 years ago) (diff) |
|---|
OnTimeMeasure Installation Procedure on PlanetLab
Prasad Calyam, Rohit Patali, Kunpeng Zhu
Aug 10, 2010
For questions regarding this document, please contact - Rohit Patali rpatali@oar.net
1. Overview
This document describes the installation, configuration and usage of OnTimeMeasure-v1.0 on PlanetLab. OnTimeMeasure is a prototype measurement service for the GENI facility users. The measurement service can be used to perform centralized and distributed orchestration and provisioning of active measurements within experiment slices for purposes such as:
- Network paths monitoring
- Network weather forecasting
- Network performance anomaly detection
- Network-bottleneck fault-location diagnosis
The 'OnTimeMeasure researcher web-portal' enables a ProtoGENI/Emulab and PlanetLab user to register, create and monitor experiment slices on a geographically distributed resources in the GENI facility.
Before proceeding further, we highly recommend reading the OnTimeMeasure Tutorial and PlanetLab Tutorial.
For details regarding OnTimeMeasure, please visit OnTimeMeasure Wiki.
For details regarding PlanetLab, please visit PlanetLab Wiki
2. OnTimeMeasure Installation Steps on PlanetLab:
2.1 Requirements
The OnTimeMeasure software package has the following requirements:
- Operating System: Fedora 8
- Pre-requisite Software: MySQL, Graphite, Perl, Python, Iperf, Ruby, Bwctl-server, Bwctl-client, Cairo, Python_Twisted, Python_Piddle, perl-CPAN
- Perl Modules: Config::Natural, POSIX, Sys::HostIP, DBI, IO::Socket::SSL, Log::Log4perl, Net::SSLeay, Math::Random, YAML
Note: The Pre-requisite Software and Perl Modules installation is handled by the scripts delivered in the OnTimeMeasure-v1.0 package. See following sections for details.
- Open ports: For RootBeacon server: MySQL TCP/3306, Graphite TCP/2003 and TCP/17280, Collector TCP/7777, HTTP TCP/17290; For NodeBeacon server: BWCTL TCP/4823, Nodescheduler TCP/17249, HTTP TCP/17290
- User Accounts: User must have registered accounts in the OnTimeMeasure Researcher Web-portal and PlanetLab.
2.2 PlanetLab Slice Creation and Configuration
Note: To obtain detailed information about PlanetLab slice creation, please refer to the 'PlanetLab Tutorial'
PlanetLab slice can be created using the web interface by logging into your account or by using the sfi-client (CLI).
2.3 Software Installation
When all the slivers are "Ready", login to the OnTimeMeasure Researcher Web-portal and provide the Slice RSpec information before proceeding to install the measurement instance within the PlanetLab slice.
Next, login using SSH to each of the servers, and install the following packages which might not have come pre-installed on a Fedora Core 8 (default OS for PlanetLab)
Note: In order to install any software using yum, use --nogpgcheck, otherwise installation will fail on PlanetLab nodes.
Install make and gcc
yum --nogpgcheck install make yum --nogpgcheck install gcc
On the Root Beacon:
Software installation
wget http://ontime.oar.net/download/OnTimeMeasure-v1.0.tar.gz tar xzf OnTimeMeasure-v1.0.tar.gz tar xzf RootBeacon.tar.gz cd RootBeacon/InstallScript chmod +x ontime_software_install.sh
Edit “ontime_software_install.sh” and add --nogpgcheck in all occurrences of “yum install” statements. Your yum install statements should look like this:
yum --nogpgcheck install packagename
./ontime_software_install.sh
Perl CPAN Module Installation
The Comprehensive Perl Archive Network (CPAN) tools is used to install the Perl modules listed in the System Requirement section and is installed by the ontime_software_install.sh script.
Note: The CPAN configuration must point to Internet2 Perl CPAN repository
sudo perl -MCPAN -e shell cpan> o conf urllist push ftp://cpan.uchicago.edu/pub/CPAN/ cpan> o conf prerequisites_policy follow cpan> o conf commit cpan> exit chmod +x ontime_perlmodule_install.sh ./ontime_perlmodule_install.sh
If some module fails to install, force install the module using CPAN, otherwise you may receive errors while trying to run file_server.pl and node_scheduler.pl later.
sudo perl –MCPAN –e shell cpan> force install modulename
MySQL Initialization
mysqladmin -u root password '<new-password>'
Graphite and Twisted Installation
Edit ontime_graphite_install.sh to add --nogpgcheck in all the “yum install” statements
chmod +x ontime_graphite_install.sh sudo ./ontime_graphite_install.sh
On a Node Beacon:
Software installation
wget http://ontime.oar.net/download/OnTimeMeasure-v1.0.tar.gz tar xzf OnTimeMeasure-v1.0.tar.gz tar xzf NodeBeacon.tar.gz cd NodeBeacon/InstallScript chmod +x ontime_software_install.sh
Edit ontime_graphite_install.sh to add --nogpgcheck in all the “yum install” statements
./ontime_software_install.sh
Perl CPAN Module Installation
The Comprehensive Perl Archive Network (CPAN) tools is used to install the Perl modules listed in the System Requirement section and is installed by the ontime_software_install.sh script.
Note: The CPAN configuration must point to Internet2 Perl CPAN repository
sudo perl -MCPAN -e shell cpan> o conf urllist push ftp://cpan.uchicago.edu/pub/CPAN/ cpan> o conf prerequisites_policy follow cpan> o conf commit cpan> exit chmod +x ontime_perlmodule_install.sh ./ontime_perlmodule_install.sh
If some module fails to install, force install the module using CPAN as explained earlier.
2.4 Software Configuration
Centralized Case:
On the Root Beacon:
MySQL configuration
cd RootBeacon/InstallScript mysql -u root -p < BuildWebServicesDatabase.sql mysql -u root -p < BuildMeasurementDatabase.sql mysql -u root –p
At the mysql prompt, type
CREATE USER 'collector'@'%' IDENTIFIED BY '<collector password>'; GRANT ALL PRIVILEGES ON `Measurements` . * TO 'collector'@'%'; GRANT ALL PRIVILEGES ON `WebServices` . * TO 'collector'@'%'; exit
Note 1: Please use the <collector password> provided as part of the Slice information at Step 2 in the Researcher Web-portal.
Note 2: If remote access to MySQL on the Root Beacon is disabled, please open the port TCP/3306 and follow the tutorial at http://www.cyberciti.biz/tips/how-do-i-enable-remote-access-to-mysql-database-server.html
Graphite Configuration
Initialize the graphite:
cd /opt/graphite/webapp/graphite/ sudo python manage.py syncdb
Note: For the first time execution, you will be prompted for creating a 'root' user.
Run the graphite and carbon daemons
cd /opt/graphite/ python bin/carbon-cache.py start sudo chmod -R 777 /opt/graphite/storage nohup /opt/graphite/bin/run-graphite-devel-server.py /opt/graphite &
Note:For some reason screen fails to work on PlanetLab
Then open <root_beacon_ip_address>:8080 in browser. No Error message should be received in order to proceed.
Root Beacon invocation options configuration
cd RootBeacon/InstallScript perl config_wizard.pl
Follow the steps as directed by the wizard script.
On a Node Beacon:
Node Beacon invocation options configuration
cd NodeBeacon/InstallScript perl config_wizard.pl
Follow the steps as directed by the wizard script.
Node Beacon invocation options configuration
2.5 Software Invocation
Centralized Case:
On the Root Beacon:
Go to "Collector/" and run
chmod +x ../AnalysisScripts/Plateau/plateau.exe chmod +x ../AnalysisScripts/Forecast/forecaster/add_forecast nohup perl collector.pl &
Then, go to "../RootScheduler/"
nohup perl file_server.pl & nohup perl action_script.pl &
No error should be reported. If you see errors while trying to run any of the scripts, it is likely that the depend perl modules are not installed correctly. A good way to check if the above scripts work is to run them without nohup to see the output and after making sure they work correctly, the scripts can be stopped and re-run using nohup. In case, an error occurs, you can install the missing modules (module name will appear in the error message) using procedure explained in the beginning.
On a Node Beacon:
Go to 'Datagen/certs' run
chmod +x createSSL.sh ./createSSL.sh cd .. nohup perl file_server.pl & nohup perl node_scheduler.pl &
